2025-09-07T07:35:24.5940468Z Current runner version: '2.328.0' 2025-09-07T07:35:24.5945511Z Runner name: 'i-06b59a500443ed91d' 2025-09-07T07:35:24.5946495Z Runner group name: 'default' 2025-09-07T07:35:24.5947168Z Machine name: 'ip-10-0-59-69' 2025-09-07T07:35:24.5949453Z ##[group]GITHUB_TOKEN Permissions 2025-09-07T07:35:24.5951228Z Contents: read 2025-09-07T07:35:24.5951709Z Metadata: read 2025-09-07T07:35:24.5952114Z ##[endgroup] 2025-09-07T07:35:24.5953770Z Secret source: Actions 2025-09-07T07:35:24.5954450Z Prepare workflow directory 2025-09-07T07:35:24.6338653Z Prepare all required actions 2025-09-07T07:35:24.6368054Z Getting action download info 2025-09-07T07:35:24.9120708Z Download action repository 'pytorch/test-infra@main' (SHA:548a4bc624d43a01cdf165a63b041f0ae014ddbd) 2025-09-07T07:35:25.9242505Z Download action repository 'pytorch/pytorch@main' (SHA:93fb23d6fae7c4e82c4239a1033e522088742634) 2025-09-07T07:35:39.6486855Z Download action repository 'actions/setup-python@a26af69be951a213d495a4c3e4e4022e16d87065' (SHA:a26af69be951a213d495a4c3e4e4022e16d87065) 2025-09-07T07:35:39.9355610Z Download action repository 'aws-actions/configure-aws-credentials@ececac1a45f3b08a01d2dd070d28d111c5fe6722' (SHA:ececac1a45f3b08a01d2dd070d28d111c5fe6722) 2025-09-07T07:35:40.1191480Z Download action repository 'aws-actions/amazon-ecr-login@062b18b96a7aff071d4dc91bc00c4c1a7945b076' (SHA:062b18b96a7aff071d4dc91bc00c4c1a7945b076) 2025-09-07T07:35:40.2614851Z Download action repository 'seemethere/upload-artifact-s3@baba72d0712b404f646cebe0730933554ebce96a' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2025-09-07T07:35:40.5104540Z Getting action download info 2025-09-07T07:35:40.6405586Z Download action repository 'actions/checkout@v4' (SHA:08eba0b27e820071cde6df949e0beb9ba4906955) 2025-09-07T07:35:40.8780131Z Getting action download info 2025-09-07T07:35:40.9695402Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2025-09-07T07:35:41.1506962Z Getting action download info 2025-09-07T07:35:41.2476797Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2025-09-07T07:35:41.4146892Z Getting action download info 2025-09-07T07:35:41.5822448Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/main (93fb23d6fae7c4e82c4239a1033e522088742634) 2025-09-07T07:35:41.5825935Z ##[group] Inputs 2025-09-07T07:35:41.5826223Z build-environment: linux-jammy-py3.9-gcc11-build 2025-09-07T07:35:41.5828723Z test-matrix: {"include": [{"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 1, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 2, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 3, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 1, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 2, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 3, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 4, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 5, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 1, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 2, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 3, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 4, "num_shards": 4, "runner": "linux.24xlarge.amd"}]} 2025-09-07T07:35:41.5831957Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:35:41.5832651Z sync-tag: 2025-09-07T07:35:41.5833309Z timeout-minutes: 720 2025-09-07T07:35:41.5833478Z use-gha: 2025-09-07T07:35:41.5833866Z dashboard-tag: training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true 2025-09-07T07:35:41.5834303Z s3-bucket: gha-artifacts 2025-09-07T07:35:41.5834473Z aws-role-to-assume: 2025-09-07T07:35:41.5834860Z disable-monitor: false 2025-09-07T07:35:41.5835051Z monitor-log-interval: 15 2025-09-07T07:35:41.5835244Z monitor-data-collect-interval: 4 2025-09-07T07:35:41.5835454Z ##[endgroup] 2025-09-07T07:35:41.5835781Z Complete job name: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:35:41.6932190Z A job started hook has been configured by the self-hosted runner administrator 2025-09-07T07:35:41.7011901Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2025-09-07T07:35:41.7020549Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:35:41.7020989Z ##[endgroup] 2025-09-07T07:35:42.8864985Z Runner Type: linux.24xlarge.amd 2025-09-07T07:35:42.8865405Z Instance Type: m7a.24xlarge 2025-09-07T07:35:42.8865598Z AMI Name: unknown 2025-09-07T07:35:42.8905079Z AMI ID: ami-05ffe3c48a9991133 2025-09-07T07:35:47.1759545Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2025-09-07T07:35:47.1759841Z with: 2025-09-07T07:35:47.1760311Z github-secret: *** 2025-09-07T07:35:47.1760746Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2025-09-07T07:35:47.1761202Z activate-with-label: false 2025-09-07T07:35:47.1761373Z label: with-ssh 2025-09-07T07:35:47.1761531Z remove-existing-keys: true 2025-09-07T07:35:47.1761709Z fail-silently: true 2025-09-07T07:35:47.1761876Z env: 2025-09-07T07:35:47.1762013Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:35:47.1762191Z ##[endgroup] 2025-09-07T07:35:47.2879997Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2025-09-07T07:35:47.2880654Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys 2025-09-07T07:35:47.3031341Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2025-09-07T07:35:47.3031641Z with: 2025-09-07T07:35:47.3031797Z no-sudo: true 2025-09-07T07:35:47.3031960Z submodules: recursive 2025-09-07T07:35:47.3032134Z fetch-depth: 0 2025-09-07T07:35:47.3032292Z env: 2025-09-07T07:35:47.3032435Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:35:47.3032605Z ##[endgroup] 2025-09-07T07:35:47.3114906Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-09-07T07:35:47.3115503Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-09-07T07:35:47.3127062Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:35:47.3127320Z env: 2025-09-07T07:35:47.3127496Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:35:47.3127703Z ##[endgroup] 2025-09-07T07:35:47.3214455Z ##[group]Run # Use all available CPUs for fetching 2025-09-07T07:35:47.3214759Z # Use all available CPUs for fetching 2025-09-07T07:35:47.3214987Z cd "${GITHUB_WORKSPACE}" 2025-09-07T07:35:47.3215226Z git config --global fetch.parallel 0 2025-09-07T07:35:47.3215483Z git config --global submodule.fetchJobs 0 2025-09-07T07:35:47.3215702Z  2025-09-07T07:35:47.3216002Z # Clean workspace. The default checkout action should also do this, but 2025-09-07T07:35:47.3216338Z # do it here as well just in case 2025-09-07T07:35:47.3216540Z if [[ -d .git ]]; then 2025-09-07T07:35:47.3216745Z  if [ -z "${NO_SUDO}" ]; then 2025-09-07T07:35:47.3216959Z  sudo git clean -ffdx 2025-09-07T07:35:47.3217142Z  else 2025-09-07T07:35:47.3217514Z  git clean -ffdx 2025-09-07T07:35:47.3217702Z  fi 2025-09-07T07:35:47.3217843Z fi 2025-09-07T07:35:47.3225847Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:35:47.3226105Z env: 2025-09-07T07:35:47.3226271Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:35:47.3226449Z NO_SUDO: true 2025-09-07T07:35:47.3226620Z ##[endgroup] 2025-09-07T07:35:47.3352729Z ##[group]Run actions/checkout@v4 2025-09-07T07:35:47.3352948Z with: 2025-09-07T07:35:47.3353124Z ref: 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:35:47.3353332Z fetch-depth: 0 2025-09-07T07:35:47.3353501Z submodules: recursive 2025-09-07T07:35:47.3353679Z show-progress: false 2025-09-07T07:35:47.3353860Z repository: pytorch/pytorch 2025-09-07T07:35:47.3354129Z token: *** 2025-09-07T07:35:47.3354285Z ssh-strict: true 2025-09-07T07:35:47.3354444Z ssh-user: git 2025-09-07T07:35:47.3354611Z persist-credentials: true 2025-09-07T07:35:47.3354785Z clean: true 2025-09-07T07:35:47.3354973Z sparse-checkout-cone-mode: true 2025-09-07T07:35:47.3355171Z fetch-tags: false 2025-09-07T07:35:47.3355326Z lfs: false 2025-09-07T07:35:47.3355489Z set-safe-directory: true 2025-09-07T07:35:47.3355671Z env: 2025-09-07T07:35:47.3355815Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:35:47.3355978Z ##[endgroup] 2025-09-07T07:35:47.4234787Z Syncing repository: pytorch/pytorch 2025-09-07T07:35:47.4235770Z ##[group]Getting Git version info 2025-09-07T07:35:47.4236093Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2025-09-07T07:35:47.4236525Z [command]/usr/bin/git version 2025-09-07T07:35:47.4423679Z git version 2.47.1 2025-09-07T07:35:47.4444645Z ##[endgroup] 2025-09-07T07:35:47.4452436Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/e0097a59-4ccc-44ff-be4e-f6a241d0dbce/.gitconfig' 2025-09-07T07:35:47.4464198Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/e0097a59-4ccc-44ff-be4e-f6a241d0dbce' before making global git config changes 2025-09-07T07:35:47.4464872Z Adding repository directory to the temporary git global config as a safe directory 2025-09-07T07:35:47.4468393Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-09-07T07:35:47.4515285Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2025-09-07T07:35:47.4517807Z ##[group]Initializing the repository 2025-09-07T07:35:47.4521193Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-09-07T07:35:47.4583564Z hint: Using 'master' as the name for the initial branch. This default branch name 2025-09-07T07:35:47.4583928Z hint: is subject to change. To configure the initial branch name to use in all 2025-09-07T07:35:47.4584266Z hint: of your new repositories, which will suppress this warning, call: 2025-09-07T07:35:47.4584522Z hint: 2025-09-07T07:35:47.4584746Z hint: git config --global init.defaultBranch 2025-09-07T07:35:47.4584987Z hint: 2025-09-07T07:35:47.4585204Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2025-09-07T07:35:47.4585551Z hint: 'development'. The just-created branch can be renamed via this command: 2025-09-07T07:35:47.4585878Z hint: 2025-09-07T07:35:47.4586032Z hint: git branch -m 2025-09-07T07:35:47.4600595Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2025-09-07T07:35:47.4609369Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2025-09-07T07:35:47.4647657Z ##[endgroup] 2025-09-07T07:35:47.4647975Z ##[group]Disabling automatic garbage collection 2025-09-07T07:35:47.4650712Z [command]/usr/bin/git config --local gc.auto 0 2025-09-07T07:35:47.4677815Z ##[endgroup] 2025-09-07T07:35:47.4678076Z ##[group]Setting up auth 2025-09-07T07:35:47.4682760Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-09-07T07:35:47.4712766Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-09-07T07:35:47.5126787Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-09-07T07:35:47.5154409Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-09-07T07:35:47.5512112Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-09-07T07:35:47.5560347Z ##[endgroup] 2025-09-07T07:35:47.5560641Z ##[group]Fetching the repository 2025-09-07T07:35:47.5566072Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2025-09-07T07:36:19.5621231Z From https://github.com/pytorch/pytorch 2025-09-07T07:36:19.5621601Z * [new branch] 160583 -> origin/160583 2025-09-07T07:36:19.5622072Z * [new branch] 2.6.0.dev20241004+ -> origin/2.6.0.dev20241004+ 2025-09-07T07:36:19.5622399Z * [new branch] 5addvllmbuild -> origin/5addvllmbuild 2025-09-07T07:36:19.5622777Z * [new branch] AaronWang04_addmmfusion_perftest -> origin/AaronWang04_addmmfusion_perftest 2025-09-07T07:36:19.5623204Z * [new branch] HDCharles-2.6.0-release-notes -> origin/HDCharles-2.6.0-release-notes 2025-09-07T07:36:19.5623558Z * [new branch] ISSUE-154849 -> origin/ISSUE-154849 2025-09-07T07:36:19.5624418Z * [new branch] JackCaoG/dynamo_make_fx_non_core_aten_ops -> origin/JackCaoG/dynamo_make_fx_non_core_aten_ops 2025-09-07T07:36:19.5626505Z * [new branch] NicoshevSVE128 -> origin/NicoshevSVE128 2025-09-07T07:36:19.5627729Z * [new branch] PR-AOTInductorNoneBug -> origin/PR-AOTInductorNoneBug 2025-09-07T07:36:19.5629152Z * [new branch] PR-AOTInductorNoneBugFix -> origin/PR-AOTInductorNoneBugFix 2025-09-07T07:36:19.5630875Z * [new branch] PR-FixConfigsIssue -> origin/PR-FixConfigsIssue 2025-09-07T07:36:19.5631532Z * [new branch] PR-NoneBugFix-viable -> origin/PR-NoneBugFix-viable 2025-09-07T07:36:19.5632832Z * [new branch] PR-ResetToZero -> origin/PR-ResetToZero 2025-09-07T07:36:19.5634136Z * [new branch] Update-Flash-Packaging -> origin/Update-Flash-Packaging 2025-09-07T07:36:19.5635346Z * [new branch] VLA_exp -> origin/VLA_exp 2025-09-07T07:36:19.5636731Z * [new branch] actually-run-mps-aot-inductor -> origin/actually-run-mps-aot-inductor 2025-09-07T07:36:19.5638824Z * [new branch] add-missing-args-normalization -> origin/add-missing-args-normalization 2025-09-07T07:36:19.5640136Z * [new branch] add-user-guide-structure -> origin/add-user-guide-structure 2025-09-07T07:36:19.5641487Z * [new branch] add-vllm-nightly-build -> origin/add-vllm-nightly-build 2025-09-07T07:36:19.5642739Z * [new branch] add_compile_benchmarking -> origin/add_compile_benchmarking 2025-09-07T07:36:19.5644023Z * [new branch] addmm-heuristic -> origin/addmm-heuristic 2025-09-07T07:36:19.5645297Z * [new branch] addsimde -> origin/addsimde 2025-09-07T07:36:19.5646603Z * [new branch] addvllmtest -> origin/addvllmtest 2025-09-07T07:36:19.5648481Z * [new branch] adi/acl_upgrade -> origin/adi/acl_upgrade 2025-09-07T07:36:19.5649759Z * [new branch] adi/test -> origin/adi/test 2025-09-07T07:36:19.5651014Z * [new branch] adi/test_bgemm -> origin/adi/test_bgemm 2025-09-07T07:36:19.5652284Z * [new branch] adi/test_fusions -> origin/adi/test_fusions 2025-09-07T07:36:19.5653341Z * [new branch] adi/test_onednn_v3.9 -> origin/adi/test_onednn_v3.9 2025-09-07T07:36:19.5654869Z * [new branch] adi/test_presve_change -> origin/adi/test_presve_change 2025-09-07T07:36:19.5655760Z * [new branch] adi/test_timm -> origin/adi/test_timm 2025-09-07T07:36:19.5657383Z * [new branch] adi/testpresve_change -> origin/adi/testpresve_change 2025-09-07T07:36:19.5659722Z * [new branch] aditew01/test/vec_bf16 -> origin/aditew01/test/vec_bf16 2025-09-07T07:36:19.5661099Z * [new branch] ah-globalfeedback-hook -> origin/ah-globalfeedback-hook 2025-09-07T07:36:19.5662313Z * [new branch] alt-disable -> origin/alt-disable 2025-09-07T07:36:19.5664446Z * [new branch] angelayi/aoti_additional_files -> origin/angelayi/aoti_additional_files 2025-09-07T07:36:19.5665422Z * [new branch] angelayi/aoti_inductor_fx -> origin/angelayi/aoti_inductor_fx 2025-09-07T07:36:19.5666780Z * [new branch] angelayi/benchmark -> origin/angelayi/benchmark 2025-09-07T07:36:19.5668093Z * [new branch] angelayi/benchmark2 -> origin/angelayi/benchmark2 2025-09-07T07:36:19.5669403Z * [new branch] angelayi/change_pytree_serialization -> origin/angelayi/change_pytree_serialization 2025-09-07T07:36:19.5670551Z * [new branch] angelayi/cpp_loader -> origin/angelayi/cpp_loader 2025-09-07T07:36:19.5672058Z * [new branch] angelayi/custom_op_subgraph -> origin/angelayi/custom_op_subgraph 2025-09-07T07:36:19.5673759Z * [new branch] angelayi/customop -> origin/angelayi/customop 2025-09-07T07:36:19.5675341Z * [new branch] angelayi/fake_cache_empty -> origin/angelayi/fake_cache_empty 2025-09-07T07:36:19.5676652Z * [new branch] angelayi/is_symbolic_tracing -> origin/angelayi/is_symbolic_tracing 2025-09-07T07:36:19.5677883Z * [new branch] angelayi/item -> origin/angelayi/item 2025-09-07T07:36:19.5679331Z * [new branch] angelayi/no_so_weight -> origin/angelayi/no_so_weight 2025-09-07T07:36:19.5680383Z * [new branch] angelayi/opoverload -> origin/angelayi/opoverload 2025-09-07T07:36:19.5681639Z * [new branch] angelayi/pattern -> origin/angelayi/pattern 2025-09-07T07:36:19.5682941Z * [new branch] angelayi/pytree -> origin/angelayi/pytree 2025-09-07T07:36:19.5684228Z * [new branch] angelayi/scan_layers -> origin/angelayi/scan_layers 2025-09-07T07:36:19.5685474Z * [new branch] angelayi/symint_input -> origin/angelayi/symint_input 2025-09-07T07:36:19.5686767Z * [new branch] angelayi/test_cpp -> origin/angelayi/test_cpp 2025-09-07T07:36:19.5687983Z * [new branch] angelayi/torch_size -> origin/angelayi/torch_size 2025-09-07T07:36:19.5689263Z * [new branch] aoti-cuda-alloc -> origin/aoti-cuda-alloc 2025-09-07T07:36:19.5690533Z * [new branch] aoti_target_windows -> origin/aoti_target_windows 2025-09-07T07:36:19.5691730Z * [new branch] aoti_weight_sharing -> origin/aoti_weight_sharing 2025-09-07T07:36:19.5693083Z * [new branch] atalman-inductor-perf-cu124 -> origin/atalman-inductor-perf-cu124 2025-09-07T07:36:19.5694339Z * [new branch] atalman-inductor-perf-cu124.1 -> origin/atalman-inductor-perf-cu124.1 2025-09-07T07:36:19.5695585Z * [new branch] atalman-patch-1 -> origin/atalman-patch-1 2025-09-07T07:36:19.5696953Z * [new branch] atalman-patch-3 -> origin/atalman-patch-3 2025-09-07T07:36:19.5698209Z * [new branch] atalman-patch-4 -> origin/atalman-patch-4 2025-09-07T07:36:19.5699544Z * [new branch] atalman-patch-5 -> origin/atalman-patch-5 2025-09-07T07:36:19.5700860Z * [new branch] atalman-patch-6 -> origin/atalman-patch-6 2025-09-07T07:36:19.5702198Z * [new branch] atalman_inductor_2.3.0 -> origin/atalman_inductor_2.3.0 2025-09-07T07:36:19.5703449Z * [new branch] atalman_inductor_2.3.1 -> origin/atalman_inductor_2.3.1 2025-09-07T07:36:19.5704668Z * [new branch] atalman_inductor_2.4.0 -> origin/atalman_inductor_2.4.0 2025-09-07T07:36:19.5706267Z * [new branch] atalman_inductor_2.4.x -> origin/atalman_inductor_2.4.x 2025-09-07T07:36:19.5707694Z * [new branch] autoupdate-transformers-pin-via-pr -> origin/autoupdate-transformers-pin-via-pr 2025-09-07T07:36:19.5709347Z * [new branch] bahuang/dtensor_demo -> origin/bahuang/dtensor_demo 2025-09-07T07:36:19.5710863Z * [new branch] bahuang/test -> origin/bahuang/test 2025-09-07T07:36:19.5712839Z * [new branch] base/1.5 -> origin/base/1.5 2025-09-07T07:36:19.5714266Z * [new branch] batching_sdpa_efficient_attention -> origin/batching_sdpa_efficient_attention 2025-09-07T07:36:19.5715450Z * [new branch] bc-lint-config -> origin/bc-lint-config 2025-09-07T07:36:19.5716673Z * [new branch] bc-lint-test-new-config -> origin/bc-lint-test-new-config 2025-09-07T07:36:19.5718045Z * [new branch] benchmark-updates -> origin/benchmark-updates 2025-09-07T07:36:19.5719347Z * [new branch] benchmarker_compat_with_do_bench -> origin/benchmarker_compat_with_do_bench 2025-09-07T07:36:19.5720582Z * [new branch] benchmarking-script -> origin/benchmarking-script 2025-09-07T07:36:19.5722492Z * [new branch] bertmaher/pinbump26 -> origin/bertmaher/pinbump26 2025-09-07T07:36:19.5724288Z * [new branch] bertrand/cutlass -> origin/bertrand/cutlass 2025-09-07T07:36:19.5725981Z * [new branch] bf/cg-custom-wrapper -> origin/bf/cg-custom-wrapper 2025-09-07T07:36:19.5727300Z * [new branch] bf/cg-or-error -> origin/bf/cg-or-error 2025-09-07T07:36:19.5728383Z * [new branch] bf/cg-remove-check -> origin/bf/cg-remove-check 2025-09-07T07:36:19.5729556Z * [new branch] bf/cg-skip-1-kernel -> origin/bf/cg-skip-1-kernel 2025-09-07T07:36:19.5730744Z * [new branch] bf/cudagraph -> origin/bf/cudagraph 2025-09-07T07:36:19.5732315Z * [new branch] bf/cudagraph-disable-input-mutation -> origin/bf/cudagraph-disable-input-mutation 2025-09-07T07:36:19.5734036Z * [new branch] bf/cudagraph-enable-input-mutation-support-benchmark -> origin/bf/cudagraph-enable-input-mutation-support-benchmark 2025-09-07T07:36:19.5735085Z * [new branch] bf/cudagraph-partition -> origin/bf/cudagraph-partition 2025-09-07T07:36:19.5736506Z * [new branch] bf/default-recompile-reason -> origin/bf/default-recompile-reason 2025-09-07T07:36:19.5737729Z * [new branch] bf/donated-buffer-bench -> origin/bf/donated-buffer-bench 2025-09-07T07:36:19.5739008Z * [new branch] bf/exp -> origin/bf/exp 2025-09-07T07:36:19.5740262Z * [new branch] bf/pa-non-divisible -> origin/bf/pa-non-divisible 2025-09-07T07:36:19.5741767Z * [new branch] bf/partition-move-cpu -> origin/bf/partition-move-cpu 2025-09-07T07:36:19.5743085Z * [new branch] bf/partition-turn-on -> origin/bf/partition-turn-on 2025-09-07T07:36:19.5744299Z * [new branch] bf/remove-check-55b0c39d -> origin/bf/remove-check-55b0c39d 2025-09-07T07:36:19.5745467Z * [new branch] bf/rope -> origin/bf/rope 2025-09-07T07:36:19.5746843Z * [new branch] bisect_perf_hf_T5_3acc6eac492 -> origin/bisect_perf_hf_T5_3acc6eac492 2025-09-07T07:36:19.5748074Z * [new branch] bisect_perf_hf_T5_3fcf66f61fb -> origin/bisect_perf_hf_T5_3fcf66f61fb 2025-09-07T07:36:19.5749275Z * [new branch] bisect_perf_hf_T5_4009d154129 -> origin/bisect_perf_hf_T5_4009d154129 2025-09-07T07:36:19.5750419Z * [new branch] bisect_perf_hf_T5_40d0740e73d -> origin/bisect_perf_hf_T5_40d0740e73d 2025-09-07T07:36:19.5751546Z * [new branch] bisect_perf_hf_T5_5268754e -> origin/bisect_perf_hf_T5_5268754e 2025-09-07T07:36:19.5752713Z * [new branch] bisect_perf_hf_T5_7d89a8d385c -> origin/bisect_perf_hf_T5_7d89a8d385c 2025-09-07T07:36:19.5753934Z * [new branch] bisect_perf_hf_T5_b7a25c1ee7c -> origin/bisect_perf_hf_T5_b7a25c1ee7c 2025-09-07T07:36:19.5755187Z * [new branch] bisect_perf_hf_T5_c25b201583f -> origin/bisect_perf_hf_T5_c25b201583f 2025-09-07T07:36:19.5756358Z * [new branch] bisect_perf_hf_T5_c93e57efac0 -> origin/bisect_perf_hf_T5_c93e57efac0 2025-09-07T07:36:19.5757643Z * [new branch] bisect_perf_hf_T5_ca9813ea149 -> origin/bisect_perf_hf_T5_ca9813ea149 2025-09-07T07:36:19.5758759Z * [new branch] bisect_perf_hf_T5_d65f194a -> origin/bisect_perf_hf_T5_d65f194a 2025-09-07T07:36:19.5759923Z * [new branch] bisect_perf_hf_T5_da94ab0b -> origin/bisect_perf_hf_T5_da94ab0b 2025-09-07T07:36:19.5761161Z * [new branch] bisect_perf_hf_T5_da94ab0b_new -> origin/bisect_perf_hf_T5_da94ab0b_new 2025-09-07T07:36:19.5762298Z * [new branch] bisect_perf_hf_T5_db4e8a1d8a8 -> origin/bisect_perf_hf_T5_db4e8a1d8a8 2025-09-07T07:36:19.5763446Z * [new branch] bisect_perf_hf_T5_e0d97e936a2 -> origin/bisect_perf_hf_T5_e0d97e936a2 2025-09-07T07:36:19.5764684Z * [new branch] bisect_perf_hf_T5_f23621ec563 -> origin/bisect_perf_hf_T5_f23621ec563 2025-09-07T07:36:19.5766463Z * [new branch] bowbao/bench_updates_stage -> origin/bowbao/bench_updates_stage 2025-09-07T07:36:19.5767615Z * [new branch] bowbao/dort_rewriter -> origin/bowbao/dort_rewriter 2025-09-07T07:36:19.5768900Z * [new branch] bowbao/wip_prs -> origin/bowbao/wip_prs 2025-09-07T07:36:19.5770521Z * [new branch] brister/break_tensorbox -> origin/brister/break_tensorbox 2025-09-07T07:36:19.5771728Z * [new branch] brister/custom_fx_backend -> origin/brister/custom_fx_backend 2025-09-07T07:36:19.5773158Z * [new branch] brister/fx_custom_triton -> origin/brister/fx_custom_triton 2025-09-07T07:36:19.5774290Z * [new branch] brister/tensor_box_output -> origin/brister/tensor_box_output 2025-09-07T07:36:19.5775546Z * [new branch] brister/tiled_reduction_no_numel_check -> origin/brister/tiled_reduction_no_numel_check 2025-09-07T07:36:19.5776753Z * [new branch] c57382a49 -> origin/c57382a49 2025-09-07T07:36:19.5777932Z * [new branch] ca_0431d47eaa -> origin/ca_0431d47eaa 2025-09-07T07:36:19.5779128Z * [new branch] ca_fix_0431d47eaa -> origin/ca_fix_0431d47eaa 2025-09-07T07:36:19.5781338Z * [new branch] camyll/revert-94bc900da97ad7f3c35b3b819bb53b23c74b581a-for-release-2.8 -> origin/camyll/revert-94bc900da97ad7f3c35b3b819bb53b23c74b581a-for-release-2.8 2025-09-07T07:36:19.5782915Z * [new branch] camyllh/test_setup_hooks_push -> origin/camyllh/test_setup_hooks_push 2025-09-07T07:36:19.5784293Z * [new branch] cherry-pick-149654-by-pytorch_bot_bot_ -> origin/cherry-pick-149654-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5785695Z * [new branch] cherry-pick-151939-by-pytorch_bot_bot_ -> origin/cherry-pick-151939-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5787046Z * [new branch] cherry-pick-154174-by-pytorch_bot_bot_ -> origin/cherry-pick-154174-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5788319Z * [new branch] cherry-pick-156260-by-pytorch_bot_bot_ -> origin/cherry-pick-156260-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5789621Z * [new branch] cherry-pick-157453-by-pytorch_bot_bot_ -> origin/cherry-pick-157453-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5790905Z * [new branch] cherry-pick-157513-by-pytorch_bot_bot_ -> origin/cherry-pick-157513-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5792116Z * [new branch] cherry-pick-157695-by-pytorch_bot_bot_ -> origin/cherry-pick-157695-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5793367Z * [new branch] cherry-pick-157732-by-pytorch_bot_bot_ -> origin/cherry-pick-157732-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5795049Z * [new branch] cherry-pick-158537-by-pytorch_bot_bot_ -> origin/cherry-pick-158537-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5796302Z * [new branch] cherry-pick-159969-by-pytorch_bot_bot_ -> origin/cherry-pick-159969-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5797600Z * [new branch] cherry-pick-160586-by-pytorch_bot_bot_ -> origin/cherry-pick-160586-by-pytorch_bot_bot_ 2025-09-07T07:36:19.5799361Z * [new branch] chilli/flex_vllm -> origin/chilli/flex_vllm 2025-09-07T07:36:19.5800669Z * [new branch] cleanup-inductor-benchmark-images -> origin/cleanup-inductor-benchmark-images 2025-09-07T07:36:19.5801835Z * [new branch] codex-testing -> origin/codex-testing 2025-09-07T07:36:19.5803883Z * [new branch] codex/add-helper-function-to-sizevars.py -> origin/codex/add-helper-function-to-sizevars.py 2025-09-07T07:36:19.5804998Z * [new branch] codex/add-helper-function-to-sizevars.py_2025-09-05 -> origin/codex/add-helper-function-to-sizevars.py_2025-09-05 2025-09-07T07:36:19.5806149Z * [new branch] codex/add-metadata-field-for-file-path -> origin/codex/add-metadata-field-for-file-path 2025-09-07T07:36:19.5807819Z * [new branch] codex/add-test-for-inductor-local-cache-behavior -> origin/codex/add-test-for-inductor-local-cache-behavior 2025-09-07T07:36:19.5809839Z * [new branch] codex/create-test-for-tensor-memory-leak-in-cudagraph -> origin/codex/create-test-for-tensor-memory-leak-in-cudagraph 2025-09-07T07:36:19.5810857Z * [new branch] codex/fix-issue-121219-in-pytorch -> origin/codex/fix-issue-121219-in-pytorch 2025-09-07T07:36:19.5812104Z * [new branch] codex/fix-issue-160415-in-pytorch -> origin/codex/fix-issue-160415-in-pytorch 2025-09-07T07:36:19.5813405Z * [new branch] codex/fix-noqengine-quantized-engine-support -> origin/codex/fix-noqengine-quantized-engine-support 2025-09-07T07:36:19.5814509Z * [new branch] codex/fix-pin_memory-error-handling -> origin/codex/fix-pin_memory-error-handling 2025-09-07T07:36:19.5815754Z * [new branch] codex/propose-fix-for-issue-160332 -> origin/codex/propose-fix-for-issue-160332 2025-09-07T07:36:19.5817101Z * [new branch] codex/refactor-lintrunner-config-to-use-uv-run -> origin/codex/refactor-lintrunner-config-to-use-uv-run 2025-09-07T07:36:19.5818311Z * [new branch] codex/remove-allow-untyped-defs-and-fix-type-errors -> origin/codex/remove-allow-untyped-defs-and-fix-type-errors 2025-09-07T07:36:19.5819391Z * [new branch] compile_fsdp2_disable_stream_and_event -> origin/compile_fsdp2_disable_stream_and_event 2025-09-07T07:36:19.5820563Z * [new branch] context_test -> origin/context_test 2025-09-07T07:36:19.5822358Z * [new branch] copilot/fix-157446 -> origin/copilot/fix-157446 2025-09-07T07:36:19.5823639Z * [new branch] copy_graph -> origin/copy_graph 2025-09-07T07:36:19.5825392Z * [new branch] cpio/fix_new_ami_tests -> origin/cpio/fix_new_ami_tests 2025-09-07T07:36:19.5827316Z * [new branch] csl/always_produce_xml -> origin/csl/always_produce_xml 2025-09-07T07:36:19.5828543Z * [new branch] csl/build_test_more_procs -> origin/csl/build_test_more_procs 2025-09-07T07:36:19.5829751Z * [new branch] csl/build_test_more_procs2 -> origin/csl/build_test_more_procs2 2025-09-07T07:36:19.5830920Z * [new branch] csl/disable_flaky_cpp_test -> origin/csl/disable_flaky_cpp_test 2025-09-07T07:36:19.5832014Z * [new branch] csl/disable_periodic_test -> origin/csl/disable_periodic_test 2025-09-07T07:36:19.5833466Z * [new branch] csl/exclude_rocm_viable_strict -> origin/csl/exclude_rocm_viable_strict 2025-09-07T07:36:19.5834954Z * [new branch] csl/katex -> origin/csl/katex 2025-09-07T07:36:19.5836241Z * [new branch] csl/larger_runner -> origin/csl/larger_runner 2025-09-07T07:36:19.5837429Z * [new branch] csl/lintrunner_stuff -> origin/csl/lintrunner_stuff 2025-09-07T07:36:19.5838666Z * [new branch] csl/mps_sharding -> origin/csl/mps_sharding 2025-09-07T07:36:19.5839870Z * [new branch] csl/multistage_docker -> origin/csl/multistage_docker 2025-09-07T07:36:19.5841048Z * [new branch] csl/name_link_check_job -> origin/csl/name_link_check_job 2025-09-07T07:36:19.5842481Z * [new branch] csl/no_keep_goin_rocm -> origin/csl/no_keep_goin_rocm 2025-09-07T07:36:19.5843690Z * [new branch] csl/not_600_timeout -> origin/csl/not_600_timeout 2025-09-07T07:36:19.5844925Z * [new branch] csl/revert_open -> origin/csl/revert_open 2025-09-07T07:36:19.5846194Z * [new branch] csl/skip_build -> origin/csl/skip_build 2025-09-07T07:36:19.5847482Z * [new branch] csl/test_cuda_build_large_runner -> origin/csl/test_cuda_build_large_runner 2025-09-07T07:36:19.5848755Z * [new branch] csl/win_sccache -> origin/csl/win_sccache 2025-09-07T07:36:19.5849988Z * [new branch] cublasltrelax2 -> origin/cublasltrelax2 2025-09-07T07:36:19.5851159Z * [new branch] cublasrelax2 -> origin/cublasrelax2 2025-09-07T07:36:19.5852528Z * [new branch] cudnnsdparefactor -> origin/cudnnsdparefactor 2025-09-07T07:36:19.5853636Z * [new branch] custom_lowering_dict -> origin/custom_lowering_dict 2025-09-07T07:36:19.5854887Z * [new branch] czhuge_muon_dev -> origin/czhuge_muon_dev 2025-09-07T07:36:19.5856677Z * [new branch] d4l3k/delete_hook -> origin/d4l3k/delete_hook 2025-09-07T07:36:19.5857944Z * [new branch] dcp_zoc -> origin/dcp_zoc 2025-09-07T07:36:19.5859215Z * [new branch] debug-guard -> origin/debug-guard 2025-09-07T07:36:19.5860423Z * [new branch] delete-quant-docs -> origin/delete-quant-docs 2025-09-07T07:36:19.5864689Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.2 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.2 2025-09-07T07:36:19.5866061Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.3 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.3 2025-09-07T07:36:19.5867633Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.4 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.4 2025-09-07T07:36:19.5868924Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.56.0 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.56.0 2025-09-07T07:36:19.5870124Z * [new branch] dependabot/pip/dot-ci/docker/protobuf-5.29.5 -> origin/dependabot/pip/dot-ci/docker/protobuf-5.29.5 2025-09-07T07:36:19.5872480Z * [new branch] dependabot/pip/dot-github/requirements/protobuf-5.29.5 -> origin/dependabot/pip/dot-github/requirements/protobuf-5.29.5 2025-09-07T07:36:19.5874102Z * [new branch] desertfire/test_cpp_wrapper -> origin/desertfire/test_cpp_wrapper 2025-09-07T07:36:19.5875318Z * [new branch] desertfire/triton-cpu-for-aarch64 -> origin/desertfire/triton-cpu-for-aarch64 2025-09-07T07:36:19.5877683Z * [new branch] dev/joona/MPSNDArrayAdd -> origin/dev/joona/MPSNDArrayAdd 2025-09-07T07:36:19.5879027Z * [new branch] dev/joona/Unranked -> origin/dev/joona/Unranked 2025-09-07T07:36:19.5880684Z * [new branch] dev/joona/cat -> origin/dev/joona/cat 2025-09-07T07:36:19.5882063Z * [new branch] dev/joona/cat_remove_graph -> origin/dev/joona/cat_remove_graph 2025-09-07T07:36:19.5883267Z * [new branch] dev/joona/embeddingbag -> origin/dev/joona/embeddingbag 2025-09-07T07:36:19.5884675Z * [new branch] dev/joona/getTensorsString -> origin/dev/joona/getTensorsString 2025-09-07T07:36:19.5886360Z * [new branch] dev/joona/maxpool2dwithindices_errmsg -> origin/dev/joona/maxpool2dwithindices_errmsg 2025-09-07T07:36:19.5888017Z * [new branch] dev/joona/mps_linear_macos14 -> origin/dev/joona/mps_linear_macos14 2025-09-07T07:36:19.5889733Z * [new branch] dev/joona/sdpa -> origin/dev/joona/sdpa 2025-09-07T07:36:19.5891273Z * [new branch] dev/joona/topk_newapi -> origin/dev/joona/topk_newapi 2025-09-07T07:36:19.5892735Z * [new branch] dev/joona/type_inf -> origin/dev/joona/type_inf 2025-09-07T07:36:19.5894133Z * [new branch] dev/joona/upsize3d -> origin/dev/joona/upsize3d 2025-09-07T07:36:19.5895285Z * [new branch] disable -> origin/disable 2025-09-07T07:36:19.5896502Z * [new branch] e2e-baseline -> origin/e2e-baseline 2025-09-07T07:36:19.5897702Z * [new branch] eigen_for_sparse_addmm_v2 -> origin/eigen_for_sparse_addmm_v2 2025-09-07T07:36:19.5899440Z * [new branch] embg/test_inductor_ci_128B -> origin/embg/test_inductor_ci_128B 2025-09-07T07:36:19.5900790Z * [new branch] embg/test_inductor_ci_base -> origin/embg/test_inductor_ci_base 2025-09-07T07:36:19.5901929Z * [new branch] embg/test_inductor_ci_control -> origin/embg/test_inductor_ci_control 2025-09-07T07:36:19.5903029Z * [new branch] embg/triton_l2_prefetch_128B -> origin/embg/triton_l2_prefetch_128B 2025-09-07T07:36:19.5904429Z * [new branch] embg/triton_l2_prefetch_256B -> origin/embg/triton_l2_prefetch_256B 2025-09-07T07:36:19.5905834Z * [new branch] eqy-patch-1 -> origin/eqy-patch-1 2025-09-07T07:36:19.5907071Z * [new branch] eqy-patch-2 -> origin/eqy-patch-2 2025-09-07T07:36:19.5908254Z * [new branch] eqy-patch-3 -> origin/eqy-patch-3 2025-09-07T07:36:19.5909421Z * [new branch] eqy-patch-4 -> origin/eqy-patch-4 2025-09-07T07:36:19.5910933Z * [new branch] example-convert-torch.nn -> origin/example-convert-torch.nn 2025-09-07T07:36:19.5912910Z * [new branch] exclamaforte/add-contiguous-threshold -> origin/exclamaforte/add-contiguous-threshold 2025-09-07T07:36:19.5914008Z * [new branch] exclamaforte/amd-ma -> origin/exclamaforte/amd-ma 2025-09-07T07:36:19.5915426Z * [new branch] exclamaforte/bump-transformer-version -> origin/exclamaforte/bump-transformer-version 2025-09-07T07:36:19.5916641Z * [new branch] exclamaforte/clear-feedback-savers -> origin/exclamaforte/clear-feedback-savers 2025-09-07T07:36:19.5917809Z * [new branch] exclamaforte/combo-kernels-perf-run -> origin/exclamaforte/combo-kernels-perf-run 2025-09-07T07:36:19.5919293Z * [new branch] exclamaforte/do_bench_refactor -> origin/exclamaforte/do_bench_refactor 2025-09-07T07:36:19.5920945Z * [new branch] exclamaforte/enable-mem-dep-fusion -> origin/exclamaforte/enable-mem-dep-fusion 2025-09-07T07:36:19.5922340Z * [new branch] exclamaforte/fix-exhaustive-autotuning -> origin/exclamaforte/fix-exhaustive-autotuning 2025-09-07T07:36:19.5923659Z * [new branch] exclamaforte/fix-exhuastive-autotuning-reland -> origin/exclamaforte/fix-exhuastive-autotuning-reland 2025-09-07T07:36:19.5924884Z * [new branch] exclamaforte/fix-trace-parsing-fx-svg -> origin/exclamaforte/fix-trace-parsing-fx-svg 2025-09-07T07:36:19.5926095Z * [new branch] exclamaforte/force-pointwise-cat-perf-run -> origin/exclamaforte/force-pointwise-cat-perf-run 2025-09-07T07:36:19.5927295Z * [new branch] exclamaforte/fusion-data -> origin/exclamaforte/fusion-data 2025-09-07T07:36:19.5928620Z * [new branch] exclamaforte/gemm-benchmark-run -> origin/exclamaforte/gemm-benchmark-run 2025-09-07T07:36:19.5929822Z * [new branch] exclamaforte/gemm-export-model -> origin/exclamaforte/gemm-export-model 2025-09-07T07:36:19.5930998Z * [new branch] exclamaforte/gemm-model -> origin/exclamaforte/gemm-model 2025-09-07T07:36:19.5932309Z * [new branch] exclamaforte/gemm-model-all-data-collection -> origin/exclamaforte/gemm-model-all-data-collection 2025-09-07T07:36:19.5933340Z * [new branch] exclamaforte/gemm-to-amd -> origin/exclamaforte/gemm-to-amd 2025-09-07T07:36:19.5934644Z * [new branch] exclamaforte/just-gemm-model -> origin/exclamaforte/just-gemm-model 2025-09-07T07:36:19.5935934Z * [new branch] exclamaforte/just-gemm-model-no-refactor -> origin/exclamaforte/just-gemm-model-no-refactor 2025-09-07T07:36:19.5937145Z * [new branch] exclamaforte/max-autotune-ieee -> origin/exclamaforte/max-autotune-ieee 2025-09-07T07:36:19.5938241Z * [new branch] exclamaforte/memory-counter -> origin/exclamaforte/memory-counter 2025-09-07T07:36:19.5939461Z * [new branch] exclamaforte/profile-diff-algo -> origin/exclamaforte/profile-diff-algo 2025-09-07T07:36:19.5940662Z * [new branch] exclamaforte/profiler-combo -> origin/exclamaforte/profiler-combo 2025-09-07T07:36:19.5942066Z * [new branch] exclamaforte/test_cpp_wrapper_mode -> origin/exclamaforte/test_cpp_wrapper_mode 2025-09-07T07:36:19.5943111Z * [new branch] exclamaforte/update-autotune-configs -> origin/exclamaforte/update-autotune-configs 2025-09-07T07:36:19.5944424Z * [new branch] exclamaforte/update-autotune-configs-2 -> origin/exclamaforte/update-autotune-configs-2 2025-09-07T07:36:19.5946133Z * [new branch] exclamforte/gemm-model-final -> origin/exclamforte/gemm-model-final 2025-09-07T07:36:19.5947512Z * [new branch] exec -> origin/exec 2025-09-07T07:36:19.5948752Z * [new branch] executorch-module-shim -> origin/executorch-module-shim 2025-09-07T07:36:19.5950090Z * [new branch] experimental-mosaic -> origin/experimental-mosaic 2025-09-07T07:36:19.5951389Z * [new branch] export-D58091437 -> origin/export-D58091437 2025-09-07T07:36:19.5952723Z * [new branch] export-D61047529 -> origin/export-D61047529 2025-09-07T07:36:19.5953965Z * [new branch] export-D70112642 -> origin/export-D70112642 2025-09-07T07:36:19.5955230Z * [new branch] export-D71412006 -> origin/export-D71412006 2025-09-07T07:36:19.5956619Z * [new branch] export-D73042989 -> origin/export-D73042989 2025-09-07T07:36:19.5957890Z * [new branch] export-D75183591 -> origin/export-D75183591 2025-09-07T07:36:19.5959147Z * [new branch] export-D75617432 -> origin/export-D75617432 2025-09-07T07:36:19.5960327Z * [new branch] export-D75659965 -> origin/export-D75659965 2025-09-07T07:36:19.5961513Z * [new branch] export-D76080931 -> origin/export-D76080931 2025-09-07T07:36:19.5962678Z * [new branch] export-D76797250 -> origin/export-D76797250 2025-09-07T07:36:19.5963887Z * [new branch] export-D76885271 -> origin/export-D76885271 2025-09-07T07:36:19.5965065Z * [new branch] export-D76885620 -> origin/export-D76885620 2025-09-07T07:36:19.5966291Z * [new branch] export-D76936623 -> origin/export-D76936623 2025-09-07T07:36:19.5967536Z * [new branch] export-D76958268 -> origin/export-D76958268 2025-09-07T07:36:19.5968738Z * [new branch] export-D78375400 -> origin/export-D78375400 2025-09-07T07:36:19.5969982Z * [new branch] export-D78431305 -> origin/export-D78431305 2025-09-07T07:36:19.5971209Z * [new branch] export-D78580107 -> origin/export-D78580107 2025-09-07T07:36:19.5972427Z * [new branch] export-D78822171 -> origin/export-D78822171 2025-09-07T07:36:19.5973597Z * [new branch] export-D78822351 -> origin/export-D78822351 2025-09-07T07:36:19.5974790Z * [new branch] export-D78822507 -> origin/export-D78822507 2025-09-07T07:36:19.5976002Z * [new branch] export-D78826994 -> origin/export-D78826994 2025-09-07T07:36:19.5977201Z * [new branch] export-D78894324 -> origin/export-D78894324 2025-09-07T07:36:19.5978528Z * [new branch] export-D78929245 -> origin/export-D78929245 2025-09-07T07:36:19.5979705Z * [new branch] export-D78934925 -> origin/export-D78934925 2025-09-07T07:36:19.5980947Z * [new branch] export-D78953203 -> origin/export-D78953203 2025-09-07T07:36:19.5982140Z * [new branch] export-D78953229 -> origin/export-D78953229 2025-09-07T07:36:19.5983269Z * [new branch] export-D78957093 -> origin/export-D78957093 2025-09-07T07:36:19.5984408Z * [new branch] export-D78957389 -> origin/export-D78957389 2025-09-07T07:36:19.5985778Z * [new branch] export-D78996107 -> origin/export-D78996107 2025-09-07T07:36:19.5986864Z * [new branch] export-D79026433 -> origin/export-D79026433 2025-09-07T07:36:19.5988082Z * [new branch] export-D79230339 -> origin/export-D79230339 2025-09-07T07:36:19.5989302Z * [new branch] export-D79319835 -> origin/export-D79319835 2025-09-07T07:36:19.5990550Z * [new branch] export-D79328456 -> origin/export-D79328456 2025-09-07T07:36:19.5991773Z * [new branch] export-D79534608 -> origin/export-D79534608 2025-09-07T07:36:19.5993177Z * [new branch] export-D79785974 -> origin/export-D79785974 2025-09-07T07:36:19.5994404Z * [new branch] export-D80025417 -> origin/export-D80025417 2025-09-07T07:36:19.5996001Z * [new branch] export-D80120333 -> origin/export-D80120333 2025-09-07T07:36:19.5997266Z * [new branch] export-D80214882 -> origin/export-D80214882 2025-09-07T07:36:19.5998438Z * [new branch] export-D80319069 -> origin/export-D80319069 2025-09-07T07:36:19.5999715Z * [new branch] export-D80321215 -> origin/export-D80321215 2025-09-07T07:36:19.6000921Z * [new branch] export-D80503451 -> origin/export-D80503451 2025-09-07T07:36:19.6002063Z * [new branch] export-D80771648 -> origin/export-D80771648 2025-09-07T07:36:19.6003242Z * [new branch] export-D80823877 -> origin/export-D80823877 2025-09-07T07:36:19.6004462Z * [new branch] export-D80948073 -> origin/export-D80948073 2025-09-07T07:36:19.6005728Z * [new branch] export-D80958642 -> origin/export-D80958642 2025-09-07T07:36:19.6006969Z * [new branch] export-D80970483 -> origin/export-D80970483 2025-09-07T07:36:19.6008165Z * [new branch] export-D81054193 -> origin/export-D81054193 2025-09-07T07:36:19.6009529Z * [new branch] export-D81060182 -> origin/export-D81060182 2025-09-07T07:36:19.6011038Z * [new branch] export-D81078973 -> origin/export-D81078973 2025-09-07T07:36:19.6012211Z * [new branch] export-D81204584 -> origin/export-D81204584 2025-09-07T07:36:19.6013874Z * [new branch] export-D81284190 -> origin/export-D81284190 2025-09-07T07:36:19.6015141Z * [new branch] export-D81299840 -> origin/export-D81299840 2025-09-07T07:36:19.6016352Z * [new branch] export-D81429090 -> origin/export-D81429090 2025-09-07T07:36:19.6017523Z * [new branch] export-D81698719 -> origin/export-D81698719 2025-09-07T07:36:19.6018983Z * [new branch] export-D81747409 -> origin/export-D81747409 2025-09-07T07:36:19.6020242Z * [new branch] exported-model-train-idempotent -> origin/exported-model-train-idempotent 2025-09-07T07:36:19.6021910Z * [new branch] ezyang/wip-aot-descriptors -> origin/ezyang/wip-aot-descriptors 2025-09-07T07:36:19.6023051Z * [new branch] fa_u8_brgemm -> origin/fa_u8_brgemm 2025-09-07T07:36:19.6024288Z * [new branch] fastmath_baseline -> origin/fastmath_baseline 2025-09-07T07:36:19.6026180Z * [new branch] fbcode/warm -> origin/fbcode/warm 2025-09-07T07:36:19.6027556Z * [new branch] fca -> origin/fca 2025-09-07T07:36:19.6028756Z * [new branch] fca2_ca5984c -> origin/fca2_ca5984c 2025-09-07T07:36:19.6029885Z * [new branch] fca5 -> origin/fca5 2025-09-07T07:36:19.6031713Z * [new branch] feature/function-numa-binding -> origin/feature/function-numa-binding 2025-09-07T07:36:19.6033103Z * [new branch] feature/function-numa-binding-take2 -> origin/feature/function-numa-binding-take2 2025-09-07T07:36:19.6033920Z * [new branch] feature/numa-nproc-fix -> origin/feature/numa-nproc-fix 2025-09-07T07:36:19.6035160Z * [new branch] feature/numa-signpost-serialize -> origin/feature/numa-signpost-serialize 2025-09-07T07:36:19.6036325Z * [new branch] feature/parallel-numa-binding -> origin/feature/parallel-numa-binding 2025-09-07T07:36:19.6038026Z * [new branch] fengyuan/external-proj -> origin/fengyuan/external-proj 2025-09-07T07:36:19.6039246Z * [new branch] fengyuan/out-of-tree-xpu-ops-improve-test -> origin/fengyuan/out-of-tree-xpu-ops-improve-test 2025-09-07T07:36:19.6040320Z * [new branch] fengyuan/out-of-tree-xpu-ops-remove-dtype -> origin/fengyuan/out-of-tree-xpu-ops-remove-dtype 2025-09-07T07:36:19.6041357Z * [new branch] fengyuan/test-xpu -> origin/fengyuan/test-xpu 2025-09-07T07:36:19.6043035Z * [new branch] ffast_math_baseline -> origin/ffast_math_baseline 2025-09-07T07:36:19.6044412Z * [new branch] ffast_math_target -> origin/ffast_math_target 2025-09-07T07:36:19.6046178Z * [new branch] findhao/base_commit -> origin/findhao/base_commit 2025-09-07T07:36:19.6047390Z * [new branch] findhao/base_commit1 -> origin/findhao/base_commit1 2025-09-07T07:36:19.6048458Z * [new branch] findhao/multistream2 -> origin/findhao/multistream2 2025-09-07T07:36:19.6049586Z * [new branch] findhao/multistream5 -> origin/findhao/multistream5 2025-09-07T07:36:19.6050673Z * [new branch] findhao/multistream6 -> origin/findhao/multistream6 2025-09-07T07:36:19.6051820Z * [new branch] findhao/operatorbench3 -> origin/findhao/operatorbench3 2025-09-07T07:36:19.6053002Z * [new branch] findhao/operatorbench5 -> origin/findhao/operatorbench5 2025-09-07T07:36:19.6054156Z * [new branch] findhao/tritonparse -> origin/findhao/tritonparse 2025-09-07T07:36:19.6055412Z * [new branch] fix -> origin/fix 2025-09-07T07:36:19.6056731Z * [new branch] fix-ck-gemm-template-format -> origin/fix-ck-gemm-template-format 2025-09-07T07:36:19.6057888Z * [new branch] fix-config-ignore -> origin/fix-config-ignore 2025-09-07T07:36:19.6059134Z * [new branch] fix-dict-guard -> origin/fix-dict-guard 2025-09-07T07:36:19.6060418Z * [new branch] fix-inductor-periodic-0528 -> origin/fix-inductor-periodic-0528 2025-09-07T07:36:19.6061505Z * [new branch] fix-mps-benchmark -> origin/fix-mps-benchmark 2025-09-07T07:36:19.6062799Z * [new branch] fix-rlease-feature-template -> origin/fix-rlease-feature-template 2025-09-07T07:36:19.6064017Z * [new branch] fix-run-condition-upload-results -> origin/fix-run-condition-upload-results 2025-09-07T07:36:19.6065157Z * [new branch] fix-torchbench -> origin/fix-torchbench 2025-09-07T07:36:19.6066410Z * [new branch] fix_153389 -> origin/fix_153389 2025-09-07T07:36:19.6067690Z * [new branch] fix_fsdp_rs_bucket2 -> origin/fix_fsdp_rs_bucket2 2025-09-07T07:36:19.6069053Z * [new branch] fix_inductor_peridic_tests -> origin/fix_inductor_peridic_tests 2025-09-07T07:36:19.6070538Z * [new branch] fix_ubn_159469 -> origin/fix_ubn_159469 2025-09-07T07:36:19.6071503Z * [new branch] fixes-triage -> origin/fixes-triage 2025-09-07T07:36:19.6072708Z * [new branch] fixflashinfer -> origin/fixflashinfer 2025-09-07T07:36:19.6073922Z * [new branch] flash_decoding_cpu -> origin/flash_decoding_cpu 2025-09-07T07:36:19.6075363Z * [new branch] flex-flash -> origin/flex-flash 2025-09-07T07:36:19.6076482Z * [new branch] flex-lowering -> origin/flex-lowering 2025-09-07T07:36:19.6077759Z * [new branch] flex-warning -> origin/flex-warning 2025-09-07T07:36:19.6078977Z * [new branch] flex_attention_functorch_grad -> origin/flex_attention_functorch_grad 2025-09-07T07:36:19.6080302Z * [new branch] flex_flash -> origin/flex_flash 2025-09-07T07:36:19.6081619Z * [new branch] flexdecode-gqa-groups -> origin/flexdecode-gqa-groups 2025-09-07T07:36:19.6083413Z * [new branch] fmassa/fix_memeff_sharding_rule -> origin/fmassa/fix_memeff_sharding_rule 2025-09-07T07:36:19.6084716Z * [new branch] fsdp2_trace_rules -> origin/fsdp2_trace_rules 2025-09-07T07:36:19.6085991Z * [new branch] fsdpv2_3d -> origin/fsdpv2_3d 2025-09-07T07:36:19.6087416Z * [new branch] fsdpv2_3d_m1 -> origin/fsdpv2_3d_m1 2025-09-07T07:36:19.6088580Z * [new branch] fx_cpp -> origin/fx_cpp 2025-09-07T07:36:19.6090357Z * [new branch] fy/fix-win -> origin/fy/fix-win 2025-09-07T07:36:19.6093439Z * [new branch] gh/AlnisM/1/base -> origin/gh/AlnisM/1/base 2025-09-07T07:36:19.6094701Z * [new branch] gh/AlnisM/1/head -> origin/gh/AlnisM/1/head 2025-09-07T07:36:19.6096908Z * [new branch] gh/CaoE/2/base -> origin/gh/CaoE/2/base 2025-09-07T07:36:19.6098130Z * [new branch] gh/CaoE/2/head -> origin/gh/CaoE/2/head 2025-09-07T07:36:19.6099298Z * [new branch] gh/CaoE/2/orig -> origin/gh/CaoE/2/orig 2025-09-07T07:36:19.6101455Z * [new branch] gh/ColinPeppler/79/base -> origin/gh/ColinPeppler/79/base 2025-09-07T07:36:19.6102755Z * [new branch] gh/ColinPeppler/79/head -> origin/gh/ColinPeppler/79/head 2025-09-07T07:36:19.6122840Z * [new branch] gh/ColinPeppler/79/orig -> origin/gh/ColinPeppler/79/orig 2025-09-07T07:36:19.6123535Z * [new branch] gh/ColinPeppler/80/base -> origin/gh/ColinPeppler/80/base 2025-09-07T07:36:19.6123942Z * [new branch] gh/ColinPeppler/80/head -> origin/gh/ColinPeppler/80/head 2025-09-07T07:36:19.6124286Z * [new branch] gh/ColinPeppler/80/orig -> origin/gh/ColinPeppler/80/orig 2025-09-07T07:36:19.6124619Z * [new branch] gh/EikanWang/67/base -> origin/gh/EikanWang/67/base 2025-09-07T07:36:19.6124932Z * [new branch] gh/EikanWang/67/head -> origin/gh/EikanWang/67/head 2025-09-07T07:36:19.6125250Z * [new branch] gh/EikanWang/80/base -> origin/gh/EikanWang/80/base 2025-09-07T07:36:19.6125579Z * [new branch] gh/EikanWang/80/head -> origin/gh/EikanWang/80/head 2025-09-07T07:36:19.6125889Z * [new branch] gh/EikanWang/80/orig -> origin/gh/EikanWang/80/orig 2025-09-07T07:36:19.6126194Z * [new branch] gh/EikanWang/81/base -> origin/gh/EikanWang/81/base 2025-09-07T07:36:19.6126500Z * [new branch] gh/EikanWang/81/head -> origin/gh/EikanWang/81/head 2025-09-07T07:36:19.6126821Z * [new branch] gh/EikanWang/81/orig -> origin/gh/EikanWang/81/orig 2025-09-07T07:36:19.6127130Z * [new branch] gh/EikanWang/82/base -> origin/gh/EikanWang/82/base 2025-09-07T07:36:19.6127468Z * [new branch] gh/EikanWang/82/head -> origin/gh/EikanWang/82/head 2025-09-07T07:36:19.6127786Z * [new branch] gh/EikanWang/82/orig -> origin/gh/EikanWang/82/orig 2025-09-07T07:36:19.6128106Z * [new branch] gh/Gasoonjia/1/base -> origin/gh/Gasoonjia/1/base 2025-09-07T07:36:19.6128462Z * [new branch] gh/Gasoonjia/1/head -> origin/gh/Gasoonjia/1/head 2025-09-07T07:36:19.6130803Z * [new branch] gh/H-Huang/131/base -> origin/gh/H-Huang/131/base 2025-09-07T07:36:19.6131749Z * [new branch] gh/H-Huang/131/head -> origin/gh/H-Huang/131/head 2025-09-07T07:36:19.6132992Z * [new branch] gh/H-Huang/131/orig -> origin/gh/H-Huang/131/orig 2025-09-07T07:36:19.6134717Z * [new branch] gh/H-Huang/132/base -> origin/gh/H-Huang/132/base 2025-09-07T07:36:19.6135857Z * [new branch] gh/H-Huang/132/head -> origin/gh/H-Huang/132/head 2025-09-07T07:36:19.6137049Z * [new branch] gh/H-Huang/132/orig -> origin/gh/H-Huang/132/orig 2025-09-07T07:36:19.6138783Z * [new branch] gh/H-Huang/180/base -> origin/gh/H-Huang/180/base 2025-09-07T07:36:19.6139957Z * [new branch] gh/H-Huang/180/head -> origin/gh/H-Huang/180/head 2025-09-07T07:36:19.6141216Z * [new branch] gh/H-Huang/180/orig -> origin/gh/H-Huang/180/orig 2025-09-07T07:36:19.6142874Z * [new branch] gh/H-Huang/182/base -> origin/gh/H-Huang/182/base 2025-09-07T07:36:19.6144081Z * [new branch] gh/H-Huang/182/head -> origin/gh/H-Huang/182/head 2025-09-07T07:36:19.6145277Z * [new branch] gh/H-Huang/182/orig -> origin/gh/H-Huang/182/orig 2025-09-07T07:36:19.6147208Z * [new branch] gh/H-Huang/187/base -> origin/gh/H-Huang/187/base 2025-09-07T07:36:19.6148332Z * [new branch] gh/H-Huang/187/head -> origin/gh/H-Huang/187/head 2025-09-07T07:36:19.6149852Z * [new branch] gh/H-Huang/187/orig -> origin/gh/H-Huang/187/orig 2025-09-07T07:36:19.6151542Z * [new branch] gh/H-Huang/202/base -> origin/gh/H-Huang/202/base 2025-09-07T07:36:19.6152760Z * [new branch] gh/H-Huang/202/head -> origin/gh/H-Huang/202/head 2025-09-07T07:36:19.6154001Z * [new branch] gh/H-Huang/202/orig -> origin/gh/H-Huang/202/orig 2025-09-07T07:36:19.6155707Z * [new branch] gh/H-Huang/203/base -> origin/gh/H-Huang/203/base 2025-09-07T07:36:19.6156900Z * [new branch] gh/H-Huang/203/head -> origin/gh/H-Huang/203/head 2025-09-07T07:36:19.6158090Z * [new branch] gh/H-Huang/203/orig -> origin/gh/H-Huang/203/orig 2025-09-07T07:36:19.6159826Z * [new branch] gh/H-Huang/204/base -> origin/gh/H-Huang/204/base 2025-09-07T07:36:19.6161049Z * [new branch] gh/H-Huang/204/head -> origin/gh/H-Huang/204/head 2025-09-07T07:36:19.6162217Z * [new branch] gh/H-Huang/204/orig -> origin/gh/H-Huang/204/orig 2025-09-07T07:36:19.6163929Z * [new branch] gh/H-Huang/205/base -> origin/gh/H-Huang/205/base 2025-09-07T07:36:19.6165103Z * [new branch] gh/H-Huang/205/head -> origin/gh/H-Huang/205/head 2025-09-07T07:36:19.6166273Z * [new branch] gh/H-Huang/205/orig -> origin/gh/H-Huang/205/orig 2025-09-07T07:36:19.6167974Z * [new branch] gh/H-Huang/206/base -> origin/gh/H-Huang/206/base 2025-09-07T07:36:19.6169192Z * [new branch] gh/H-Huang/206/head -> origin/gh/H-Huang/206/head 2025-09-07T07:36:19.6170387Z * [new branch] gh/H-Huang/206/orig -> origin/gh/H-Huang/206/orig 2025-09-07T07:36:19.6172095Z * [new branch] gh/H-Huang/207/base -> origin/gh/H-Huang/207/base 2025-09-07T07:36:19.6173270Z * [new branch] gh/H-Huang/207/head -> origin/gh/H-Huang/207/head 2025-09-07T07:36:19.6174514Z * [new branch] gh/H-Huang/207/orig -> origin/gh/H-Huang/207/orig 2025-09-07T07:36:19.6176194Z * [new branch] gh/H-Huang/208/base -> origin/gh/H-Huang/208/base 2025-09-07T07:36:19.6177357Z * [new branch] gh/H-Huang/208/head -> origin/gh/H-Huang/208/head 2025-09-07T07:36:19.6178642Z * [new branch] gh/H-Huang/208/orig -> origin/gh/H-Huang/208/orig 2025-09-07T07:36:19.6180242Z * [new branch] gh/H-Huang/209/base -> origin/gh/H-Huang/209/base 2025-09-07T07:36:19.6181439Z * [new branch] gh/H-Huang/209/head -> origin/gh/H-Huang/209/head 2025-09-07T07:36:19.6182612Z * [new branch] gh/H-Huang/209/orig -> origin/gh/H-Huang/209/orig 2025-09-07T07:36:19.6184427Z * [new branch] gh/H-Huang/210/base -> origin/gh/H-Huang/210/base 2025-09-07T07:36:19.6185596Z * [new branch] gh/H-Huang/210/head -> origin/gh/H-Huang/210/head 2025-09-07T07:36:19.6186869Z * [new branch] gh/H-Huang/210/orig -> origin/gh/H-Huang/210/orig 2025-09-07T07:36:19.6188599Z * [new branch] gh/H-Huang/211/base -> origin/gh/H-Huang/211/base 2025-09-07T07:36:19.6189801Z * [new branch] gh/H-Huang/211/head -> origin/gh/H-Huang/211/head 2025-09-07T07:36:19.6191014Z * [new branch] gh/H-Huang/211/orig -> origin/gh/H-Huang/211/orig 2025-09-07T07:36:19.6192651Z * [new branch] gh/H-Huang/212/base -> origin/gh/H-Huang/212/base 2025-09-07T07:36:19.6193849Z * [new branch] gh/H-Huang/212/head -> origin/gh/H-Huang/212/head 2025-09-07T07:36:19.6195009Z * [new branch] gh/H-Huang/212/orig -> origin/gh/H-Huang/212/orig 2025-09-07T07:36:19.6197350Z * [new branch] gh/H-Huang/213/base -> origin/gh/H-Huang/213/base 2025-09-07T07:36:19.6198556Z * [new branch] gh/H-Huang/213/head -> origin/gh/H-Huang/213/head 2025-09-07T07:36:19.6199734Z * [new branch] gh/H-Huang/213/orig -> origin/gh/H-Huang/213/orig 2025-09-07T07:36:19.6201445Z * [new branch] gh/H-Huang/214/base -> origin/gh/H-Huang/214/base 2025-09-07T07:36:19.6202618Z * [new branch] gh/H-Huang/214/head -> origin/gh/H-Huang/214/head 2025-09-07T07:36:19.6203798Z * [new branch] gh/H-Huang/214/orig -> origin/gh/H-Huang/214/orig 2025-09-07T07:36:19.6205992Z * [new branch] gh/IvanKobzarev/112/base -> origin/gh/IvanKobzarev/112/base 2025-09-07T07:36:19.6207215Z * [new branch] gh/IvanKobzarev/112/head -> origin/gh/IvanKobzarev/112/head 2025-09-07T07:36:19.6208427Z * [new branch] gh/IvanKobzarev/112/orig -> origin/gh/IvanKobzarev/112/orig 2025-09-07T07:36:19.6210428Z * [new branch] gh/IvanKobzarev/115/base -> origin/gh/IvanKobzarev/115/base 2025-09-07T07:36:19.6211680Z * [new branch] gh/IvanKobzarev/115/head -> origin/gh/IvanKobzarev/115/head 2025-09-07T07:36:19.6212957Z * [new branch] gh/IvanKobzarev/115/orig -> origin/gh/IvanKobzarev/115/orig 2025-09-07T07:36:19.6214958Z * [new branch] gh/IvanKobzarev/116/base -> origin/gh/IvanKobzarev/116/base 2025-09-07T07:36:19.6216193Z * [new branch] gh/IvanKobzarev/116/head -> origin/gh/IvanKobzarev/116/head 2025-09-07T07:36:19.6217410Z * [new branch] gh/IvanKobzarev/116/orig -> origin/gh/IvanKobzarev/116/orig 2025-09-07T07:36:19.6219181Z * [new branch] gh/IvanKobzarev/118/base -> origin/gh/IvanKobzarev/118/base 2025-09-07T07:36:19.6220569Z * [new branch] gh/IvanKobzarev/118/head -> origin/gh/IvanKobzarev/118/head 2025-09-07T07:36:19.6221765Z * [new branch] gh/IvanKobzarev/118/orig -> origin/gh/IvanKobzarev/118/orig 2025-09-07T07:36:19.6223693Z * [new branch] gh/IvanKobzarev/126/base -> origin/gh/IvanKobzarev/126/base 2025-09-07T07:36:19.6224966Z * [new branch] gh/IvanKobzarev/126/head -> origin/gh/IvanKobzarev/126/head 2025-09-07T07:36:19.6226211Z * [new branch] gh/IvanKobzarev/126/orig -> origin/gh/IvanKobzarev/126/orig 2025-09-07T07:36:19.6228033Z * [new branch] gh/IvanKobzarev/127/base -> origin/gh/IvanKobzarev/127/base 2025-09-07T07:36:19.6229360Z * [new branch] gh/IvanKobzarev/127/head -> origin/gh/IvanKobzarev/127/head 2025-09-07T07:36:19.6230503Z * [new branch] gh/IvanKobzarev/127/orig -> origin/gh/IvanKobzarev/127/orig 2025-09-07T07:36:19.6232223Z * [new branch] gh/IvanKobzarev/128/base -> origin/gh/IvanKobzarev/128/base 2025-09-07T07:36:19.6233412Z * [new branch] gh/IvanKobzarev/128/head -> origin/gh/IvanKobzarev/128/head 2025-09-07T07:36:19.6234606Z * [new branch] gh/IvanKobzarev/128/orig -> origin/gh/IvanKobzarev/128/orig 2025-09-07T07:36:19.6236458Z * [new branch] gh/IvanKobzarev/132/base -> origin/gh/IvanKobzarev/132/base 2025-09-07T07:36:19.6237781Z * [new branch] gh/IvanKobzarev/132/head -> origin/gh/IvanKobzarev/132/head 2025-09-07T07:36:19.6239012Z * [new branch] gh/IvanKobzarev/132/orig -> origin/gh/IvanKobzarev/132/orig 2025-09-07T07:36:19.6241074Z * [new branch] gh/IvanKobzarev/133/base -> origin/gh/IvanKobzarev/133/base 2025-09-07T07:36:19.6242468Z * [new branch] gh/IvanKobzarev/133/head -> origin/gh/IvanKobzarev/133/head 2025-09-07T07:36:19.6243706Z * [new branch] gh/IvanKobzarev/133/orig -> origin/gh/IvanKobzarev/133/orig 2025-09-07T07:36:19.6245384Z * [new branch] gh/IvanKobzarev/134/base -> origin/gh/IvanKobzarev/134/base 2025-09-07T07:36:19.6246594Z * [new branch] gh/IvanKobzarev/134/head -> origin/gh/IvanKobzarev/134/head 2025-09-07T07:36:19.6247769Z * [new branch] gh/IvanKobzarev/134/orig -> origin/gh/IvanKobzarev/134/orig 2025-09-07T07:36:19.6249714Z * [new branch] gh/IvanKobzarev/135/base -> origin/gh/IvanKobzarev/135/base 2025-09-07T07:36:19.6250992Z * [new branch] gh/IvanKobzarev/135/head -> origin/gh/IvanKobzarev/135/head 2025-09-07T07:36:19.6252222Z * [new branch] gh/IvanKobzarev/135/orig -> origin/gh/IvanKobzarev/135/orig 2025-09-07T07:36:19.6254099Z * [new branch] gh/IvanKobzarev/136/base -> origin/gh/IvanKobzarev/136/base 2025-09-07T07:36:19.6255298Z * [new branch] gh/IvanKobzarev/136/head -> origin/gh/IvanKobzarev/136/head 2025-09-07T07:36:19.6256507Z * [new branch] gh/IvanKobzarev/136/orig -> origin/gh/IvanKobzarev/136/orig 2025-09-07T07:36:19.6258308Z * [new branch] gh/IvanKobzarev/137/base -> origin/gh/IvanKobzarev/137/base 2025-09-07T07:36:19.6259504Z * [new branch] gh/IvanKobzarev/137/head -> origin/gh/IvanKobzarev/137/head 2025-09-07T07:36:19.6260688Z * [new branch] gh/IvanKobzarev/137/orig -> origin/gh/IvanKobzarev/137/orig 2025-09-07T07:36:19.6262441Z * [new branch] gh/IvanKobzarev/138/base -> origin/gh/IvanKobzarev/138/base 2025-09-07T07:36:19.6263842Z * [new branch] gh/IvanKobzarev/138/head -> origin/gh/IvanKobzarev/138/head 2025-09-07T07:36:19.6265108Z * [new branch] gh/IvanKobzarev/138/orig -> origin/gh/IvanKobzarev/138/orig 2025-09-07T07:36:19.6266900Z * [new branch] gh/IvanKobzarev/139/base -> origin/gh/IvanKobzarev/139/base 2025-09-07T07:36:19.6268108Z * [new branch] gh/IvanKobzarev/139/head -> origin/gh/IvanKobzarev/139/head 2025-09-07T07:36:19.6269306Z * [new branch] gh/IvanKobzarev/139/orig -> origin/gh/IvanKobzarev/139/orig 2025-09-07T07:36:19.6271103Z * [new branch] gh/IvanKobzarev/140/base -> origin/gh/IvanKobzarev/140/base 2025-09-07T07:36:19.6272295Z * [new branch] gh/IvanKobzarev/140/head -> origin/gh/IvanKobzarev/140/head 2025-09-07T07:36:19.6273484Z * [new branch] gh/IvanKobzarev/140/orig -> origin/gh/IvanKobzarev/140/orig 2025-09-07T07:36:19.6275742Z * [new branch] gh/IvanKobzarev/141/base -> origin/gh/IvanKobzarev/141/base 2025-09-07T07:36:19.6277122Z * [new branch] gh/IvanKobzarev/141/head -> origin/gh/IvanKobzarev/141/head 2025-09-07T07:36:19.6278397Z * [new branch] gh/IvanKobzarev/141/orig -> origin/gh/IvanKobzarev/141/orig 2025-09-07T07:36:19.6280978Z * [new branch] gh/IvanKobzarev/142/base -> origin/gh/IvanKobzarev/142/base 2025-09-07T07:36:19.6282218Z * [new branch] gh/IvanKobzarev/142/head -> origin/gh/IvanKobzarev/142/head 2025-09-07T07:36:19.6283325Z * [new branch] gh/IvanKobzarev/142/orig -> origin/gh/IvanKobzarev/142/orig 2025-09-07T07:36:19.6284654Z * [new branch] gh/IvanKobzarev/143/base -> origin/gh/IvanKobzarev/143/base 2025-09-07T07:36:19.6285899Z * [new branch] gh/IvanKobzarev/143/head -> origin/gh/IvanKobzarev/143/head 2025-09-07T07:36:19.6287119Z * [new branch] gh/IvanKobzarev/143/orig -> origin/gh/IvanKobzarev/143/orig 2025-09-07T07:36:19.6288996Z * [new branch] gh/IvanKobzarev/144/base -> origin/gh/IvanKobzarev/144/base 2025-09-07T07:36:19.6290188Z * [new branch] gh/IvanKobzarev/144/head -> origin/gh/IvanKobzarev/144/head 2025-09-07T07:36:19.6291381Z * [new branch] gh/IvanKobzarev/144/orig -> origin/gh/IvanKobzarev/144/orig 2025-09-07T07:36:19.6293183Z * [new branch] gh/IvanKobzarev/145/base -> origin/gh/IvanKobzarev/145/base 2025-09-07T07:36:19.6294580Z * [new branch] gh/IvanKobzarev/145/head -> origin/gh/IvanKobzarev/145/head 2025-09-07T07:36:19.6295889Z * [new branch] gh/IvanKobzarev/145/orig -> origin/gh/IvanKobzarev/145/orig 2025-09-07T07:36:19.6297649Z * [new branch] gh/IvanKobzarev/146/base -> origin/gh/IvanKobzarev/146/base 2025-09-07T07:36:19.6298878Z * [new branch] gh/IvanKobzarev/146/head -> origin/gh/IvanKobzarev/146/head 2025-09-07T07:36:19.6300085Z * [new branch] gh/IvanKobzarev/146/orig -> origin/gh/IvanKobzarev/146/orig 2025-09-07T07:36:19.6302310Z * [new branch] gh/NikhilAPatel/1/base -> origin/gh/NikhilAPatel/1/base 2025-09-07T07:36:19.6303611Z * [new branch] gh/NikhilAPatel/1/head -> origin/gh/NikhilAPatel/1/head 2025-09-07T07:36:19.6305180Z * [new branch] gh/NikhilAPatel/2/base -> origin/gh/NikhilAPatel/2/base 2025-09-07T07:36:19.6306455Z * [new branch] gh/NikhilAPatel/2/head -> origin/gh/NikhilAPatel/2/head 2025-09-07T07:36:19.6308374Z * [new branch] gh/NikhilAPatel/4/base -> origin/gh/NikhilAPatel/4/base 2025-09-07T07:36:19.6309815Z * [new branch] gh/NikhilAPatel/4/head -> origin/gh/NikhilAPatel/4/head 2025-09-07T07:36:19.6311937Z * [new branch] gh/PaliC/1/base -> origin/gh/PaliC/1/base 2025-09-07T07:36:19.6313075Z * [new branch] gh/PaliC/1/head -> origin/gh/PaliC/1/head 2025-09-07T07:36:19.6314245Z * [new branch] gh/PaliC/1/orig -> origin/gh/PaliC/1/orig 2025-09-07T07:36:19.6316033Z * [new branch] gh/PaliC/17/base -> origin/gh/PaliC/17/base 2025-09-07T07:36:19.6317182Z * [new branch] gh/PaliC/17/head -> origin/gh/PaliC/17/head 2025-09-07T07:36:19.6318490Z * [new branch] gh/PaliC/17/orig -> origin/gh/PaliC/17/orig 2025-09-07T07:36:19.6320254Z * [new branch] gh/PaliC/18/base -> origin/gh/PaliC/18/base 2025-09-07T07:36:19.6321400Z * [new branch] gh/PaliC/18/head -> origin/gh/PaliC/18/head 2025-09-07T07:36:19.6322604Z * [new branch] gh/PaliC/18/orig -> origin/gh/PaliC/18/orig 2025-09-07T07:36:19.6324419Z * [new branch] gh/PaliC/2/base -> origin/gh/PaliC/2/base 2025-09-07T07:36:19.6325500Z * [new branch] gh/PaliC/2/head -> origin/gh/PaliC/2/head 2025-09-07T07:36:19.6326677Z * [new branch] gh/PaliC/2/orig -> origin/gh/PaliC/2/orig 2025-09-07T07:36:19.6328400Z * [new branch] gh/PaliC/20/base -> origin/gh/PaliC/20/base 2025-09-07T07:36:19.6329749Z * [new branch] gh/PaliC/20/head -> origin/gh/PaliC/20/head 2025-09-07T07:36:19.6331000Z * [new branch] gh/PaliC/20/orig -> origin/gh/PaliC/20/orig 2025-09-07T07:36:19.6332720Z * [new branch] gh/PaliC/21/base -> origin/gh/PaliC/21/base 2025-09-07T07:36:19.6334002Z * [new branch] gh/PaliC/21/head -> origin/gh/PaliC/21/head 2025-09-07T07:36:19.6335159Z * [new branch] gh/PaliC/21/orig -> origin/gh/PaliC/21/orig 2025-09-07T07:36:19.6336881Z * [new branch] gh/PaliC/22/base -> origin/gh/PaliC/22/base 2025-09-07T07:36:19.6338027Z * [new branch] gh/PaliC/22/head -> origin/gh/PaliC/22/head 2025-09-07T07:36:19.6339219Z * [new branch] gh/PaliC/22/orig -> origin/gh/PaliC/22/orig 2025-09-07T07:36:19.6340962Z * [new branch] gh/PaliC/23/base -> origin/gh/PaliC/23/base 2025-09-07T07:36:19.6342148Z * [new branch] gh/PaliC/23/head -> origin/gh/PaliC/23/head 2025-09-07T07:36:19.6343319Z * [new branch] gh/PaliC/23/orig -> origin/gh/PaliC/23/orig 2025-09-07T07:36:19.6345024Z * [new branch] gh/PaliC/24/base -> origin/gh/PaliC/24/base 2025-09-07T07:36:19.6346267Z * [new branch] gh/PaliC/24/head -> origin/gh/PaliC/24/head 2025-09-07T07:36:19.6347489Z * [new branch] gh/PaliC/24/orig -> origin/gh/PaliC/24/orig 2025-09-07T07:36:19.6349658Z * [new branch] gh/PaulZhang12/17/base -> origin/gh/PaulZhang12/17/base 2025-09-07T07:36:19.6350817Z * [new branch] gh/PaulZhang12/17/head -> origin/gh/PaulZhang12/17/head 2025-09-07T07:36:19.6352755Z * [new branch] gh/PaulZhang12/20/base -> origin/gh/PaulZhang12/20/base 2025-09-07T07:36:19.6353953Z * [new branch] gh/PaulZhang12/20/head -> origin/gh/PaulZhang12/20/head 2025-09-07T07:36:19.6355186Z * [new branch] gh/PaulZhang12/20/orig -> origin/gh/PaulZhang12/20/orig 2025-09-07T07:36:19.6356947Z * [new branch] gh/PaulZhang12/21/base -> origin/gh/PaulZhang12/21/base 2025-09-07T07:36:19.6358230Z * [new branch] gh/PaulZhang12/21/head -> origin/gh/PaulZhang12/21/head 2025-09-07T07:36:19.6359404Z * [new branch] gh/PaulZhang12/21/orig -> origin/gh/PaulZhang12/21/orig 2025-09-07T07:36:19.6361214Z * [new branch] gh/PaulZhang12/22/base -> origin/gh/PaulZhang12/22/base 2025-09-07T07:36:19.6362392Z * [new branch] gh/PaulZhang12/22/head -> origin/gh/PaulZhang12/22/head 2025-09-07T07:36:19.6363593Z * [new branch] gh/PaulZhang12/22/orig -> origin/gh/PaulZhang12/22/orig 2025-09-07T07:36:19.6365347Z * [new branch] gh/PaulZhang12/23/base -> origin/gh/PaulZhang12/23/base 2025-09-07T07:36:19.6366730Z * [new branch] gh/PaulZhang12/23/head -> origin/gh/PaulZhang12/23/head 2025-09-07T07:36:19.6367908Z * [new branch] gh/PaulZhang12/23/orig -> origin/gh/PaulZhang12/23/orig 2025-09-07T07:36:19.6369475Z * [new branch] gh/PaulZhang12/24/base -> origin/gh/PaulZhang12/24/base 2025-09-07T07:36:19.6370648Z * [new branch] gh/PaulZhang12/24/head -> origin/gh/PaulZhang12/24/head 2025-09-07T07:36:19.6371886Z * [new branch] gh/PaulZhang12/24/orig -> origin/gh/PaulZhang12/24/orig 2025-09-07T07:36:19.6373640Z * [new branch] gh/PaulZhang12/25/base -> origin/gh/PaulZhang12/25/base 2025-09-07T07:36:19.6374813Z * [new branch] gh/PaulZhang12/25/head -> origin/gh/PaulZhang12/25/head 2025-09-07T07:36:19.6376057Z * [new branch] gh/PaulZhang12/25/orig -> origin/gh/PaulZhang12/25/orig 2025-09-07T07:36:19.6378158Z * [new branch] gh/SamGinzburg/11/base -> origin/gh/SamGinzburg/11/base 2025-09-07T07:36:19.6379471Z * [new branch] gh/SamGinzburg/11/head -> origin/gh/SamGinzburg/11/head 2025-09-07T07:36:19.6381951Z * [new branch] gh/Sidharth123-cpu/24/base -> origin/gh/Sidharth123-cpu/24/base 2025-09-07T07:36:19.6384039Z * [new branch] gh/Sidharth123-cpu/25/base -> origin/gh/Sidharth123-cpu/25/base 2025-09-07T07:36:19.6386052Z * [new branch] gh/Sidharth123-cpu/26/base -> origin/gh/Sidharth123-cpu/26/base 2025-09-07T07:36:19.6387908Z * [new branch] gh/Sidharth123-cpu/27/base -> origin/gh/Sidharth123-cpu/27/base 2025-09-07T07:36:19.6390097Z * [new branch] gh/StrongerXi/1/base -> origin/gh/StrongerXi/1/base 2025-09-07T07:36:19.6391262Z * [new branch] gh/StrongerXi/1/head -> origin/gh/StrongerXi/1/head 2025-09-07T07:36:19.6393002Z * [new branch] gh/StrongerXi/133/base -> origin/gh/StrongerXi/133/base 2025-09-07T07:36:19.6394186Z * [new branch] gh/StrongerXi/133/head -> origin/gh/StrongerXi/133/head 2025-09-07T07:36:19.6395383Z * [new branch] gh/StrongerXi/133/orig -> origin/gh/StrongerXi/133/orig 2025-09-07T07:36:19.6397078Z * [new branch] gh/StrongerXi/134/base -> origin/gh/StrongerXi/134/base 2025-09-07T07:36:19.6398220Z * [new branch] gh/StrongerXi/134/head -> origin/gh/StrongerXi/134/head 2025-09-07T07:36:19.6399419Z * [new branch] gh/StrongerXi/134/orig -> origin/gh/StrongerXi/134/orig 2025-09-07T07:36:19.6401101Z * [new branch] gh/StrongerXi/136/base -> origin/gh/StrongerXi/136/base 2025-09-07T07:36:19.6402313Z * [new branch] gh/StrongerXi/136/head -> origin/gh/StrongerXi/136/head 2025-09-07T07:36:19.6403552Z * [new branch] gh/StrongerXi/136/orig -> origin/gh/StrongerXi/136/orig 2025-09-07T07:36:19.6405332Z * [new branch] gh/StrongerXi/137/base -> origin/gh/StrongerXi/137/base 2025-09-07T07:36:19.6406482Z * [new branch] gh/StrongerXi/137/head -> origin/gh/StrongerXi/137/head 2025-09-07T07:36:19.6407700Z * [new branch] gh/StrongerXi/137/orig -> origin/gh/StrongerXi/137/orig 2025-09-07T07:36:19.6409350Z * [new branch] gh/StrongerXi/138/base -> origin/gh/StrongerXi/138/base 2025-09-07T07:36:19.6410818Z * [new branch] gh/StrongerXi/138/head -> origin/gh/StrongerXi/138/head 2025-09-07T07:36:19.6412035Z * [new branch] gh/StrongerXi/138/orig -> origin/gh/StrongerXi/138/orig 2025-09-07T07:36:19.6413803Z * [new branch] gh/StrongerXi/139/base -> origin/gh/StrongerXi/139/base 2025-09-07T07:36:19.6415046Z * [new branch] gh/StrongerXi/139/head -> origin/gh/StrongerXi/139/head 2025-09-07T07:36:19.6416324Z * [new branch] gh/StrongerXi/139/orig -> origin/gh/StrongerXi/139/orig 2025-09-07T07:36:19.6418014Z * [new branch] gh/StrongerXi/140/base -> origin/gh/StrongerXi/140/base 2025-09-07T07:36:19.6419187Z * [new branch] gh/StrongerXi/140/head -> origin/gh/StrongerXi/140/head 2025-09-07T07:36:19.6420484Z * [new branch] gh/StrongerXi/140/orig -> origin/gh/StrongerXi/140/orig 2025-09-07T07:36:19.6422199Z * [new branch] gh/StrongerXi/71/base -> origin/gh/StrongerXi/71/base 2025-09-07T07:36:19.6423458Z * [new branch] gh/StrongerXi/71/head -> origin/gh/StrongerXi/71/head 2025-09-07T07:36:19.6425080Z * [new branch] gh/StrongerXi/72/base -> origin/gh/StrongerXi/72/base 2025-09-07T07:36:19.6426393Z * [new branch] gh/StrongerXi/72/head -> origin/gh/StrongerXi/72/head 2025-09-07T07:36:19.6428632Z * [new branch] gh/XilunWu/133/base -> origin/gh/XilunWu/133/base 2025-09-07T07:36:19.6429761Z * [new branch] gh/XilunWu/133/head -> origin/gh/XilunWu/133/head 2025-09-07T07:36:19.6431217Z * [new branch] gh/XilunWu/133/orig -> origin/gh/XilunWu/133/orig 2025-09-07T07:36:19.6432819Z * [new branch] gh/XilunWu/139/base -> origin/gh/XilunWu/139/base 2025-09-07T07:36:19.6434027Z * [new branch] gh/XilunWu/139/head -> origin/gh/XilunWu/139/head 2025-09-07T07:36:19.6435123Z * [new branch] gh/XilunWu/139/orig -> origin/gh/XilunWu/139/orig 2025-09-07T07:36:19.6436874Z * [new branch] gh/XilunWu/143/base -> origin/gh/XilunWu/143/base 2025-09-07T07:36:19.6438118Z * [new branch] gh/XilunWu/143/head -> origin/gh/XilunWu/143/head 2025-09-07T07:36:19.6439310Z * [new branch] gh/XilunWu/143/orig -> origin/gh/XilunWu/143/orig 2025-09-07T07:36:19.6441270Z * [new branch] gh/XilunWu/144/base -> origin/gh/XilunWu/144/base 2025-09-07T07:36:19.6442432Z * [new branch] gh/XilunWu/144/head -> origin/gh/XilunWu/144/head 2025-09-07T07:36:19.6443638Z * [new branch] gh/XilunWu/144/orig -> origin/gh/XilunWu/144/orig 2025-09-07T07:36:19.6445456Z * [new branch] gh/XilunWu/145/base -> origin/gh/XilunWu/145/base 2025-09-07T07:36:19.6446599Z * [new branch] gh/XilunWu/145/head -> origin/gh/XilunWu/145/head 2025-09-07T07:36:19.6447774Z * [new branch] gh/XilunWu/145/orig -> origin/gh/XilunWu/145/orig 2025-09-07T07:36:19.6449348Z * [new branch] gh/XilunWu/146/base -> origin/gh/XilunWu/146/base 2025-09-07T07:36:19.6450554Z * [new branch] gh/XilunWu/146/head -> origin/gh/XilunWu/146/head 2025-09-07T07:36:19.6451708Z * [new branch] gh/XilunWu/146/orig -> origin/gh/XilunWu/146/orig 2025-09-07T07:36:19.6453433Z * [new branch] gh/XilunWu/147/base -> origin/gh/XilunWu/147/base 2025-09-07T07:36:19.6454644Z * [new branch] gh/XilunWu/147/head -> origin/gh/XilunWu/147/head 2025-09-07T07:36:19.6455839Z * [new branch] gh/XilunWu/147/orig -> origin/gh/XilunWu/147/orig 2025-09-07T07:36:19.6457436Z * [new branch] gh/XilunWu/148/base -> origin/gh/XilunWu/148/base 2025-09-07T07:36:19.6458661Z * [new branch] gh/XilunWu/148/head -> origin/gh/XilunWu/148/head 2025-09-07T07:36:19.6459849Z * [new branch] gh/XilunWu/148/orig -> origin/gh/XilunWu/148/orig 2025-09-07T07:36:19.6461431Z * [new branch] gh/XilunWu/149/base -> origin/gh/XilunWu/149/base 2025-09-07T07:36:19.6462615Z * [new branch] gh/XilunWu/149/head -> origin/gh/XilunWu/149/head 2025-09-07T07:36:19.6463804Z * [new branch] gh/XilunWu/149/orig -> origin/gh/XilunWu/149/orig 2025-09-07T07:36:19.6465373Z * [new branch] gh/XilunWu/150/base -> origin/gh/XilunWu/150/base 2025-09-07T07:36:19.6466614Z * [new branch] gh/XilunWu/150/head -> origin/gh/XilunWu/150/head 2025-09-07T07:36:19.6467811Z * [new branch] gh/XilunWu/150/orig -> origin/gh/XilunWu/150/orig 2025-09-07T07:36:19.6469723Z * [new branch] gh/XilunWu/151/base -> origin/gh/XilunWu/151/base 2025-09-07T07:36:19.6470846Z * [new branch] gh/XilunWu/151/head -> origin/gh/XilunWu/151/head 2025-09-07T07:36:19.6472062Z * [new branch] gh/XilunWu/151/orig -> origin/gh/XilunWu/151/orig 2025-09-07T07:36:19.6473672Z * [new branch] gh/XilunWu/152/base -> origin/gh/XilunWu/152/base 2025-09-07T07:36:19.6474891Z * [new branch] gh/XilunWu/152/head -> origin/gh/XilunWu/152/head 2025-09-07T07:36:19.6476140Z * [new branch] gh/XilunWu/152/orig -> origin/gh/XilunWu/152/orig 2025-09-07T07:36:19.6478020Z * [new branch] gh/XilunWu/153/base -> origin/gh/XilunWu/153/base 2025-09-07T07:36:19.6479341Z * [new branch] gh/XilunWu/153/head -> origin/gh/XilunWu/153/head 2025-09-07T07:36:19.6480425Z * [new branch] gh/XilunWu/153/orig -> origin/gh/XilunWu/153/orig 2025-09-07T07:36:19.6482243Z * [new branch] gh/XilunWu/160/base -> origin/gh/XilunWu/160/base 2025-09-07T07:36:19.6483368Z * [new branch] gh/XilunWu/160/head -> origin/gh/XilunWu/160/head 2025-09-07T07:36:19.6484612Z * [new branch] gh/XilunWu/160/orig -> origin/gh/XilunWu/160/orig 2025-09-07T07:36:19.6486486Z * [new branch] gh/XilunWu/161/base -> origin/gh/XilunWu/161/base 2025-09-07T07:36:19.6487672Z * [new branch] gh/XilunWu/161/head -> origin/gh/XilunWu/161/head 2025-09-07T07:36:19.6488777Z * [new branch] gh/XilunWu/161/orig -> origin/gh/XilunWu/161/orig 2025-09-07T07:36:19.6490589Z * [new branch] gh/XilunWu/163/base -> origin/gh/XilunWu/163/base 2025-09-07T07:36:19.6491756Z * [new branch] gh/XilunWu/163/head -> origin/gh/XilunWu/163/head 2025-09-07T07:36:19.6492940Z * [new branch] gh/XilunWu/163/orig -> origin/gh/XilunWu/163/orig 2025-09-07T07:36:19.6495141Z * [new branch] gh/XilunWu/164/base -> origin/gh/XilunWu/164/base 2025-09-07T07:36:19.6496423Z * [new branch] gh/XilunWu/164/head -> origin/gh/XilunWu/164/head 2025-09-07T07:36:19.6497665Z * [new branch] gh/XilunWu/164/orig -> origin/gh/XilunWu/164/orig 2025-09-07T07:36:19.6499518Z * [new branch] gh/XilunWu/165/base -> origin/gh/XilunWu/165/base 2025-09-07T07:36:19.6500826Z * [new branch] gh/XilunWu/165/head -> origin/gh/XilunWu/165/head 2025-09-07T07:36:19.6502024Z * [new branch] gh/XilunWu/165/orig -> origin/gh/XilunWu/165/orig 2025-09-07T07:36:19.6503892Z * [new branch] gh/XilunWu/166/base -> origin/gh/XilunWu/166/base 2025-09-07T07:36:19.6505132Z * [new branch] gh/XilunWu/166/head -> origin/gh/XilunWu/166/head 2025-09-07T07:36:19.6506437Z * [new branch] gh/XilunWu/166/orig -> origin/gh/XilunWu/166/orig 2025-09-07T07:36:19.6508198Z * [new branch] gh/XilunWu/167/base -> origin/gh/XilunWu/167/base 2025-09-07T07:36:19.6509408Z * [new branch] gh/XilunWu/167/head -> origin/gh/XilunWu/167/head 2025-09-07T07:36:19.6510838Z * [new branch] gh/XilunWu/167/orig -> origin/gh/XilunWu/167/orig 2025-09-07T07:36:19.6513157Z * [new branch] gh/XilunWu/168/base -> origin/gh/XilunWu/168/base 2025-09-07T07:36:19.6514312Z * [new branch] gh/XilunWu/168/head -> origin/gh/XilunWu/168/head 2025-09-07T07:36:19.6515516Z * [new branch] gh/XilunWu/168/orig -> origin/gh/XilunWu/168/orig 2025-09-07T07:36:19.6517320Z * [new branch] gh/XilunWu/169/base -> origin/gh/XilunWu/169/base 2025-09-07T07:36:19.6518513Z * [new branch] gh/XilunWu/169/head -> origin/gh/XilunWu/169/head 2025-09-07T07:36:19.6519774Z * [new branch] gh/XilunWu/169/orig -> origin/gh/XilunWu/169/orig 2025-09-07T07:36:19.6521528Z * [new branch] gh/XilunWu/170/base -> origin/gh/XilunWu/170/base 2025-09-07T07:36:19.6522753Z * [new branch] gh/XilunWu/170/head -> origin/gh/XilunWu/170/head 2025-09-07T07:36:19.6523932Z * [new branch] gh/XilunWu/170/orig -> origin/gh/XilunWu/170/orig 2025-09-07T07:36:19.6526162Z * [new branch] gh/XuehaiPan/14/base -> origin/gh/XuehaiPan/14/base 2025-09-07T07:36:19.6527385Z * [new branch] gh/XuehaiPan/14/head -> origin/gh/XuehaiPan/14/head 2025-09-07T07:36:19.6528503Z * [new branch] gh/XuehaiPan/14/orig -> origin/gh/XuehaiPan/14/orig 2025-09-07T07:36:19.6530331Z * [new branch] gh/XuehaiPan/179/base -> origin/gh/XuehaiPan/179/base 2025-09-07T07:36:19.6531652Z * [new branch] gh/XuehaiPan/179/head -> origin/gh/XuehaiPan/179/head 2025-09-07T07:36:19.6532757Z * [new branch] gh/XuehaiPan/179/orig -> origin/gh/XuehaiPan/179/orig 2025-09-07T07:36:19.6534561Z * [new branch] gh/XuehaiPan/189/base -> origin/gh/XuehaiPan/189/base 2025-09-07T07:36:19.6535742Z * [new branch] gh/XuehaiPan/189/head -> origin/gh/XuehaiPan/189/head 2025-09-07T07:36:19.6536973Z * [new branch] gh/XuehaiPan/189/orig -> origin/gh/XuehaiPan/189/orig 2025-09-07T07:36:19.6538698Z * [new branch] gh/XuehaiPan/232/base -> origin/gh/XuehaiPan/232/base 2025-09-07T07:36:19.6539866Z * [new branch] gh/XuehaiPan/232/head -> origin/gh/XuehaiPan/232/head 2025-09-07T07:36:19.6541070Z * [new branch] gh/XuehaiPan/232/orig -> origin/gh/XuehaiPan/232/orig 2025-09-07T07:36:19.6542774Z * [new branch] gh/XuehaiPan/249/base -> origin/gh/XuehaiPan/249/base 2025-09-07T07:36:19.6544087Z * [new branch] gh/XuehaiPan/249/head -> origin/gh/XuehaiPan/249/head 2025-09-07T07:36:19.6545238Z * [new branch] gh/XuehaiPan/249/orig -> origin/gh/XuehaiPan/249/orig 2025-09-07T07:36:19.6546962Z * [new branch] gh/XuehaiPan/253/base -> origin/gh/XuehaiPan/253/base 2025-09-07T07:36:19.6548284Z * [new branch] gh/XuehaiPan/253/head -> origin/gh/XuehaiPan/253/head 2025-09-07T07:36:19.6549457Z * [new branch] gh/XuehaiPan/253/orig -> origin/gh/XuehaiPan/253/orig 2025-09-07T07:36:19.6551095Z * [new branch] gh/XuehaiPan/254/base -> origin/gh/XuehaiPan/254/base 2025-09-07T07:36:19.6552340Z * [new branch] gh/XuehaiPan/254/head -> origin/gh/XuehaiPan/254/head 2025-09-07T07:36:19.6553677Z * [new branch] gh/XuehaiPan/254/orig -> origin/gh/XuehaiPan/254/orig 2025-09-07T07:36:19.6555459Z * [new branch] gh/XuehaiPan/255/base -> origin/gh/XuehaiPan/255/base 2025-09-07T07:36:19.6556646Z * [new branch] gh/XuehaiPan/255/head -> origin/gh/XuehaiPan/255/head 2025-09-07T07:36:19.6557755Z * [new branch] gh/XuehaiPan/255/orig -> origin/gh/XuehaiPan/255/orig 2025-09-07T07:36:19.6559437Z * [new branch] gh/XuehaiPan/257/base -> origin/gh/XuehaiPan/257/base 2025-09-07T07:36:19.6560608Z * [new branch] gh/XuehaiPan/257/head -> origin/gh/XuehaiPan/257/head 2025-09-07T07:36:19.6561772Z * [new branch] gh/XuehaiPan/257/orig -> origin/gh/XuehaiPan/257/orig 2025-09-07T07:36:19.6563559Z * [new branch] gh/XuehaiPan/271/base -> origin/gh/XuehaiPan/271/base 2025-09-07T07:36:19.6564736Z * [new branch] gh/XuehaiPan/271/head -> origin/gh/XuehaiPan/271/head 2025-09-07T07:36:19.6565918Z * [new branch] gh/XuehaiPan/271/orig -> origin/gh/XuehaiPan/271/orig 2025-09-07T07:36:19.6567625Z * [new branch] gh/XuehaiPan/290/base -> origin/gh/XuehaiPan/290/base 2025-09-07T07:36:19.6568961Z * [new branch] gh/XuehaiPan/290/head -> origin/gh/XuehaiPan/290/head 2025-09-07T07:36:19.6570107Z * [new branch] gh/XuehaiPan/290/orig -> origin/gh/XuehaiPan/290/orig 2025-09-07T07:36:19.6571858Z * [new branch] gh/XuehaiPan/343/base -> origin/gh/XuehaiPan/343/base 2025-09-07T07:36:19.6573080Z * [new branch] gh/XuehaiPan/343/head -> origin/gh/XuehaiPan/343/head 2025-09-07T07:36:19.6583132Z * [new branch] gh/XuehaiPan/343/orig -> origin/gh/XuehaiPan/343/orig 2025-09-07T07:36:19.6583464Z * [new branch] gh/XuehaiPan/347/base -> origin/gh/XuehaiPan/347/base 2025-09-07T07:36:19.6583787Z * [new branch] gh/XuehaiPan/347/head -> origin/gh/XuehaiPan/347/head 2025-09-07T07:36:19.6584196Z * [new branch] gh/XuehaiPan/347/orig -> origin/gh/XuehaiPan/347/orig 2025-09-07T07:36:19.6584517Z * [new branch] gh/XuehaiPan/348/base -> origin/gh/XuehaiPan/348/base 2025-09-07T07:36:19.6584830Z * [new branch] gh/XuehaiPan/348/head -> origin/gh/XuehaiPan/348/head 2025-09-07T07:36:19.6585142Z * [new branch] gh/XuehaiPan/348/orig -> origin/gh/XuehaiPan/348/orig 2025-09-07T07:36:19.6585484Z * [new branch] gh/XuehaiPan/350/base -> origin/gh/XuehaiPan/350/base 2025-09-07T07:36:19.6585849Z * [new branch] gh/XuehaiPan/350/head -> origin/gh/XuehaiPan/350/head 2025-09-07T07:36:19.6586697Z * [new branch] gh/XuehaiPan/350/orig -> origin/gh/XuehaiPan/350/orig 2025-09-07T07:36:19.6588543Z * [new branch] gh/XuehaiPan/356/base -> origin/gh/XuehaiPan/356/base 2025-09-07T07:36:19.6589748Z * [new branch] gh/XuehaiPan/356/head -> origin/gh/XuehaiPan/356/head 2025-09-07T07:36:19.6590931Z * [new branch] gh/XuehaiPan/356/orig -> origin/gh/XuehaiPan/356/orig 2025-09-07T07:36:19.6592617Z * [new branch] gh/XuehaiPan/357/base -> origin/gh/XuehaiPan/357/base 2025-09-07T07:36:19.6593823Z * [new branch] gh/XuehaiPan/357/head -> origin/gh/XuehaiPan/357/head 2025-09-07T07:36:19.6594998Z * [new branch] gh/XuehaiPan/357/orig -> origin/gh/XuehaiPan/357/orig 2025-09-07T07:36:19.6597069Z * [new branch] gh/XuehaiPan/358/base -> origin/gh/XuehaiPan/358/base 2025-09-07T07:36:19.6598252Z * [new branch] gh/XuehaiPan/358/head -> origin/gh/XuehaiPan/358/head 2025-09-07T07:36:19.6599440Z * [new branch] gh/XuehaiPan/358/orig -> origin/gh/XuehaiPan/358/orig 2025-09-07T07:36:19.6601185Z * [new branch] gh/XuehaiPan/359/base -> origin/gh/XuehaiPan/359/base 2025-09-07T07:36:19.6602349Z * [new branch] gh/XuehaiPan/359/head -> origin/gh/XuehaiPan/359/head 2025-09-07T07:36:19.6603584Z * [new branch] gh/XuehaiPan/359/orig -> origin/gh/XuehaiPan/359/orig 2025-09-07T07:36:19.6605299Z * [new branch] gh/XuehaiPan/360/base -> origin/gh/XuehaiPan/360/base 2025-09-07T07:36:19.6606601Z * [new branch] gh/XuehaiPan/360/head -> origin/gh/XuehaiPan/360/head 2025-09-07T07:36:19.6607791Z * [new branch] gh/XuehaiPan/360/orig -> origin/gh/XuehaiPan/360/orig 2025-09-07T07:36:19.6609569Z * [new branch] gh/XuehaiPan/365/base -> origin/gh/XuehaiPan/365/base 2025-09-07T07:36:19.6610998Z * [new branch] gh/XuehaiPan/365/head -> origin/gh/XuehaiPan/365/head 2025-09-07T07:36:19.6612145Z * [new branch] gh/XuehaiPan/365/orig -> origin/gh/XuehaiPan/365/orig 2025-09-07T07:36:19.6613946Z * [new branch] gh/XuehaiPan/366/base -> origin/gh/XuehaiPan/366/base 2025-09-07T07:36:19.6615187Z * [new branch] gh/XuehaiPan/366/head -> origin/gh/XuehaiPan/366/head 2025-09-07T07:36:19.6616938Z * [new branch] gh/XuehaiPan/369/base -> origin/gh/XuehaiPan/369/base 2025-09-07T07:36:19.6618455Z * [new branch] gh/XuehaiPan/369/head -> origin/gh/XuehaiPan/369/head 2025-09-07T07:36:19.6619675Z * [new branch] gh/XuehaiPan/369/orig -> origin/gh/XuehaiPan/369/orig 2025-09-07T07:36:19.6621496Z * [new branch] gh/XuehaiPan/370/base -> origin/gh/XuehaiPan/370/base 2025-09-07T07:36:19.6622677Z * [new branch] gh/XuehaiPan/370/head -> origin/gh/XuehaiPan/370/head 2025-09-07T07:36:19.6623845Z * [new branch] gh/XuehaiPan/370/orig -> origin/gh/XuehaiPan/370/orig 2025-09-07T07:36:19.6625597Z * [new branch] gh/XuehaiPan/380/base -> origin/gh/XuehaiPan/380/base 2025-09-07T07:36:19.6626881Z * [new branch] gh/XuehaiPan/380/head -> origin/gh/XuehaiPan/380/head 2025-09-07T07:36:19.6628167Z * [new branch] gh/XuehaiPan/380/orig -> origin/gh/XuehaiPan/380/orig 2025-09-07T07:36:19.6629816Z * [new branch] gh/XuehaiPan/381/base -> origin/gh/XuehaiPan/381/base 2025-09-07T07:36:19.6631012Z * [new branch] gh/XuehaiPan/381/head -> origin/gh/XuehaiPan/381/head 2025-09-07T07:36:19.6632777Z * [new branch] gh/XuehaiPan/382/base -> origin/gh/XuehaiPan/382/base 2025-09-07T07:36:19.6633991Z * [new branch] gh/XuehaiPan/382/head -> origin/gh/XuehaiPan/382/head 2025-09-07T07:36:19.6635171Z * [new branch] gh/XuehaiPan/382/orig -> origin/gh/XuehaiPan/382/orig 2025-09-07T07:36:19.6637043Z * [new branch] gh/XuehaiPan/383/base -> origin/gh/XuehaiPan/383/base 2025-09-07T07:36:19.6638316Z * [new branch] gh/XuehaiPan/383/head -> origin/gh/XuehaiPan/383/head 2025-09-07T07:36:19.6639491Z * [new branch] gh/XuehaiPan/383/orig -> origin/gh/XuehaiPan/383/orig 2025-09-07T07:36:19.6641221Z * [new branch] gh/XuehaiPan/384/base -> origin/gh/XuehaiPan/384/base 2025-09-07T07:36:19.6642426Z * [new branch] gh/XuehaiPan/384/head -> origin/gh/XuehaiPan/384/head 2025-09-07T07:36:19.6643562Z * [new branch] gh/XuehaiPan/384/orig -> origin/gh/XuehaiPan/384/orig 2025-09-07T07:36:19.6645336Z * [new branch] gh/XuehaiPan/385/base -> origin/gh/XuehaiPan/385/base 2025-09-07T07:36:19.6646574Z * [new branch] gh/XuehaiPan/385/head -> origin/gh/XuehaiPan/385/head 2025-09-07T07:36:19.6647705Z * [new branch] gh/XuehaiPan/385/orig -> origin/gh/XuehaiPan/385/orig 2025-09-07T07:36:19.6649357Z * [new branch] gh/XuehaiPan/386/base -> origin/gh/XuehaiPan/386/base 2025-09-07T07:36:19.6650625Z * [new branch] gh/XuehaiPan/386/head -> origin/gh/XuehaiPan/386/head 2025-09-07T07:36:19.6651794Z * [new branch] gh/XuehaiPan/386/orig -> origin/gh/XuehaiPan/386/orig 2025-09-07T07:36:19.6653642Z * [new branch] gh/XuehaiPan/387/base -> origin/gh/XuehaiPan/387/base 2025-09-07T07:36:19.6654890Z * [new branch] gh/XuehaiPan/387/head -> origin/gh/XuehaiPan/387/head 2025-09-07T07:36:19.6656095Z * [new branch] gh/XuehaiPan/387/orig -> origin/gh/XuehaiPan/387/orig 2025-09-07T07:36:19.6658263Z * [new branch] gh/ZainRizvi/1/base -> origin/gh/ZainRizvi/1/base 2025-09-07T07:36:19.6659410Z * [new branch] gh/ZainRizvi/1/head -> origin/gh/ZainRizvi/1/head 2025-09-07T07:36:19.6661064Z * [new branch] gh/ZainRizvi/2/base -> origin/gh/ZainRizvi/2/base 2025-09-07T07:36:19.6662226Z * [new branch] gh/ZainRizvi/2/head -> origin/gh/ZainRizvi/2/head 2025-09-07T07:36:19.6663881Z * [new branch] gh/ZainRizvi/3/base -> origin/gh/ZainRizvi/3/base 2025-09-07T07:36:19.6665035Z * [new branch] gh/ZainRizvi/3/head -> origin/gh/ZainRizvi/3/head 2025-09-07T07:36:19.6666849Z * [new branch] gh/ZainRizvi/4/base -> origin/gh/ZainRizvi/4/base 2025-09-07T07:36:19.6668125Z * [new branch] gh/ZainRizvi/4/head -> origin/gh/ZainRizvi/4/head 2025-09-07T07:36:19.6669771Z * [new branch] gh/ZainRizvi/5/base -> origin/gh/ZainRizvi/5/base 2025-09-07T07:36:19.6670877Z * [new branch] gh/ZainRizvi/5/head -> origin/gh/ZainRizvi/5/head 2025-09-07T07:36:19.6672563Z * [new branch] gh/ZainRizvi/6/base -> origin/gh/ZainRizvi/6/base 2025-09-07T07:36:19.6673723Z * [new branch] gh/ZainRizvi/6/head -> origin/gh/ZainRizvi/6/head 2025-09-07T07:36:19.6674913Z * [new branch] gh/ZainRizvi/6/orig -> origin/gh/ZainRizvi/6/orig 2025-09-07T07:36:19.6676578Z * [new branch] gh/ZainRizvi/7/base -> origin/gh/ZainRizvi/7/base 2025-09-07T07:36:19.6677916Z * [new branch] gh/ZainRizvi/7/head -> origin/gh/ZainRizvi/7/head 2025-09-07T07:36:19.6678968Z * [new branch] gh/ZainRizvi/7/orig -> origin/gh/ZainRizvi/7/orig 2025-09-07T07:36:19.6680704Z * [new branch] gh/ZainRizvi/8/base -> origin/gh/ZainRizvi/8/base 2025-09-07T07:36:19.6681886Z * [new branch] gh/ZainRizvi/8/head -> origin/gh/ZainRizvi/8/head 2025-09-07T07:36:19.6683598Z * [new branch] gh/ZainRizvi/9/base -> origin/gh/ZainRizvi/9/base 2025-09-07T07:36:19.6684809Z * [new branch] gh/ZainRizvi/9/head -> origin/gh/ZainRizvi/9/head 2025-09-07T07:36:19.6686061Z * [new branch] gh/ZainRizvi/9/orig -> origin/gh/ZainRizvi/9/orig 2025-09-07T07:36:19.6688203Z * [new branch] gh/ZhiweiYan-96/39/base -> origin/gh/ZhiweiYan-96/39/base 2025-09-07T07:36:19.6689410Z * [new branch] gh/ZhiweiYan-96/39/head -> origin/gh/ZhiweiYan-96/39/head 2025-09-07T07:36:19.6690918Z * [new branch] gh/ZhiweiYan-96/39/orig -> origin/gh/ZhiweiYan-96/39/orig 2025-09-07T07:36:19.6692698Z * [new branch] gh/ZhiweiYan-96/44/base -> origin/gh/ZhiweiYan-96/44/base 2025-09-07T07:36:19.6693889Z * [new branch] gh/ZhiweiYan-96/44/head -> origin/gh/ZhiweiYan-96/44/head 2025-09-07T07:36:19.6695634Z * [new branch] gh/ZhiweiYan-96/45/base -> origin/gh/ZhiweiYan-96/45/base 2025-09-07T07:36:19.6696745Z * [new branch] gh/ZhiweiYan-96/45/head -> origin/gh/ZhiweiYan-96/45/head 2025-09-07T07:36:19.6698527Z * [new branch] gh/ZhiweiYan-96/49/base -> origin/gh/ZhiweiYan-96/49/base 2025-09-07T07:36:19.6699711Z * [new branch] gh/ZhiweiYan-96/49/head -> origin/gh/ZhiweiYan-96/49/head 2025-09-07T07:36:19.6701588Z * [new branch] gh/ZhiweiYan-96/62/base -> origin/gh/ZhiweiYan-96/62/base 2025-09-07T07:36:19.6702766Z * [new branch] gh/ZhiweiYan-96/62/head -> origin/gh/ZhiweiYan-96/62/head 2025-09-07T07:36:19.6704515Z * [new branch] gh/ZhiweiYan-96/64/base -> origin/gh/ZhiweiYan-96/64/base 2025-09-07T07:36:19.6705760Z * [new branch] gh/ZhiweiYan-96/64/head -> origin/gh/ZhiweiYan-96/64/head 2025-09-07T07:36:19.6706986Z * [new branch] gh/ZhiweiYan-96/64/orig -> origin/gh/ZhiweiYan-96/64/orig 2025-09-07T07:36:19.6708663Z * [new branch] gh/ZhiweiYan-96/65/base -> origin/gh/ZhiweiYan-96/65/base 2025-09-07T07:36:19.6709994Z * [new branch] gh/ZhiweiYan-96/65/head -> origin/gh/ZhiweiYan-96/65/head 2025-09-07T07:36:19.6711280Z * [new branch] gh/ZhiweiYan-96/65/orig -> origin/gh/ZhiweiYan-96/65/orig 2025-09-07T07:36:19.6713053Z * [new branch] gh/ZhiweiYan-96/66/base -> origin/gh/ZhiweiYan-96/66/base 2025-09-07T07:36:19.6714228Z * [new branch] gh/ZhiweiYan-96/66/head -> origin/gh/ZhiweiYan-96/66/head 2025-09-07T07:36:19.6715917Z * [new branch] gh/ZhiweiYan-96/67/base -> origin/gh/ZhiweiYan-96/67/base 2025-09-07T07:36:19.6717073Z * [new branch] gh/ZhiweiYan-96/67/head -> origin/gh/ZhiweiYan-96/67/head 2025-09-07T07:36:19.6719100Z * [new branch] gh/ZhiweiYan-96/68/base -> origin/gh/ZhiweiYan-96/68/base 2025-09-07T07:36:19.6719915Z * [new branch] gh/ZhiweiYan-96/68/head -> origin/gh/ZhiweiYan-96/68/head 2025-09-07T07:36:19.6721221Z * [new branch] gh/ZhiweiYan-96/68/orig -> origin/gh/ZhiweiYan-96/68/orig 2025-09-07T07:36:19.6723412Z * [new branch] gh/aakhundov/1/base -> origin/gh/aakhundov/1/base 2025-09-07T07:36:19.6724660Z * [new branch] gh/aakhundov/1/head -> origin/gh/aakhundov/1/head 2025-09-07T07:36:19.6726247Z * [new branch] gh/aakhundov/2/base -> origin/gh/aakhundov/2/base 2025-09-07T07:36:19.6727668Z * [new branch] gh/aakhundov/2/head -> origin/gh/aakhundov/2/head 2025-09-07T07:36:19.6729855Z * [new branch] gh/aditew01/openblas -> origin/gh/aditew01/openblas 2025-09-07T07:36:19.6730610Z * [new branch] gh/aditew01/sbgemm -> origin/gh/aditew01/sbgemm 2025-09-07T07:36:19.6731905Z * [new branch] gh/aditew01/vecbf16 -> origin/gh/aditew01/vecbf16 2025-09-07T07:36:19.6733867Z * [new branch] gh/alexbrauckmann/paddedtensor_faketensor_init -> origin/gh/alexbrauckmann/paddedtensor_faketensor_init 2025-09-07T07:36:19.6735818Z * [new branch] gh/alexsamardzic/9/base -> origin/gh/alexsamardzic/9/base 2025-09-07T07:36:19.6737028Z * [new branch] gh/alexsamardzic/9/head -> origin/gh/alexsamardzic/9/head 2025-09-07T07:36:19.6738263Z * [new branch] gh/alexsamardzic/9/orig -> origin/gh/alexsamardzic/9/orig 2025-09-07T07:36:19.6740347Z * [new branch] gh/amjames/18/base -> origin/gh/amjames/18/base 2025-09-07T07:36:19.6741499Z * [new branch] gh/amjames/18/head -> origin/gh/amjames/18/head 2025-09-07T07:36:19.6742786Z * [new branch] gh/amjames/18/orig -> origin/gh/amjames/18/orig 2025-09-07T07:36:19.6745192Z * [new branch] gh/andrewor14/35/base -> origin/gh/andrewor14/35/base 2025-09-07T07:36:19.6746503Z * [new branch] gh/andrewor14/35/head -> origin/gh/andrewor14/35/head 2025-09-07T07:36:19.6747741Z * [new branch] gh/andrewor14/35/orig -> origin/gh/andrewor14/35/orig 2025-09-07T07:36:19.6749629Z * [new branch] gh/andrewor14/50/base -> origin/gh/andrewor14/50/base 2025-09-07T07:36:19.6750927Z * [new branch] gh/andrewor14/50/head -> origin/gh/andrewor14/50/head 2025-09-07T07:36:19.6752160Z * [new branch] gh/andrewor14/50/orig -> origin/gh/andrewor14/50/orig 2025-09-07T07:36:19.6753819Z * [new branch] gh/andrewor14/51/base -> origin/gh/andrewor14/51/base 2025-09-07T07:36:19.6755098Z * [new branch] gh/andrewor14/51/orig -> origin/gh/andrewor14/51/orig 2025-09-07T07:36:19.6757332Z * [new branch] gh/andyanwang/1/base -> origin/gh/andyanwang/1/base 2025-09-07T07:36:19.6758552Z * [new branch] gh/andyanwang/1/head -> origin/gh/andyanwang/1/head 2025-09-07T07:36:19.6759719Z * [new branch] gh/andyanwang/1/orig -> origin/gh/andyanwang/1/orig 2025-09-07T07:36:19.6761582Z * [new branch] gh/andyanwang/13/base -> origin/gh/andyanwang/13/base 2025-09-07T07:36:19.6762810Z * [new branch] gh/andyanwang/13/head -> origin/gh/andyanwang/13/head 2025-09-07T07:36:19.6764484Z * [new branch] gh/andyanwang/13/orig -> origin/gh/andyanwang/13/orig 2025-09-07T07:36:19.6766496Z * [new branch] gh/andyanwang/2/base -> origin/gh/andyanwang/2/base 2025-09-07T07:36:19.6767662Z * [new branch] gh/andyanwang/2/head -> origin/gh/andyanwang/2/head 2025-09-07T07:36:19.6768845Z * [new branch] gh/andyanwang/2/orig -> origin/gh/andyanwang/2/orig 2025-09-07T07:36:19.6770577Z * [new branch] gh/andyanwang/28/base -> origin/gh/andyanwang/28/base 2025-09-07T07:36:19.6771811Z * [new branch] gh/andyanwang/28/head -> origin/gh/andyanwang/28/head 2025-09-07T07:36:19.6773032Z * [new branch] gh/andyanwang/28/orig -> origin/gh/andyanwang/28/orig 2025-09-07T07:36:19.6774606Z * [new branch] gh/andyanwang/3/base -> origin/gh/andyanwang/3/base 2025-09-07T07:36:19.6775832Z * [new branch] gh/andyanwang/3/head -> origin/gh/andyanwang/3/head 2025-09-07T07:36:19.6777034Z * [new branch] gh/andyanwang/3/orig -> origin/gh/andyanwang/3/orig 2025-09-07T07:36:19.6778793Z * [new branch] gh/andyanwang/30/base -> origin/gh/andyanwang/30/base 2025-09-07T07:36:19.6780227Z * [new branch] gh/andyanwang/30/orig -> origin/gh/andyanwang/30/orig 2025-09-07T07:36:19.6781978Z * [new branch] gh/andyanwang/31/base -> origin/gh/andyanwang/31/base 2025-09-07T07:36:19.6783299Z * [new branch] gh/andyanwang/31/orig -> origin/gh/andyanwang/31/orig 2025-09-07T07:36:19.6785346Z * [new branch] gh/andyanwang/32/base -> origin/gh/andyanwang/32/base 2025-09-07T07:36:19.6786631Z * [new branch] gh/andyanwang/32/head -> origin/gh/andyanwang/32/head 2025-09-07T07:36:19.6787973Z * [new branch] gh/andyanwang/32/orig -> origin/gh/andyanwang/32/orig 2025-09-07T07:36:19.6789820Z * [new branch] gh/andyanwang/39/base -> origin/gh/andyanwang/39/base 2025-09-07T07:36:19.6791080Z * [new branch] gh/andyanwang/39/head -> origin/gh/andyanwang/39/head 2025-09-07T07:36:19.6792266Z * [new branch] gh/andyanwang/39/orig -> origin/gh/andyanwang/39/orig 2025-09-07T07:36:19.6794073Z * [new branch] gh/andyanwang/4/base -> origin/gh/andyanwang/4/base 2025-09-07T07:36:19.6795188Z * [new branch] gh/andyanwang/4/head -> origin/gh/andyanwang/4/head 2025-09-07T07:36:19.6796487Z * [new branch] gh/andyanwang/4/orig -> origin/gh/andyanwang/4/orig 2025-09-07T07:36:19.6798642Z * [new branch] gh/angelayi/107/base -> origin/gh/angelayi/107/base 2025-09-07T07:36:19.6799924Z * [new branch] gh/angelayi/107/head -> origin/gh/angelayi/107/head 2025-09-07T07:36:19.6801605Z * [new branch] gh/angelayi/111/base -> origin/gh/angelayi/111/base 2025-09-07T07:36:19.6802933Z * [new branch] gh/angelayi/111/head -> origin/gh/angelayi/111/head 2025-09-07T07:36:19.6804143Z * [new branch] gh/angelayi/111/orig -> origin/gh/angelayi/111/orig 2025-09-07T07:36:19.6805803Z * [new branch] gh/angelayi/112/base -> origin/gh/angelayi/112/base 2025-09-07T07:36:19.6807064Z * [new branch] gh/angelayi/112/head -> origin/gh/angelayi/112/head 2025-09-07T07:36:19.6808266Z * [new branch] gh/angelayi/112/orig -> origin/gh/angelayi/112/orig 2025-09-07T07:36:19.6812650Z * [new branch] gh/angelayi/113/base -> origin/gh/angelayi/113/base 2025-09-07T07:36:19.6813881Z * [new branch] gh/angelayi/113/head -> origin/gh/angelayi/113/head 2025-09-07T07:36:19.6815065Z * [new branch] gh/angelayi/113/orig -> origin/gh/angelayi/113/orig 2025-09-07T07:36:19.6816832Z * [new branch] gh/angelayi/114/base -> origin/gh/angelayi/114/base 2025-09-07T07:36:19.6818010Z * [new branch] gh/angelayi/114/head -> origin/gh/angelayi/114/head 2025-09-07T07:36:19.6819163Z * [new branch] gh/angelayi/114/orig -> origin/gh/angelayi/114/orig 2025-09-07T07:36:19.6820897Z * [new branch] gh/angelayi/115/base -> origin/gh/angelayi/115/base 2025-09-07T07:36:19.6822124Z * [new branch] gh/angelayi/115/head -> origin/gh/angelayi/115/head 2025-09-07T07:36:19.6823316Z * [new branch] gh/angelayi/115/orig -> origin/gh/angelayi/115/orig 2025-09-07T07:36:19.6825585Z * [new branch] gh/anijain2305/753/base -> origin/gh/anijain2305/753/base 2025-09-07T07:36:19.6826848Z * [new branch] gh/anijain2305/753/head -> origin/gh/anijain2305/753/head 2025-09-07T07:36:19.6828114Z * [new branch] gh/anijain2305/753/orig -> origin/gh/anijain2305/753/orig 2025-09-07T07:36:19.6829909Z * [new branch] gh/anijain2305/766/base -> origin/gh/anijain2305/766/base 2025-09-07T07:36:19.6831039Z * [new branch] gh/anijain2305/766/head -> origin/gh/anijain2305/766/head 2025-09-07T07:36:19.6832190Z * [new branch] gh/anijain2305/766/orig -> origin/gh/anijain2305/766/orig 2025-09-07T07:36:19.6834157Z * [new branch] gh/anijain2305/790/base -> origin/gh/anijain2305/790/base 2025-09-07T07:36:19.6835254Z * [new branch] gh/anijain2305/790/head -> origin/gh/anijain2305/790/head 2025-09-07T07:36:19.6836480Z * [new branch] gh/anijain2305/790/orig -> origin/gh/anijain2305/790/orig 2025-09-07T07:36:19.6838173Z * [new branch] gh/anijain2305/792/base -> origin/gh/anijain2305/792/base 2025-09-07T07:36:19.6839318Z * [new branch] gh/anijain2305/792/head -> origin/gh/anijain2305/792/head 2025-09-07T07:36:19.6840713Z * [new branch] gh/anijain2305/792/orig -> origin/gh/anijain2305/792/orig 2025-09-07T07:36:19.6842419Z * [new branch] gh/anijain2305/803/base -> origin/gh/anijain2305/803/base 2025-09-07T07:36:19.6843618Z * [new branch] gh/anijain2305/803/head -> origin/gh/anijain2305/803/head 2025-09-07T07:36:19.6844835Z * [new branch] gh/anijain2305/803/orig -> origin/gh/anijain2305/803/orig 2025-09-07T07:36:19.6846487Z * [new branch] gh/anijain2305/804/base -> origin/gh/anijain2305/804/base 2025-09-07T07:36:19.6847651Z * [new branch] gh/anijain2305/804/head -> origin/gh/anijain2305/804/head 2025-09-07T07:36:19.6848834Z * [new branch] gh/anijain2305/804/orig -> origin/gh/anijain2305/804/orig 2025-09-07T07:36:19.6850568Z * [new branch] gh/anijain2305/805/base -> origin/gh/anijain2305/805/base 2025-09-07T07:36:19.6851785Z * [new branch] gh/anijain2305/805/head -> origin/gh/anijain2305/805/head 2025-09-07T07:36:19.6852975Z * [new branch] gh/anijain2305/805/orig -> origin/gh/anijain2305/805/orig 2025-09-07T07:36:19.6854802Z * [new branch] gh/anijain2305/810/base -> origin/gh/anijain2305/810/base 2025-09-07T07:36:19.6855977Z * [new branch] gh/anijain2305/810/head -> origin/gh/anijain2305/810/head 2025-09-07T07:36:19.6857182Z * [new branch] gh/anijain2305/810/orig -> origin/gh/anijain2305/810/orig 2025-09-07T07:36:19.6858915Z * [new branch] gh/anijain2305/812/base -> origin/gh/anijain2305/812/base 2025-09-07T07:36:19.6860179Z * [new branch] gh/anijain2305/812/head -> origin/gh/anijain2305/812/head 2025-09-07T07:36:19.6861568Z * [new branch] gh/anijain2305/812/orig -> origin/gh/anijain2305/812/orig 2025-09-07T07:36:19.6863082Z * [new branch] gh/anijain2305/838/base -> origin/gh/anijain2305/838/base 2025-09-07T07:36:19.6864288Z * [new branch] gh/anijain2305/838/head -> origin/gh/anijain2305/838/head 2025-09-07T07:36:19.6865476Z * [new branch] gh/anijain2305/838/orig -> origin/gh/anijain2305/838/orig 2025-09-07T07:36:19.6867311Z * [new branch] gh/anijain2305/839/base -> origin/gh/anijain2305/839/base 2025-09-07T07:36:19.6868498Z * [new branch] gh/anijain2305/839/head -> origin/gh/anijain2305/839/head 2025-09-07T07:36:19.6869664Z * [new branch] gh/anijain2305/839/orig -> origin/gh/anijain2305/839/orig 2025-09-07T07:36:19.6871372Z * [new branch] gh/anijain2305/843/base -> origin/gh/anijain2305/843/base 2025-09-07T07:36:19.6872577Z * [new branch] gh/anijain2305/843/head -> origin/gh/anijain2305/843/head 2025-09-07T07:36:19.6873747Z * [new branch] gh/anijain2305/843/orig -> origin/gh/anijain2305/843/orig 2025-09-07T07:36:19.6875644Z * [new branch] gh/anijain2305/844/base -> origin/gh/anijain2305/844/base 2025-09-07T07:36:19.6876828Z * [new branch] gh/anijain2305/844/head -> origin/gh/anijain2305/844/head 2025-09-07T07:36:19.6878073Z * [new branch] gh/anijain2305/844/orig -> origin/gh/anijain2305/844/orig 2025-09-07T07:36:19.6879913Z * [new branch] gh/anijain2305/846/base -> origin/gh/anijain2305/846/base 2025-09-07T07:36:19.6881194Z * [new branch] gh/anijain2305/846/head -> origin/gh/anijain2305/846/head 2025-09-07T07:36:19.6882334Z * [new branch] gh/anijain2305/846/orig -> origin/gh/anijain2305/846/orig 2025-09-07T07:36:19.6884157Z * [new branch] gh/anijain2305/848/base -> origin/gh/anijain2305/848/base 2025-09-07T07:36:19.6885417Z * [new branch] gh/anijain2305/848/head -> origin/gh/anijain2305/848/head 2025-09-07T07:36:19.6886597Z * [new branch] gh/anijain2305/848/orig -> origin/gh/anijain2305/848/orig 2025-09-07T07:36:19.6888316Z * [new branch] gh/anijain2305/849/base -> origin/gh/anijain2305/849/base 2025-09-07T07:36:19.6889485Z * [new branch] gh/anijain2305/849/head -> origin/gh/anijain2305/849/head 2025-09-07T07:36:19.6890657Z * [new branch] gh/anijain2305/849/orig -> origin/gh/anijain2305/849/orig 2025-09-07T07:36:19.6892838Z * [new branch] gh/anijain2305/850/base -> origin/gh/anijain2305/850/base 2025-09-07T07:36:19.6894018Z * [new branch] gh/anijain2305/850/head -> origin/gh/anijain2305/850/head 2025-09-07T07:36:19.6895231Z * [new branch] gh/anijain2305/850/orig -> origin/gh/anijain2305/850/orig 2025-09-07T07:36:19.6896989Z * [new branch] gh/anijain2305/851/base -> origin/gh/anijain2305/851/base 2025-09-07T07:36:19.6898563Z * [new branch] gh/anijain2305/851/head -> origin/gh/anijain2305/851/head 2025-09-07T07:36:19.6899325Z * [new branch] gh/anijain2305/851/orig -> origin/gh/anijain2305/851/orig 2025-09-07T07:36:19.6901284Z * [new branch] gh/anijain2305/852/base -> origin/gh/anijain2305/852/base 2025-09-07T07:36:19.6902480Z * [new branch] gh/anijain2305/852/head -> origin/gh/anijain2305/852/head 2025-09-07T07:36:19.6903691Z * [new branch] gh/anijain2305/852/orig -> origin/gh/anijain2305/852/orig 2025-09-07T07:36:19.6905426Z * [new branch] gh/anijain2305/853/base -> origin/gh/anijain2305/853/base 2025-09-07T07:36:19.6906659Z * [new branch] gh/anijain2305/853/head -> origin/gh/anijain2305/853/head 2025-09-07T07:36:19.6907831Z * [new branch] gh/anijain2305/853/orig -> origin/gh/anijain2305/853/orig 2025-09-07T07:36:19.6909750Z * [new branch] gh/anijain2305/854/base -> origin/gh/anijain2305/854/base 2025-09-07T07:36:19.6911282Z * [new branch] gh/anijain2305/854/head -> origin/gh/anijain2305/854/head 2025-09-07T07:36:19.6912495Z * [new branch] gh/anijain2305/854/orig -> origin/gh/anijain2305/854/orig 2025-09-07T07:36:19.6914331Z * [new branch] gh/anijain2305/855/base -> origin/gh/anijain2305/855/base 2025-09-07T07:36:19.6915550Z * [new branch] gh/anijain2305/855/head -> origin/gh/anijain2305/855/head 2025-09-07T07:36:19.6916809Z * [new branch] gh/anijain2305/855/orig -> origin/gh/anijain2305/855/orig 2025-09-07T07:36:19.6918596Z * [new branch] gh/anijain2305/856/base -> origin/gh/anijain2305/856/base 2025-09-07T07:36:19.6919804Z * [new branch] gh/anijain2305/856/head -> origin/gh/anijain2305/856/head 2025-09-07T07:36:19.6921048Z * [new branch] gh/anijain2305/856/orig -> origin/gh/anijain2305/856/orig 2025-09-07T07:36:19.6922791Z * [new branch] gh/anijain2305/857/base -> origin/gh/anijain2305/857/base 2025-09-07T07:36:19.6924055Z * [new branch] gh/anijain2305/857/head -> origin/gh/anijain2305/857/head 2025-09-07T07:36:19.6925231Z * [new branch] gh/anijain2305/857/orig -> origin/gh/anijain2305/857/orig 2025-09-07T07:36:19.6926996Z * [new branch] gh/anijain2305/858/base -> origin/gh/anijain2305/858/base 2025-09-07T07:36:19.6928263Z * [new branch] gh/anijain2305/858/head -> origin/gh/anijain2305/858/head 2025-09-07T07:36:19.6929571Z * [new branch] gh/anijain2305/858/orig -> origin/gh/anijain2305/858/orig 2025-09-07T07:36:19.6931273Z * [new branch] gh/anijain2305/859/base -> origin/gh/anijain2305/859/base 2025-09-07T07:36:19.6932515Z * [new branch] gh/anijain2305/859/head -> origin/gh/anijain2305/859/head 2025-09-07T07:36:19.6933740Z * [new branch] gh/anijain2305/859/orig -> origin/gh/anijain2305/859/orig 2025-09-07T07:36:19.6935589Z * [new branch] gh/anijain2305/860/base -> origin/gh/anijain2305/860/base 2025-09-07T07:36:19.6936801Z * [new branch] gh/anijain2305/860/head -> origin/gh/anijain2305/860/head 2025-09-07T07:36:19.6937998Z * [new branch] gh/anijain2305/860/orig -> origin/gh/anijain2305/860/orig 2025-09-07T07:36:19.6939735Z * [new branch] gh/anijain2305/861/base -> origin/gh/anijain2305/861/base 2025-09-07T07:36:19.6940896Z * [new branch] gh/anijain2305/861/head -> origin/gh/anijain2305/861/head 2025-09-07T07:36:19.6942107Z * [new branch] gh/anijain2305/861/orig -> origin/gh/anijain2305/861/orig 2025-09-07T07:36:19.6943872Z * [new branch] gh/anijain2305/862/base -> origin/gh/anijain2305/862/base 2025-09-07T07:36:19.6945130Z * [new branch] gh/anijain2305/862/head -> origin/gh/anijain2305/862/head 2025-09-07T07:36:19.6946385Z * [new branch] gh/anijain2305/862/orig -> origin/gh/anijain2305/862/orig 2025-09-07T07:36:19.6948332Z * [new branch] gh/anijain2305/863/base -> origin/gh/anijain2305/863/base 2025-09-07T07:36:19.6949549Z * [new branch] gh/anijain2305/863/head -> origin/gh/anijain2305/863/head 2025-09-07T07:36:19.6950724Z * [new branch] gh/anijain2305/863/orig -> origin/gh/anijain2305/863/orig 2025-09-07T07:36:19.6952640Z * [new branch] gh/anijain2305/864/base -> origin/gh/anijain2305/864/base 2025-09-07T07:36:19.6953826Z * [new branch] gh/anijain2305/864/head -> origin/gh/anijain2305/864/head 2025-09-07T07:36:19.6954993Z * [new branch] gh/anijain2305/864/orig -> origin/gh/anijain2305/864/orig 2025-09-07T07:36:19.6956794Z * [new branch] gh/anijain2305/865/base -> origin/gh/anijain2305/865/base 2025-09-07T07:36:19.6957989Z * [new branch] gh/anijain2305/865/head -> origin/gh/anijain2305/865/head 2025-09-07T07:36:19.6959144Z * [new branch] gh/anijain2305/865/orig -> origin/gh/anijain2305/865/orig 2025-09-07T07:36:19.6961411Z * [new branch] gh/anijain2305/866/base -> origin/gh/anijain2305/866/base 2025-09-07T07:36:19.6962609Z * [new branch] gh/anijain2305/866/head -> origin/gh/anijain2305/866/head 2025-09-07T07:36:19.6963812Z * [new branch] gh/anijain2305/866/orig -> origin/gh/anijain2305/866/orig 2025-09-07T07:36:19.6966025Z * [new branch] gh/anjali411/216/base -> origin/gh/anjali411/216/base 2025-09-07T07:36:19.6967212Z * [new branch] gh/anjali411/216/head -> origin/gh/anjali411/216/head 2025-09-07T07:36:19.6968463Z * [new branch] gh/anjali411/216/orig -> origin/gh/anjali411/216/orig 2025-09-07T07:36:19.6970729Z * [new branch] gh/ankitageorge/13/base -> origin/gh/ankitageorge/13/base 2025-09-07T07:36:19.6971935Z * [new branch] gh/ankitageorge/13/head -> origin/gh/ankitageorge/13/head 2025-09-07T07:36:19.6973185Z * [new branch] gh/ankitageorge/13/orig -> origin/gh/ankitageorge/13/orig 2025-09-07T07:36:19.6975036Z * [new branch] gh/ankitageorge/14/base -> origin/gh/ankitageorge/14/base 2025-09-07T07:36:19.6976177Z * [new branch] gh/ankitageorge/14/head -> origin/gh/ankitageorge/14/head 2025-09-07T07:36:19.6977536Z * [new branch] gh/ankitageorge/14/orig -> origin/gh/ankitageorge/14/orig 2025-09-07T07:36:19.6979381Z * [new branch] gh/ankitageorge/15/base -> origin/gh/ankitageorge/15/base 2025-09-07T07:36:19.6980566Z * [new branch] gh/ankitageorge/15/head -> origin/gh/ankitageorge/15/head 2025-09-07T07:36:19.6981812Z * [new branch] gh/ankitageorge/15/orig -> origin/gh/ankitageorge/15/orig 2025-09-07T07:36:19.6983677Z * [new branch] gh/ankitageorge/16/base -> origin/gh/ankitageorge/16/base 2025-09-07T07:36:19.6985015Z * [new branch] gh/ankitageorge/16/head -> origin/gh/ankitageorge/16/head 2025-09-07T07:36:19.6986420Z * [new branch] gh/ankitageorge/16/orig -> origin/gh/ankitageorge/16/orig 2025-09-07T07:36:19.6988275Z * [new branch] gh/ankitageorge/17/base -> origin/gh/ankitageorge/17/base 2025-09-07T07:36:19.6989437Z * [new branch] gh/ankitageorge/17/head -> origin/gh/ankitageorge/17/head 2025-09-07T07:36:19.6990616Z * [new branch] gh/ankitageorge/17/orig -> origin/gh/ankitageorge/17/orig 2025-09-07T07:36:19.6992509Z * [new branch] gh/ankitageorge/21/base -> origin/gh/ankitageorge/21/base 2025-09-07T07:36:19.6993629Z * [new branch] gh/ankitageorge/21/head -> origin/gh/ankitageorge/21/head 2025-09-07T07:36:19.6994807Z * [new branch] gh/ankitageorge/21/orig -> origin/gh/ankitageorge/21/orig 2025-09-07T07:36:19.6997094Z * [new branch] gh/anshul-si/1/base -> origin/gh/anshul-si/1/base 2025-09-07T07:36:19.6998305Z * [new branch] gh/anshul-si/1/head -> origin/gh/anshul-si/1/head 2025-09-07T07:36:19.6999993Z * [new branch] gh/anshul-si/15/base -> origin/gh/anshul-si/15/base 2025-09-07T07:36:19.7001166Z * [new branch] gh/anshul-si/15/head -> origin/gh/anshul-si/15/head 2025-09-07T07:36:19.7002411Z * [new branch] gh/anshul-si/15/orig -> origin/gh/anshul-si/15/orig 2025-09-07T07:36:19.7004297Z * [new branch] gh/anshul-si/16/base -> origin/gh/anshul-si/16/base 2025-09-07T07:36:19.7005440Z * [new branch] gh/anshul-si/16/head -> origin/gh/anshul-si/16/head 2025-09-07T07:36:19.7006642Z * [new branch] gh/anshul-si/16/orig -> origin/gh/anshul-si/16/orig 2025-09-07T07:36:19.7008475Z * [new branch] gh/anshul-si/17/base -> origin/gh/anshul-si/17/base 2025-09-07T07:36:19.7009817Z * [new branch] gh/anshul-si/17/head -> origin/gh/anshul-si/17/head 2025-09-07T07:36:19.7011258Z * [new branch] gh/anshul-si/17/orig -> origin/gh/anshul-si/17/orig 2025-09-07T07:36:19.7013042Z * [new branch] gh/anshul-si/18/base -> origin/gh/anshul-si/18/base 2025-09-07T07:36:19.7014396Z * [new branch] gh/anshul-si/18/head -> origin/gh/anshul-si/18/head 2025-09-07T07:36:19.7015932Z * [new branch] gh/anshul-si/18/orig -> origin/gh/anshul-si/18/orig 2025-09-07T07:36:19.7017392Z * [new branch] gh/anshul-si/19/base -> origin/gh/anshul-si/19/base 2025-09-07T07:36:19.7018619Z * [new branch] gh/anshul-si/19/head -> origin/gh/anshul-si/19/head 2025-09-07T07:36:19.7019900Z * [new branch] gh/anshul-si/19/orig -> origin/gh/anshul-si/19/orig 2025-09-07T07:36:19.7021871Z * [new branch] gh/anshul-si/2/base -> origin/gh/anshul-si/2/base 2025-09-07T07:36:19.7022762Z * [new branch] gh/anshul-si/2/head -> origin/gh/anshul-si/2/head 2025-09-07T07:36:19.7024685Z * [new branch] gh/anshul-si/20/base -> origin/gh/anshul-si/20/base 2025-09-07T07:36:19.7025906Z * [new branch] gh/anshul-si/20/head -> origin/gh/anshul-si/20/head 2025-09-07T07:36:19.7027134Z * [new branch] gh/anshul-si/20/orig -> origin/gh/anshul-si/20/orig 2025-09-07T07:36:19.7028796Z * [new branch] gh/anshul-si/21/base -> origin/gh/anshul-si/21/base 2025-09-07T07:36:19.7030128Z * [new branch] gh/anshul-si/21/head -> origin/gh/anshul-si/21/head 2025-09-07T07:36:19.7031225Z * [new branch] gh/anshul-si/21/orig -> origin/gh/anshul-si/21/orig 2025-09-07T07:36:19.7032955Z * [new branch] gh/anshul-si/22/base -> origin/gh/anshul-si/22/base 2025-09-07T07:36:19.7034207Z * [new branch] gh/anshul-si/22/head -> origin/gh/anshul-si/22/head 2025-09-07T07:36:19.7035438Z * [new branch] gh/anshul-si/22/orig -> origin/gh/anshul-si/22/orig 2025-09-07T07:36:19.7037129Z * [new branch] gh/anshul-si/23/base -> origin/gh/anshul-si/23/base 2025-09-07T07:36:19.7038349Z * [new branch] gh/anshul-si/23/head -> origin/gh/anshul-si/23/head 2025-09-07T07:36:19.7039524Z * [new branch] gh/anshul-si/23/orig -> origin/gh/anshul-si/23/orig 2025-09-07T07:36:19.7041221Z * [new branch] gh/anshul-si/24/base -> origin/gh/anshul-si/24/base 2025-09-07T07:36:19.7042489Z * [new branch] gh/anshul-si/24/head -> origin/gh/anshul-si/24/head 2025-09-07T07:36:19.7043688Z * [new branch] gh/anshul-si/24/orig -> origin/gh/anshul-si/24/orig 2025-09-07T07:36:19.7045375Z * [new branch] gh/anshul-si/25/base -> origin/gh/anshul-si/25/base 2025-09-07T07:36:19.7046594Z * [new branch] gh/anshul-si/25/head -> origin/gh/anshul-si/25/head 2025-09-07T07:36:19.7047803Z * [new branch] gh/anshul-si/25/orig -> origin/gh/anshul-si/25/orig 2025-09-07T07:36:19.7049497Z * [new branch] gh/anshul-si/26/base -> origin/gh/anshul-si/26/base 2025-09-07T07:36:19.7050713Z * [new branch] gh/anshul-si/26/head -> origin/gh/anshul-si/26/head 2025-09-07T07:36:19.7051875Z * [new branch] gh/anshul-si/26/orig -> origin/gh/anshul-si/26/orig 2025-09-07T07:36:19.7053659Z * [new branch] gh/anshul-si/27/base -> origin/gh/anshul-si/27/base 2025-09-07T07:36:19.7054842Z * [new branch] gh/anshul-si/27/head -> origin/gh/anshul-si/27/head 2025-09-07T07:36:19.7056196Z * [new branch] gh/anshul-si/27/orig -> origin/gh/anshul-si/27/orig 2025-09-07T07:36:19.7057865Z * [new branch] gh/anshul-si/28/base -> origin/gh/anshul-si/28/base 2025-09-07T07:36:19.7059067Z * [new branch] gh/anshul-si/28/head -> origin/gh/anshul-si/28/head 2025-09-07T07:36:19.7060265Z * [new branch] gh/anshul-si/28/orig -> origin/gh/anshul-si/28/orig 2025-09-07T07:36:19.7061854Z * [new branch] gh/anshul-si/29/base -> origin/gh/anshul-si/29/base 2025-09-07T07:36:19.7063172Z * [new branch] gh/anshul-si/29/head -> origin/gh/anshul-si/29/head 2025-09-07T07:36:19.7064375Z * [new branch] gh/anshul-si/29/orig -> origin/gh/anshul-si/29/orig 2025-09-07T07:36:19.7066038Z * [new branch] gh/anshul-si/3/base -> origin/gh/anshul-si/3/base 2025-09-07T07:36:19.7067222Z * [new branch] gh/anshul-si/3/head -> origin/gh/anshul-si/3/head 2025-09-07T07:36:19.7068875Z * [new branch] gh/anshul-si/4/base -> origin/gh/anshul-si/4/base 2025-09-07T07:36:19.7070001Z * [new branch] gh/anshul-si/4/head -> origin/gh/anshul-si/4/head 2025-09-07T07:36:19.7071991Z * [new branch] gh/anshul-si/5/base -> origin/gh/anshul-si/5/base 2025-09-07T07:36:19.7073232Z * [new branch] gh/anshul-si/5/head -> origin/gh/anshul-si/5/head 2025-09-07T07:36:19.7075596Z * [new branch] gh/aorenste/132/base -> origin/gh/aorenste/132/base 2025-09-07T07:36:19.7076877Z * [new branch] gh/aorenste/132/head -> origin/gh/aorenste/132/head 2025-09-07T07:36:19.7079129Z * [new branch] gh/bdhirsh/650/base -> origin/gh/bdhirsh/650/base 2025-09-07T07:36:19.7080567Z * [new branch] gh/bdhirsh/650/head -> origin/gh/bdhirsh/650/head 2025-09-07T07:36:19.7081675Z * [new branch] gh/bdhirsh/650/orig -> origin/gh/bdhirsh/650/orig 2025-09-07T07:36:19.7083494Z * [new branch] gh/bdhirsh/663/base -> origin/gh/bdhirsh/663/base 2025-09-07T07:36:19.7084753Z * [new branch] gh/bdhirsh/663/head -> origin/gh/bdhirsh/663/head 2025-09-07T07:36:19.7085974Z * [new branch] gh/bdhirsh/663/orig -> origin/gh/bdhirsh/663/orig 2025-09-07T07:36:19.7087919Z * [new branch] gh/bdhirsh/665/base -> origin/gh/bdhirsh/665/base 2025-09-07T07:36:19.7089064Z * [new branch] gh/bdhirsh/665/head -> origin/gh/bdhirsh/665/head 2025-09-07T07:36:19.7090228Z * [new branch] gh/bdhirsh/665/orig -> origin/gh/bdhirsh/665/orig 2025-09-07T07:36:19.7092206Z * [new branch] gh/bdhirsh/666/base -> origin/gh/bdhirsh/666/base 2025-09-07T07:36:19.7093636Z * [new branch] gh/bdhirsh/666/head -> origin/gh/bdhirsh/666/head 2025-09-07T07:36:19.7094928Z * [new branch] gh/bdhirsh/666/orig -> origin/gh/bdhirsh/666/orig 2025-09-07T07:36:19.7096749Z * [new branch] gh/bdhirsh/667/base -> origin/gh/bdhirsh/667/base 2025-09-07T07:36:19.7097926Z * [new branch] gh/bdhirsh/667/head -> origin/gh/bdhirsh/667/head 2025-09-07T07:36:19.7099157Z * [new branch] gh/bdhirsh/667/orig -> origin/gh/bdhirsh/667/orig 2025-09-07T07:36:19.7100845Z * [new branch] gh/bdhirsh/668/base -> origin/gh/bdhirsh/668/base 2025-09-07T07:36:19.7114828Z * [new branch] gh/bdhirsh/668/head -> origin/gh/bdhirsh/668/head 2025-09-07T07:36:19.7115280Z * [new branch] gh/bdhirsh/668/orig -> origin/gh/bdhirsh/668/orig 2025-09-07T07:36:19.7115814Z * [new branch] gh/bdhirsh/669/base -> origin/gh/bdhirsh/669/base 2025-09-07T07:36:19.7116140Z * [new branch] gh/bdhirsh/669/head -> origin/gh/bdhirsh/669/head 2025-09-07T07:36:19.7116446Z * [new branch] gh/bdhirsh/669/orig -> origin/gh/bdhirsh/669/orig 2025-09-07T07:36:19.7116745Z * [new branch] gh/bdhirsh/670/base -> origin/gh/bdhirsh/670/base 2025-09-07T07:36:19.7117053Z * [new branch] gh/bdhirsh/670/head -> origin/gh/bdhirsh/670/head 2025-09-07T07:36:19.7117374Z * [new branch] gh/bdhirsh/670/orig -> origin/gh/bdhirsh/670/orig 2025-09-07T07:36:19.7117724Z * [new branch] gh/benjaminglass1/100/base -> origin/gh/benjaminglass1/100/base 2025-09-07T07:36:19.7118102Z * [new branch] gh/benjaminglass1/100/head -> origin/gh/benjaminglass1/100/head 2025-09-07T07:36:19.7118472Z * [new branch] gh/benjaminglass1/100/orig -> origin/gh/benjaminglass1/100/orig 2025-09-07T07:36:19.7118824Z * [new branch] gh/benjaminglass1/101/base -> origin/gh/benjaminglass1/101/base 2025-09-07T07:36:19.7120084Z * [new branch] gh/benjaminglass1/101/head -> origin/gh/benjaminglass1/101/head 2025-09-07T07:36:19.7121219Z * [new branch] gh/benjaminglass1/101/orig -> origin/gh/benjaminglass1/101/orig 2025-09-07T07:36:19.7122920Z * [new branch] gh/benjaminglass1/102/base -> origin/gh/benjaminglass1/102/base 2025-09-07T07:36:19.7124107Z * [new branch] gh/benjaminglass1/102/head -> origin/gh/benjaminglass1/102/head 2025-09-07T07:36:19.7125284Z * [new branch] gh/benjaminglass1/102/orig -> origin/gh/benjaminglass1/102/orig 2025-09-07T07:36:19.7127089Z * [new branch] gh/benjaminglass1/103/base -> origin/gh/benjaminglass1/103/base 2025-09-07T07:36:19.7128219Z * [new branch] gh/benjaminglass1/103/head -> origin/gh/benjaminglass1/103/head 2025-09-07T07:36:19.7129580Z * [new branch] gh/benjaminglass1/103/orig -> origin/gh/benjaminglass1/103/orig 2025-09-07T07:36:19.7131427Z * [new branch] gh/benjaminglass1/104/base -> origin/gh/benjaminglass1/104/base 2025-09-07T07:36:19.7132623Z * [new branch] gh/benjaminglass1/104/head -> origin/gh/benjaminglass1/104/head 2025-09-07T07:36:19.7133776Z * [new branch] gh/benjaminglass1/104/orig -> origin/gh/benjaminglass1/104/orig 2025-09-07T07:36:19.7135408Z * [new branch] gh/benjaminglass1/105/base -> origin/gh/benjaminglass1/105/base 2025-09-07T07:36:19.7136593Z * [new branch] gh/benjaminglass1/105/head -> origin/gh/benjaminglass1/105/head 2025-09-07T07:36:19.7137791Z * [new branch] gh/benjaminglass1/105/orig -> origin/gh/benjaminglass1/105/orig 2025-09-07T07:36:19.7139503Z * [new branch] gh/benjaminglass1/106/base -> origin/gh/benjaminglass1/106/base 2025-09-07T07:36:19.7140679Z * [new branch] gh/benjaminglass1/106/head -> origin/gh/benjaminglass1/106/head 2025-09-07T07:36:19.7141967Z * [new branch] gh/benjaminglass1/106/orig -> origin/gh/benjaminglass1/106/orig 2025-09-07T07:36:19.7143625Z * [new branch] gh/benjaminglass1/79/base -> origin/gh/benjaminglass1/79/base 2025-09-07T07:36:19.7144833Z * [new branch] gh/benjaminglass1/79/head -> origin/gh/benjaminglass1/79/head 2025-09-07T07:36:19.7146019Z * [new branch] gh/benjaminglass1/79/orig -> origin/gh/benjaminglass1/79/orig 2025-09-07T07:36:19.7147841Z * [new branch] gh/benjaminglass1/86/base -> origin/gh/benjaminglass1/86/base 2025-09-07T07:36:19.7149048Z * [new branch] gh/benjaminglass1/86/head -> origin/gh/benjaminglass1/86/head 2025-09-07T07:36:19.7150322Z * [new branch] gh/benjaminglass1/86/orig -> origin/gh/benjaminglass1/86/orig 2025-09-07T07:36:19.7152099Z * [new branch] gh/benjaminglass1/89/base -> origin/gh/benjaminglass1/89/base 2025-09-07T07:36:19.7153297Z * [new branch] gh/benjaminglass1/89/head -> origin/gh/benjaminglass1/89/head 2025-09-07T07:36:19.7154494Z * [new branch] gh/benjaminglass1/89/orig -> origin/gh/benjaminglass1/89/orig 2025-09-07T07:36:19.7156141Z * [new branch] gh/benjaminglass1/91/base -> origin/gh/benjaminglass1/91/base 2025-09-07T07:36:19.7157329Z * [new branch] gh/benjaminglass1/91/head -> origin/gh/benjaminglass1/91/head 2025-09-07T07:36:19.7158494Z * [new branch] gh/benjaminglass1/91/orig -> origin/gh/benjaminglass1/91/orig 2025-09-07T07:36:19.7160225Z * [new branch] gh/benjaminglass1/93/base -> origin/gh/benjaminglass1/93/base 2025-09-07T07:36:19.7161408Z * [new branch] gh/benjaminglass1/93/head -> origin/gh/benjaminglass1/93/head 2025-09-07T07:36:19.7162644Z * [new branch] gh/benjaminglass1/93/orig -> origin/gh/benjaminglass1/93/orig 2025-09-07T07:36:19.7164337Z * [new branch] gh/benjaminglass1/95/base -> origin/gh/benjaminglass1/95/base 2025-09-07T07:36:19.7165672Z * [new branch] gh/benjaminglass1/95/head -> origin/gh/benjaminglass1/95/head 2025-09-07T07:36:19.7166836Z * [new branch] gh/benjaminglass1/95/orig -> origin/gh/benjaminglass1/95/orig 2025-09-07T07:36:19.7168737Z * [new branch] gh/benjaminglass1/97/base -> origin/gh/benjaminglass1/97/base 2025-09-07T07:36:19.7169822Z * [new branch] gh/benjaminglass1/97/head -> origin/gh/benjaminglass1/97/head 2025-09-07T07:36:19.7171086Z * [new branch] gh/benjaminglass1/97/orig -> origin/gh/benjaminglass1/97/orig 2025-09-07T07:36:19.7172810Z * [new branch] gh/benjaminglass1/99/base -> origin/gh/benjaminglass1/99/base 2025-09-07T07:36:19.7173997Z * [new branch] gh/benjaminglass1/99/head -> origin/gh/benjaminglass1/99/head 2025-09-07T07:36:19.7175291Z * [new branch] gh/benjaminglass1/99/orig -> origin/gh/benjaminglass1/99/orig 2025-09-07T07:36:19.7177515Z * [new branch] gh/bobrenjc93/514/base -> origin/gh/bobrenjc93/514/base 2025-09-07T07:36:19.7178615Z * [new branch] gh/bobrenjc93/514/head -> origin/gh/bobrenjc93/514/head 2025-09-07T07:36:19.7181628Z * [new branch] gh/bobrenjc93/514/orig -> origin/gh/bobrenjc93/514/orig 2025-09-07T07:36:19.7183238Z * [new branch] gh/bobrenjc93/521/base -> origin/gh/bobrenjc93/521/base 2025-09-07T07:36:19.7183561Z * [new branch] gh/bobrenjc93/521/head -> origin/gh/bobrenjc93/521/head 2025-09-07T07:36:19.7184176Z * [new branch] gh/bobrenjc93/521/orig -> origin/gh/bobrenjc93/521/orig 2025-09-07T07:36:19.7185630Z * [new branch] gh/bobrenjc93/522/base -> origin/gh/bobrenjc93/522/base 2025-09-07T07:36:19.7187271Z * [new branch] gh/bobrenjc93/522/head -> origin/gh/bobrenjc93/522/head 2025-09-07T07:36:19.7188052Z * [new branch] gh/bobrenjc93/522/orig -> origin/gh/bobrenjc93/522/orig 2025-09-07T07:36:19.7189805Z * [new branch] gh/bobrenjc93/525/base -> origin/gh/bobrenjc93/525/base 2025-09-07T07:36:19.7191114Z * [new branch] gh/bobrenjc93/525/head -> origin/gh/bobrenjc93/525/head 2025-09-07T07:36:19.7192399Z * [new branch] gh/bobrenjc93/525/orig -> origin/gh/bobrenjc93/525/orig 2025-09-07T07:36:19.7194102Z * [new branch] gh/bobrenjc93/526/base -> origin/gh/bobrenjc93/526/base 2025-09-07T07:36:19.7195289Z * [new branch] gh/bobrenjc93/526/head -> origin/gh/bobrenjc93/526/head 2025-09-07T07:36:19.7196439Z * [new branch] gh/bobrenjc93/526/orig -> origin/gh/bobrenjc93/526/orig 2025-09-07T07:36:19.7198164Z * [new branch] gh/bobrenjc93/527/base -> origin/gh/bobrenjc93/527/base 2025-09-07T07:36:19.7199360Z * [new branch] gh/bobrenjc93/527/head -> origin/gh/bobrenjc93/527/head 2025-09-07T07:36:19.7200822Z * [new branch] gh/bobrenjc93/527/orig -> origin/gh/bobrenjc93/527/orig 2025-09-07T07:36:19.7202583Z * [new branch] gh/bobrenjc93/528/base -> origin/gh/bobrenjc93/528/base 2025-09-07T07:36:19.7203830Z * [new branch] gh/bobrenjc93/528/head -> origin/gh/bobrenjc93/528/head 2025-09-07T07:36:19.7205036Z * [new branch] gh/bobrenjc93/528/orig -> origin/gh/bobrenjc93/528/orig 2025-09-07T07:36:19.7206722Z * [new branch] gh/bobrenjc93/529/base -> origin/gh/bobrenjc93/529/base 2025-09-07T07:36:19.7207905Z * [new branch] gh/bobrenjc93/529/head -> origin/gh/bobrenjc93/529/head 2025-09-07T07:36:19.7209076Z * [new branch] gh/bobrenjc93/529/orig -> origin/gh/bobrenjc93/529/orig 2025-09-07T07:36:19.7210950Z * [new branch] gh/bobrenjc93/535/base -> origin/gh/bobrenjc93/535/base 2025-09-07T07:36:19.7212124Z * [new branch] gh/bobrenjc93/535/head -> origin/gh/bobrenjc93/535/head 2025-09-07T07:36:19.7213342Z * [new branch] gh/bobrenjc93/535/orig -> origin/gh/bobrenjc93/535/orig 2025-09-07T07:36:19.7215089Z * [new branch] gh/bobrenjc93/537/base -> origin/gh/bobrenjc93/537/base 2025-09-07T07:36:19.7216390Z * [new branch] gh/bobrenjc93/537/head -> origin/gh/bobrenjc93/537/head 2025-09-07T07:36:19.7217554Z * [new branch] gh/bobrenjc93/537/orig -> origin/gh/bobrenjc93/537/orig 2025-09-07T07:36:19.7219555Z * [new branch] gh/bobrenjc93/539/base -> origin/gh/bobrenjc93/539/base 2025-09-07T07:36:19.7220757Z * [new branch] gh/bobrenjc93/539/head -> origin/gh/bobrenjc93/539/head 2025-09-07T07:36:19.7221979Z * [new branch] gh/bobrenjc93/539/orig -> origin/gh/bobrenjc93/539/orig 2025-09-07T07:36:19.7223720Z * [new branch] gh/bobrenjc93/540/base -> origin/gh/bobrenjc93/540/base 2025-09-07T07:36:19.7224945Z * [new branch] gh/bobrenjc93/540/head -> origin/gh/bobrenjc93/540/head 2025-09-07T07:36:19.7226371Z * [new branch] gh/bobrenjc93/540/orig -> origin/gh/bobrenjc93/540/orig 2025-09-07T07:36:19.7228009Z * [new branch] gh/bobrenjc93/541/base -> origin/gh/bobrenjc93/541/base 2025-09-07T07:36:19.7229145Z * [new branch] gh/bobrenjc93/541/head -> origin/gh/bobrenjc93/541/head 2025-09-07T07:36:19.7230403Z * [new branch] gh/bobrenjc93/541/orig -> origin/gh/bobrenjc93/541/orig 2025-09-07T07:36:19.7231999Z * [new branch] gh/bobrenjc93/542/base -> origin/gh/bobrenjc93/542/base 2025-09-07T07:36:19.7233210Z * [new branch] gh/bobrenjc93/542/head -> origin/gh/bobrenjc93/542/head 2025-09-07T07:36:19.7234500Z * [new branch] gh/bobrenjc93/542/orig -> origin/gh/bobrenjc93/542/orig 2025-09-07T07:36:19.7236426Z * [new branch] gh/bobrenjc93/543/base -> origin/gh/bobrenjc93/543/base 2025-09-07T07:36:19.7237618Z * [new branch] gh/bobrenjc93/543/head -> origin/gh/bobrenjc93/543/head 2025-09-07T07:36:19.7238812Z * [new branch] gh/bobrenjc93/543/orig -> origin/gh/bobrenjc93/543/orig 2025-09-07T07:36:19.7240377Z * [new branch] gh/bobrenjc93/544/base -> origin/gh/bobrenjc93/544/base 2025-09-07T07:36:19.7241580Z * [new branch] gh/bobrenjc93/544/head -> origin/gh/bobrenjc93/544/head 2025-09-07T07:36:19.7242766Z * [new branch] gh/bobrenjc93/544/orig -> origin/gh/bobrenjc93/544/orig 2025-09-07T07:36:19.7244823Z * [new branch] gh/bobrenjc93/545/base -> origin/gh/bobrenjc93/545/base 2025-09-07T07:36:19.7246139Z * [new branch] gh/bobrenjc93/545/head -> origin/gh/bobrenjc93/545/head 2025-09-07T07:36:19.7247373Z * [new branch] gh/bobrenjc93/545/orig -> origin/gh/bobrenjc93/545/orig 2025-09-07T07:36:19.7249148Z * [new branch] gh/bobrenjc93/546/base -> origin/gh/bobrenjc93/546/base 2025-09-07T07:36:19.7250351Z * [new branch] gh/bobrenjc93/546/head -> origin/gh/bobrenjc93/546/head 2025-09-07T07:36:19.7251543Z * [new branch] gh/bobrenjc93/546/orig -> origin/gh/bobrenjc93/546/orig 2025-09-07T07:36:19.7253889Z * [new branch] gh/bobrenjc93/547/base -> origin/gh/bobrenjc93/547/base 2025-09-07T07:36:19.7255111Z * [new branch] gh/bobrenjc93/547/head -> origin/gh/bobrenjc93/547/head 2025-09-07T07:36:19.7256348Z * [new branch] gh/bobrenjc93/547/orig -> origin/gh/bobrenjc93/547/orig 2025-09-07T07:36:19.7258086Z * [new branch] gh/bobrenjc93/548/base -> origin/gh/bobrenjc93/548/base 2025-09-07T07:36:19.7259205Z * [new branch] gh/bobrenjc93/548/head -> origin/gh/bobrenjc93/548/head 2025-09-07T07:36:19.7260385Z * [new branch] gh/bobrenjc93/548/orig -> origin/gh/bobrenjc93/548/orig 2025-09-07T07:36:19.7262033Z * [new branch] gh/bobrenjc93/549/base -> origin/gh/bobrenjc93/549/base 2025-09-07T07:36:19.7263323Z * [new branch] gh/bobrenjc93/549/head -> origin/gh/bobrenjc93/549/head 2025-09-07T07:36:19.7264542Z * [new branch] gh/bobrenjc93/549/orig -> origin/gh/bobrenjc93/549/orig 2025-09-07T07:36:19.7266555Z * [new branch] gh/bobrenjc93/550/base -> origin/gh/bobrenjc93/550/base 2025-09-07T07:36:19.7267738Z * [new branch] gh/bobrenjc93/550/head -> origin/gh/bobrenjc93/550/head 2025-09-07T07:36:19.7268938Z * [new branch] gh/bobrenjc93/550/orig -> origin/gh/bobrenjc93/550/orig 2025-09-07T07:36:19.7270941Z * [new branch] gh/bobrenjc93/551/base -> origin/gh/bobrenjc93/551/base 2025-09-07T07:36:19.7272347Z * [new branch] gh/bobrenjc93/551/head -> origin/gh/bobrenjc93/551/head 2025-09-07T07:36:19.7273533Z * [new branch] gh/bobrenjc93/551/orig -> origin/gh/bobrenjc93/551/orig 2025-09-07T07:36:19.7275486Z * [new branch] gh/bobrenjc93/552/base -> origin/gh/bobrenjc93/552/base 2025-09-07T07:36:19.7276587Z * [new branch] gh/bobrenjc93/552/head -> origin/gh/bobrenjc93/552/head 2025-09-07T07:36:19.7277783Z * [new branch] gh/bobrenjc93/552/orig -> origin/gh/bobrenjc93/552/orig 2025-09-07T07:36:19.7279569Z * [new branch] gh/bobrenjc93/553/base -> origin/gh/bobrenjc93/553/base 2025-09-07T07:36:19.7280794Z * [new branch] gh/bobrenjc93/553/head -> origin/gh/bobrenjc93/553/head 2025-09-07T07:36:19.7282012Z * [new branch] gh/bobrenjc93/553/orig -> origin/gh/bobrenjc93/553/orig 2025-09-07T07:36:19.7283853Z * [new branch] gh/bobrenjc93/554/base -> origin/gh/bobrenjc93/554/base 2025-09-07T07:36:19.7284781Z * [new branch] gh/bobrenjc93/554/head -> origin/gh/bobrenjc93/554/head 2025-09-07T07:36:19.7285999Z * [new branch] gh/bobrenjc93/554/orig -> origin/gh/bobrenjc93/554/orig 2025-09-07T07:36:19.7287863Z * [new branch] gh/bobrenjc93/555/base -> origin/gh/bobrenjc93/555/base 2025-09-07T07:36:19.7288989Z * [new branch] gh/bobrenjc93/555/head -> origin/gh/bobrenjc93/555/head 2025-09-07T07:36:19.7290207Z * [new branch] gh/bobrenjc93/555/orig -> origin/gh/bobrenjc93/555/orig 2025-09-07T07:36:19.7291983Z * [new branch] gh/bobrenjc93/556/base -> origin/gh/bobrenjc93/556/base 2025-09-07T07:36:19.7293153Z * [new branch] gh/bobrenjc93/556/head -> origin/gh/bobrenjc93/556/head 2025-09-07T07:36:19.7294327Z * [new branch] gh/bobrenjc93/556/orig -> origin/gh/bobrenjc93/556/orig 2025-09-07T07:36:19.7296493Z * [new branch] gh/briancoutinho/2/base -> origin/gh/briancoutinho/2/base 2025-09-07T07:36:19.7297780Z * [new branch] gh/briancoutinho/2/head -> origin/gh/briancoutinho/2/head 2025-09-07T07:36:19.7300042Z * [new branch] gh/c00w/23/base -> origin/gh/c00w/23/base 2025-09-07T07:36:19.7301152Z * [new branch] gh/c00w/23/head -> origin/gh/c00w/23/head 2025-09-07T07:36:19.7302935Z * [new branch] gh/c00w/48/base -> origin/gh/c00w/48/base 2025-09-07T07:36:19.7304163Z * [new branch] gh/c00w/48/head -> origin/gh/c00w/48/head 2025-09-07T07:36:19.7305373Z * [new branch] gh/c00w/48/orig -> origin/gh/c00w/48/orig 2025-09-07T07:36:19.7307216Z * [new branch] gh/c00w/53/base -> origin/gh/c00w/53/base 2025-09-07T07:36:19.7308501Z * [new branch] gh/c00w/53/head -> origin/gh/c00w/53/head 2025-09-07T07:36:19.7310309Z * [new branch] gh/c00w/53/orig -> origin/gh/c00w/53/orig 2025-09-07T07:36:19.7314766Z * [new branch] gh/c00w/54/base -> origin/gh/c00w/54/base 2025-09-07T07:36:19.7315953Z * [new branch] gh/c00w/54/head -> origin/gh/c00w/54/head 2025-09-07T07:36:19.7317178Z * [new branch] gh/c00w/54/orig -> origin/gh/c00w/54/orig 2025-09-07T07:36:19.7318843Z * [new branch] gh/c00w/55/base -> origin/gh/c00w/55/base 2025-09-07T07:36:19.7320181Z * [new branch] gh/c00w/55/head -> origin/gh/c00w/55/head 2025-09-07T07:36:19.7321400Z * [new branch] gh/c00w/55/orig -> origin/gh/c00w/55/orig 2025-09-07T07:36:19.7323103Z * [new branch] gh/c00w/56/base -> origin/gh/c00w/56/base 2025-09-07T07:36:19.7324339Z * [new branch] gh/c00w/56/head -> origin/gh/c00w/56/head 2025-09-07T07:36:19.7325624Z * [new branch] gh/c00w/56/orig -> origin/gh/c00w/56/orig 2025-09-07T07:36:19.7327744Z * [new branch] gh/clee2000/1/base -> origin/gh/clee2000/1/base 2025-09-07T07:36:19.7329253Z * [new branch] gh/clee2000/1/head -> origin/gh/clee2000/1/head 2025-09-07T07:36:19.7330333Z * [new branch] gh/clee2000/1/orig -> origin/gh/clee2000/1/orig 2025-09-07T07:36:19.7332476Z * [new branch] gh/coconutruben/1/base -> origin/gh/coconutruben/1/base 2025-09-07T07:36:19.7333769Z * [new branch] gh/coconutruben/1/head -> origin/gh/coconutruben/1/head 2025-09-07T07:36:19.7335613Z * [new branch] gh/coconutruben/11/base -> origin/gh/coconutruben/11/base 2025-09-07T07:36:19.7336878Z * [new branch] gh/coconutruben/11/head -> origin/gh/coconutruben/11/head 2025-09-07T07:36:19.7338167Z * [new branch] gh/coconutruben/11/orig -> origin/gh/coconutruben/11/orig 2025-09-07T07:36:19.7340304Z * [new branch] gh/coconutruben/12/base -> origin/gh/coconutruben/12/base 2025-09-07T07:36:19.7341735Z * [new branch] gh/coconutruben/12/head -> origin/gh/coconutruben/12/head 2025-09-07T07:36:19.7343125Z * [new branch] gh/coconutruben/12/orig -> origin/gh/coconutruben/12/orig 2025-09-07T07:36:19.7344842Z * [new branch] gh/coconutruben/13/base -> origin/gh/coconutruben/13/base 2025-09-07T07:36:19.7346172Z * [new branch] gh/coconutruben/13/head -> origin/gh/coconutruben/13/head 2025-09-07T07:36:19.7347444Z * [new branch] gh/coconutruben/13/orig -> origin/gh/coconutruben/13/orig 2025-09-07T07:36:19.7349408Z * [new branch] gh/coconutruben/14/base -> origin/gh/coconutruben/14/base 2025-09-07T07:36:19.7350647Z * [new branch] gh/coconutruben/14/head -> origin/gh/coconutruben/14/head 2025-09-07T07:36:19.7351859Z * [new branch] gh/coconutruben/14/orig -> origin/gh/coconutruben/14/orig 2025-09-07T07:36:19.7353819Z * [new branch] gh/coconutruben/15/base -> origin/gh/coconutruben/15/base 2025-09-07T07:36:19.7355137Z * [new branch] gh/coconutruben/15/head -> origin/gh/coconutruben/15/head 2025-09-07T07:36:19.7356536Z * [new branch] gh/coconutruben/15/orig -> origin/gh/coconutruben/15/orig 2025-09-07T07:36:19.7358259Z * [new branch] gh/coconutruben/16/base -> origin/gh/coconutruben/16/base 2025-09-07T07:36:19.7359434Z * [new branch] gh/coconutruben/16/head -> origin/gh/coconutruben/16/head 2025-09-07T07:36:19.7360643Z * [new branch] gh/coconutruben/16/orig -> origin/gh/coconutruben/16/orig 2025-09-07T07:36:19.7362555Z * [new branch] gh/coconutruben/17/base -> origin/gh/coconutruben/17/base 2025-09-07T07:36:19.7363844Z * [new branch] gh/coconutruben/17/head -> origin/gh/coconutruben/17/head 2025-09-07T07:36:19.7365116Z * [new branch] gh/coconutruben/17/orig -> origin/gh/coconutruben/17/orig 2025-09-07T07:36:19.7366922Z * [new branch] gh/coconutruben/18/base -> origin/gh/coconutruben/18/base 2025-09-07T07:36:19.7368186Z * [new branch] gh/coconutruben/18/head -> origin/gh/coconutruben/18/head 2025-09-07T07:36:19.7369385Z * [new branch] gh/coconutruben/18/orig -> origin/gh/coconutruben/18/orig 2025-09-07T07:36:19.7371187Z * [new branch] gh/coconutruben/19/base -> origin/gh/coconutruben/19/base 2025-09-07T07:36:19.7372471Z * [new branch] gh/coconutruben/19/head -> origin/gh/coconutruben/19/head 2025-09-07T07:36:19.7373795Z * [new branch] gh/coconutruben/19/orig -> origin/gh/coconutruben/19/orig 2025-09-07T07:36:19.7375768Z * [new branch] gh/coconutruben/20/base -> origin/gh/coconutruben/20/base 2025-09-07T07:36:19.7377048Z * [new branch] gh/coconutruben/20/head -> origin/gh/coconutruben/20/head 2025-09-07T07:36:19.7378281Z * [new branch] gh/coconutruben/20/orig -> origin/gh/coconutruben/20/orig 2025-09-07T07:36:19.7380063Z * [new branch] gh/coconutruben/21/base -> origin/gh/coconutruben/21/base 2025-09-07T07:36:19.7381308Z * [new branch] gh/coconutruben/21/head -> origin/gh/coconutruben/21/head 2025-09-07T07:36:19.7382428Z * [new branch] gh/coconutruben/21/orig -> origin/gh/coconutruben/21/orig 2025-09-07T07:36:19.7384231Z * [new branch] gh/coconutruben/22/base -> origin/gh/coconutruben/22/base 2025-09-07T07:36:19.7385576Z * [new branch] gh/coconutruben/22/head -> origin/gh/coconutruben/22/head 2025-09-07T07:36:19.7386989Z * [new branch] gh/coconutruben/22/orig -> origin/gh/coconutruben/22/orig 2025-09-07T07:36:19.7388778Z * [new branch] gh/coconutruben/24/base -> origin/gh/coconutruben/24/base 2025-09-07T07:36:19.7390088Z * [new branch] gh/coconutruben/24/head -> origin/gh/coconutruben/24/head 2025-09-07T07:36:19.7391385Z * [new branch] gh/coconutruben/24/orig -> origin/gh/coconutruben/24/orig 2025-09-07T07:36:19.7393421Z * [new branch] gh/coconutruben/25/base -> origin/gh/coconutruben/25/base 2025-09-07T07:36:19.7394916Z * [new branch] gh/coconutruben/25/head -> origin/gh/coconutruben/25/head 2025-09-07T07:36:19.7396313Z * [new branch] gh/coconutruben/25/orig -> origin/gh/coconutruben/25/orig 2025-09-07T07:36:19.7398076Z * [new branch] gh/coconutruben/28/base -> origin/gh/coconutruben/28/base 2025-09-07T07:36:19.7399307Z * [new branch] gh/coconutruben/28/head -> origin/gh/coconutruben/28/head 2025-09-07T07:36:19.7400508Z * [new branch] gh/coconutruben/28/orig -> origin/gh/coconutruben/28/orig 2025-09-07T07:36:19.7402347Z * [new branch] gh/coconutruben/29/base -> origin/gh/coconutruben/29/base 2025-09-07T07:36:19.7403590Z * [new branch] gh/coconutruben/29/head -> origin/gh/coconutruben/29/head 2025-09-07T07:36:19.7404844Z * [new branch] gh/coconutruben/29/orig -> origin/gh/coconutruben/29/orig 2025-09-07T07:36:19.7406620Z * [new branch] gh/coconutruben/30/base -> origin/gh/coconutruben/30/base 2025-09-07T07:36:19.7407860Z * [new branch] gh/coconutruben/30/head -> origin/gh/coconutruben/30/head 2025-09-07T07:36:19.7409158Z * [new branch] gh/coconutruben/30/orig -> origin/gh/coconutruben/30/orig 2025-09-07T07:36:19.7411675Z * [new branch] gh/coconutruben/31/base -> origin/gh/coconutruben/31/base 2025-09-07T07:36:19.7412986Z * [new branch] gh/coconutruben/31/head -> origin/gh/coconutruben/31/head 2025-09-07T07:36:19.7414248Z * [new branch] gh/coconutruben/31/orig -> origin/gh/coconutruben/31/orig 2025-09-07T07:36:19.7416213Z * [new branch] gh/coconutruben/32/base -> origin/gh/coconutruben/32/base 2025-09-07T07:36:19.7417519Z * [new branch] gh/coconutruben/32/head -> origin/gh/coconutruben/32/head 2025-09-07T07:36:19.7418798Z * [new branch] gh/coconutruben/32/orig -> origin/gh/coconutruben/32/orig 2025-09-07T07:36:19.7420844Z * [new branch] gh/coconutruben/33/base -> origin/gh/coconutruben/33/base 2025-09-07T07:36:19.7422132Z * [new branch] gh/coconutruben/33/head -> origin/gh/coconutruben/33/head 2025-09-07T07:36:19.7423374Z * [new branch] gh/coconutruben/33/orig -> origin/gh/coconutruben/33/orig 2025-09-07T07:36:19.7425251Z * [new branch] gh/coconutruben/34/base -> origin/gh/coconutruben/34/base 2025-09-07T07:36:19.7426500Z * [new branch] gh/coconutruben/34/head -> origin/gh/coconutruben/34/head 2025-09-07T07:36:19.7427738Z * [new branch] gh/coconutruben/34/orig -> origin/gh/coconutruben/34/orig 2025-09-07T07:36:19.7429552Z * [new branch] gh/coconutruben/35/base -> origin/gh/coconutruben/35/base 2025-09-07T07:36:19.7430783Z * [new branch] gh/coconutruben/35/head -> origin/gh/coconutruben/35/head 2025-09-07T07:36:19.7432128Z * [new branch] gh/coconutruben/35/orig -> origin/gh/coconutruben/35/orig 2025-09-07T07:36:19.7434910Z * [new branch] gh/coconutruben/36/base -> origin/gh/coconutruben/36/base 2025-09-07T07:36:19.7436482Z * [new branch] gh/coconutruben/36/head -> origin/gh/coconutruben/36/head 2025-09-07T07:36:19.7438272Z * [new branch] gh/coconutruben/36/orig -> origin/gh/coconutruben/36/orig 2025-09-07T07:36:19.7440292Z * [new branch] gh/coconutruben/37/base -> origin/gh/coconutruben/37/base 2025-09-07T07:36:19.7441440Z * [new branch] gh/coconutruben/37/head -> origin/gh/coconutruben/37/head 2025-09-07T07:36:19.7442690Z * [new branch] gh/coconutruben/37/orig -> origin/gh/coconutruben/37/orig 2025-09-07T07:36:19.7444521Z * [new branch] gh/coconutruben/38/base -> origin/gh/coconutruben/38/base 2025-09-07T07:36:19.7445836Z * [new branch] gh/coconutruben/38/head -> origin/gh/coconutruben/38/head 2025-09-07T07:36:19.7447121Z * [new branch] gh/coconutruben/38/orig -> origin/gh/coconutruben/38/orig 2025-09-07T07:36:19.7449014Z * [new branch] gh/coconutruben/39/base -> origin/gh/coconutruben/39/base 2025-09-07T07:36:19.7450180Z * [new branch] gh/coconutruben/39/head -> origin/gh/coconutruben/39/head 2025-09-07T07:36:19.7451399Z * [new branch] gh/coconutruben/39/orig -> origin/gh/coconutruben/39/orig 2025-09-07T07:36:19.7453358Z * [new branch] gh/coconutruben/40/base -> origin/gh/coconutruben/40/base 2025-09-07T07:36:19.7454535Z * [new branch] gh/coconutruben/40/head -> origin/gh/coconutruben/40/head 2025-09-07T07:36:19.7455720Z * [new branch] gh/coconutruben/40/orig -> origin/gh/coconutruben/40/orig 2025-09-07T07:36:19.7457733Z * [new branch] gh/coconutruben/41/base -> origin/gh/coconutruben/41/base 2025-09-07T07:36:19.7458968Z * [new branch] gh/coconutruben/41/head -> origin/gh/coconutruben/41/head 2025-09-07T07:36:19.7460179Z * [new branch] gh/coconutruben/41/orig -> origin/gh/coconutruben/41/orig 2025-09-07T07:36:19.7462161Z * [new branch] gh/coconutruben/42/base -> origin/gh/coconutruben/42/base 2025-09-07T07:36:19.7463509Z * [new branch] gh/coconutruben/42/head -> origin/gh/coconutruben/42/head 2025-09-07T07:36:19.7464835Z * [new branch] gh/coconutruben/42/orig -> origin/gh/coconutruben/42/orig 2025-09-07T07:36:19.7466853Z * [new branch] gh/coconutruben/43/base -> origin/gh/coconutruben/43/base 2025-09-07T07:36:19.7468141Z * [new branch] gh/coconutruben/43/head -> origin/gh/coconutruben/43/head 2025-09-07T07:36:19.7469457Z * [new branch] gh/coconutruben/43/orig -> origin/gh/coconutruben/43/orig 2025-09-07T07:36:19.7471431Z * [new branch] gh/coconutruben/44/base -> origin/gh/coconutruben/44/base 2025-09-07T07:36:19.7472715Z * [new branch] gh/coconutruben/44/head -> origin/gh/coconutruben/44/head 2025-09-07T07:36:19.7473969Z * [new branch] gh/coconutruben/44/orig -> origin/gh/coconutruben/44/orig 2025-09-07T07:36:19.7475903Z * [new branch] gh/coconutruben/45/base -> origin/gh/coconutruben/45/base 2025-09-07T07:36:19.7477151Z * [new branch] gh/coconutruben/45/head -> origin/gh/coconutruben/45/head 2025-09-07T07:36:19.7478412Z * [new branch] gh/coconutruben/45/orig -> origin/gh/coconutruben/45/orig 2025-09-07T07:36:19.7480240Z * [new branch] gh/coconutruben/46/base -> origin/gh/coconutruben/46/base 2025-09-07T07:36:19.7481487Z * [new branch] gh/coconutruben/46/head -> origin/gh/coconutruben/46/head 2025-09-07T07:36:19.7482797Z * [new branch] gh/coconutruben/46/orig -> origin/gh/coconutruben/46/orig 2025-09-07T07:36:19.7484769Z * [new branch] gh/coconutruben/47/base -> origin/gh/coconutruben/47/base 2025-09-07T07:36:19.7485972Z * [new branch] gh/coconutruben/47/head -> origin/gh/coconutruben/47/head 2025-09-07T07:36:19.7487203Z * [new branch] gh/coconutruben/47/orig -> origin/gh/coconutruben/47/orig 2025-09-07T07:36:19.7489170Z * [new branch] gh/coconutruben/48/base -> origin/gh/coconutruben/48/base 2025-09-07T07:36:19.7490452Z * [new branch] gh/coconutruben/48/head -> origin/gh/coconutruben/48/head 2025-09-07T07:36:19.7491706Z * [new branch] gh/coconutruben/48/orig -> origin/gh/coconutruben/48/orig 2025-09-07T07:36:19.7493731Z * [new branch] gh/coconutruben/49/base -> origin/gh/coconutruben/49/base 2025-09-07T07:36:19.7494975Z * [new branch] gh/coconutruben/49/head -> origin/gh/coconutruben/49/head 2025-09-07T07:36:19.7496203Z * [new branch] gh/coconutruben/49/orig -> origin/gh/coconutruben/49/orig 2025-09-07T07:36:19.7498050Z * [new branch] gh/coconutruben/50/base -> origin/gh/coconutruben/50/base 2025-09-07T07:36:19.7499340Z * [new branch] gh/coconutruben/50/head -> origin/gh/coconutruben/50/head 2025-09-07T07:36:19.7500839Z * [new branch] gh/coconutruben/50/orig -> origin/gh/coconutruben/50/orig 2025-09-07T07:36:19.7502590Z * [new branch] gh/coconutruben/51/base -> origin/gh/coconutruben/51/base 2025-09-07T07:36:19.7503846Z * [new branch] gh/coconutruben/51/head -> origin/gh/coconutruben/51/head 2025-09-07T07:36:19.7505156Z * [new branch] gh/coconutruben/51/orig -> origin/gh/coconutruben/51/orig 2025-09-07T07:36:19.7507262Z * [new branch] gh/coconutruben/52/base -> origin/gh/coconutruben/52/base 2025-09-07T07:36:19.7508535Z * [new branch] gh/coconutruben/52/head -> origin/gh/coconutruben/52/head 2025-09-07T07:36:19.7509949Z * [new branch] gh/coconutruben/52/orig -> origin/gh/coconutruben/52/orig 2025-09-07T07:36:19.7512449Z * [new branch] gh/coconutruben/53/base -> origin/gh/coconutruben/53/base 2025-09-07T07:36:19.7513115Z * [new branch] gh/coconutruben/53/head -> origin/gh/coconutruben/53/head 2025-09-07T07:36:19.7514370Z * [new branch] gh/coconutruben/53/orig -> origin/gh/coconutruben/53/orig 2025-09-07T07:36:19.7516215Z * [new branch] gh/coconutruben/54/base -> origin/gh/coconutruben/54/base 2025-09-07T07:36:19.7517515Z * [new branch] gh/coconutruben/54/head -> origin/gh/coconutruben/54/head 2025-09-07T07:36:19.7518783Z * [new branch] gh/coconutruben/54/orig -> origin/gh/coconutruben/54/orig 2025-09-07T07:36:19.7520645Z * [new branch] gh/coconutruben/55/base -> origin/gh/coconutruben/55/base 2025-09-07T07:36:19.7521847Z * [new branch] gh/coconutruben/55/head -> origin/gh/coconutruben/55/head 2025-09-07T07:36:19.7523136Z * [new branch] gh/coconutruben/55/orig -> origin/gh/coconutruben/55/orig 2025-09-07T07:36:19.7525016Z * [new branch] gh/coconutruben/56/base -> origin/gh/coconutruben/56/base 2025-09-07T07:36:19.7526266Z * [new branch] gh/coconutruben/56/head -> origin/gh/coconutruben/56/head 2025-09-07T07:36:19.7527525Z * [new branch] gh/coconutruben/56/orig -> origin/gh/coconutruben/56/orig 2025-09-07T07:36:19.7529469Z * [new branch] gh/coconutruben/57/base -> origin/gh/coconutruben/57/base 2025-09-07T07:36:19.7530764Z * [new branch] gh/coconutruben/57/head -> origin/gh/coconutruben/57/head 2025-09-07T07:36:19.7532086Z * [new branch] gh/coconutruben/57/orig -> origin/gh/coconutruben/57/orig 2025-09-07T07:36:19.7534173Z * [new branch] gh/coconutruben/58/base -> origin/gh/coconutruben/58/base 2025-09-07T07:36:19.7535858Z * [new branch] gh/coconutruben/58/head -> origin/gh/coconutruben/58/head 2025-09-07T07:36:19.7536824Z * [new branch] gh/coconutruben/58/orig -> origin/gh/coconutruben/58/orig 2025-09-07T07:36:19.7538900Z * [new branch] gh/coconutruben/59/base -> origin/gh/coconutruben/59/base 2025-09-07T07:36:19.7540047Z * [new branch] gh/coconutruben/59/head -> origin/gh/coconutruben/59/head 2025-09-07T07:36:19.7541221Z * [new branch] gh/coconutruben/59/orig -> origin/gh/coconutruben/59/orig 2025-09-07T07:36:19.7543033Z * [new branch] gh/coconutruben/60/base -> origin/gh/coconutruben/60/base 2025-09-07T07:36:19.7544290Z * [new branch] gh/coconutruben/60/head -> origin/gh/coconutruben/60/head 2025-09-07T07:36:19.7545561Z * [new branch] gh/coconutruben/60/orig -> origin/gh/coconutruben/60/orig 2025-09-07T07:36:19.7547521Z * [new branch] gh/coconutruben/61/base -> origin/gh/coconutruben/61/base 2025-09-07T07:36:19.7548900Z * [new branch] gh/coconutruben/61/head -> origin/gh/coconutruben/61/head 2025-09-07T07:36:19.7550125Z * [new branch] gh/coconutruben/61/orig -> origin/gh/coconutruben/61/orig 2025-09-07T07:36:19.7552104Z * [new branch] gh/coconutruben/62/base -> origin/gh/coconutruben/62/base 2025-09-07T07:36:19.7553329Z * [new branch] gh/coconutruben/62/head -> origin/gh/coconutruben/62/head 2025-09-07T07:36:19.7554694Z * [new branch] gh/coconutruben/62/orig -> origin/gh/coconutruben/62/orig 2025-09-07T07:36:19.7556648Z * [new branch] gh/coconutruben/63/base -> origin/gh/coconutruben/63/base 2025-09-07T07:36:19.7557936Z * [new branch] gh/coconutruben/63/head -> origin/gh/coconutruben/63/head 2025-09-07T07:36:19.7559195Z * [new branch] gh/coconutruben/63/orig -> origin/gh/coconutruben/63/orig 2025-09-07T07:36:19.7560983Z * [new branch] gh/coconutruben/64/base -> origin/gh/coconutruben/64/base 2025-09-07T07:36:19.7562315Z * [new branch] gh/coconutruben/64/head -> origin/gh/coconutruben/64/head 2025-09-07T07:36:19.7563537Z * [new branch] gh/coconutruben/64/orig -> origin/gh/coconutruben/64/orig 2025-09-07T07:36:19.7565361Z * [new branch] gh/coconutruben/65/base -> origin/gh/coconutruben/65/base 2025-09-07T07:36:19.7566625Z * [new branch] gh/coconutruben/65/head -> origin/gh/coconutruben/65/head 2025-09-07T07:36:19.7567840Z * [new branch] gh/coconutruben/65/orig -> origin/gh/coconutruben/65/orig 2025-09-07T07:36:19.7569691Z * [new branch] gh/coconutruben/66/base -> origin/gh/coconutruben/66/base 2025-09-07T07:36:19.7570889Z * [new branch] gh/coconutruben/66/head -> origin/gh/coconutruben/66/head 2025-09-07T07:36:19.7572362Z * [new branch] gh/coconutruben/66/orig -> origin/gh/coconutruben/66/orig 2025-09-07T07:36:19.7574654Z * [new branch] gh/codingwithsurya/12/base -> origin/gh/codingwithsurya/12/base 2025-09-07T07:36:19.7576153Z * [new branch] gh/codingwithsurya/12/head -> origin/gh/codingwithsurya/12/head 2025-09-07T07:36:19.7577640Z * [new branch] gh/codingwithsurya/12/orig -> origin/gh/codingwithsurya/12/orig 2025-09-07T07:36:19.7579146Z * [new branch] gh/codingwithsurya/14/base -> origin/gh/codingwithsurya/14/base 2025-09-07T07:36:19.7580394Z * [new branch] gh/codingwithsurya/14/head -> origin/gh/codingwithsurya/14/head 2025-09-07T07:36:19.7581592Z * [new branch] gh/codingwithsurya/14/orig -> origin/gh/codingwithsurya/14/orig 2025-09-07T07:36:19.7583456Z * [new branch] gh/codingwithsurya/15/base -> origin/gh/codingwithsurya/15/base 2025-09-07T07:36:19.7584716Z * [new branch] gh/codingwithsurya/15/head -> origin/gh/codingwithsurya/15/head 2025-09-07T07:36:19.7586037Z * [new branch] gh/codingwithsurya/15/orig -> origin/gh/codingwithsurya/15/orig 2025-09-07T07:36:19.7587922Z * [new branch] gh/codingwithsurya/16/base -> origin/gh/codingwithsurya/16/base 2025-09-07T07:36:19.7589274Z * [new branch] gh/codingwithsurya/16/head -> origin/gh/codingwithsurya/16/head 2025-09-07T07:36:19.7590483Z * [new branch] gh/codingwithsurya/16/orig -> origin/gh/codingwithsurya/16/orig 2025-09-07T07:36:19.7592370Z * [new branch] gh/codingwithsurya/17/base -> origin/gh/codingwithsurya/17/base 2025-09-07T07:36:19.7593649Z * [new branch] gh/codingwithsurya/17/head -> origin/gh/codingwithsurya/17/head 2025-09-07T07:36:19.7594901Z * [new branch] gh/codingwithsurya/17/orig -> origin/gh/codingwithsurya/17/orig 2025-09-07T07:36:19.7596769Z * [new branch] gh/codingwithsurya/18/base -> origin/gh/codingwithsurya/18/base 2025-09-07T07:36:19.7598025Z * [new branch] gh/codingwithsurya/18/head -> origin/gh/codingwithsurya/18/head 2025-09-07T07:36:19.7599230Z * [new branch] gh/codingwithsurya/18/orig -> origin/gh/codingwithsurya/18/orig 2025-09-07T07:36:19.7601111Z * [new branch] gh/codingwithsurya/19/base -> origin/gh/codingwithsurya/19/base 2025-09-07T07:36:19.7602356Z * [new branch] gh/codingwithsurya/19/head -> origin/gh/codingwithsurya/19/head 2025-09-07T07:36:19.7603568Z * [new branch] gh/codingwithsurya/19/orig -> origin/gh/codingwithsurya/19/orig 2025-09-07T07:36:19.7605288Z * [new branch] gh/codingwithsurya/20/base -> origin/gh/codingwithsurya/20/base 2025-09-07T07:36:19.7606503Z * [new branch] gh/codingwithsurya/20/head -> origin/gh/codingwithsurya/20/head 2025-09-07T07:36:19.7607768Z * [new branch] gh/codingwithsurya/20/orig -> origin/gh/codingwithsurya/20/orig 2025-09-07T07:36:19.7609754Z * [new branch] gh/codingwithsurya/21/base -> origin/gh/codingwithsurya/21/base 2025-09-07T07:36:19.7611115Z * [new branch] gh/codingwithsurya/21/head -> origin/gh/codingwithsurya/21/head 2025-09-07T07:36:19.7612448Z * [new branch] gh/codingwithsurya/21/orig -> origin/gh/codingwithsurya/21/orig 2025-09-07T07:36:19.7614654Z * [new branch] gh/colinchan15/1/base -> origin/gh/colinchan15/1/base 2025-09-07T07:36:19.7615856Z * [new branch] gh/colinchan15/1/head -> origin/gh/colinchan15/1/head 2025-09-07T07:36:19.7617425Z * [new branch] gh/colinchan15/2/base -> origin/gh/colinchan15/2/base 2025-09-07T07:36:19.7618579Z * [new branch] gh/colinchan15/2/head -> origin/gh/colinchan15/2/head 2025-09-07T07:36:19.7620158Z * [new branch] gh/colinchan15/3/base -> origin/gh/colinchan15/3/base 2025-09-07T07:36:19.7621261Z * [new branch] gh/colinchan15/3/head -> origin/gh/colinchan15/3/head 2025-09-07T07:36:19.7622955Z * [new branch] gh/colinchan15/6/base -> origin/gh/colinchan15/6/base 2025-09-07T07:36:19.7624096Z * [new branch] gh/colinchan15/6/head -> origin/gh/colinchan15/6/head 2025-09-07T07:36:19.7626371Z * [new branch] gh/davidberard98/382/base -> origin/gh/davidberard98/382/base 2025-09-07T07:36:19.7627750Z * [new branch] gh/davidberard98/382/head -> origin/gh/davidberard98/382/head 2025-09-07T07:36:19.7628972Z * [new branch] gh/davidberard98/382/orig -> origin/gh/davidberard98/382/orig 2025-09-07T07:36:19.7630686Z * [new branch] gh/davidberard98/386/base -> origin/gh/davidberard98/386/base 2025-09-07T07:36:19.7631915Z * [new branch] gh/davidberard98/386/head -> origin/gh/davidberard98/386/head 2025-09-07T07:36:19.7633127Z * [new branch] gh/davidberard98/386/orig -> origin/gh/davidberard98/386/orig 2025-09-07T07:36:19.7634858Z * [new branch] gh/davidberard98/391/base -> origin/gh/davidberard98/391/base 2025-09-07T07:36:19.7636127Z * [new branch] gh/davidberard98/391/head -> origin/gh/davidberard98/391/head 2025-09-07T07:36:19.7637233Z * [new branch] gh/davidberard98/391/orig -> origin/gh/davidberard98/391/orig 2025-09-07T07:36:19.7638996Z * [new branch] gh/davidberard98/392/base -> origin/gh/davidberard98/392/base 2025-09-07T07:36:19.7640176Z * [new branch] gh/davidberard98/392/head -> origin/gh/davidberard98/392/head 2025-09-07T07:36:19.7641365Z * [new branch] gh/davidberard98/392/orig -> origin/gh/davidberard98/392/orig 2025-09-07T07:36:19.7643216Z * [new branch] gh/davidberard98/394/base -> origin/gh/davidberard98/394/base 2025-09-07T07:36:19.7644893Z * [new branch] gh/davidberard98/394/head -> origin/gh/davidberard98/394/head 2025-09-07T07:36:19.7645672Z * [new branch] gh/davidberard98/394/orig -> origin/gh/davidberard98/394/orig 2025-09-07T07:36:19.7647389Z * [new branch] gh/davidberard98/396/base -> origin/gh/davidberard98/396/base 2025-09-07T07:36:19.7648574Z * [new branch] gh/davidberard98/396/head -> origin/gh/davidberard98/396/head 2025-09-07T07:36:19.7649960Z * [new branch] gh/davidberard98/396/orig -> origin/gh/davidberard98/396/orig 2025-09-07T07:36:19.7651859Z * [new branch] gh/davidberard98/397/base -> origin/gh/davidberard98/397/base 2025-09-07T07:36:19.7653169Z * [new branch] gh/davidberard98/397/head -> origin/gh/davidberard98/397/head 2025-09-07T07:36:19.7654388Z * [new branch] gh/davidberard98/397/orig -> origin/gh/davidberard98/397/orig 2025-09-07T07:36:19.7656204Z * [new branch] gh/davidberard98/398/base -> origin/gh/davidberard98/398/base 2025-09-07T07:36:19.7657265Z * [new branch] gh/davidberard98/398/head -> origin/gh/davidberard98/398/head 2025-09-07T07:36:19.7658511Z * [new branch] gh/davidberard98/398/orig -> origin/gh/davidberard98/398/orig 2025-09-07T07:36:19.7660283Z * [new branch] gh/davidberard98/399/base -> origin/gh/davidberard98/399/base 2025-09-07T07:36:19.7661532Z * [new branch] gh/davidberard98/399/head -> origin/gh/davidberard98/399/head 2025-09-07T07:36:19.7662740Z * [new branch] gh/davidberard98/399/orig -> origin/gh/davidberard98/399/orig 2025-09-07T07:36:19.7664533Z * [new branch] gh/davidberard98/400/base -> origin/gh/davidberard98/400/base 2025-09-07T07:36:19.7665788Z * [new branch] gh/davidberard98/400/head -> origin/gh/davidberard98/400/head 2025-09-07T07:36:19.7667021Z * [new branch] gh/davidberard98/400/orig -> origin/gh/davidberard98/400/orig 2025-09-07T07:36:19.7668711Z * [new branch] gh/davidberard98/401/base -> origin/gh/davidberard98/401/base 2025-09-07T07:36:19.7669920Z * [new branch] gh/davidberard98/401/head -> origin/gh/davidberard98/401/head 2025-09-07T07:36:19.7671090Z * [new branch] gh/davidberard98/401/orig -> origin/gh/davidberard98/401/orig 2025-09-07T07:36:19.7672847Z * [new branch] gh/davidberard98/402/base -> origin/gh/davidberard98/402/base 2025-09-07T07:36:19.7674029Z * [new branch] gh/davidberard98/402/head -> origin/gh/davidberard98/402/head 2025-09-07T07:36:19.7675232Z * [new branch] gh/davidberard98/402/orig -> origin/gh/davidberard98/402/orig 2025-09-07T07:36:19.7676968Z * [new branch] gh/davidberard98/403/base -> origin/gh/davidberard98/403/base 2025-09-07T07:36:19.7678186Z * [new branch] gh/davidberard98/403/head -> origin/gh/davidberard98/403/head 2025-09-07T07:36:19.7679373Z * [new branch] gh/davidberard98/403/orig -> origin/gh/davidberard98/403/orig 2025-09-07T07:36:19.7681210Z * [new branch] gh/davidberard98/404/base -> origin/gh/davidberard98/404/base 2025-09-07T07:36:19.7682422Z * [new branch] gh/davidberard98/404/head -> origin/gh/davidberard98/404/head 2025-09-07T07:36:19.7683494Z * [new branch] gh/davidberard98/404/orig -> origin/gh/davidberard98/404/orig 2025-09-07T07:36:19.7685351Z * [new branch] gh/davidberard98/405/base -> origin/gh/davidberard98/405/base 2025-09-07T07:36:19.7686561Z * [new branch] gh/davidberard98/405/head -> origin/gh/davidberard98/405/head 2025-09-07T07:36:19.7687757Z * [new branch] gh/davidberard98/405/orig -> origin/gh/davidberard98/405/orig 2025-09-07T07:36:19.7689671Z * [new branch] gh/davidberard98/406/base -> origin/gh/davidberard98/406/base 2025-09-07T07:36:19.7690969Z * [new branch] gh/davidberard98/406/head -> origin/gh/davidberard98/406/head 2025-09-07T07:36:19.7692259Z * [new branch] gh/davidberard98/406/orig -> origin/gh/davidberard98/406/orig 2025-09-07T07:36:19.7694650Z * [new branch] gh/davidberard98/407/base -> origin/gh/davidberard98/407/base 2025-09-07T07:36:19.7695856Z * [new branch] gh/davidberard98/407/head -> origin/gh/davidberard98/407/head 2025-09-07T07:36:19.7697156Z * [new branch] gh/davidberard98/407/orig -> origin/gh/davidberard98/407/orig 2025-09-07T07:36:19.7698925Z * [new branch] gh/davidberard98/408/base -> origin/gh/davidberard98/408/base 2025-09-07T07:36:19.7700097Z * [new branch] gh/davidberard98/408/head -> origin/gh/davidberard98/408/head 2025-09-07T07:36:19.7701278Z * [new branch] gh/davidberard98/408/orig -> origin/gh/davidberard98/408/orig 2025-09-07T07:36:19.7702931Z * [new branch] gh/davidberard98/409/base -> origin/gh/davidberard98/409/base 2025-09-07T07:36:19.7704207Z * [new branch] gh/davidberard98/409/head -> origin/gh/davidberard98/409/head 2025-09-07T07:36:19.7705557Z * [new branch] gh/davidberard98/409/orig -> origin/gh/davidberard98/409/orig 2025-09-07T07:36:19.7707825Z * [new branch] gh/desertfire/594/base -> origin/gh/desertfire/594/base 2025-09-07T07:36:19.7708987Z * [new branch] gh/desertfire/594/head -> origin/gh/desertfire/594/head 2025-09-07T07:36:19.7712995Z * [new branch] gh/desertfire/594/orig -> origin/gh/desertfire/594/orig 2025-09-07T07:36:19.7714755Z * [new branch] gh/desertfire/595/base -> origin/gh/desertfire/595/base 2025-09-07T07:36:19.7715951Z * [new branch] gh/desertfire/595/head -> origin/gh/desertfire/595/head 2025-09-07T07:36:19.7717139Z * [new branch] gh/desertfire/595/orig -> origin/gh/desertfire/595/orig 2025-09-07T07:36:19.7718823Z * [new branch] gh/desertfire/597/base -> origin/gh/desertfire/597/base 2025-09-07T07:36:19.7720046Z * [new branch] gh/desertfire/597/head -> origin/gh/desertfire/597/head 2025-09-07T07:36:19.7721241Z * [new branch] gh/desertfire/597/orig -> origin/gh/desertfire/597/orig 2025-09-07T07:36:19.7723344Z * [new branch] gh/dharakk/1/base -> origin/gh/dharakk/1/base 2025-09-07T07:36:19.7724805Z * [new branch] gh/dharakk/1/head -> origin/gh/dharakk/1/head 2025-09-07T07:36:19.7726936Z * [new branch] gh/drisspg/149/base -> origin/gh/drisspg/149/base 2025-09-07T07:36:19.7728111Z * [new branch] gh/drisspg/149/head -> origin/gh/drisspg/149/head 2025-09-07T07:36:19.7729293Z * [new branch] gh/drisspg/149/orig -> origin/gh/drisspg/149/orig 2025-09-07T07:36:19.7731026Z * [new branch] gh/drisspg/159/base -> origin/gh/drisspg/159/base 2025-09-07T07:36:19.7732200Z * [new branch] gh/drisspg/159/head -> origin/gh/drisspg/159/head 2025-09-07T07:36:19.7733414Z * [new branch] gh/drisspg/159/orig -> origin/gh/drisspg/159/orig 2025-09-07T07:36:19.7735254Z * [new branch] gh/drisspg/166/base -> origin/gh/drisspg/166/base 2025-09-07T07:36:19.7736312Z * [new branch] gh/drisspg/166/head -> origin/gh/drisspg/166/head 2025-09-07T07:36:19.7737481Z * [new branch] gh/drisspg/166/orig -> origin/gh/drisspg/166/orig 2025-09-07T07:36:19.7739158Z * [new branch] gh/drisspg/170/base -> origin/gh/drisspg/170/base 2025-09-07T07:36:19.7740390Z * [new branch] gh/drisspg/170/head -> origin/gh/drisspg/170/head 2025-09-07T07:36:19.7741577Z * [new branch] gh/drisspg/170/orig -> origin/gh/drisspg/170/orig 2025-09-07T07:36:19.7743275Z * [new branch] gh/drisspg/173/base -> origin/gh/drisspg/173/base 2025-09-07T07:36:19.7744532Z * [new branch] gh/drisspg/173/head -> origin/gh/drisspg/173/head 2025-09-07T07:36:19.7745816Z * [new branch] gh/drisspg/173/orig -> origin/gh/drisspg/173/orig 2025-09-07T07:36:19.7747564Z * [new branch] gh/drisspg/177/base -> origin/gh/drisspg/177/base 2025-09-07T07:36:19.7748774Z * [new branch] gh/drisspg/177/head -> origin/gh/drisspg/177/head 2025-09-07T07:36:19.7749935Z * [new branch] gh/drisspg/177/orig -> origin/gh/drisspg/177/orig 2025-09-07T07:36:19.7751648Z * [new branch] gh/drisspg/178/base -> origin/gh/drisspg/178/base 2025-09-07T07:36:19.7752868Z * [new branch] gh/drisspg/178/head -> origin/gh/drisspg/178/head 2025-09-07T07:36:19.7753967Z * [new branch] gh/drisspg/178/orig -> origin/gh/drisspg/178/orig 2025-09-07T07:36:19.7755715Z * [new branch] gh/drisspg/180/base -> origin/gh/drisspg/180/base 2025-09-07T07:36:19.7756970Z * [new branch] gh/drisspg/180/head -> origin/gh/drisspg/180/head 2025-09-07T07:36:19.7758177Z * [new branch] gh/drisspg/180/orig -> origin/gh/drisspg/180/orig 2025-09-07T07:36:19.7760039Z * [new branch] gh/drisspg/181/base -> origin/gh/drisspg/181/base 2025-09-07T07:36:19.7761201Z * [new branch] gh/drisspg/181/head -> origin/gh/drisspg/181/head 2025-09-07T07:36:19.7762406Z * [new branch] gh/drisspg/181/orig -> origin/gh/drisspg/181/orig 2025-09-07T07:36:19.7764053Z * [new branch] gh/drisspg/182/base -> origin/gh/drisspg/182/base 2025-09-07T07:36:19.7765255Z * [new branch] gh/drisspg/182/head -> origin/gh/drisspg/182/head 2025-09-07T07:36:19.7767089Z * [new branch] gh/drisspg/183/base -> origin/gh/drisspg/183/base 2025-09-07T07:36:19.7767979Z * [new branch] gh/drisspg/183/head -> origin/gh/drisspg/183/head 2025-09-07T07:36:19.7769666Z * [new branch] gh/drisspg/184/base -> origin/gh/drisspg/184/base 2025-09-07T07:36:19.7770842Z * [new branch] gh/drisspg/184/head -> origin/gh/drisspg/184/head 2025-09-07T07:36:19.7772735Z * [new branch] gh/drisspg/185/base -> origin/gh/drisspg/185/base 2025-09-07T07:36:19.7773987Z * [new branch] gh/drisspg/185/head -> origin/gh/drisspg/185/head 2025-09-07T07:36:19.7775698Z * [new branch] gh/drisspg/186/base -> origin/gh/drisspg/186/base 2025-09-07T07:36:19.7776894Z * [new branch] gh/drisspg/186/head -> origin/gh/drisspg/186/head 2025-09-07T07:36:19.7778067Z * [new branch] gh/drisspg/186/orig -> origin/gh/drisspg/186/orig 2025-09-07T07:36:19.7779765Z * [new branch] gh/drisspg/187/base -> origin/gh/drisspg/187/base 2025-09-07T07:36:19.7780950Z * [new branch] gh/drisspg/187/head -> origin/gh/drisspg/187/head 2025-09-07T07:36:19.7782145Z * [new branch] gh/drisspg/187/orig -> origin/gh/drisspg/187/orig 2025-09-07T07:36:19.7783869Z * [new branch] gh/drisspg/188/base -> origin/gh/drisspg/188/base 2025-09-07T07:36:19.7785155Z * [new branch] gh/drisspg/188/head -> origin/gh/drisspg/188/head 2025-09-07T07:36:19.7786332Z * [new branch] gh/drisspg/188/orig -> origin/gh/drisspg/188/orig 2025-09-07T07:36:19.7788567Z * [new branch] gh/drisspg/189/base -> origin/gh/drisspg/189/base 2025-09-07T07:36:19.7789880Z * [new branch] gh/drisspg/189/head -> origin/gh/drisspg/189/head 2025-09-07T07:36:19.7791119Z * [new branch] gh/drisspg/189/orig -> origin/gh/drisspg/189/orig 2025-09-07T07:36:19.7792880Z * [new branch] gh/drisspg/190/base -> origin/gh/drisspg/190/base 2025-09-07T07:36:19.7794102Z * [new branch] gh/drisspg/190/head -> origin/gh/drisspg/190/head 2025-09-07T07:36:19.7795472Z * [new branch] gh/drisspg/190/orig -> origin/gh/drisspg/190/orig 2025-09-07T07:36:19.7797227Z * [new branch] gh/drisspg/191/base -> origin/gh/drisspg/191/base 2025-09-07T07:36:19.7798433Z * [new branch] gh/drisspg/191/head -> origin/gh/drisspg/191/head 2025-09-07T07:36:19.7799612Z * [new branch] gh/drisspg/191/orig -> origin/gh/drisspg/191/orig 2025-09-07T07:36:19.7801358Z * [new branch] gh/drisspg/192/base -> origin/gh/drisspg/192/base 2025-09-07T07:36:19.7802514Z * [new branch] gh/drisspg/192/head -> origin/gh/drisspg/192/head 2025-09-07T07:36:19.7803713Z * [new branch] gh/drisspg/192/orig -> origin/gh/drisspg/192/orig 2025-09-07T07:36:19.7805478Z * [new branch] gh/drisspg/193/base -> origin/gh/drisspg/193/base 2025-09-07T07:36:19.7806784Z * [new branch] gh/drisspg/193/head -> origin/gh/drisspg/193/head 2025-09-07T07:36:19.7807964Z * [new branch] gh/drisspg/193/orig -> origin/gh/drisspg/193/orig 2025-09-07T07:36:19.7809789Z * [new branch] gh/drisspg/194/base -> origin/gh/drisspg/194/base 2025-09-07T07:36:19.7811076Z * [new branch] gh/drisspg/194/head -> origin/gh/drisspg/194/head 2025-09-07T07:36:19.7812253Z * [new branch] gh/drisspg/194/orig -> origin/gh/drisspg/194/orig 2025-09-07T07:36:19.7814056Z * [new branch] gh/drisspg/195/base -> origin/gh/drisspg/195/base 2025-09-07T07:36:19.7815240Z * [new branch] gh/drisspg/195/head -> origin/gh/drisspg/195/head 2025-09-07T07:36:19.7816441Z * [new branch] gh/drisspg/195/orig -> origin/gh/drisspg/195/orig 2025-09-07T07:36:19.7818180Z * [new branch] gh/drisspg/196/base -> origin/gh/drisspg/196/base 2025-09-07T07:36:19.7819370Z * [new branch] gh/drisspg/196/head -> origin/gh/drisspg/196/head 2025-09-07T07:36:19.7820551Z * [new branch] gh/drisspg/196/orig -> origin/gh/drisspg/196/orig 2025-09-07T07:36:19.7822306Z * [new branch] gh/drisspg/197/base -> origin/gh/drisspg/197/base 2025-09-07T07:36:19.7823549Z * [new branch] gh/drisspg/197/head -> origin/gh/drisspg/197/head 2025-09-07T07:36:19.7824803Z * [new branch] gh/drisspg/197/orig -> origin/gh/drisspg/197/orig 2025-09-07T07:36:19.7826595Z * [new branch] gh/drisspg/198/base -> origin/gh/drisspg/198/base 2025-09-07T07:36:19.7827772Z * [new branch] gh/drisspg/198/head -> origin/gh/drisspg/198/head 2025-09-07T07:36:19.7828957Z * [new branch] gh/drisspg/198/orig -> origin/gh/drisspg/198/orig 2025-09-07T07:36:19.7830888Z * [new branch] gh/drisspg/199/base -> origin/gh/drisspg/199/base 2025-09-07T07:36:19.7832164Z * [new branch] gh/drisspg/199/head -> origin/gh/drisspg/199/head 2025-09-07T07:36:19.7833348Z * [new branch] gh/drisspg/199/orig -> origin/gh/drisspg/199/orig 2025-09-07T07:36:19.7835674Z * [new branch] gh/dsjohns2/1/base -> origin/gh/dsjohns2/1/base 2025-09-07T07:36:19.7836759Z * [new branch] gh/dsjohns2/1/head -> origin/gh/dsjohns2/1/head 2025-09-07T07:36:19.7838948Z * [new branch] gh/eellison/784/base -> origin/gh/eellison/784/base 2025-09-07T07:36:19.7840144Z * [new branch] gh/eellison/784/head -> origin/gh/eellison/784/head 2025-09-07T07:36:19.7841327Z * [new branch] gh/eellison/784/orig -> origin/gh/eellison/784/orig 2025-09-07T07:36:19.7843194Z * [new branch] gh/eellison/785/base -> origin/gh/eellison/785/base 2025-09-07T07:36:19.7844409Z * [new branch] gh/eellison/785/head -> origin/gh/eellison/785/head 2025-09-07T07:36:19.7845571Z * [new branch] gh/eellison/785/orig -> origin/gh/eellison/785/orig 2025-09-07T07:36:19.7847278Z * [new branch] gh/eellison/789/base -> origin/gh/eellison/789/base 2025-09-07T07:36:19.7848478Z * [new branch] gh/eellison/789/head -> origin/gh/eellison/789/head 2025-09-07T07:36:19.7849660Z * [new branch] gh/eellison/789/orig -> origin/gh/eellison/789/orig 2025-09-07T07:36:19.7851328Z * [new branch] gh/eellison/800/base -> origin/gh/eellison/800/base 2025-09-07T07:36:19.7852515Z * [new branch] gh/eellison/800/head -> origin/gh/eellison/800/head 2025-09-07T07:36:19.7853712Z * [new branch] gh/eellison/800/orig -> origin/gh/eellison/800/orig 2025-09-07T07:36:19.7855447Z * [new branch] gh/eellison/801/base -> origin/gh/eellison/801/base 2025-09-07T07:36:19.7856617Z * [new branch] gh/eellison/801/head -> origin/gh/eellison/801/head 2025-09-07T07:36:19.7857808Z * [new branch] gh/eellison/801/orig -> origin/gh/eellison/801/orig 2025-09-07T07:36:19.7859543Z * [new branch] gh/eellison/802/base -> origin/gh/eellison/802/base 2025-09-07T07:36:19.7860733Z * [new branch] gh/eellison/802/head -> origin/gh/eellison/802/head 2025-09-07T07:36:19.7861941Z * [new branch] gh/eellison/802/orig -> origin/gh/eellison/802/orig 2025-09-07T07:36:19.7863657Z * [new branch] gh/eellison/805/base -> origin/gh/eellison/805/base 2025-09-07T07:36:19.7864815Z * [new branch] gh/eellison/805/head -> origin/gh/eellison/805/head 2025-09-07T07:36:19.7866196Z * [new branch] gh/eellison/805/orig -> origin/gh/eellison/805/orig 2025-09-07T07:36:19.7867982Z * [new branch] gh/eellison/808/base -> origin/gh/eellison/808/base 2025-09-07T07:36:19.7869218Z * [new branch] gh/eellison/808/head -> origin/gh/eellison/808/head 2025-09-07T07:36:19.7870393Z * [new branch] gh/eellison/808/orig -> origin/gh/eellison/808/orig 2025-09-07T07:36:19.7872180Z * [new branch] gh/eellison/809/base -> origin/gh/eellison/809/base 2025-09-07T07:36:19.7873364Z * [new branch] gh/eellison/809/head -> origin/gh/eellison/809/head 2025-09-07T07:36:19.7874553Z * [new branch] gh/eellison/809/orig -> origin/gh/eellison/809/orig 2025-09-07T07:36:19.7876330Z * [new branch] gh/eellison/813/base -> origin/gh/eellison/813/base 2025-09-07T07:36:19.7877523Z * [new branch] gh/eellison/813/head -> origin/gh/eellison/813/head 2025-09-07T07:36:19.7878744Z * [new branch] gh/eellison/813/orig -> origin/gh/eellison/813/orig 2025-09-07T07:36:19.7880451Z * [new branch] gh/eellison/814/base -> origin/gh/eellison/814/base 2025-09-07T07:36:19.7881663Z * [new branch] gh/eellison/814/head -> origin/gh/eellison/814/head 2025-09-07T07:36:19.7883290Z * [new branch] gh/eellison/814/orig -> origin/gh/eellison/814/orig 2025-09-07T07:36:19.7885495Z * [new branch] gh/eellison/815/base -> origin/gh/eellison/815/base 2025-09-07T07:36:19.7886865Z * [new branch] gh/eellison/815/head -> origin/gh/eellison/815/head 2025-09-07T07:36:19.7887845Z * [new branch] gh/eellison/815/orig -> origin/gh/eellison/815/orig 2025-09-07T07:36:19.7889620Z * [new branch] gh/eellison/816/base -> origin/gh/eellison/816/base 2025-09-07T07:36:19.7890801Z * [new branch] gh/eellison/816/head -> origin/gh/eellison/816/head 2025-09-07T07:36:19.7891976Z * [new branch] gh/eellison/816/orig -> origin/gh/eellison/816/orig 2025-09-07T07:36:19.7893654Z * [new branch] gh/eellison/817/base -> origin/gh/eellison/817/base 2025-09-07T07:36:19.7894858Z * [new branch] gh/eellison/817/head -> origin/gh/eellison/817/head 2025-09-07T07:36:19.7896026Z * [new branch] gh/eellison/817/orig -> origin/gh/eellison/817/orig 2025-09-07T07:36:19.7897841Z * [new branch] gh/eellison/818/base -> origin/gh/eellison/818/base 2025-09-07T07:36:19.7899061Z * [new branch] gh/eellison/818/head -> origin/gh/eellison/818/head 2025-09-07T07:36:19.7900232Z * [new branch] gh/eellison/818/orig -> origin/gh/eellison/818/orig 2025-09-07T07:36:19.7902094Z * [new branch] gh/eellison/819/base -> origin/gh/eellison/819/base 2025-09-07T07:36:19.7903391Z * [new branch] gh/eellison/819/head -> origin/gh/eellison/819/head 2025-09-07T07:36:19.7904594Z * [new branch] gh/eellison/819/orig -> origin/gh/eellison/819/orig 2025-09-07T07:36:19.7906993Z * [new branch] gh/eellison/820/base -> origin/gh/eellison/820/base 2025-09-07T07:36:19.7908315Z * [new branch] gh/eellison/820/head -> origin/gh/eellison/820/head 2025-09-07T07:36:19.7909519Z * [new branch] gh/eellison/820/orig -> origin/gh/eellison/820/orig 2025-09-07T07:36:19.7911457Z * [new branch] gh/eellison/821/base -> origin/gh/eellison/821/base 2025-09-07T07:36:19.7912670Z * [new branch] gh/eellison/821/head -> origin/gh/eellison/821/head 2025-09-07T07:36:19.7913911Z * [new branch] gh/eellison/821/orig -> origin/gh/eellison/821/orig 2025-09-07T07:36:19.7915710Z * [new branch] gh/eellison/822/base -> origin/gh/eellison/822/base 2025-09-07T07:36:19.7916926Z * [new branch] gh/eellison/822/head -> origin/gh/eellison/822/head 2025-09-07T07:36:19.7918085Z * [new branch] gh/eellison/822/orig -> origin/gh/eellison/822/orig 2025-09-07T07:36:19.7919902Z * [new branch] gh/eellison/823/base -> origin/gh/eellison/823/base 2025-09-07T07:36:19.7921186Z * [new branch] gh/eellison/823/head -> origin/gh/eellison/823/head 2025-09-07T07:36:19.7922413Z * [new branch] gh/eellison/823/orig -> origin/gh/eellison/823/orig 2025-09-07T07:36:19.7924562Z * [new branch] gh/etaf/132/base -> origin/gh/etaf/132/base 2025-09-07T07:36:19.7925779Z * [new branch] gh/etaf/132/head -> origin/gh/etaf/132/head 2025-09-07T07:36:19.7926972Z * [new branch] gh/etaf/132/orig -> origin/gh/etaf/132/orig 2025-09-07T07:36:19.7928701Z * [new branch] gh/etaf/138/base -> origin/gh/etaf/138/base 2025-09-07T07:36:19.7929898Z * [new branch] gh/etaf/138/head -> origin/gh/etaf/138/head 2025-09-07T07:36:19.7931110Z * [new branch] gh/etaf/138/orig -> origin/gh/etaf/138/orig 2025-09-07T07:36:19.7932844Z * [new branch] gh/etaf/140/base -> origin/gh/etaf/140/base 2025-09-07T07:36:19.7934037Z * [new branch] gh/etaf/140/head -> origin/gh/etaf/140/head 2025-09-07T07:36:19.7935376Z * [new branch] gh/etaf/140/orig -> origin/gh/etaf/140/orig 2025-09-07T07:36:19.7936933Z * [new branch] gh/etaf/143/base -> origin/gh/etaf/143/base 2025-09-07T07:36:19.7938137Z * [new branch] gh/etaf/143/head -> origin/gh/etaf/143/head 2025-09-07T07:36:19.7939541Z * [new branch] gh/etaf/143/orig -> origin/gh/etaf/143/orig 2025-09-07T07:36:19.7941287Z * [new branch] gh/etaf/147/base -> origin/gh/etaf/147/base 2025-09-07T07:36:19.7942475Z * [new branch] gh/etaf/147/head -> origin/gh/etaf/147/head 2025-09-07T07:36:19.7944324Z * [new branch] gh/etaf/151/base -> origin/gh/etaf/151/base 2025-09-07T07:36:19.7945688Z * [new branch] gh/etaf/151/head -> origin/gh/etaf/151/head 2025-09-07T07:36:19.7946943Z * [new branch] gh/etaf/151/orig -> origin/gh/etaf/151/orig 2025-09-07T07:36:19.7948795Z * [new branch] gh/etaf/152/base -> origin/gh/etaf/152/base 2025-09-07T07:36:19.7950000Z * [new branch] gh/etaf/152/head -> origin/gh/etaf/152/head 2025-09-07T07:36:19.7951214Z * [new branch] gh/etaf/152/orig -> origin/gh/etaf/152/orig 2025-09-07T07:36:19.7952996Z * [new branch] gh/etaf/153/base -> origin/gh/etaf/153/base 2025-09-07T07:36:19.7954641Z * [new branch] gh/etaf/153/head -> origin/gh/etaf/153/head 2025-09-07T07:36:19.7955856Z * [new branch] gh/etaf/153/orig -> origin/gh/etaf/153/orig 2025-09-07T07:36:19.7957698Z * [new branch] gh/etaf/154/base -> origin/gh/etaf/154/base 2025-09-07T07:36:19.7958934Z * [new branch] gh/etaf/154/head -> origin/gh/etaf/154/head 2025-09-07T07:36:19.7960095Z * [new branch] gh/etaf/154/orig -> origin/gh/etaf/154/orig 2025-09-07T07:36:19.7961970Z * [new branch] gh/etaf/155/base -> origin/gh/etaf/155/base 2025-09-07T07:36:19.7963185Z * [new branch] gh/etaf/155/head -> origin/gh/etaf/155/head 2025-09-07T07:36:19.7964377Z * [new branch] gh/etaf/155/orig -> origin/gh/etaf/155/orig 2025-09-07T07:36:19.7966445Z * [new branch] gh/etaf/156/base -> origin/gh/etaf/156/base 2025-09-07T07:36:19.7967782Z * [new branch] gh/etaf/156/head -> origin/gh/etaf/156/head 2025-09-07T07:36:19.7968960Z * [new branch] gh/etaf/156/orig -> origin/gh/etaf/156/orig 2025-09-07T07:36:19.7970806Z * [new branch] gh/etaf/157/base -> origin/gh/etaf/157/base 2025-09-07T07:36:19.7972064Z * [new branch] gh/etaf/157/head -> origin/gh/etaf/157/head 2025-09-07T07:36:19.7973253Z * [new branch] gh/etaf/157/orig -> origin/gh/etaf/157/orig 2025-09-07T07:36:19.7974891Z * [new branch] gh/etaf/158/base -> origin/gh/etaf/158/base 2025-09-07T07:36:19.7976250Z * [new branch] gh/etaf/158/head -> origin/gh/etaf/158/head 2025-09-07T07:36:19.7977477Z * [new branch] gh/etaf/158/orig -> origin/gh/etaf/158/orig 2025-09-07T07:36:19.7979308Z * [new branch] gh/etaf/159/base -> origin/gh/etaf/159/base 2025-09-07T07:36:19.7980584Z * [new branch] gh/etaf/159/head -> origin/gh/etaf/159/head 2025-09-07T07:36:19.7981748Z * [new branch] gh/etaf/159/orig -> origin/gh/etaf/159/orig 2025-09-07T07:36:19.7983496Z * [new branch] gh/etaf/160/base -> origin/gh/etaf/160/base 2025-09-07T07:36:19.7984761Z * [new branch] gh/etaf/160/head -> origin/gh/etaf/160/head 2025-09-07T07:36:19.7986011Z * [new branch] gh/etaf/160/orig -> origin/gh/etaf/160/orig 2025-09-07T07:36:19.7987848Z * [new branch] gh/etaf/161/base -> origin/gh/etaf/161/base 2025-09-07T07:36:19.7989166Z * [new branch] gh/etaf/161/head -> origin/gh/etaf/161/head 2025-09-07T07:36:19.7990274Z * [new branch] gh/etaf/161/orig -> origin/gh/etaf/161/orig 2025-09-07T07:36:19.7992344Z * [new branch] gh/etaf/162/base -> origin/gh/etaf/162/base 2025-09-07T07:36:19.7993562Z * [new branch] gh/etaf/162/head -> origin/gh/etaf/162/head 2025-09-07T07:36:19.7994763Z * [new branch] gh/etaf/162/orig -> origin/gh/etaf/162/orig 2025-09-07T07:36:19.7996652Z * [new branch] gh/etaf/163/base -> origin/gh/etaf/163/base 2025-09-07T07:36:19.7997865Z * [new branch] gh/etaf/163/head -> origin/gh/etaf/163/head 2025-09-07T07:36:19.7999045Z * [new branch] gh/etaf/163/orig -> origin/gh/etaf/163/orig 2025-09-07T07:36:19.8000894Z * [new branch] gh/etaf/164/base -> origin/gh/etaf/164/base 2025-09-07T07:36:19.8002122Z * [new branch] gh/etaf/164/head -> origin/gh/etaf/164/head 2025-09-07T07:36:19.8003303Z * [new branch] gh/etaf/164/orig -> origin/gh/etaf/164/orig 2025-09-07T07:36:19.8005063Z * [new branch] gh/etaf/165/base -> origin/gh/etaf/165/base 2025-09-07T07:36:19.8006251Z * [new branch] gh/etaf/165/orig -> origin/gh/etaf/165/orig 2025-09-07T07:36:19.8008035Z * [new branch] gh/etaf/166/base -> origin/gh/etaf/166/base 2025-09-07T07:36:19.8009248Z * [new branch] gh/etaf/166/head -> origin/gh/etaf/166/head 2025-09-07T07:36:19.8010638Z * [new branch] gh/etaf/166/orig -> origin/gh/etaf/166/orig 2025-09-07T07:36:19.8012782Z * [new branch] gh/etaf/167/base -> origin/gh/etaf/167/base 2025-09-07T07:36:19.8014056Z * [new branch] gh/etaf/167/head -> origin/gh/etaf/167/head 2025-09-07T07:36:19.8015252Z * [new branch] gh/etaf/167/orig -> origin/gh/etaf/167/orig 2025-09-07T07:36:19.8016999Z * [new branch] gh/etaf/168/base -> origin/gh/etaf/168/base 2025-09-07T07:36:19.8018274Z * [new branch] gh/etaf/168/head -> origin/gh/etaf/168/head 2025-09-07T07:36:19.8019473Z * [new branch] gh/etaf/168/orig -> origin/gh/etaf/168/orig 2025-09-07T07:36:19.8021723Z * [new branch] gh/etaf/169/base -> origin/gh/etaf/169/base 2025-09-07T07:36:19.8022927Z * [new branch] gh/etaf/169/head -> origin/gh/etaf/169/head 2025-09-07T07:36:19.8024098Z * [new branch] gh/etaf/169/orig -> origin/gh/etaf/169/orig 2025-09-07T07:36:19.8026309Z * [new branch] gh/exclamaforte/1/base -> origin/gh/exclamaforte/1/base 2025-09-07T07:36:19.8027509Z * [new branch] gh/exclamaforte/1/head -> origin/gh/exclamaforte/1/head 2025-09-07T07:36:19.8029260Z * [new branch] gh/exclamaforte/2/base -> origin/gh/exclamaforte/2/base 2025-09-07T07:36:19.8030600Z * [new branch] gh/exclamaforte/2/head -> origin/gh/exclamaforte/2/head 2025-09-07T07:36:19.8032263Z * [new branch] gh/exclamaforte/3/base -> origin/gh/exclamaforte/3/base 2025-09-07T07:36:19.8033480Z * [new branch] gh/exclamaforte/3/head -> origin/gh/exclamaforte/3/head 2025-09-07T07:36:19.8035126Z * [new branch] gh/exclamaforte/4/base -> origin/gh/exclamaforte/4/base 2025-09-07T07:36:19.8036294Z * [new branch] gh/exclamaforte/4/head -> origin/gh/exclamaforte/4/head 2025-09-07T07:36:19.8038763Z * [new branch] gh/ezyang/2374/base -> origin/gh/ezyang/2374/base 2025-09-07T07:36:19.8039826Z * [new branch] gh/ezyang/2374/head -> origin/gh/ezyang/2374/head 2025-09-07T07:36:19.8041181Z * [new branch] gh/ezyang/2374/orig -> origin/gh/ezyang/2374/orig 2025-09-07T07:36:19.8042777Z * [new branch] gh/ezyang/2973/base -> origin/gh/ezyang/2973/base 2025-09-07T07:36:19.8044189Z * [new branch] gh/ezyang/2973/head -> origin/gh/ezyang/2973/head 2025-09-07T07:36:19.8045294Z * [new branch] gh/ezyang/2973/orig -> origin/gh/ezyang/2973/orig 2025-09-07T07:36:19.8046957Z * [new branch] gh/ezyang/2974/base -> origin/gh/ezyang/2974/base 2025-09-07T07:36:19.8048126Z * [new branch] gh/ezyang/2974/head -> origin/gh/ezyang/2974/head 2025-09-07T07:36:19.8049490Z * [new branch] gh/ezyang/2974/orig -> origin/gh/ezyang/2974/orig 2025-09-07T07:36:19.8051227Z * [new branch] gh/ezyang/3074/base -> origin/gh/ezyang/3074/base 2025-09-07T07:36:19.8052395Z * [new branch] gh/ezyang/3074/head -> origin/gh/ezyang/3074/head 2025-09-07T07:36:19.8053610Z * [new branch] gh/ezyang/3074/orig -> origin/gh/ezyang/3074/orig 2025-09-07T07:36:19.8055316Z * [new branch] gh/ezyang/3088/base -> origin/gh/ezyang/3088/base 2025-09-07T07:36:19.8056482Z * [new branch] gh/ezyang/3088/head -> origin/gh/ezyang/3088/head 2025-09-07T07:36:19.8057761Z * [new branch] gh/ezyang/3088/orig -> origin/gh/ezyang/3088/orig 2025-09-07T07:36:19.8059507Z * [new branch] gh/ezyang/3092/base -> origin/gh/ezyang/3092/base 2025-09-07T07:36:19.8060732Z * [new branch] gh/ezyang/3092/head -> origin/gh/ezyang/3092/head 2025-09-07T07:36:19.8061999Z * [new branch] gh/ezyang/3092/orig -> origin/gh/ezyang/3092/orig 2025-09-07T07:36:19.8063675Z * [new branch] gh/ezyang/3103/base -> origin/gh/ezyang/3103/base 2025-09-07T07:36:19.8064856Z * [new branch] gh/ezyang/3103/head -> origin/gh/ezyang/3103/head 2025-09-07T07:36:19.8066113Z * [new branch] gh/ezyang/3103/orig -> origin/gh/ezyang/3103/orig 2025-09-07T07:36:19.8068274Z * [new branch] gh/ezyang/3105/base -> origin/gh/ezyang/3105/base 2025-09-07T07:36:19.8068989Z * [new branch] gh/ezyang/3105/head -> origin/gh/ezyang/3105/head 2025-09-07T07:36:19.8070154Z * [new branch] gh/ezyang/3105/orig -> origin/gh/ezyang/3105/orig 2025-09-07T07:36:19.8071881Z * [new branch] gh/ezyang/3114/base -> origin/gh/ezyang/3114/base 2025-09-07T07:36:19.8073103Z * [new branch] gh/ezyang/3114/head -> origin/gh/ezyang/3114/head 2025-09-07T07:36:19.8074259Z * [new branch] gh/ezyang/3114/orig -> origin/gh/ezyang/3114/orig 2025-09-07T07:36:19.8075943Z * [new branch] gh/ezyang/3116/base -> origin/gh/ezyang/3116/base 2025-09-07T07:36:19.8077128Z * [new branch] gh/ezyang/3116/head -> origin/gh/ezyang/3116/head 2025-09-07T07:36:19.8078413Z * [new branch] gh/ezyang/3116/orig -> origin/gh/ezyang/3116/orig 2025-09-07T07:36:19.8080088Z * [new branch] gh/ezyang/3120/base -> origin/gh/ezyang/3120/base 2025-09-07T07:36:19.8081300Z * [new branch] gh/ezyang/3120/head -> origin/gh/ezyang/3120/head 2025-09-07T07:36:19.8082497Z * [new branch] gh/ezyang/3120/orig -> origin/gh/ezyang/3120/orig 2025-09-07T07:36:19.8084254Z * [new branch] gh/ezyang/3122/base -> origin/gh/ezyang/3122/base 2025-09-07T07:36:19.8085639Z * [new branch] gh/ezyang/3122/head -> origin/gh/ezyang/3122/head 2025-09-07T07:36:19.8086849Z * [new branch] gh/ezyang/3122/orig -> origin/gh/ezyang/3122/orig 2025-09-07T07:36:19.8088523Z * [new branch] gh/ezyang/3123/base -> origin/gh/ezyang/3123/base 2025-09-07T07:36:19.8089707Z * [new branch] gh/ezyang/3123/head -> origin/gh/ezyang/3123/head 2025-09-07T07:36:19.8091056Z * [new branch] gh/ezyang/3123/orig -> origin/gh/ezyang/3123/orig 2025-09-07T07:36:19.8092711Z * [new branch] gh/ezyang/3125/base -> origin/gh/ezyang/3125/base 2025-09-07T07:36:19.8093913Z * [new branch] gh/ezyang/3125/head -> origin/gh/ezyang/3125/head 2025-09-07T07:36:19.8095180Z * [new branch] gh/ezyang/3125/orig -> origin/gh/ezyang/3125/orig 2025-09-07T07:36:19.8096862Z * [new branch] gh/ezyang/3126/base -> origin/gh/ezyang/3126/base 2025-09-07T07:36:19.8097999Z * [new branch] gh/ezyang/3126/head -> origin/gh/ezyang/3126/head 2025-09-07T07:36:19.8099230Z * [new branch] gh/ezyang/3126/orig -> origin/gh/ezyang/3126/orig 2025-09-07T07:36:19.8101453Z * [new branch] gh/ezyang/3127/base -> origin/gh/ezyang/3127/base 2025-09-07T07:36:19.8102694Z * [new branch] gh/ezyang/3127/head -> origin/gh/ezyang/3127/head 2025-09-07T07:36:19.8103876Z * [new branch] gh/ezyang/3127/orig -> origin/gh/ezyang/3127/orig 2025-09-07T07:36:19.8105742Z * [new branch] gh/ezyang/3128/base -> origin/gh/ezyang/3128/base 2025-09-07T07:36:19.8106922Z * [new branch] gh/ezyang/3128/head -> origin/gh/ezyang/3128/head 2025-09-07T07:36:19.8108114Z * [new branch] gh/ezyang/3128/orig -> origin/gh/ezyang/3128/orig 2025-09-07T07:36:19.8110038Z * [new branch] gh/ezyang/3129/base -> origin/gh/ezyang/3129/base 2025-09-07T07:36:19.8111275Z * [new branch] gh/ezyang/3129/head -> origin/gh/ezyang/3129/head 2025-09-07T07:36:19.8112543Z * [new branch] gh/ezyang/3129/orig -> origin/gh/ezyang/3129/orig 2025-09-07T07:36:19.8114272Z * [new branch] gh/ezyang/3130/base -> origin/gh/ezyang/3130/base 2025-09-07T07:36:19.8115470Z * [new branch] gh/ezyang/3130/head -> origin/gh/ezyang/3130/head 2025-09-07T07:36:19.8116605Z * [new branch] gh/ezyang/3130/orig -> origin/gh/ezyang/3130/orig 2025-09-07T07:36:19.8118352Z * [new branch] gh/ezyang/3131/base -> origin/gh/ezyang/3131/base 2025-09-07T07:36:19.8119516Z * [new branch] gh/ezyang/3131/head -> origin/gh/ezyang/3131/head 2025-09-07T07:36:19.8120908Z * [new branch] gh/ezyang/3131/orig -> origin/gh/ezyang/3131/orig 2025-09-07T07:36:19.8122646Z * [new branch] gh/ezyang/3132/base -> origin/gh/ezyang/3132/base 2025-09-07T07:36:19.8123845Z * [new branch] gh/ezyang/3132/head -> origin/gh/ezyang/3132/head 2025-09-07T07:36:19.8125620Z * [new branch] gh/ezyang/3132/orig -> origin/gh/ezyang/3132/orig 2025-09-07T07:36:19.8127017Z * [new branch] gh/ezyang/3133/base -> origin/gh/ezyang/3133/base 2025-09-07T07:36:19.8128179Z * [new branch] gh/ezyang/3133/head -> origin/gh/ezyang/3133/head 2025-09-07T07:36:19.8129452Z * [new branch] gh/ezyang/3133/orig -> origin/gh/ezyang/3133/orig 2025-09-07T07:36:19.8131202Z * [new branch] gh/ezyang/3134/base -> origin/gh/ezyang/3134/base 2025-09-07T07:36:19.8132366Z * [new branch] gh/ezyang/3134/head -> origin/gh/ezyang/3134/head 2025-09-07T07:36:19.8133549Z * [new branch] gh/ezyang/3134/orig -> origin/gh/ezyang/3134/orig 2025-09-07T07:36:19.8135286Z * [new branch] gh/ezyang/3135/base -> origin/gh/ezyang/3135/base 2025-09-07T07:36:19.8136467Z * [new branch] gh/ezyang/3135/head -> origin/gh/ezyang/3135/head 2025-09-07T07:36:19.8137696Z * [new branch] gh/ezyang/3135/orig -> origin/gh/ezyang/3135/orig 2025-09-07T07:36:19.8139469Z * [new branch] gh/ezyang/3136/base -> origin/gh/ezyang/3136/base 2025-09-07T07:36:19.8140953Z * [new branch] gh/ezyang/3136/head -> origin/gh/ezyang/3136/head 2025-09-07T07:36:19.8141875Z * [new branch] gh/ezyang/3136/orig -> origin/gh/ezyang/3136/orig 2025-09-07T07:36:19.8143514Z * [new branch] gh/ezyang/3137/base -> origin/gh/ezyang/3137/base 2025-09-07T07:36:19.8144766Z * [new branch] gh/ezyang/3137/head -> origin/gh/ezyang/3137/head 2025-09-07T07:36:19.8146086Z * [new branch] gh/ezyang/3137/orig -> origin/gh/ezyang/3137/orig 2025-09-07T07:36:19.8147814Z * [new branch] gh/ezyang/3138/base -> origin/gh/ezyang/3138/base 2025-09-07T07:36:19.8148992Z * [new branch] gh/ezyang/3138/head -> origin/gh/ezyang/3138/head 2025-09-07T07:36:19.8150195Z * [new branch] gh/ezyang/3138/orig -> origin/gh/ezyang/3138/orig 2025-09-07T07:36:19.8151942Z * [new branch] gh/ezyang/3139/base -> origin/gh/ezyang/3139/base 2025-09-07T07:36:19.8153533Z * [new branch] gh/ezyang/3139/head -> origin/gh/ezyang/3139/head 2025-09-07T07:36:19.8154757Z * [new branch] gh/ezyang/3139/orig -> origin/gh/ezyang/3139/orig 2025-09-07T07:36:19.8156590Z * [new branch] gh/ezyang/3140/base -> origin/gh/ezyang/3140/base 2025-09-07T07:36:19.8157787Z * [new branch] gh/ezyang/3140/head -> origin/gh/ezyang/3140/head 2025-09-07T07:36:19.8158999Z * [new branch] gh/ezyang/3140/orig -> origin/gh/ezyang/3140/orig 2025-09-07T07:36:19.8160736Z * [new branch] gh/ezyang/3141/base -> origin/gh/ezyang/3141/base 2025-09-07T07:36:19.8161877Z * [new branch] gh/ezyang/3141/head -> origin/gh/ezyang/3141/head 2025-09-07T07:36:19.8163122Z * [new branch] gh/ezyang/3141/orig -> origin/gh/ezyang/3141/orig 2025-09-07T07:36:19.8164858Z * [new branch] gh/ezyang/3142/base -> origin/gh/ezyang/3142/base 2025-09-07T07:36:19.8166031Z * [new branch] gh/ezyang/3142/head -> origin/gh/ezyang/3142/head 2025-09-07T07:36:19.8167201Z * [new branch] gh/ezyang/3142/orig -> origin/gh/ezyang/3142/orig 2025-09-07T07:36:19.8168882Z * [new branch] gh/ezyang/3143/base -> origin/gh/ezyang/3143/base 2025-09-07T07:36:19.8170020Z * [new branch] gh/ezyang/3143/head -> origin/gh/ezyang/3143/head 2025-09-07T07:36:19.8171179Z * [new branch] gh/ezyang/3143/orig -> origin/gh/ezyang/3143/orig 2025-09-07T07:36:19.8173317Z * [new branch] gh/fadara01/1/base -> origin/gh/fadara01/1/base 2025-09-07T07:36:19.8175386Z * [new branch] gh/fadara01/1/head -> origin/gh/fadara01/1/head 2025-09-07T07:36:19.8176568Z * [new branch] gh/fadara01/1/orig -> origin/gh/fadara01/1/orig 2025-09-07T07:36:19.8178905Z * [new branch] gh/fduwjj/171/base -> origin/gh/fduwjj/171/base 2025-09-07T07:36:19.8180188Z * [new branch] gh/fduwjj/171/head -> origin/gh/fduwjj/171/head 2025-09-07T07:36:19.8181332Z * [new branch] gh/fduwjj/171/orig -> origin/gh/fduwjj/171/orig 2025-09-07T07:36:19.8183162Z * [new branch] gh/fduwjj/175/base -> origin/gh/fduwjj/175/base 2025-09-07T07:36:19.8184529Z * [new branch] gh/fduwjj/175/head -> origin/gh/fduwjj/175/head 2025-09-07T07:36:19.8185732Z * [new branch] gh/fduwjj/175/orig -> origin/gh/fduwjj/175/orig 2025-09-07T07:36:19.8187535Z * [new branch] gh/fduwjj/176/base -> origin/gh/fduwjj/176/base 2025-09-07T07:36:19.8188729Z * [new branch] gh/fduwjj/176/head -> origin/gh/fduwjj/176/head 2025-09-07T07:36:19.8189985Z * [new branch] gh/fduwjj/176/orig -> origin/gh/fduwjj/176/orig 2025-09-07T07:36:19.8191701Z * [new branch] gh/fduwjj/177/base -> origin/gh/fduwjj/177/base 2025-09-07T07:36:19.8193140Z * [new branch] gh/fduwjj/177/head -> origin/gh/fduwjj/177/head 2025-09-07T07:36:19.8194247Z * [new branch] gh/fduwjj/177/orig -> origin/gh/fduwjj/177/orig 2025-09-07T07:36:19.8196075Z * [new branch] gh/fduwjj/178/base -> origin/gh/fduwjj/178/base 2025-09-07T07:36:19.8197311Z * [new branch] gh/fduwjj/178/head -> origin/gh/fduwjj/178/head 2025-09-07T07:36:19.8198486Z * [new branch] gh/fduwjj/178/orig -> origin/gh/fduwjj/178/orig 2025-09-07T07:36:19.8200166Z * [new branch] gh/fduwjj/179/base -> origin/gh/fduwjj/179/base 2025-09-07T07:36:19.8201342Z * [new branch] gh/fduwjj/179/head -> origin/gh/fduwjj/179/head 2025-09-07T07:36:19.8202540Z * [new branch] gh/fduwjj/179/orig -> origin/gh/fduwjj/179/orig 2025-09-07T07:36:19.8204294Z * [new branch] gh/fduwjj/180/base -> origin/gh/fduwjj/180/base 2025-09-07T07:36:19.8205490Z * [new branch] gh/fduwjj/180/head -> origin/gh/fduwjj/180/head 2025-09-07T07:36:19.8206663Z * [new branch] gh/fduwjj/180/orig -> origin/gh/fduwjj/180/orig 2025-09-07T07:36:19.8208370Z * [new branch] gh/fduwjj/181/base -> origin/gh/fduwjj/181/base 2025-09-07T07:36:19.8209543Z * [new branch] gh/fduwjj/181/head -> origin/gh/fduwjj/181/head 2025-09-07T07:36:19.8214338Z * [new branch] gh/fduwjj/181/orig -> origin/gh/fduwjj/181/orig 2025-09-07T07:36:19.8216164Z * [new branch] gh/fduwjj/182/base -> origin/gh/fduwjj/182/base 2025-09-07T07:36:19.8217371Z * [new branch] gh/fduwjj/182/head -> origin/gh/fduwjj/182/head 2025-09-07T07:36:19.8218544Z * [new branch] gh/fduwjj/182/orig -> origin/gh/fduwjj/182/orig 2025-09-07T07:36:19.8220294Z * [new branch] gh/fduwjj/183/base -> origin/gh/fduwjj/183/base 2025-09-07T07:36:19.8221655Z * [new branch] gh/fduwjj/183/head -> origin/gh/fduwjj/183/head 2025-09-07T07:36:19.8222832Z * [new branch] gh/fduwjj/183/orig -> origin/gh/fduwjj/183/orig 2025-09-07T07:36:19.8224749Z * [new branch] gh/fduwjj/184/base -> origin/gh/fduwjj/184/base 2025-09-07T07:36:19.8225982Z * [new branch] gh/fduwjj/184/head -> origin/gh/fduwjj/184/head 2025-09-07T07:36:19.8227166Z * [new branch] gh/fduwjj/184/orig -> origin/gh/fduwjj/184/orig 2025-09-07T07:36:19.8228914Z * [new branch] gh/fduwjj/185/base -> origin/gh/fduwjj/185/base 2025-09-07T07:36:19.8230104Z * [new branch] gh/fduwjj/185/head -> origin/gh/fduwjj/185/head 2025-09-07T07:36:19.8231506Z * [new branch] gh/fduwjj/185/orig -> origin/gh/fduwjj/185/orig 2025-09-07T07:36:19.8233178Z * [new branch] gh/fduwjj/186/base -> origin/gh/fduwjj/186/base 2025-09-07T07:36:19.8234381Z * [new branch] gh/fduwjj/186/head -> origin/gh/fduwjj/186/head 2025-09-07T07:36:19.8235550Z * [new branch] gh/fduwjj/186/orig -> origin/gh/fduwjj/186/orig 2025-09-07T07:36:19.8237261Z * [new branch] gh/fduwjj/187/base -> origin/gh/fduwjj/187/base 2025-09-07T07:36:19.8238900Z * [new branch] gh/fduwjj/187/head -> origin/gh/fduwjj/187/head 2025-09-07T07:36:19.8240102Z * [new branch] gh/fduwjj/187/orig -> origin/gh/fduwjj/187/orig 2025-09-07T07:36:19.8241686Z * [new branch] gh/fduwjj/188/base -> origin/gh/fduwjj/188/base 2025-09-07T07:36:19.8242833Z * [new branch] gh/fduwjj/188/head -> origin/gh/fduwjj/188/head 2025-09-07T07:36:19.8243931Z * [new branch] gh/fduwjj/188/orig -> origin/gh/fduwjj/188/orig 2025-09-07T07:36:19.8245651Z * [new branch] gh/fduwjj/189/base -> origin/gh/fduwjj/189/base 2025-09-07T07:36:19.8246693Z * [new branch] gh/fduwjj/189/head -> origin/gh/fduwjj/189/head 2025-09-07T07:36:19.8247794Z * [new branch] gh/fduwjj/189/orig -> origin/gh/fduwjj/189/orig 2025-09-07T07:36:19.8249920Z * [new branch] gh/fduwjj/190/base -> origin/gh/fduwjj/190/base 2025-09-07T07:36:19.8251143Z * [new branch] gh/fduwjj/190/head -> origin/gh/fduwjj/190/head 2025-09-07T07:36:19.8252383Z * [new branch] gh/fduwjj/190/orig -> origin/gh/fduwjj/190/orig 2025-09-07T07:36:19.8253995Z * [new branch] gh/fduwjj/191/base -> origin/gh/fduwjj/191/base 2025-09-07T07:36:19.8255358Z * [new branch] gh/fduwjj/191/head -> origin/gh/fduwjj/191/head 2025-09-07T07:36:19.8256521Z * [new branch] gh/fduwjj/191/orig -> origin/gh/fduwjj/191/orig 2025-09-07T07:36:19.8258856Z * [new branch] gh/fegin/306/base -> origin/gh/fegin/306/base 2025-09-07T07:36:19.8259861Z * [new branch] gh/fegin/306/head -> origin/gh/fegin/306/head 2025-09-07T07:36:19.8261133Z * [new branch] gh/fegin/306/orig -> origin/gh/fegin/306/orig 2025-09-07T07:36:19.8262921Z * [new branch] gh/fegin/307/base -> origin/gh/fegin/307/base 2025-09-07T07:36:19.8263978Z * [new branch] gh/fegin/307/head -> origin/gh/fegin/307/head 2025-09-07T07:36:19.8265140Z * [new branch] gh/fegin/307/orig -> origin/gh/fegin/307/orig 2025-09-07T07:36:19.8267166Z * [new branch] gh/fegin/308/base -> origin/gh/fegin/308/base 2025-09-07T07:36:19.8268359Z * [new branch] gh/fegin/308/head -> origin/gh/fegin/308/head 2025-09-07T07:36:19.8269619Z * [new branch] gh/fegin/308/orig -> origin/gh/fegin/308/orig 2025-09-07T07:36:19.8271383Z * [new branch] gh/fegin/309/base -> origin/gh/fegin/309/base 2025-09-07T07:36:19.8272558Z * [new branch] gh/fegin/309/head -> origin/gh/fegin/309/head 2025-09-07T07:36:19.8273786Z * [new branch] gh/fegin/309/orig -> origin/gh/fegin/309/orig 2025-09-07T07:36:19.8276471Z * [new branch] gh/fegin/310/base -> origin/gh/fegin/310/base 2025-09-07T07:36:19.8276791Z * [new branch] gh/fegin/310/head -> origin/gh/fegin/310/head 2025-09-07T07:36:19.8277906Z * [new branch] gh/fegin/310/orig -> origin/gh/fegin/310/orig 2025-09-07T07:36:19.8279680Z * [new branch] gh/fegin/311/base -> origin/gh/fegin/311/base 2025-09-07T07:36:19.8280868Z * [new branch] gh/fegin/311/head -> origin/gh/fegin/311/head 2025-09-07T07:36:19.8282079Z * [new branch] gh/fegin/311/orig -> origin/gh/fegin/311/orig 2025-09-07T07:36:19.8283776Z * [new branch] gh/fegin/312/base -> origin/gh/fegin/312/base 2025-09-07T07:36:19.8284994Z * [new branch] gh/fegin/312/head -> origin/gh/fegin/312/head 2025-09-07T07:36:19.8286137Z * [new branch] gh/fegin/312/orig -> origin/gh/fegin/312/orig 2025-09-07T07:36:19.8287810Z * [new branch] gh/fegin/313/base -> origin/gh/fegin/313/base 2025-09-07T07:36:19.8288964Z * [new branch] gh/fegin/313/head -> origin/gh/fegin/313/head 2025-09-07T07:36:19.8290159Z * [new branch] gh/fegin/313/orig -> origin/gh/fegin/313/orig 2025-09-07T07:36:19.8292328Z * [new branch] gh/fffrog/124/base -> origin/gh/fffrog/124/base 2025-09-07T07:36:19.8293523Z * [new branch] gh/fffrog/124/head -> origin/gh/fffrog/124/head 2025-09-07T07:36:19.8294771Z * [new branch] gh/fffrog/124/orig -> origin/gh/fffrog/124/orig 2025-09-07T07:36:19.8296553Z * [new branch] gh/fffrog/129/base -> origin/gh/fffrog/129/base 2025-09-07T07:36:19.8297661Z * [new branch] gh/fffrog/129/head -> origin/gh/fffrog/129/head 2025-09-07T07:36:19.8298912Z * [new branch] gh/fffrog/129/orig -> origin/gh/fffrog/129/orig 2025-09-07T07:36:19.8301787Z * [new branch] gh/fffrog/130/base -> origin/gh/fffrog/130/base 2025-09-07T07:36:19.8303059Z * [new branch] gh/fffrog/130/head -> origin/gh/fffrog/130/head 2025-09-07T07:36:19.8303652Z * [new branch] gh/fffrog/130/orig -> origin/gh/fffrog/130/orig 2025-09-07T07:36:19.8304967Z * [new branch] gh/fffrog/131/base -> origin/gh/fffrog/131/base 2025-09-07T07:36:19.8306190Z * [new branch] gh/fffrog/131/head -> origin/gh/fffrog/131/head 2025-09-07T07:36:19.8307413Z * [new branch] gh/fffrog/131/orig -> origin/gh/fffrog/131/orig 2025-09-07T07:36:19.8309562Z * [new branch] gh/fffrog/132/base -> origin/gh/fffrog/132/base 2025-09-07T07:36:19.8310993Z * [new branch] gh/fffrog/132/head -> origin/gh/fffrog/132/head 2025-09-07T07:36:19.8312177Z * [new branch] gh/fffrog/132/orig -> origin/gh/fffrog/132/orig 2025-09-07T07:36:19.8313904Z * [new branch] gh/fffrog/133/base -> origin/gh/fffrog/133/base 2025-09-07T07:36:19.8315084Z * [new branch] gh/fffrog/133/head -> origin/gh/fffrog/133/head 2025-09-07T07:36:19.8316397Z * [new branch] gh/fffrog/133/orig -> origin/gh/fffrog/133/orig 2025-09-07T07:36:19.8318057Z * [new branch] gh/fffrog/134/base -> origin/gh/fffrog/134/base 2025-09-07T07:36:19.8319262Z * [new branch] gh/fffrog/134/head -> origin/gh/fffrog/134/head 2025-09-07T07:36:19.8320528Z * [new branch] gh/fffrog/134/orig -> origin/gh/fffrog/134/orig 2025-09-07T07:36:19.8322234Z * [new branch] gh/fffrog/135/base -> origin/gh/fffrog/135/base 2025-09-07T07:36:19.8323364Z * [new branch] gh/fffrog/135/head -> origin/gh/fffrog/135/head 2025-09-07T07:36:19.8324595Z * [new branch] gh/fffrog/135/orig -> origin/gh/fffrog/135/orig 2025-09-07T07:36:19.8326272Z * [new branch] gh/fffrog/136/base -> origin/gh/fffrog/136/base 2025-09-07T07:36:19.8327427Z * [new branch] gh/fffrog/136/head -> origin/gh/fffrog/136/head 2025-09-07T07:36:19.8328644Z * [new branch] gh/fffrog/136/orig -> origin/gh/fffrog/136/orig 2025-09-07T07:36:19.8330217Z * [new branch] gh/fffrog/137/base -> origin/gh/fffrog/137/base 2025-09-07T07:36:19.8331583Z * [new branch] gh/fffrog/137/head -> origin/gh/fffrog/137/head 2025-09-07T07:36:19.8332659Z * [new branch] gh/fffrog/137/orig -> origin/gh/fffrog/137/orig 2025-09-07T07:36:19.8334347Z * [new branch] gh/fffrog/138/base -> origin/gh/fffrog/138/base 2025-09-07T07:36:19.8335733Z * [new branch] gh/fffrog/138/head -> origin/gh/fffrog/138/head 2025-09-07T07:36:19.8336680Z * [new branch] gh/fffrog/138/orig -> origin/gh/fffrog/138/orig 2025-09-07T07:36:19.8338542Z * [new branch] gh/fffrog/139/base -> origin/gh/fffrog/139/base 2025-09-07T07:36:19.8340208Z * [new branch] gh/fffrog/139/head -> origin/gh/fffrog/139/head 2025-09-07T07:36:19.8341460Z * [new branch] gh/fffrog/139/orig -> origin/gh/fffrog/139/orig 2025-09-07T07:36:19.8343206Z * [new branch] gh/fffrog/140/base -> origin/gh/fffrog/140/base 2025-09-07T07:36:19.8344415Z * [new branch] gh/fffrog/140/head -> origin/gh/fffrog/140/head 2025-09-07T07:36:19.8345561Z * [new branch] gh/fffrog/140/orig -> origin/gh/fffrog/140/orig 2025-09-07T07:36:19.8347483Z * [new branch] gh/fffrog/141/base -> origin/gh/fffrog/141/base 2025-09-07T07:36:19.8348532Z * [new branch] gh/fffrog/141/head -> origin/gh/fffrog/141/head 2025-09-07T07:36:19.8349779Z * [new branch] gh/fffrog/141/orig -> origin/gh/fffrog/141/orig 2025-09-07T07:36:19.8351521Z * [new branch] gh/fffrog/142/base -> origin/gh/fffrog/142/base 2025-09-07T07:36:19.8352710Z * [new branch] gh/fffrog/142/head -> origin/gh/fffrog/142/head 2025-09-07T07:36:19.8353873Z * [new branch] gh/fffrog/142/orig -> origin/gh/fffrog/142/orig 2025-09-07T07:36:19.8355573Z * [new branch] gh/fffrog/143/base -> origin/gh/fffrog/143/base 2025-09-07T07:36:19.8356774Z * [new branch] gh/fffrog/143/head -> origin/gh/fffrog/143/head 2025-09-07T07:36:19.8357976Z * [new branch] gh/fffrog/143/orig -> origin/gh/fffrog/143/orig 2025-09-07T07:36:19.8360088Z * [new branch] gh/fffrog/144/base -> origin/gh/fffrog/144/base 2025-09-07T07:36:19.8361293Z * [new branch] gh/fffrog/144/head -> origin/gh/fffrog/144/head 2025-09-07T07:36:19.8362579Z * [new branch] gh/fffrog/144/orig -> origin/gh/fffrog/144/orig 2025-09-07T07:36:19.8364354Z * [new branch] gh/fffrog/145/base -> origin/gh/fffrog/145/base 2025-09-07T07:36:19.8365504Z * [new branch] gh/fffrog/145/head -> origin/gh/fffrog/145/head 2025-09-07T07:36:19.8366833Z * [new branch] gh/fffrog/145/orig -> origin/gh/fffrog/145/orig 2025-09-07T07:36:19.8368958Z * [new branch] gh/fffrog/146/base -> origin/gh/fffrog/146/base 2025-09-07T07:36:19.8369672Z * [new branch] gh/fffrog/146/head -> origin/gh/fffrog/146/head 2025-09-07T07:36:19.8370951Z * [new branch] gh/fffrog/146/orig -> origin/gh/fffrog/146/orig 2025-09-07T07:36:19.8372679Z * [new branch] gh/fffrog/147/base -> origin/gh/fffrog/147/base 2025-09-07T07:36:19.8374021Z * [new branch] gh/fffrog/147/head -> origin/gh/fffrog/147/head 2025-09-07T07:36:19.8375253Z * [new branch] gh/fffrog/147/orig -> origin/gh/fffrog/147/orig 2025-09-07T07:36:19.8377023Z * [new branch] gh/fffrog/148/base -> origin/gh/fffrog/148/base 2025-09-07T07:36:19.8378220Z * [new branch] gh/fffrog/148/head -> origin/gh/fffrog/148/head 2025-09-07T07:36:19.8379431Z * [new branch] gh/fffrog/148/orig -> origin/gh/fffrog/148/orig 2025-09-07T07:36:19.8381169Z * [new branch] gh/fffrog/149/base -> origin/gh/fffrog/149/base 2025-09-07T07:36:19.8382344Z * [new branch] gh/fffrog/149/head -> origin/gh/fffrog/149/head 2025-09-07T07:36:19.8383701Z * [new branch] gh/fffrog/149/orig -> origin/gh/fffrog/149/orig 2025-09-07T07:36:19.8385369Z * [new branch] gh/fffrog/150/base -> origin/gh/fffrog/150/base 2025-09-07T07:36:19.8386640Z * [new branch] gh/fffrog/150/head -> origin/gh/fffrog/150/head 2025-09-07T07:36:19.8387897Z * [new branch] gh/fffrog/150/orig -> origin/gh/fffrog/150/orig 2025-09-07T07:36:19.8389656Z * [new branch] gh/fffrog/151/base -> origin/gh/fffrog/151/base 2025-09-07T07:36:19.8390897Z * [new branch] gh/fffrog/151/head -> origin/gh/fffrog/151/head 2025-09-07T07:36:19.8392046Z * [new branch] gh/fffrog/151/orig -> origin/gh/fffrog/151/orig 2025-09-07T07:36:19.8393812Z * [new branch] gh/fffrog/152/base -> origin/gh/fffrog/152/base 2025-09-07T07:36:19.8395015Z * [new branch] gh/fffrog/152/head -> origin/gh/fffrog/152/head 2025-09-07T07:36:19.8396916Z * [new branch] gh/fffrog/153/base -> origin/gh/fffrog/153/base 2025-09-07T07:36:19.8398007Z * [new branch] gh/fffrog/153/head -> origin/gh/fffrog/153/head 2025-09-07T07:36:19.8399192Z * [new branch] gh/fffrog/153/orig -> origin/gh/fffrog/153/orig 2025-09-07T07:36:19.8401398Z * [new branch] gh/gmagogsfm/1/base -> origin/gh/gmagogsfm/1/base 2025-09-07T07:36:19.8402595Z * [new branch] gh/gmagogsfm/1/head -> origin/gh/gmagogsfm/1/head 2025-09-07T07:36:19.8403878Z * [new branch] gh/gmagogsfm/1/orig -> origin/gh/gmagogsfm/1/orig 2025-09-07T07:36:19.8405537Z * [new branch] gh/gmagogsfm/2/base -> origin/gh/gmagogsfm/2/base 2025-09-07T07:36:19.8406655Z * [new branch] gh/gmagogsfm/2/head -> origin/gh/gmagogsfm/2/head 2025-09-07T07:36:19.8407841Z * [new branch] gh/gmagogsfm/2/orig -> origin/gh/gmagogsfm/2/orig 2025-09-07T07:36:19.8409593Z * [new branch] gh/gmagogsfm/3/base -> origin/gh/gmagogsfm/3/base 2025-09-07T07:36:19.8411012Z * [new branch] gh/gmagogsfm/3/head -> origin/gh/gmagogsfm/3/head 2025-09-07T07:36:19.8412223Z * [new branch] gh/gmagogsfm/3/orig -> origin/gh/gmagogsfm/3/orig 2025-09-07T07:36:19.8414291Z * [new branch] gh/guangyey/134/base -> origin/gh/guangyey/134/base 2025-09-07T07:36:19.8415556Z * [new branch] gh/guangyey/134/head -> origin/gh/guangyey/134/head 2025-09-07T07:36:19.8416726Z * [new branch] gh/guangyey/134/orig -> origin/gh/guangyey/134/orig 2025-09-07T07:36:19.8418469Z * [new branch] gh/guangyey/135/base -> origin/gh/guangyey/135/base 2025-09-07T07:36:19.8419637Z * [new branch] gh/guangyey/135/head -> origin/gh/guangyey/135/head 2025-09-07T07:36:19.8420847Z * [new branch] gh/guangyey/135/orig -> origin/gh/guangyey/135/orig 2025-09-07T07:36:19.8422507Z * [new branch] gh/guangyey/139/base -> origin/gh/guangyey/139/base 2025-09-07T07:36:19.8423670Z * [new branch] gh/guangyey/139/head -> origin/gh/guangyey/139/head 2025-09-07T07:36:19.8424839Z * [new branch] gh/guangyey/139/orig -> origin/gh/guangyey/139/orig 2025-09-07T07:36:19.8426614Z * [new branch] gh/guangyey/140/base -> origin/gh/guangyey/140/base 2025-09-07T07:36:19.8427802Z * [new branch] gh/guangyey/140/head -> origin/gh/guangyey/140/head 2025-09-07T07:36:19.8428996Z * [new branch] gh/guangyey/140/orig -> origin/gh/guangyey/140/orig 2025-09-07T07:36:19.8430705Z * [new branch] gh/guangyey/142/base -> origin/gh/guangyey/142/base 2025-09-07T07:36:19.8431921Z * [new branch] gh/guangyey/142/head -> origin/gh/guangyey/142/head 2025-09-07T07:36:19.8433175Z * [new branch] gh/guangyey/142/orig -> origin/gh/guangyey/142/orig 2025-09-07T07:36:19.8434841Z * [new branch] gh/guangyey/145/base -> origin/gh/guangyey/145/base 2025-09-07T07:36:19.8436078Z * [new branch] gh/guangyey/145/head -> origin/gh/guangyey/145/head 2025-09-07T07:36:19.8437244Z * [new branch] gh/guangyey/145/orig -> origin/gh/guangyey/145/orig 2025-09-07T07:36:19.8438903Z * [new branch] gh/guangyey/153/base -> origin/gh/guangyey/153/base 2025-09-07T07:36:19.8440070Z * [new branch] gh/guangyey/153/head -> origin/gh/guangyey/153/head 2025-09-07T07:36:19.8441252Z * [new branch] gh/guangyey/153/orig -> origin/gh/guangyey/153/orig 2025-09-07T07:36:19.8442934Z * [new branch] gh/guangyey/159/base -> origin/gh/guangyey/159/base 2025-09-07T07:36:19.8444246Z * [new branch] gh/guangyey/159/head -> origin/gh/guangyey/159/head 2025-09-07T07:36:19.8445696Z * [new branch] gh/guangyey/159/orig -> origin/gh/guangyey/159/orig 2025-09-07T07:36:19.8447708Z * [new branch] gh/guangyey/163/base -> origin/gh/guangyey/163/base 2025-09-07T07:36:19.8448986Z * [new branch] gh/guangyey/163/head -> origin/gh/guangyey/163/head 2025-09-07T07:36:19.8450127Z * [new branch] gh/guangyey/163/orig -> origin/gh/guangyey/163/orig 2025-09-07T07:36:19.8451851Z * [new branch] gh/guangyey/168/base -> origin/gh/guangyey/168/base 2025-09-07T07:36:19.8453027Z * [new branch] gh/guangyey/168/head -> origin/gh/guangyey/168/head 2025-09-07T07:36:19.8454204Z * [new branch] gh/guangyey/168/orig -> origin/gh/guangyey/168/orig 2025-09-07T07:36:19.8455868Z * [new branch] gh/guangyey/169/base -> origin/gh/guangyey/169/base 2025-09-07T07:36:19.8480317Z * [new branch] gh/guangyey/169/head -> origin/gh/guangyey/169/head 2025-09-07T07:36:19.8480738Z * [new branch] gh/guangyey/169/orig -> origin/gh/guangyey/169/orig 2025-09-07T07:36:19.8480913Z * [new branch] gh/guangyey/170/base -> origin/gh/guangyey/170/base 2025-09-07T07:36:19.8481086Z * [new branch] gh/guangyey/170/head -> origin/gh/guangyey/170/head 2025-09-07T07:36:19.8481280Z * [new branch] gh/guangyey/170/orig -> origin/gh/guangyey/170/orig 2025-09-07T07:36:19.8481447Z * [new branch] gh/guangyey/171/base -> origin/gh/guangyey/171/base 2025-09-07T07:36:19.8481607Z * [new branch] gh/guangyey/171/head -> origin/gh/guangyey/171/head 2025-09-07T07:36:19.8481733Z * [new branch] gh/guangyey/171/orig -> origin/gh/guangyey/171/orig 2025-09-07T07:36:19.8481869Z * [new branch] gh/guangyey/174/base -> origin/gh/guangyey/174/base 2025-09-07T07:36:19.8482177Z * [new branch] gh/guangyey/174/head -> origin/gh/guangyey/174/head 2025-09-07T07:36:19.8482312Z * [new branch] gh/guangyey/174/orig -> origin/gh/guangyey/174/orig 2025-09-07T07:36:19.8482434Z * [new branch] gh/guangyey/176/base -> origin/gh/guangyey/176/base 2025-09-07T07:36:19.8482562Z * [new branch] gh/guangyey/176/head -> origin/gh/guangyey/176/head 2025-09-07T07:36:19.8482684Z * [new branch] gh/guangyey/176/orig -> origin/gh/guangyey/176/orig 2025-09-07T07:36:19.8482808Z * [new branch] gh/guangyey/178/base -> origin/gh/guangyey/178/base 2025-09-07T07:36:19.8482946Z * [new branch] gh/guangyey/178/head -> origin/gh/guangyey/178/head 2025-09-07T07:36:19.8483070Z * [new branch] gh/guangyey/178/orig -> origin/gh/guangyey/178/orig 2025-09-07T07:36:19.8483198Z * [new branch] gh/guangyey/181/base -> origin/gh/guangyey/181/base 2025-09-07T07:36:19.8483333Z * [new branch] gh/guangyey/181/head -> origin/gh/guangyey/181/head 2025-09-07T07:36:19.8483473Z * [new branch] gh/guangyey/181/orig -> origin/gh/guangyey/181/orig 2025-09-07T07:36:19.8485157Z * [new branch] gh/guangyey/182/base -> origin/gh/guangyey/182/base 2025-09-07T07:36:19.8486326Z * [new branch] gh/guangyey/182/head -> origin/gh/guangyey/182/head 2025-09-07T07:36:19.8487614Z * [new branch] gh/guangyey/182/orig -> origin/gh/guangyey/182/orig 2025-09-07T07:36:19.8489286Z * [new branch] gh/guangyey/183/base -> origin/gh/guangyey/183/base 2025-09-07T07:36:19.8490517Z * [new branch] gh/guangyey/183/head -> origin/gh/guangyey/183/head 2025-09-07T07:36:19.8491735Z * [new branch] gh/guangyey/183/orig -> origin/gh/guangyey/183/orig 2025-09-07T07:36:19.8493972Z * [new branch] gh/guangyey/184/base -> origin/gh/guangyey/184/base 2025-09-07T07:36:19.8495243Z * [new branch] gh/guangyey/184/head -> origin/gh/guangyey/184/head 2025-09-07T07:36:19.8496385Z * [new branch] gh/guangyey/184/orig -> origin/gh/guangyey/184/orig 2025-09-07T07:36:19.8498101Z * [new branch] gh/guangyey/185/base -> origin/gh/guangyey/185/base 2025-09-07T07:36:19.8499408Z * [new branch] gh/guangyey/185/head -> origin/gh/guangyey/185/head 2025-09-07T07:36:19.8500649Z * [new branch] gh/guangyey/185/orig -> origin/gh/guangyey/185/orig 2025-09-07T07:36:19.8502378Z * [new branch] gh/guangyey/186/base -> origin/gh/guangyey/186/base 2025-09-07T07:36:19.8503570Z * [new branch] gh/guangyey/186/head -> origin/gh/guangyey/186/head 2025-09-07T07:36:19.8504706Z * [new branch] gh/guangyey/186/orig -> origin/gh/guangyey/186/orig 2025-09-07T07:36:19.8506502Z * [new branch] gh/guangyey/187/base -> origin/gh/guangyey/187/base 2025-09-07T07:36:19.8507682Z * [new branch] gh/guangyey/187/head -> origin/gh/guangyey/187/head 2025-09-07T07:36:19.8508845Z * [new branch] gh/guangyey/187/orig -> origin/gh/guangyey/187/orig 2025-09-07T07:36:19.8510876Z * [new branch] gh/guangyey/188/base -> origin/gh/guangyey/188/base 2025-09-07T07:36:19.8512063Z * [new branch] gh/guangyey/188/head -> origin/gh/guangyey/188/head 2025-09-07T07:36:19.8513224Z * [new branch] gh/guangyey/188/orig -> origin/gh/guangyey/188/orig 2025-09-07T07:36:19.8515242Z * [new branch] gh/guangyey/189/base -> origin/gh/guangyey/189/base 2025-09-07T07:36:19.8516500Z * [new branch] gh/guangyey/189/head -> origin/gh/guangyey/189/head 2025-09-07T07:36:19.8517706Z * [new branch] gh/guangyey/189/orig -> origin/gh/guangyey/189/orig 2025-09-07T07:36:19.8519455Z * [new branch] gh/guangyey/190/base -> origin/gh/guangyey/190/base 2025-09-07T07:36:19.8520639Z * [new branch] gh/guangyey/190/head -> origin/gh/guangyey/190/head 2025-09-07T07:36:19.8521838Z * [new branch] gh/guangyey/190/orig -> origin/gh/guangyey/190/orig 2025-09-07T07:36:19.8523556Z * [new branch] gh/guangyey/191/base -> origin/gh/guangyey/191/base 2025-09-07T07:36:19.8524780Z * [new branch] gh/guangyey/191/head -> origin/gh/guangyey/191/head 2025-09-07T07:36:19.8525926Z * [new branch] gh/guangyey/191/orig -> origin/gh/guangyey/191/orig 2025-09-07T07:36:19.8527664Z * [new branch] gh/guangyey/192/base -> origin/gh/guangyey/192/base 2025-09-07T07:36:19.8528908Z * [new branch] gh/guangyey/192/head -> origin/gh/guangyey/192/head 2025-09-07T07:36:19.8530125Z * [new branch] gh/guangyey/192/orig -> origin/gh/guangyey/192/orig 2025-09-07T07:36:19.8531869Z * [new branch] gh/guangyey/193/base -> origin/gh/guangyey/193/base 2025-09-07T07:36:19.8533156Z * [new branch] gh/guangyey/193/head -> origin/gh/guangyey/193/head 2025-09-07T07:36:19.8534299Z * [new branch] gh/guangyey/193/orig -> origin/gh/guangyey/193/orig 2025-09-07T07:36:19.8536089Z * [new branch] gh/guangyey/194/base -> origin/gh/guangyey/194/base 2025-09-07T07:36:19.8537263Z * [new branch] gh/guangyey/194/head -> origin/gh/guangyey/194/head 2025-09-07T07:36:19.8538503Z * [new branch] gh/guangyey/194/orig -> origin/gh/guangyey/194/orig 2025-09-07T07:36:19.8540208Z * [new branch] gh/guangyey/195/base -> origin/gh/guangyey/195/base 2025-09-07T07:36:19.8541446Z * [new branch] gh/guangyey/195/head -> origin/gh/guangyey/195/head 2025-09-07T07:36:19.8542668Z * [new branch] gh/guangyey/195/orig -> origin/gh/guangyey/195/orig 2025-09-07T07:36:19.8544424Z * [new branch] gh/guangyey/196/base -> origin/gh/guangyey/196/base 2025-09-07T07:36:19.8545511Z * [new branch] gh/guangyey/196/head -> origin/gh/guangyey/196/head 2025-09-07T07:36:19.8546754Z * [new branch] gh/guangyey/196/orig -> origin/gh/guangyey/196/orig 2025-09-07T07:36:19.8548569Z * [new branch] gh/guangyey/197/base -> origin/gh/guangyey/197/base 2025-09-07T07:36:19.8549872Z * [new branch] gh/guangyey/197/head -> origin/gh/guangyey/197/head 2025-09-07T07:36:19.8551206Z * [new branch] gh/guangyey/197/orig -> origin/gh/guangyey/197/orig 2025-09-07T07:36:19.8552952Z * [new branch] gh/guangyey/198/base -> origin/gh/guangyey/198/base 2025-09-07T07:36:19.8554164Z * [new branch] gh/guangyey/198/head -> origin/gh/guangyey/198/head 2025-09-07T07:36:19.8555336Z * [new branch] gh/guangyey/198/orig -> origin/gh/guangyey/198/orig 2025-09-07T07:36:19.8557012Z * [new branch] gh/guangyey/199/base -> origin/gh/guangyey/199/base 2025-09-07T07:36:19.8558172Z * [new branch] gh/guangyey/199/head -> origin/gh/guangyey/199/head 2025-09-07T07:36:19.8559598Z * [new branch] gh/guangyey/199/orig -> origin/gh/guangyey/199/orig 2025-09-07T07:36:19.8561093Z * [new branch] gh/guangyey/200/base -> origin/gh/guangyey/200/base 2025-09-07T07:36:19.8562249Z * [new branch] gh/guangyey/200/head -> origin/gh/guangyey/200/head 2025-09-07T07:36:19.8563453Z * [new branch] gh/guangyey/200/orig -> origin/gh/guangyey/200/orig 2025-09-07T07:36:19.8565211Z * [new branch] gh/guangyey/201/base -> origin/gh/guangyey/201/base 2025-09-07T07:36:19.8566525Z * [new branch] gh/guangyey/201/head -> origin/gh/guangyey/201/head 2025-09-07T07:36:19.8567680Z * [new branch] gh/guangyey/201/orig -> origin/gh/guangyey/201/orig 2025-09-07T07:36:19.8569732Z * [new branch] gh/guangyey/202/base -> origin/gh/guangyey/202/base 2025-09-07T07:36:19.8570667Z * [new branch] gh/guangyey/202/head -> origin/gh/guangyey/202/head 2025-09-07T07:36:19.8571820Z * [new branch] gh/guangyey/202/orig -> origin/gh/guangyey/202/orig 2025-09-07T07:36:19.8573570Z * [new branch] gh/guangyey/203/base -> origin/gh/guangyey/203/base 2025-09-07T07:36:19.8574691Z * [new branch] gh/guangyey/203/head -> origin/gh/guangyey/203/head 2025-09-07T07:36:19.8575872Z * [new branch] gh/guangyey/203/orig -> origin/gh/guangyey/203/orig 2025-09-07T07:36:19.8577594Z * [new branch] gh/guangyey/204/base -> origin/gh/guangyey/204/base 2025-09-07T07:36:19.8578832Z * [new branch] gh/guangyey/204/head -> origin/gh/guangyey/204/head 2025-09-07T07:36:19.8579999Z * [new branch] gh/guangyey/204/orig -> origin/gh/guangyey/204/orig 2025-09-07T07:36:19.8581712Z * [new branch] gh/guangyey/205/base -> origin/gh/guangyey/205/base 2025-09-07T07:36:19.8582949Z * [new branch] gh/guangyey/205/head -> origin/gh/guangyey/205/head 2025-09-07T07:36:19.8584153Z * [new branch] gh/guangyey/205/orig -> origin/gh/guangyey/205/orig 2025-09-07T07:36:19.8586040Z * [new branch] gh/guangyey/206/base -> origin/gh/guangyey/206/base 2025-09-07T07:36:19.8587234Z * [new branch] gh/guangyey/206/head -> origin/gh/guangyey/206/head 2025-09-07T07:36:19.8588431Z * [new branch] gh/guangyey/206/orig -> origin/gh/guangyey/206/orig 2025-09-07T07:36:19.8590144Z * [new branch] gh/guangyey/207/base -> origin/gh/guangyey/207/base 2025-09-07T07:36:19.8591381Z * [new branch] gh/guangyey/207/head -> origin/gh/guangyey/207/head 2025-09-07T07:36:19.8592633Z * [new branch] gh/guangyey/207/orig -> origin/gh/guangyey/207/orig 2025-09-07T07:36:19.8594378Z * [new branch] gh/guangyey/79/base -> origin/gh/guangyey/79/base 2025-09-07T07:36:19.8595548Z * [new branch] gh/guangyey/79/head -> origin/gh/guangyey/79/head 2025-09-07T07:36:19.8596710Z * [new branch] gh/guangyey/79/orig -> origin/gh/guangyey/79/orig 2025-09-07T07:36:19.8598469Z * [new branch] gh/guangyey/89/base -> origin/gh/guangyey/89/base 2025-09-07T07:36:19.8599734Z * [new branch] gh/guangyey/89/head -> origin/gh/guangyey/89/head 2025-09-07T07:36:19.8600914Z * [new branch] gh/guangyey/89/orig -> origin/gh/guangyey/89/orig 2025-09-07T07:36:19.8603131Z * [new branch] gh/guilhermeleobas/107/base -> origin/gh/guilhermeleobas/107/base 2025-09-07T07:36:19.8604333Z * [new branch] gh/guilhermeleobas/107/head -> origin/gh/guilhermeleobas/107/head 2025-09-07T07:36:19.8605707Z * [new branch] gh/guilhermeleobas/107/orig -> origin/gh/guilhermeleobas/107/orig 2025-09-07T07:36:19.8607350Z * [new branch] gh/guilhermeleobas/108/base -> origin/gh/guilhermeleobas/108/base 2025-09-07T07:36:19.8608643Z * [new branch] gh/guilhermeleobas/108/head -> origin/gh/guilhermeleobas/108/head 2025-09-07T07:36:19.8613205Z * [new branch] gh/guilhermeleobas/108/orig -> origin/gh/guilhermeleobas/108/orig 2025-09-07T07:36:19.8615495Z * [new branch] gh/guilhermeleobas/124/base -> origin/gh/guilhermeleobas/124/base 2025-09-07T07:36:19.8616892Z * [new branch] gh/guilhermeleobas/124/head -> origin/gh/guilhermeleobas/124/head 2025-09-07T07:36:19.8617963Z * [new branch] gh/guilhermeleobas/124/orig -> origin/gh/guilhermeleobas/124/orig 2025-09-07T07:36:19.8619768Z * [new branch] gh/guilhermeleobas/147/base -> origin/gh/guilhermeleobas/147/base 2025-09-07T07:36:19.8620931Z * [new branch] gh/guilhermeleobas/147/head -> origin/gh/guilhermeleobas/147/head 2025-09-07T07:36:19.8622155Z * [new branch] gh/guilhermeleobas/147/orig -> origin/gh/guilhermeleobas/147/orig 2025-09-07T07:36:19.8623873Z * [new branch] gh/guilhermeleobas/150/base -> origin/gh/guilhermeleobas/150/base 2025-09-07T07:36:19.8625196Z * [new branch] gh/guilhermeleobas/150/head -> origin/gh/guilhermeleobas/150/head 2025-09-07T07:36:19.8626513Z * [new branch] gh/guilhermeleobas/150/orig -> origin/gh/guilhermeleobas/150/orig 2025-09-07T07:36:19.8628256Z * [new branch] gh/guilhermeleobas/163/base -> origin/gh/guilhermeleobas/163/base 2025-09-07T07:36:19.8629478Z * [new branch] gh/guilhermeleobas/163/head -> origin/gh/guilhermeleobas/163/head 2025-09-07T07:36:19.8630639Z * [new branch] gh/guilhermeleobas/163/orig -> origin/gh/guilhermeleobas/163/orig 2025-09-07T07:36:19.8632330Z * [new branch] gh/guilhermeleobas/164/base -> origin/gh/guilhermeleobas/164/base 2025-09-07T07:36:19.8633496Z * [new branch] gh/guilhermeleobas/164/head -> origin/gh/guilhermeleobas/164/head 2025-09-07T07:36:19.8634665Z * [new branch] gh/guilhermeleobas/164/orig -> origin/gh/guilhermeleobas/164/orig 2025-09-07T07:36:19.8636701Z * [new branch] gh/guilhermeleobas/165/base -> origin/gh/guilhermeleobas/165/base 2025-09-07T07:36:19.8637655Z * [new branch] gh/guilhermeleobas/165/head -> origin/gh/guilhermeleobas/165/head 2025-09-07T07:36:19.8638835Z * [new branch] gh/guilhermeleobas/165/orig -> origin/gh/guilhermeleobas/165/orig 2025-09-07T07:36:19.8640523Z * [new branch] gh/guilhermeleobas/166/base -> origin/gh/guilhermeleobas/166/base 2025-09-07T07:36:19.8641732Z * [new branch] gh/guilhermeleobas/166/head -> origin/gh/guilhermeleobas/166/head 2025-09-07T07:36:19.8642896Z * [new branch] gh/guilhermeleobas/166/orig -> origin/gh/guilhermeleobas/166/orig 2025-09-07T07:36:19.8644692Z * [new branch] gh/guilhermeleobas/167/base -> origin/gh/guilhermeleobas/167/base 2025-09-07T07:36:19.8645759Z * [new branch] gh/guilhermeleobas/167/head -> origin/gh/guilhermeleobas/167/head 2025-09-07T07:36:19.8646960Z * [new branch] gh/guilhermeleobas/167/orig -> origin/gh/guilhermeleobas/167/orig 2025-09-07T07:36:19.8648647Z * [new branch] gh/guilhermeleobas/168/base -> origin/gh/guilhermeleobas/168/base 2025-09-07T07:36:19.8649833Z * [new branch] gh/guilhermeleobas/168/head -> origin/gh/guilhermeleobas/168/head 2025-09-07T07:36:19.8650990Z * [new branch] gh/guilhermeleobas/168/orig -> origin/gh/guilhermeleobas/168/orig 2025-09-07T07:36:19.8652773Z * [new branch] gh/guilhermeleobas/169/base -> origin/gh/guilhermeleobas/169/base 2025-09-07T07:36:19.8653946Z * [new branch] gh/guilhermeleobas/169/head -> origin/gh/guilhermeleobas/169/head 2025-09-07T07:36:19.8655130Z * [new branch] gh/guilhermeleobas/169/orig -> origin/gh/guilhermeleobas/169/orig 2025-09-07T07:36:19.8656885Z * [new branch] gh/guilhermeleobas/170/base -> origin/gh/guilhermeleobas/170/base 2025-09-07T07:36:19.8658086Z * [new branch] gh/guilhermeleobas/170/head -> origin/gh/guilhermeleobas/170/head 2025-09-07T07:36:19.8659385Z * [new branch] gh/guilhermeleobas/170/orig -> origin/gh/guilhermeleobas/170/orig 2025-09-07T07:36:19.8661051Z * [new branch] gh/guilhermeleobas/171/base -> origin/gh/guilhermeleobas/171/base 2025-09-07T07:36:19.8662468Z * [new branch] gh/guilhermeleobas/171/head -> origin/gh/guilhermeleobas/171/head 2025-09-07T07:36:19.8663606Z * [new branch] gh/guilhermeleobas/171/orig -> origin/gh/guilhermeleobas/171/orig 2025-09-07T07:36:19.8665350Z * [new branch] gh/guilhermeleobas/173/base -> origin/gh/guilhermeleobas/173/base 2025-09-07T07:36:19.8666606Z * [new branch] gh/guilhermeleobas/173/head -> origin/gh/guilhermeleobas/173/head 2025-09-07T07:36:19.8667801Z * [new branch] gh/guilhermeleobas/173/orig -> origin/gh/guilhermeleobas/173/orig 2025-09-07T07:36:19.8669523Z * [new branch] gh/guilhermeleobas/192/base -> origin/gh/guilhermeleobas/192/base 2025-09-07T07:36:19.8670757Z * [new branch] gh/guilhermeleobas/192/head -> origin/gh/guilhermeleobas/192/head 2025-09-07T07:36:19.8671932Z * [new branch] gh/guilhermeleobas/192/orig -> origin/gh/guilhermeleobas/192/orig 2025-09-07T07:36:19.8673985Z * [new branch] gh/guilhermeleobas/193/base -> origin/gh/guilhermeleobas/193/base 2025-09-07T07:36:19.8675202Z * [new branch] gh/guilhermeleobas/193/head -> origin/gh/guilhermeleobas/193/head 2025-09-07T07:36:19.8676450Z * [new branch] gh/guilhermeleobas/193/orig -> origin/gh/guilhermeleobas/193/orig 2025-09-07T07:36:19.8678576Z * [new branch] gh/guilhermeleobas/194/base -> origin/gh/guilhermeleobas/194/base 2025-09-07T07:36:19.8679788Z * [new branch] gh/guilhermeleobas/194/head -> origin/gh/guilhermeleobas/194/head 2025-09-07T07:36:19.8680977Z * [new branch] gh/guilhermeleobas/194/orig -> origin/gh/guilhermeleobas/194/orig 2025-09-07T07:36:19.8682688Z * [new branch] gh/guilhermeleobas/203/base -> origin/gh/guilhermeleobas/203/base 2025-09-07T07:36:19.8683879Z * [new branch] gh/guilhermeleobas/203/head -> origin/gh/guilhermeleobas/203/head 2025-09-07T07:36:19.8685043Z * [new branch] gh/guilhermeleobas/203/orig -> origin/gh/guilhermeleobas/203/orig 2025-09-07T07:36:19.8686826Z * [new branch] gh/guilhermeleobas/204/base -> origin/gh/guilhermeleobas/204/base 2025-09-07T07:36:19.8688019Z * [new branch] gh/guilhermeleobas/204/head -> origin/gh/guilhermeleobas/204/head 2025-09-07T07:36:19.8689193Z * [new branch] gh/guilhermeleobas/204/orig -> origin/gh/guilhermeleobas/204/orig 2025-09-07T07:36:19.8691017Z * [new branch] gh/guilhermeleobas/205/base -> origin/gh/guilhermeleobas/205/base 2025-09-07T07:36:19.8692136Z * [new branch] gh/guilhermeleobas/205/head -> origin/gh/guilhermeleobas/205/head 2025-09-07T07:36:19.8693319Z * [new branch] gh/guilhermeleobas/205/orig -> origin/gh/guilhermeleobas/205/orig 2025-09-07T07:36:19.8695193Z * [new branch] gh/guilhermeleobas/209/base -> origin/gh/guilhermeleobas/209/base 2025-09-07T07:36:19.8696367Z * [new branch] gh/guilhermeleobas/209/head -> origin/gh/guilhermeleobas/209/head 2025-09-07T07:36:19.8697652Z * [new branch] gh/guilhermeleobas/209/orig -> origin/gh/guilhermeleobas/209/orig 2025-09-07T07:36:19.8699439Z * [new branch] gh/guilhermeleobas/210/base -> origin/gh/guilhermeleobas/210/base 2025-09-07T07:36:19.8700686Z * [new branch] gh/guilhermeleobas/210/head -> origin/gh/guilhermeleobas/210/head 2025-09-07T07:36:19.8701873Z * [new branch] gh/guilhermeleobas/210/orig -> origin/gh/guilhermeleobas/210/orig 2025-09-07T07:36:19.8703650Z * [new branch] gh/guilhermeleobas/211/base -> origin/gh/guilhermeleobas/211/base 2025-09-07T07:36:19.8704842Z * [new branch] gh/guilhermeleobas/211/head -> origin/gh/guilhermeleobas/211/head 2025-09-07T07:36:19.8706080Z * [new branch] gh/guilhermeleobas/211/orig -> origin/gh/guilhermeleobas/211/orig 2025-09-07T07:36:19.8708025Z * [new branch] gh/guilhermeleobas/214/base -> origin/gh/guilhermeleobas/214/base 2025-09-07T07:36:19.8709182Z * [new branch] gh/guilhermeleobas/214/head -> origin/gh/guilhermeleobas/214/head 2025-09-07T07:36:19.8710563Z * [new branch] gh/guilhermeleobas/214/orig -> origin/gh/guilhermeleobas/214/orig 2025-09-07T07:36:19.8712341Z * [new branch] gh/guilhermeleobas/215/base -> origin/gh/guilhermeleobas/215/base 2025-09-07T07:36:19.8713551Z * [new branch] gh/guilhermeleobas/215/head -> origin/gh/guilhermeleobas/215/head 2025-09-07T07:36:19.8714762Z * [new branch] gh/guilhermeleobas/215/orig -> origin/gh/guilhermeleobas/215/orig 2025-09-07T07:36:19.8716485Z * [new branch] gh/guilhermeleobas/216/base -> origin/gh/guilhermeleobas/216/base 2025-09-07T07:36:19.8717705Z * [new branch] gh/guilhermeleobas/216/head -> origin/gh/guilhermeleobas/216/head 2025-09-07T07:36:19.8718888Z * [new branch] gh/guilhermeleobas/216/orig -> origin/gh/guilhermeleobas/216/orig 2025-09-07T07:36:19.8720727Z * [new branch] gh/guilhermeleobas/217/base -> origin/gh/guilhermeleobas/217/base 2025-09-07T07:36:19.8721884Z * [new branch] gh/guilhermeleobas/217/head -> origin/gh/guilhermeleobas/217/head 2025-09-07T07:36:19.8723074Z * [new branch] gh/guilhermeleobas/217/orig -> origin/gh/guilhermeleobas/217/orig 2025-09-07T07:36:19.8724770Z * [new branch] gh/guilhermeleobas/219/base -> origin/gh/guilhermeleobas/219/base 2025-09-07T07:36:19.8725961Z * [new branch] gh/guilhermeleobas/219/head -> origin/gh/guilhermeleobas/219/head 2025-09-07T07:36:19.8727135Z * [new branch] gh/guilhermeleobas/219/orig -> origin/gh/guilhermeleobas/219/orig 2025-09-07T07:36:19.8728860Z * [new branch] gh/guilhermeleobas/220/base -> origin/gh/guilhermeleobas/220/base 2025-09-07T07:36:19.8730268Z * [new branch] gh/guilhermeleobas/220/head -> origin/gh/guilhermeleobas/220/head 2025-09-07T07:36:19.8731432Z * [new branch] gh/guilhermeleobas/220/orig -> origin/gh/guilhermeleobas/220/orig 2025-09-07T07:36:19.8733192Z * [new branch] gh/guilhermeleobas/221/base -> origin/gh/guilhermeleobas/221/base 2025-09-07T07:36:19.8734384Z * [new branch] gh/guilhermeleobas/221/head -> origin/gh/guilhermeleobas/221/head 2025-09-07T07:36:19.8735596Z * [new branch] gh/guilhermeleobas/221/orig -> origin/gh/guilhermeleobas/221/orig 2025-09-07T07:36:19.8737556Z * [new branch] gh/guilhermeleobas/222/base -> origin/gh/guilhermeleobas/222/base 2025-09-07T07:36:19.8738583Z * [new branch] gh/guilhermeleobas/222/head -> origin/gh/guilhermeleobas/222/head 2025-09-07T07:36:19.8739825Z * [new branch] gh/guilhermeleobas/222/orig -> origin/gh/guilhermeleobas/222/orig 2025-09-07T07:36:19.8741580Z * [new branch] gh/guilhermeleobas/223/base -> origin/gh/guilhermeleobas/223/base 2025-09-07T07:36:19.8742829Z * [new branch] gh/guilhermeleobas/223/head -> origin/gh/guilhermeleobas/223/head 2025-09-07T07:36:19.8744090Z * [new branch] gh/guilhermeleobas/223/orig -> origin/gh/guilhermeleobas/223/orig 2025-09-07T07:36:19.8745871Z * [new branch] gh/guilhermeleobas/224/base -> origin/gh/guilhermeleobas/224/base 2025-09-07T07:36:19.8747111Z * [new branch] gh/guilhermeleobas/224/head -> origin/gh/guilhermeleobas/224/head 2025-09-07T07:36:19.8748252Z * [new branch] gh/guilhermeleobas/224/orig -> origin/gh/guilhermeleobas/224/orig 2025-09-07T07:36:19.8750000Z * [new branch] gh/guilhermeleobas/225/base -> origin/gh/guilhermeleobas/225/base 2025-09-07T07:36:19.8751238Z * [new branch] gh/guilhermeleobas/225/head -> origin/gh/guilhermeleobas/225/head 2025-09-07T07:36:19.8752414Z * [new branch] gh/guilhermeleobas/225/orig -> origin/gh/guilhermeleobas/225/orig 2025-09-07T07:36:19.8754274Z * [new branch] gh/guilhermeleobas/226/base -> origin/gh/guilhermeleobas/226/base 2025-09-07T07:36:19.8755470Z * [new branch] gh/guilhermeleobas/226/head -> origin/gh/guilhermeleobas/226/head 2025-09-07T07:36:19.8756635Z * [new branch] gh/guilhermeleobas/226/orig -> origin/gh/guilhermeleobas/226/orig 2025-09-07T07:36:19.8758407Z * [new branch] gh/guilhermeleobas/227/base -> origin/gh/guilhermeleobas/227/base 2025-09-07T07:36:19.8759590Z * [new branch] gh/guilhermeleobas/227/head -> origin/gh/guilhermeleobas/227/head 2025-09-07T07:36:19.8760798Z * [new branch] gh/guilhermeleobas/227/orig -> origin/gh/guilhermeleobas/227/orig 2025-09-07T07:36:19.8762572Z * [new branch] gh/guilhermeleobas/228/base -> origin/gh/guilhermeleobas/228/base 2025-09-07T07:36:19.8763760Z * [new branch] gh/guilhermeleobas/228/head -> origin/gh/guilhermeleobas/228/head 2025-09-07T07:36:19.8764892Z * [new branch] gh/guilhermeleobas/228/orig -> origin/gh/guilhermeleobas/228/orig 2025-09-07T07:36:19.8766773Z * [new branch] gh/guilhermeleobas/229/base -> origin/gh/guilhermeleobas/229/base 2025-09-07T07:36:19.8767974Z * [new branch] gh/guilhermeleobas/229/head -> origin/gh/guilhermeleobas/229/head 2025-09-07T07:36:19.8769171Z * [new branch] gh/guilhermeleobas/229/orig -> origin/gh/guilhermeleobas/229/orig 2025-09-07T07:36:19.8770982Z * [new branch] gh/guilhermeleobas/230/base -> origin/gh/guilhermeleobas/230/base 2025-09-07T07:36:19.8772176Z * [new branch] gh/guilhermeleobas/230/head -> origin/gh/guilhermeleobas/230/head 2025-09-07T07:36:19.8773386Z * [new branch] gh/guilhermeleobas/230/orig -> origin/gh/guilhermeleobas/230/orig 2025-09-07T07:36:19.8775102Z * [new branch] gh/guilhermeleobas/231/base -> origin/gh/guilhermeleobas/231/base 2025-09-07T07:36:19.8776293Z * [new branch] gh/guilhermeleobas/231/head -> origin/gh/guilhermeleobas/231/head 2025-09-07T07:36:19.8777455Z * [new branch] gh/guilhermeleobas/231/orig -> origin/gh/guilhermeleobas/231/orig 2025-09-07T07:36:19.8779194Z * [new branch] gh/guilhermeleobas/232/base -> origin/gh/guilhermeleobas/232/base 2025-09-07T07:36:19.8780437Z * [new branch] gh/guilhermeleobas/232/head -> origin/gh/guilhermeleobas/232/head 2025-09-07T07:36:19.8781613Z * [new branch] gh/guilhermeleobas/232/orig -> origin/gh/guilhermeleobas/232/orig 2025-09-07T07:36:19.8783431Z * [new branch] gh/guilhermeleobas/233/base -> origin/gh/guilhermeleobas/233/base 2025-09-07T07:36:19.8784492Z * [new branch] gh/guilhermeleobas/233/head -> origin/gh/guilhermeleobas/233/head 2025-09-07T07:36:19.8785807Z * [new branch] gh/guilhermeleobas/233/orig -> origin/gh/guilhermeleobas/233/orig 2025-09-07T07:36:19.8787686Z * [new branch] gh/guilhermeleobas/234/base -> origin/gh/guilhermeleobas/234/base 2025-09-07T07:36:19.8788870Z * [new branch] gh/guilhermeleobas/234/head -> origin/gh/guilhermeleobas/234/head 2025-09-07T07:36:19.8790042Z * [new branch] gh/guilhermeleobas/234/orig -> origin/gh/guilhermeleobas/234/orig 2025-09-07T07:36:19.8791757Z * [new branch] gh/guilhermeleobas/235/base -> origin/gh/guilhermeleobas/235/base 2025-09-07T07:36:19.8792925Z * [new branch] gh/guilhermeleobas/235/head -> origin/gh/guilhermeleobas/235/head 2025-09-07T07:36:19.8794155Z * [new branch] gh/guilhermeleobas/235/orig -> origin/gh/guilhermeleobas/235/orig 2025-09-07T07:36:19.8795872Z * [new branch] gh/guilhermeleobas/236/base -> origin/gh/guilhermeleobas/236/base 2025-09-07T07:36:19.8797066Z * [new branch] gh/guilhermeleobas/236/head -> origin/gh/guilhermeleobas/236/head 2025-09-07T07:36:19.8798252Z * [new branch] gh/guilhermeleobas/236/orig -> origin/gh/guilhermeleobas/236/orig 2025-09-07T07:36:19.8799970Z * [new branch] gh/guilhermeleobas/237/base -> origin/gh/guilhermeleobas/237/base 2025-09-07T07:36:19.8801299Z * [new branch] gh/guilhermeleobas/237/head -> origin/gh/guilhermeleobas/237/head 2025-09-07T07:36:19.8802436Z * [new branch] gh/guilhermeleobas/237/orig -> origin/gh/guilhermeleobas/237/orig 2025-09-07T07:36:19.8804211Z * [new branch] gh/guilhermeleobas/238/base -> origin/gh/guilhermeleobas/238/base 2025-09-07T07:36:19.8805422Z * [new branch] gh/guilhermeleobas/238/head -> origin/gh/guilhermeleobas/238/head 2025-09-07T07:36:19.8806608Z * [new branch] gh/guilhermeleobas/238/orig -> origin/gh/guilhermeleobas/238/orig 2025-09-07T07:36:19.8808404Z * [new branch] gh/guilhermeleobas/239/base -> origin/gh/guilhermeleobas/239/base 2025-09-07T07:36:19.8809575Z * [new branch] gh/guilhermeleobas/239/head -> origin/gh/guilhermeleobas/239/head 2025-09-07T07:36:19.8810982Z * [new branch] gh/guilhermeleobas/239/orig -> origin/gh/guilhermeleobas/239/orig 2025-09-07T07:36:19.8812788Z * [new branch] gh/guilhermeleobas/240/base -> origin/gh/guilhermeleobas/240/base 2025-09-07T07:36:19.8813988Z * [new branch] gh/guilhermeleobas/240/head -> origin/gh/guilhermeleobas/240/head 2025-09-07T07:36:19.8815153Z * [new branch] gh/guilhermeleobas/240/orig -> origin/gh/guilhermeleobas/240/orig 2025-09-07T07:36:19.8816909Z * [new branch] gh/guilhermeleobas/241/base -> origin/gh/guilhermeleobas/241/base 2025-09-07T07:36:19.8818177Z * [new branch] gh/guilhermeleobas/241/head -> origin/gh/guilhermeleobas/241/head 2025-09-07T07:36:19.8819387Z * [new branch] gh/guilhermeleobas/241/orig -> origin/gh/guilhermeleobas/241/orig 2025-09-07T07:36:19.8821326Z * [new branch] gh/guilhermeleobas/242/base -> origin/gh/guilhermeleobas/242/base 2025-09-07T07:36:19.8822533Z * [new branch] gh/guilhermeleobas/242/head -> origin/gh/guilhermeleobas/242/head 2025-09-07T07:36:19.8823673Z * [new branch] gh/guilhermeleobas/242/orig -> origin/gh/guilhermeleobas/242/orig 2025-09-07T07:36:19.8825379Z * [new branch] gh/guilhermeleobas/243/base -> origin/gh/guilhermeleobas/243/base 2025-09-07T07:36:19.8826620Z * [new branch] gh/guilhermeleobas/243/head -> origin/gh/guilhermeleobas/243/head 2025-09-07T07:36:19.8827800Z * [new branch] gh/guilhermeleobas/243/orig -> origin/gh/guilhermeleobas/243/orig 2025-09-07T07:36:19.8829646Z * [new branch] gh/guilhermeleobas/244/base -> origin/gh/guilhermeleobas/244/base 2025-09-07T07:36:19.8830701Z * [new branch] gh/guilhermeleobas/244/head -> origin/gh/guilhermeleobas/244/head 2025-09-07T07:36:19.8831869Z * [new branch] gh/guilhermeleobas/244/orig -> origin/gh/guilhermeleobas/244/orig 2025-09-07T07:36:19.8833622Z * [new branch] gh/guilhermeleobas/245/base -> origin/gh/guilhermeleobas/245/base 2025-09-07T07:36:19.8834813Z * [new branch] gh/guilhermeleobas/245/head -> origin/gh/guilhermeleobas/245/head 2025-09-07T07:36:19.8836193Z * [new branch] gh/guilhermeleobas/245/orig -> origin/gh/guilhermeleobas/245/orig 2025-09-07T07:36:19.8838052Z * [new branch] gh/guilhermeleobas/73/base -> origin/gh/guilhermeleobas/73/base 2025-09-07T07:36:19.8839249Z * [new branch] gh/guilhermeleobas/73/head -> origin/gh/guilhermeleobas/73/head 2025-09-07T07:36:19.8840389Z * [new branch] gh/guilhermeleobas/73/orig -> origin/gh/guilhermeleobas/73/orig 2025-09-07T07:36:19.8842539Z * [new branch] gh/henrylhtsang/140/base -> origin/gh/henrylhtsang/140/base 2025-09-07T07:36:19.8843763Z * [new branch] gh/henrylhtsang/140/head -> origin/gh/henrylhtsang/140/head 2025-09-07T07:36:19.8844929Z * [new branch] gh/henrylhtsang/140/orig -> origin/gh/henrylhtsang/140/orig 2025-09-07T07:36:19.8846623Z * [new branch] gh/henrylhtsang/141/base -> origin/gh/henrylhtsang/141/base 2025-09-07T07:36:19.8847819Z * [new branch] gh/henrylhtsang/141/head -> origin/gh/henrylhtsang/141/head 2025-09-07T07:36:19.8849011Z * [new branch] gh/henrylhtsang/141/orig -> origin/gh/henrylhtsang/141/orig 2025-09-07T07:36:19.8850952Z * [new branch] gh/henrylhtsang/142/base -> origin/gh/henrylhtsang/142/base 2025-09-07T07:36:19.8852252Z * [new branch] gh/henrylhtsang/142/head -> origin/gh/henrylhtsang/142/head 2025-09-07T07:36:19.8853486Z * [new branch] gh/henrylhtsang/142/orig -> origin/gh/henrylhtsang/142/orig 2025-09-07T07:36:19.8855242Z * [new branch] gh/henrylhtsang/143/base -> origin/gh/henrylhtsang/143/base 2025-09-07T07:36:19.8856433Z * [new branch] gh/henrylhtsang/143/head -> origin/gh/henrylhtsang/143/head 2025-09-07T07:36:19.8857596Z * [new branch] gh/henrylhtsang/143/orig -> origin/gh/henrylhtsang/143/orig 2025-09-07T07:36:19.8859357Z * [new branch] gh/henrylhtsang/144/base -> origin/gh/henrylhtsang/144/base 2025-09-07T07:36:19.8860653Z * [new branch] gh/henrylhtsang/144/head -> origin/gh/henrylhtsang/144/head 2025-09-07T07:36:19.8861830Z * [new branch] gh/henrylhtsang/144/orig -> origin/gh/henrylhtsang/144/orig 2025-09-07T07:36:19.8863570Z * [new branch] gh/henrylhtsang/145/base -> origin/gh/henrylhtsang/145/base 2025-09-07T07:36:19.8864773Z * [new branch] gh/henrylhtsang/145/head -> origin/gh/henrylhtsang/145/head 2025-09-07T07:36:19.8866005Z * [new branch] gh/henrylhtsang/145/orig -> origin/gh/henrylhtsang/145/orig 2025-09-07T07:36:19.8867798Z * [new branch] gh/henrylhtsang/146/base -> origin/gh/henrylhtsang/146/base 2025-09-07T07:36:19.8869080Z * [new branch] gh/henrylhtsang/146/head -> origin/gh/henrylhtsang/146/head 2025-09-07T07:36:19.8870272Z * [new branch] gh/henrylhtsang/146/orig -> origin/gh/henrylhtsang/146/orig 2025-09-07T07:36:19.8872315Z * [new branch] gh/henrylhtsang/147/base -> origin/gh/henrylhtsang/147/base 2025-09-07T07:36:19.8873492Z * [new branch] gh/henrylhtsang/147/head -> origin/gh/henrylhtsang/147/head 2025-09-07T07:36:19.8874672Z * [new branch] gh/henrylhtsang/147/orig -> origin/gh/henrylhtsang/147/orig 2025-09-07T07:36:19.8876579Z * [new branch] gh/henrylhtsang/148/base -> origin/gh/henrylhtsang/148/base 2025-09-07T07:36:19.8877991Z * [new branch] gh/henrylhtsang/148/head -> origin/gh/henrylhtsang/148/head 2025-09-07T07:36:19.8879131Z * [new branch] gh/henrylhtsang/148/orig -> origin/gh/henrylhtsang/148/orig 2025-09-07T07:36:19.8880872Z * [new branch] gh/henrylhtsang/149/base -> origin/gh/henrylhtsang/149/base 2025-09-07T07:36:19.8882091Z * [new branch] gh/henrylhtsang/149/head -> origin/gh/henrylhtsang/149/head 2025-09-07T07:36:19.8883336Z * [new branch] gh/henrylhtsang/149/orig -> origin/gh/henrylhtsang/149/orig 2025-09-07T07:36:19.8885436Z * [new branch] gh/huydhn/1/next -> origin/gh/huydhn/1/next 2025-09-07T07:36:19.8887124Z * [new branch] gh/huydhn/2/next -> origin/gh/huydhn/2/next 2025-09-07T07:36:19.8888786Z * [new branch] gh/huydhn/3/next -> origin/gh/huydhn/3/next 2025-09-07T07:36:19.8890548Z * [new branch] gh/huydhn/4/next -> origin/gh/huydhn/4/next 2025-09-07T07:36:19.8892236Z * [new branch] gh/huydhn/5/next -> origin/gh/huydhn/5/next 2025-09-07T07:36:19.8893882Z * [new branch] gh/huydhn/6/next -> origin/gh/huydhn/6/next 2025-09-07T07:36:19.8896018Z * [new branch] gh/int3/97/base -> origin/gh/int3/97/base 2025-09-07T07:36:19.8897231Z * [new branch] gh/int3/97/head -> origin/gh/int3/97/head 2025-09-07T07:36:19.8899342Z * [new branch] gh/isuruf/101/base -> origin/gh/isuruf/101/base 2025-09-07T07:36:19.8900576Z * [new branch] gh/isuruf/101/head -> origin/gh/isuruf/101/head 2025-09-07T07:36:19.8902246Z * [new branch] gh/isuruf/141/base -> origin/gh/isuruf/141/base 2025-09-07T07:36:19.8903507Z * [new branch] gh/isuruf/141/head -> origin/gh/isuruf/141/head 2025-09-07T07:36:19.8904651Z * [new branch] gh/isuruf/141/orig -> origin/gh/isuruf/141/orig 2025-09-07T07:36:19.8906977Z * [new branch] gh/isuruf/142/base -> origin/gh/isuruf/142/base 2025-09-07T07:36:19.8908196Z * [new branch] gh/isuruf/142/head -> origin/gh/isuruf/142/head 2025-09-07T07:36:19.8909399Z * [new branch] gh/isuruf/142/orig -> origin/gh/isuruf/142/orig 2025-09-07T07:36:19.8911441Z * [new branch] gh/isuruf/143/base -> origin/gh/isuruf/143/base 2025-09-07T07:36:19.8912623Z * [new branch] gh/isuruf/143/head -> origin/gh/isuruf/143/head 2025-09-07T07:36:19.8913808Z * [new branch] gh/isuruf/143/orig -> origin/gh/isuruf/143/orig 2025-09-07T07:36:19.8915481Z * [new branch] gh/isuruf/144/base -> origin/gh/isuruf/144/base 2025-09-07T07:36:19.8916634Z * [new branch] gh/isuruf/144/head -> origin/gh/isuruf/144/head 2025-09-07T07:36:19.8917880Z * [new branch] gh/isuruf/144/orig -> origin/gh/isuruf/144/orig 2025-09-07T07:36:19.8919558Z * [new branch] gh/isuruf/145/base -> origin/gh/isuruf/145/base 2025-09-07T07:36:19.8920752Z * [new branch] gh/isuruf/145/head -> origin/gh/isuruf/145/head 2025-09-07T07:36:19.8921920Z * [new branch] gh/isuruf/145/orig -> origin/gh/isuruf/145/orig 2025-09-07T07:36:19.8923602Z * [new branch] gh/isuruf/146/base -> origin/gh/isuruf/146/base 2025-09-07T07:36:19.8924847Z * [new branch] gh/isuruf/146/head -> origin/gh/isuruf/146/head 2025-09-07T07:36:19.8926003Z * [new branch] gh/isuruf/146/orig -> origin/gh/isuruf/146/orig 2025-09-07T07:36:19.8927726Z * [new branch] gh/isuruf/81/base -> origin/gh/isuruf/81/base 2025-09-07T07:36:19.8928939Z * [new branch] gh/isuruf/81/head -> origin/gh/isuruf/81/head 2025-09-07T07:36:19.8930500Z * [new branch] gh/isuruf/81/orig -> origin/gh/isuruf/81/orig 2025-09-07T07:36:19.8932309Z * [new branch] gh/jamesjwu/150/base -> origin/gh/jamesjwu/150/base 2025-09-07T07:36:19.8933557Z * [new branch] gh/jamesjwu/150/head -> origin/gh/jamesjwu/150/head 2025-09-07T07:36:19.8934736Z * [new branch] gh/jamesjwu/150/orig -> origin/gh/jamesjwu/150/orig 2025-09-07T07:36:19.8936568Z * [new branch] gh/jamesjwu/154/base -> origin/gh/jamesjwu/154/base 2025-09-07T07:36:19.8937704Z * [new branch] gh/jamesjwu/154/head -> origin/gh/jamesjwu/154/head 2025-09-07T07:36:19.8938886Z * [new branch] gh/jamesjwu/154/orig -> origin/gh/jamesjwu/154/orig 2025-09-07T07:36:19.8940638Z * [new branch] gh/jamesjwu/155/base -> origin/gh/jamesjwu/155/base 2025-09-07T07:36:19.8941844Z * [new branch] gh/jamesjwu/155/head -> origin/gh/jamesjwu/155/head 2025-09-07T07:36:19.8942998Z * [new branch] gh/jamesjwu/155/orig -> origin/gh/jamesjwu/155/orig 2025-09-07T07:36:19.8944672Z * [new branch] gh/jamesjwu/159/base -> origin/gh/jamesjwu/159/base 2025-09-07T07:36:19.8946144Z * [new branch] gh/jamesjwu/159/head -> origin/gh/jamesjwu/159/head 2025-09-07T07:36:19.8947377Z * [new branch] gh/jamesjwu/159/orig -> origin/gh/jamesjwu/159/orig 2025-09-07T07:36:19.8949298Z * [new branch] gh/jamesjwu/163/base -> origin/gh/jamesjwu/163/base 2025-09-07T07:36:19.8951005Z * [new branch] gh/jamesjwu/163/head -> origin/gh/jamesjwu/163/head 2025-09-07T07:36:19.8952194Z * [new branch] gh/jamesjwu/163/orig -> origin/gh/jamesjwu/163/orig 2025-09-07T07:36:19.8953857Z * [new branch] gh/jamesjwu/171/base -> origin/gh/jamesjwu/171/base 2025-09-07T07:36:19.8955035Z * [new branch] gh/jamesjwu/171/head -> origin/gh/jamesjwu/171/head 2025-09-07T07:36:19.8956165Z * [new branch] gh/jamesjwu/171/orig -> origin/gh/jamesjwu/171/orig 2025-09-07T07:36:19.8957825Z * [new branch] gh/jamesjwu/176/base -> origin/gh/jamesjwu/176/base 2025-09-07T07:36:19.8959051Z * [new branch] gh/jamesjwu/176/head -> origin/gh/jamesjwu/176/head 2025-09-07T07:36:19.8960249Z * [new branch] gh/jamesjwu/176/orig -> origin/gh/jamesjwu/176/orig 2025-09-07T07:36:19.8961928Z * [new branch] gh/jamesjwu/181/base -> origin/gh/jamesjwu/181/base 2025-09-07T07:36:19.8963110Z * [new branch] gh/jamesjwu/181/head -> origin/gh/jamesjwu/181/head 2025-09-07T07:36:19.8964320Z * [new branch] gh/jamesjwu/181/orig -> origin/gh/jamesjwu/181/orig 2025-09-07T07:36:19.8965974Z * [new branch] gh/jamesjwu/182/base -> origin/gh/jamesjwu/182/base 2025-09-07T07:36:19.8967250Z * [new branch] gh/jamesjwu/182/head -> origin/gh/jamesjwu/182/head 2025-09-07T07:36:19.8968419Z * [new branch] gh/jamesjwu/182/orig -> origin/gh/jamesjwu/182/orig 2025-09-07T07:36:19.8970120Z * [new branch] gh/jamesjwu/183/base -> origin/gh/jamesjwu/183/base 2025-09-07T07:36:19.8971328Z * [new branch] gh/jamesjwu/183/head -> origin/gh/jamesjwu/183/head 2025-09-07T07:36:19.8972944Z * [new branch] gh/jamesjwu/183/orig -> origin/gh/jamesjwu/183/orig 2025-09-07T07:36:19.8974634Z * [new branch] gh/jamesjwu/184/base -> origin/gh/jamesjwu/184/base 2025-09-07T07:36:19.8975830Z * [new branch] gh/jamesjwu/184/head -> origin/gh/jamesjwu/184/head 2025-09-07T07:36:19.8977019Z * [new branch] gh/jamesjwu/184/orig -> origin/gh/jamesjwu/184/orig 2025-09-07T07:36:19.8978705Z * [new branch] gh/jamesjwu/185/base -> origin/gh/jamesjwu/185/base 2025-09-07T07:36:19.8980254Z * [new branch] gh/jamesjwu/185/head -> origin/gh/jamesjwu/185/head 2025-09-07T07:36:19.8981115Z * [new branch] gh/jamesjwu/185/orig -> origin/gh/jamesjwu/185/orig 2025-09-07T07:36:19.8982834Z * [new branch] gh/jamesjwu/186/base -> origin/gh/jamesjwu/186/base 2025-09-07T07:36:19.8984069Z * [new branch] gh/jamesjwu/186/head -> origin/gh/jamesjwu/186/head 2025-09-07T07:36:19.8985404Z * [new branch] gh/jamesjwu/186/orig -> origin/gh/jamesjwu/186/orig 2025-09-07T07:36:19.8987153Z * [new branch] gh/jamesjwu/187/base -> origin/gh/jamesjwu/187/base 2025-09-07T07:36:19.8988313Z * [new branch] gh/jamesjwu/187/head -> origin/gh/jamesjwu/187/head 2025-09-07T07:36:19.8989468Z * [new branch] gh/jamesjwu/187/orig -> origin/gh/jamesjwu/187/orig 2025-09-07T07:36:19.8991195Z * [new branch] gh/jamesjwu/188/base -> origin/gh/jamesjwu/188/base 2025-09-07T07:36:19.8992355Z * [new branch] gh/jamesjwu/188/head -> origin/gh/jamesjwu/188/head 2025-09-07T07:36:19.8993516Z * [new branch] gh/jamesjwu/188/orig -> origin/gh/jamesjwu/188/orig 2025-09-07T07:36:19.8995176Z * [new branch] gh/jamesjwu/189/base -> origin/gh/jamesjwu/189/base 2025-09-07T07:36:19.8996420Z * [new branch] gh/jamesjwu/189/head -> origin/gh/jamesjwu/189/head 2025-09-07T07:36:19.8997727Z * [new branch] gh/jamesjwu/189/orig -> origin/gh/jamesjwu/189/orig 2025-09-07T07:36:19.8999804Z * [new branch] gh/jamesjwu/190/base -> origin/gh/jamesjwu/190/base 2025-09-07T07:36:19.9001112Z * [new branch] gh/jamesjwu/190/head -> origin/gh/jamesjwu/190/head 2025-09-07T07:36:19.9002301Z * [new branch] gh/jamesjwu/190/orig -> origin/gh/jamesjwu/190/orig 2025-09-07T07:36:19.9004160Z * [new branch] gh/jamesjwu/52/base -> origin/gh/jamesjwu/52/base 2025-09-07T07:36:19.9005435Z * [new branch] gh/jamesjwu/52/head -> origin/gh/jamesjwu/52/head 2025-09-07T07:36:19.9007051Z * [new branch] gh/jamesjwu/53/base -> origin/gh/jamesjwu/53/base 2025-09-07T07:36:19.9008220Z * [new branch] gh/jamesjwu/53/head -> origin/gh/jamesjwu/53/head 2025-09-07T07:36:19.9009960Z * [new branch] gh/jamesjwu/54/base -> origin/gh/jamesjwu/54/base 2025-09-07T07:36:19.9011165Z * [new branch] gh/jamesjwu/54/head -> origin/gh/jamesjwu/54/head 2025-09-07T07:36:19.9012807Z * [new branch] gh/jamesjwu/55/base -> origin/gh/jamesjwu/55/base 2025-09-07T07:36:19.9013998Z * [new branch] gh/jamesjwu/55/head -> origin/gh/jamesjwu/55/head 2025-09-07T07:36:19.9015594Z * [new branch] gh/jamesjwu/56/base -> origin/gh/jamesjwu/56/base 2025-09-07T07:36:19.9016873Z * [new branch] gh/jamesjwu/56/head -> origin/gh/jamesjwu/56/head 2025-09-07T07:36:19.9018646Z * [new branch] gh/jamesjwu/57/base -> origin/gh/jamesjwu/57/base 2025-09-07T07:36:19.9019792Z * [new branch] gh/jamesjwu/57/head -> origin/gh/jamesjwu/57/head 2025-09-07T07:36:19.9021427Z * [new branch] gh/jamesjwu/58/base -> origin/gh/jamesjwu/58/base 2025-09-07T07:36:19.9022608Z * [new branch] gh/jamesjwu/58/head -> origin/gh/jamesjwu/58/head 2025-09-07T07:36:19.9024211Z * [new branch] gh/jamesjwu/59/base -> origin/gh/jamesjwu/59/base 2025-09-07T07:36:19.9025354Z * [new branch] gh/jamesjwu/59/head -> origin/gh/jamesjwu/59/head 2025-09-07T07:36:19.9027095Z * [new branch] gh/jamesjwu/60/base -> origin/gh/jamesjwu/60/base 2025-09-07T07:36:19.9028260Z * [new branch] gh/jamesjwu/60/head -> origin/gh/jamesjwu/60/head 2025-09-07T07:36:19.9030082Z * [new branch] gh/jamesjwu/61/base -> origin/gh/jamesjwu/61/base 2025-09-07T07:36:19.9031173Z * [new branch] gh/jamesjwu/61/head -> origin/gh/jamesjwu/61/head 2025-09-07T07:36:19.9033289Z * [new branch] gh/jamesjwu/62/base -> origin/gh/jamesjwu/62/base 2025-09-07T07:36:19.9034464Z * [new branch] gh/jamesjwu/62/head -> origin/gh/jamesjwu/62/head 2025-09-07T07:36:19.9036101Z * [new branch] gh/jamesjwu/63/base -> origin/gh/jamesjwu/63/base 2025-09-07T07:36:19.9037303Z * [new branch] gh/jamesjwu/63/head -> origin/gh/jamesjwu/63/head 2025-09-07T07:36:19.9039060Z * [new branch] gh/jamesjwu/64/base -> origin/gh/jamesjwu/64/base 2025-09-07T07:36:19.9040279Z * [new branch] gh/jamesjwu/64/head -> origin/gh/jamesjwu/64/head 2025-09-07T07:36:19.9041877Z * [new branch] gh/jamesjwu/65/base -> origin/gh/jamesjwu/65/base 2025-09-07T07:36:19.9043021Z * [new branch] gh/jamesjwu/65/head -> origin/gh/jamesjwu/65/head 2025-09-07T07:36:19.9045225Z * [new branch] gh/janeyx99/165/base -> origin/gh/janeyx99/165/base 2025-09-07T07:36:19.9046450Z * [new branch] gh/janeyx99/165/head -> origin/gh/janeyx99/165/head 2025-09-07T07:36:19.9047705Z * [new branch] gh/janeyx99/165/orig -> origin/gh/janeyx99/165/orig 2025-09-07T07:36:19.9049290Z * [new branch] gh/janeyx99/201/base -> origin/gh/janeyx99/201/base 2025-09-07T07:36:19.9050469Z * [new branch] gh/janeyx99/201/head -> origin/gh/janeyx99/201/head 2025-09-07T07:36:19.9051667Z * [new branch] gh/janeyx99/201/orig -> origin/gh/janeyx99/201/orig 2025-09-07T07:36:19.9053490Z * [new branch] gh/janeyx99/225/base -> origin/gh/janeyx99/225/base 2025-09-07T07:36:19.9054869Z * [new branch] gh/janeyx99/225/head -> origin/gh/janeyx99/225/head 2025-09-07T07:36:19.9056057Z * [new branch] gh/janeyx99/225/orig -> origin/gh/janeyx99/225/orig 2025-09-07T07:36:19.9057785Z * [new branch] gh/janeyx99/296/base -> origin/gh/janeyx99/296/base 2025-09-07T07:36:19.9058964Z * [new branch] gh/janeyx99/296/head -> origin/gh/janeyx99/296/head 2025-09-07T07:36:19.9060135Z * [new branch] gh/janeyx99/296/orig -> origin/gh/janeyx99/296/orig 2025-09-07T07:36:19.9061805Z * [new branch] gh/janeyx99/297/base -> origin/gh/janeyx99/297/base 2025-09-07T07:36:19.9062984Z * [new branch] gh/janeyx99/297/head -> origin/gh/janeyx99/297/head 2025-09-07T07:36:19.9064232Z * [new branch] gh/janeyx99/297/orig -> origin/gh/janeyx99/297/orig 2025-09-07T07:36:19.9066029Z * [new branch] gh/janeyx99/298/base -> origin/gh/janeyx99/298/base 2025-09-07T07:36:19.9067268Z * [new branch] gh/janeyx99/298/head -> origin/gh/janeyx99/298/head 2025-09-07T07:36:19.9068466Z * [new branch] gh/janeyx99/298/orig -> origin/gh/janeyx99/298/orig 2025-09-07T07:36:19.9070189Z * [new branch] gh/janeyx99/299/base -> origin/gh/janeyx99/299/base 2025-09-07T07:36:19.9071435Z * [new branch] gh/janeyx99/299/head -> origin/gh/janeyx99/299/head 2025-09-07T07:36:19.9072615Z * [new branch] gh/janeyx99/299/orig -> origin/gh/janeyx99/299/orig 2025-09-07T07:36:19.9074433Z * [new branch] gh/janeyx99/300/base -> origin/gh/janeyx99/300/base 2025-09-07T07:36:19.9075790Z * [new branch] gh/janeyx99/300/head -> origin/gh/janeyx99/300/head 2025-09-07T07:36:19.9076955Z * [new branch] gh/janeyx99/300/orig -> origin/gh/janeyx99/300/orig 2025-09-07T07:36:19.9078701Z * [new branch] gh/janeyx99/301/base -> origin/gh/janeyx99/301/base 2025-09-07T07:36:19.9079976Z * [new branch] gh/janeyx99/301/head -> origin/gh/janeyx99/301/head 2025-09-07T07:36:19.9081231Z * [new branch] gh/janeyx99/301/orig -> origin/gh/janeyx99/301/orig 2025-09-07T07:36:19.9083262Z * [new branch] gh/janeyx99/302/base -> origin/gh/janeyx99/302/base 2025-09-07T07:36:19.9084521Z * [new branch] gh/janeyx99/302/head -> origin/gh/janeyx99/302/head 2025-09-07T07:36:19.9086533Z * [new branch] gh/janeyx99/303/base -> origin/gh/janeyx99/303/base 2025-09-07T07:36:19.9087689Z * [new branch] gh/janeyx99/303/head -> origin/gh/janeyx99/303/head 2025-09-07T07:36:19.9089461Z * [new branch] gh/janeyx99/88/base -> origin/gh/janeyx99/88/base 2025-09-07T07:36:19.9090901Z * [new branch] gh/janeyx99/88/head -> origin/gh/janeyx99/88/head 2025-09-07T07:36:19.9092064Z * [new branch] gh/janeyx99/88/orig -> origin/gh/janeyx99/88/orig 2025-09-07T07:36:19.9094254Z * [new branch] gh/jansel/360/base -> origin/gh/jansel/360/base 2025-09-07T07:36:19.9095506Z * [new branch] gh/jansel/360/head -> origin/gh/jansel/360/head 2025-09-07T07:36:19.9097315Z * [new branch] gh/jansel/451/base -> origin/gh/jansel/451/base 2025-09-07T07:36:19.9098503Z * [new branch] gh/jansel/451/head -> origin/gh/jansel/451/head 2025-09-07T07:36:19.9099688Z * [new branch] gh/jansel/451/orig -> origin/gh/jansel/451/orig 2025-09-07T07:36:19.9101342Z * [new branch] gh/jansel/462/base -> origin/gh/jansel/462/base 2025-09-07T07:36:19.9102539Z * [new branch] gh/jansel/462/head -> origin/gh/jansel/462/head 2025-09-07T07:36:19.9103712Z * [new branch] gh/jansel/462/orig -> origin/gh/jansel/462/orig 2025-09-07T07:36:19.9105404Z * [new branch] gh/jansel/531/base -> origin/gh/jansel/531/base 2025-09-07T07:36:19.9106636Z * [new branch] gh/jansel/531/head -> origin/gh/jansel/531/head 2025-09-07T07:36:19.9107805Z * [new branch] gh/jansel/531/orig -> origin/gh/jansel/531/orig 2025-09-07T07:36:19.9113470Z * [new branch] gh/jbschlosser/208/head -> origin/gh/jbschlosser/208/head 2025-09-07T07:36:19.9115314Z * [new branch] gh/jbschlosser/247/base -> origin/gh/jbschlosser/247/base 2025-09-07T07:36:19.9116581Z * [new branch] gh/jbschlosser/247/head -> origin/gh/jbschlosser/247/head 2025-09-07T07:36:19.9117828Z * [new branch] gh/jbschlosser/247/orig -> origin/gh/jbschlosser/247/orig 2025-09-07T07:36:19.9119550Z * [new branch] gh/jbschlosser/248/base -> origin/gh/jbschlosser/248/base 2025-09-07T07:36:19.9120754Z * [new branch] gh/jbschlosser/248/head -> origin/gh/jbschlosser/248/head 2025-09-07T07:36:19.9121968Z * [new branch] gh/jbschlosser/248/orig -> origin/gh/jbschlosser/248/orig 2025-09-07T07:36:19.9123733Z * [new branch] gh/jbschlosser/250/base -> origin/gh/jbschlosser/250/base 2025-09-07T07:36:19.9124914Z * [new branch] gh/jbschlosser/250/head -> origin/gh/jbschlosser/250/head 2025-09-07T07:36:19.9126094Z * [new branch] gh/jbschlosser/250/orig -> origin/gh/jbschlosser/250/orig 2025-09-07T07:36:19.9128171Z * [new branch] gh/jiayisunx/59/base -> origin/gh/jiayisunx/59/base 2025-09-07T07:36:19.9129365Z * [new branch] gh/jiayisunx/59/head -> origin/gh/jiayisunx/59/head 2025-09-07T07:36:19.9130734Z * [new branch] gh/jiayisunx/59/orig -> origin/gh/jiayisunx/59/orig 2025-09-07T07:36:19.9132436Z * [new branch] gh/jiayisunx/61/base -> origin/gh/jiayisunx/61/base 2025-09-07T07:36:19.9133663Z * [new branch] gh/jiayisunx/61/head -> origin/gh/jiayisunx/61/head 2025-09-07T07:36:19.9134950Z * [new branch] gh/jiayisunx/61/orig -> origin/gh/jiayisunx/61/orig 2025-09-07T07:36:19.9136514Z * [new branch] gh/jiayisunx/64/base -> origin/gh/jiayisunx/64/base 2025-09-07T07:36:19.9137693Z * [new branch] gh/jiayisunx/64/head -> origin/gh/jiayisunx/64/head 2025-09-07T07:36:19.9138875Z * [new branch] gh/jiayisunx/64/orig -> origin/gh/jiayisunx/64/orig 2025-09-07T07:36:19.9140570Z * [new branch] gh/jiayisunx/65/base -> origin/gh/jiayisunx/65/base 2025-09-07T07:36:19.9141791Z * [new branch] gh/jiayisunx/65/head -> origin/gh/jiayisunx/65/head 2025-09-07T07:36:19.9142965Z * [new branch] gh/jiayisunx/65/orig -> origin/gh/jiayisunx/65/orig 2025-09-07T07:36:19.9144631Z * [new branch] gh/jiayisunx/66/base -> origin/gh/jiayisunx/66/base 2025-09-07T07:36:19.9145889Z * [new branch] gh/jiayisunx/66/head -> origin/gh/jiayisunx/66/head 2025-09-07T07:36:19.9147143Z * [new branch] gh/jiayisunx/66/orig -> origin/gh/jiayisunx/66/orig 2025-09-07T07:36:19.9148903Z * [new branch] gh/jiayisunx/67/base -> origin/gh/jiayisunx/67/base 2025-09-07T07:36:19.9150098Z * [new branch] gh/jiayisunx/67/head -> origin/gh/jiayisunx/67/head 2025-09-07T07:36:19.9151263Z * [new branch] gh/jiayisunx/67/orig -> origin/gh/jiayisunx/67/orig 2025-09-07T07:36:19.9152969Z * [new branch] gh/jiayisunx/68/base -> origin/gh/jiayisunx/68/base 2025-09-07T07:36:19.9154110Z * [new branch] gh/jiayisunx/68/head -> origin/gh/jiayisunx/68/head 2025-09-07T07:36:19.9155297Z * [new branch] gh/jiayisunx/68/orig -> origin/gh/jiayisunx/68/orig 2025-09-07T07:36:19.9157020Z * [new branch] gh/jiayisunx/69/base -> origin/gh/jiayisunx/69/base 2025-09-07T07:36:19.9158311Z * [new branch] gh/jiayisunx/69/head -> origin/gh/jiayisunx/69/head 2025-09-07T07:36:19.9159468Z * [new branch] gh/jiayisunx/69/orig -> origin/gh/jiayisunx/69/orig 2025-09-07T07:36:19.9161139Z * [new branch] gh/jiayisunx/70/base -> origin/gh/jiayisunx/70/base 2025-09-07T07:36:19.9162300Z * [new branch] gh/jiayisunx/70/head -> origin/gh/jiayisunx/70/head 2025-09-07T07:36:19.9163525Z * [new branch] gh/jiayisunx/70/orig -> origin/gh/jiayisunx/70/orig 2025-09-07T07:36:19.9165365Z * [new branch] gh/jiayisunx/71/base -> origin/gh/jiayisunx/71/base 2025-09-07T07:36:19.9166559Z * [new branch] gh/jiayisunx/71/head -> origin/gh/jiayisunx/71/head 2025-09-07T07:36:19.9167716Z * [new branch] gh/jiayisunx/71/orig -> origin/gh/jiayisunx/71/orig 2025-09-07T07:36:19.9169463Z * [new branch] gh/jiayisunx/72/base -> origin/gh/jiayisunx/72/base 2025-09-07T07:36:19.9170608Z * [new branch] gh/jiayisunx/72/head -> origin/gh/jiayisunx/72/head 2025-09-07T07:36:19.9171817Z * [new branch] gh/jiayisunx/72/orig -> origin/gh/jiayisunx/72/orig 2025-09-07T07:36:19.9173538Z * [new branch] gh/jiayisunx/73/base -> origin/gh/jiayisunx/73/base 2025-09-07T07:36:19.9174753Z * [new branch] gh/jiayisunx/73/head -> origin/gh/jiayisunx/73/head 2025-09-07T07:36:19.9175942Z * [new branch] gh/jiayisunx/73/orig -> origin/gh/jiayisunx/73/orig 2025-09-07T07:36:19.9177625Z * [new branch] gh/jiayisunx/74/base -> origin/gh/jiayisunx/74/base 2025-09-07T07:36:19.9178786Z * [new branch] gh/jiayisunx/74/head -> origin/gh/jiayisunx/74/head 2025-09-07T07:36:19.9180038Z * [new branch] gh/jiayisunx/74/orig -> origin/gh/jiayisunx/74/orig 2025-09-07T07:36:19.9181736Z * [new branch] gh/jiayisunx/75/base -> origin/gh/jiayisunx/75/base 2025-09-07T07:36:19.9183112Z * [new branch] gh/jiayisunx/75/head -> origin/gh/jiayisunx/75/head 2025-09-07T07:36:19.9183987Z * [new branch] gh/jiayisunx/75/orig -> origin/gh/jiayisunx/75/orig 2025-09-07T07:36:19.9185782Z * [new branch] gh/jiayisunx/76/base -> origin/gh/jiayisunx/76/base 2025-09-07T07:36:19.9186927Z * [new branch] gh/jiayisunx/76/head -> origin/gh/jiayisunx/76/head 2025-09-07T07:36:19.9188138Z * [new branch] gh/jiayisunx/76/orig -> origin/gh/jiayisunx/76/orig 2025-09-07T07:36:19.9190137Z * [new branch] gh/jjwu@meta.com/1/base -> origin/gh/jjwu@meta.com/1/base 2025-09-07T07:36:19.9191295Z * [new branch] gh/jjwu@meta.com/1/head -> origin/gh/jjwu@meta.com/1/head 2025-09-07T07:36:19.9193855Z * [new branch] gh/justinchuby/111/base -> origin/gh/justinchuby/111/base 2025-09-07T07:36:19.9195124Z * [new branch] gh/justinchuby/111/head -> origin/gh/justinchuby/111/head 2025-09-07T07:36:19.9196489Z * [new branch] gh/justinchuby/111/orig -> origin/gh/justinchuby/111/orig 2025-09-07T07:36:19.9198340Z * [new branch] gh/justinchuby/112/base -> origin/gh/justinchuby/112/base 2025-09-07T07:36:19.9199492Z * [new branch] gh/justinchuby/112/head -> origin/gh/justinchuby/112/head 2025-09-07T07:36:19.9200853Z * [new branch] gh/justinchuby/112/orig -> origin/gh/justinchuby/112/orig 2025-09-07T07:36:19.9202573Z * [new branch] gh/justinchuby/113/base -> origin/gh/justinchuby/113/base 2025-09-07T07:36:19.9203770Z * [new branch] gh/justinchuby/113/head -> origin/gh/justinchuby/113/head 2025-09-07T07:36:19.9205014Z * [new branch] gh/justinchuby/113/orig -> origin/gh/justinchuby/113/orig 2025-09-07T07:36:19.9206700Z * [new branch] gh/justinchuby/114/base -> origin/gh/justinchuby/114/base 2025-09-07T07:36:19.9207921Z * [new branch] gh/justinchuby/114/head -> origin/gh/justinchuby/114/head 2025-09-07T07:36:19.9209138Z * [new branch] gh/justinchuby/114/orig -> origin/gh/justinchuby/114/orig 2025-09-07T07:36:19.9211026Z * [new branch] gh/justinchuby/115/base -> origin/gh/justinchuby/115/base 2025-09-07T07:36:19.9212228Z * [new branch] gh/justinchuby/115/head -> origin/gh/justinchuby/115/head 2025-09-07T07:36:19.9213377Z * [new branch] gh/justinchuby/115/orig -> origin/gh/justinchuby/115/orig 2025-09-07T07:36:19.9215553Z * [new branch] gh/karthickai/1/base -> origin/gh/karthickai/1/base 2025-09-07T07:36:19.9216803Z * [new branch] gh/karthickai/1/head -> origin/gh/karthickai/1/head 2025-09-07T07:36:19.9217973Z * [new branch] gh/karthickai/1/orig -> origin/gh/karthickai/1/orig 2025-09-07T07:36:19.9219637Z * [new branch] gh/karthickai/2/base -> origin/gh/karthickai/2/base 2025-09-07T07:36:19.9220793Z * [new branch] gh/karthickai/2/head -> origin/gh/karthickai/2/head 2025-09-07T07:36:19.9221946Z * [new branch] gh/karthickai/2/orig -> origin/gh/karthickai/2/orig 2025-09-07T07:36:19.9224025Z * [new branch] gh/kurtamohler/32/base -> origin/gh/kurtamohler/32/base 2025-09-07T07:36:19.9225195Z * [new branch] gh/kurtamohler/32/head -> origin/gh/kurtamohler/32/head 2025-09-07T07:36:19.9226458Z * [new branch] gh/kurtamohler/32/orig -> origin/gh/kurtamohler/32/orig 2025-09-07T07:36:19.9228179Z * [new branch] gh/kurtamohler/33/base -> origin/gh/kurtamohler/33/base 2025-09-07T07:36:19.9229440Z * [new branch] gh/kurtamohler/33/head -> origin/gh/kurtamohler/33/head 2025-09-07T07:36:19.9230592Z * [new branch] gh/kurtamohler/33/orig -> origin/gh/kurtamohler/33/orig 2025-09-07T07:36:19.9232344Z * [new branch] gh/kurtamohler/34/base -> origin/gh/kurtamohler/34/base 2025-09-07T07:36:19.9233665Z * [new branch] gh/kurtamohler/34/head -> origin/gh/kurtamohler/34/head 2025-09-07T07:36:19.9234789Z * [new branch] gh/kurtamohler/34/orig -> origin/gh/kurtamohler/34/orig 2025-09-07T07:36:19.9236411Z * [new branch] gh/kurtamohler/41/base -> origin/gh/kurtamohler/41/base 2025-09-07T07:36:19.9238280Z * [new branch] gh/kurtamohler/41/head -> origin/gh/kurtamohler/41/head 2025-09-07T07:36:19.9239484Z * [new branch] gh/kurtamohler/41/orig -> origin/gh/kurtamohler/41/orig 2025-09-07T07:36:19.9241263Z * [new branch] gh/kurtamohler/46/base -> origin/gh/kurtamohler/46/base 2025-09-07T07:36:19.9242452Z * [new branch] gh/kurtamohler/46/head -> origin/gh/kurtamohler/46/head 2025-09-07T07:36:19.9243618Z * [new branch] gh/kurtamohler/46/orig -> origin/gh/kurtamohler/46/orig 2025-09-07T07:36:19.9245333Z * [new branch] gh/kurtamohler/47/base -> origin/gh/kurtamohler/47/base 2025-09-07T07:36:19.9246711Z * [new branch] gh/kurtamohler/47/head -> origin/gh/kurtamohler/47/head 2025-09-07T07:36:19.9247964Z * [new branch] gh/kurtamohler/47/orig -> origin/gh/kurtamohler/47/orig 2025-09-07T07:36:19.9249626Z * [new branch] gh/kurtamohler/48/base -> origin/gh/kurtamohler/48/base 2025-09-07T07:36:19.9250784Z * [new branch] gh/kurtamohler/48/head -> origin/gh/kurtamohler/48/head 2025-09-07T07:36:19.9251938Z * [new branch] gh/kurtamohler/48/orig -> origin/gh/kurtamohler/48/orig 2025-09-07T07:36:19.9253649Z * [new branch] gh/kurtamohler/49/base -> origin/gh/kurtamohler/49/base 2025-09-07T07:36:19.9254803Z * [new branch] gh/kurtamohler/49/head -> origin/gh/kurtamohler/49/head 2025-09-07T07:36:19.9256021Z * [new branch] gh/kurtamohler/49/orig -> origin/gh/kurtamohler/49/orig 2025-09-07T07:36:19.9257668Z * [new branch] gh/kurtamohler/50/base -> origin/gh/kurtamohler/50/base 2025-09-07T07:36:19.9258867Z * [new branch] gh/kurtamohler/50/head -> origin/gh/kurtamohler/50/head 2025-09-07T07:36:19.9260032Z * [new branch] gh/kurtamohler/50/orig -> origin/gh/kurtamohler/50/orig 2025-09-07T07:36:19.9262312Z * [new branch] gh/kwen2501/130/base -> origin/gh/kwen2501/130/base 2025-09-07T07:36:19.9263602Z * [new branch] gh/kwen2501/130/head -> origin/gh/kwen2501/130/head 2025-09-07T07:36:19.9264843Z * [new branch] gh/kwen2501/130/orig -> origin/gh/kwen2501/130/orig 2025-09-07T07:36:19.9266700Z * [new branch] gh/kwen2501/15/base -> origin/gh/kwen2501/15/base 2025-09-07T07:36:19.9267922Z * [new branch] gh/kwen2501/15/head -> origin/gh/kwen2501/15/head 2025-09-07T07:36:19.9269599Z * [new branch] gh/kwen2501/156/base -> origin/gh/kwen2501/156/base 2025-09-07T07:36:19.9270786Z * [new branch] gh/kwen2501/156/head -> origin/gh/kwen2501/156/head 2025-09-07T07:36:19.9271965Z * [new branch] gh/kwen2501/156/orig -> origin/gh/kwen2501/156/orig 2025-09-07T07:36:19.9273815Z * [new branch] gh/kwen2501/170/base -> origin/gh/kwen2501/170/base 2025-09-07T07:36:19.9275023Z * [new branch] gh/kwen2501/170/head -> origin/gh/kwen2501/170/head 2025-09-07T07:36:19.9276790Z * [new branch] gh/kwen2501/186/base -> origin/gh/kwen2501/186/base 2025-09-07T07:36:19.9278004Z * [new branch] gh/kwen2501/186/head -> origin/gh/kwen2501/186/head 2025-09-07T07:36:19.9279254Z * [new branch] gh/kwen2501/186/orig -> origin/gh/kwen2501/186/orig 2025-09-07T07:36:19.9280860Z * [new branch] gh/kwen2501/187/base -> origin/gh/kwen2501/187/base 2025-09-07T07:36:19.9282305Z * [new branch] gh/kwen2501/187/head -> origin/gh/kwen2501/187/head 2025-09-07T07:36:19.9283874Z * [new branch] gh/kwen2501/187/orig -> origin/gh/kwen2501/187/orig 2025-09-07T07:36:19.9285549Z * [new branch] gh/kwen2501/188/base -> origin/gh/kwen2501/188/base 2025-09-07T07:36:19.9286720Z * [new branch] gh/kwen2501/188/head -> origin/gh/kwen2501/188/head 2025-09-07T07:36:19.9287897Z * [new branch] gh/kwen2501/188/orig -> origin/gh/kwen2501/188/orig 2025-09-07T07:36:19.9289619Z * [new branch] gh/kwen2501/194/base -> origin/gh/kwen2501/194/base 2025-09-07T07:36:19.9290863Z * [new branch] gh/kwen2501/194/head -> origin/gh/kwen2501/194/head 2025-09-07T07:36:19.9292104Z * [new branch] gh/kwen2501/194/orig -> origin/gh/kwen2501/194/orig 2025-09-07T07:36:19.9293790Z * [new branch] gh/kwen2501/199/base -> origin/gh/kwen2501/199/base 2025-09-07T07:36:19.9295397Z * [new branch] gh/kwen2501/199/head -> origin/gh/kwen2501/199/head 2025-09-07T07:36:19.9296657Z * [new branch] gh/kwen2501/199/orig -> origin/gh/kwen2501/199/orig 2025-09-07T07:36:19.9298307Z * [new branch] gh/kwen2501/200/base -> origin/gh/kwen2501/200/base 2025-09-07T07:36:19.9299496Z * [new branch] gh/kwen2501/200/head -> origin/gh/kwen2501/200/head 2025-09-07T07:36:19.9300640Z * [new branch] gh/kwen2501/200/orig -> origin/gh/kwen2501/200/orig 2025-09-07T07:36:19.9302304Z * [new branch] gh/kwen2501/201/base -> origin/gh/kwen2501/201/base 2025-09-07T07:36:19.9303470Z * [new branch] gh/kwen2501/201/head -> origin/gh/kwen2501/201/head 2025-09-07T07:36:19.9304637Z * [new branch] gh/kwen2501/201/orig -> origin/gh/kwen2501/201/orig 2025-09-07T07:36:19.9306398Z * [new branch] gh/kwen2501/203/base -> origin/gh/kwen2501/203/base 2025-09-07T07:36:19.9307581Z * [new branch] gh/kwen2501/203/head -> origin/gh/kwen2501/203/head 2025-09-07T07:36:19.9308930Z * [new branch] gh/kwen2501/203/orig -> origin/gh/kwen2501/203/orig 2025-09-07T07:36:19.9310811Z * [new branch] gh/kwen2501/204/base -> origin/gh/kwen2501/204/base 2025-09-07T07:36:19.9311949Z * [new branch] gh/kwen2501/204/head -> origin/gh/kwen2501/204/head 2025-09-07T07:36:19.9313242Z * [new branch] gh/kwen2501/204/orig -> origin/gh/kwen2501/204/orig 2025-09-07T07:36:19.9314927Z * [new branch] gh/kwen2501/205/base -> origin/gh/kwen2501/205/base 2025-09-07T07:36:19.9316092Z * [new branch] gh/kwen2501/205/head -> origin/gh/kwen2501/205/head 2025-09-07T07:36:19.9317285Z * [new branch] gh/kwen2501/205/orig -> origin/gh/kwen2501/205/orig 2025-09-07T07:36:19.9318922Z * [new branch] gh/kwen2501/206/base -> origin/gh/kwen2501/206/base 2025-09-07T07:36:19.9320082Z * [new branch] gh/kwen2501/206/head -> origin/gh/kwen2501/206/head 2025-09-07T07:36:19.9321254Z * [new branch] gh/kwen2501/206/orig -> origin/gh/kwen2501/206/orig 2025-09-07T07:36:19.9323056Z * [new branch] gh/kwen2501/207/base -> origin/gh/kwen2501/207/base 2025-09-07T07:36:19.9324217Z * [new branch] gh/kwen2501/207/head -> origin/gh/kwen2501/207/head 2025-09-07T07:36:19.9325438Z * [new branch] gh/kwen2501/207/orig -> origin/gh/kwen2501/207/orig 2025-09-07T07:36:19.9327095Z * [new branch] gh/kwen2501/208/base -> origin/gh/kwen2501/208/base 2025-09-07T07:36:19.9328250Z * [new branch] gh/kwen2501/208/head -> origin/gh/kwen2501/208/head 2025-09-07T07:36:19.9329491Z * [new branch] gh/kwen2501/208/orig -> origin/gh/kwen2501/208/orig 2025-09-07T07:36:19.9331948Z * [new branch] gh/kwen2501/209/base -> origin/gh/kwen2501/209/base 2025-09-07T07:36:19.9333439Z * [new branch] gh/kwen2501/209/head -> origin/gh/kwen2501/209/head 2025-09-07T07:36:19.9334638Z * [new branch] gh/kwen2501/209/orig -> origin/gh/kwen2501/209/orig 2025-09-07T07:36:19.9336378Z * [new branch] gh/kwen2501/210/base -> origin/gh/kwen2501/210/base 2025-09-07T07:36:19.9337537Z * [new branch] gh/kwen2501/210/head -> origin/gh/kwen2501/210/head 2025-09-07T07:36:19.9338694Z * [new branch] gh/kwen2501/210/orig -> origin/gh/kwen2501/210/orig 2025-09-07T07:36:19.9340432Z * [new branch] gh/kwen2501/211/base -> origin/gh/kwen2501/211/base 2025-09-07T07:36:19.9341638Z * [new branch] gh/kwen2501/211/head -> origin/gh/kwen2501/211/head 2025-09-07T07:36:19.9343366Z * [new branch] gh/kwen2501/212/base -> origin/gh/kwen2501/212/base 2025-09-07T07:36:19.9344684Z * [new branch] gh/kwen2501/212/head -> origin/gh/kwen2501/212/head 2025-09-07T07:36:19.9345900Z * [new branch] gh/kwen2501/212/orig -> origin/gh/kwen2501/212/orig 2025-09-07T07:36:19.9347745Z * [new branch] gh/kwen2501/213/base -> origin/gh/kwen2501/213/base 2025-09-07T07:36:19.9348931Z * [new branch] gh/kwen2501/213/head -> origin/gh/kwen2501/213/head 2025-09-07T07:36:19.9350120Z * [new branch] gh/kwen2501/213/orig -> origin/gh/kwen2501/213/orig 2025-09-07T07:36:19.9351928Z * [new branch] gh/kwen2501/214/base -> origin/gh/kwen2501/214/base 2025-09-07T07:36:19.9353115Z * [new branch] gh/kwen2501/214/head -> origin/gh/kwen2501/214/head 2025-09-07T07:36:19.9354281Z * [new branch] gh/kwen2501/214/orig -> origin/gh/kwen2501/214/orig 2025-09-07T07:36:19.9356041Z * [new branch] gh/kwen2501/215/base -> origin/gh/kwen2501/215/base 2025-09-07T07:36:19.9357217Z * [new branch] gh/kwen2501/215/head -> origin/gh/kwen2501/215/head 2025-09-07T07:36:19.9358404Z * [new branch] gh/kwen2501/215/orig -> origin/gh/kwen2501/215/orig 2025-09-07T07:36:19.9360082Z * [new branch] gh/kwen2501/216/base -> origin/gh/kwen2501/216/base 2025-09-07T07:36:19.9361252Z * [new branch] gh/kwen2501/216/head -> origin/gh/kwen2501/216/head 2025-09-07T07:36:19.9362439Z * [new branch] gh/kwen2501/216/orig -> origin/gh/kwen2501/216/orig 2025-09-07T07:36:19.9364284Z * [new branch] gh/kwen2501/217/base -> origin/gh/kwen2501/217/base 2025-09-07T07:36:19.9365483Z * [new branch] gh/kwen2501/217/head -> origin/gh/kwen2501/217/head 2025-09-07T07:36:19.9366698Z * [new branch] gh/kwen2501/217/orig -> origin/gh/kwen2501/217/orig 2025-09-07T07:36:19.9368419Z * [new branch] gh/kwen2501/218/base -> origin/gh/kwen2501/218/base 2025-09-07T07:36:19.9369591Z * [new branch] gh/kwen2501/218/head -> origin/gh/kwen2501/218/head 2025-09-07T07:36:19.9370753Z * [new branch] gh/kwen2501/218/orig -> origin/gh/kwen2501/218/orig 2025-09-07T07:36:19.9372465Z * [new branch] gh/kwen2501/219/base -> origin/gh/kwen2501/219/base 2025-09-07T07:36:19.9373677Z * [new branch] gh/kwen2501/219/head -> origin/gh/kwen2501/219/head 2025-09-07T07:36:19.9374875Z * [new branch] gh/kwen2501/219/orig -> origin/gh/kwen2501/219/orig 2025-09-07T07:36:19.9376596Z * [new branch] gh/kwen2501/220/base -> origin/gh/kwen2501/220/base 2025-09-07T07:36:19.9377765Z * [new branch] gh/kwen2501/220/head -> origin/gh/kwen2501/220/head 2025-09-07T07:36:19.9379093Z * [new branch] gh/kwen2501/220/orig -> origin/gh/kwen2501/220/orig 2025-09-07T07:36:19.9381003Z * [new branch] gh/kwen2501/221/base -> origin/gh/kwen2501/221/base 2025-09-07T07:36:19.9382107Z * [new branch] gh/kwen2501/221/head -> origin/gh/kwen2501/221/head 2025-09-07T07:36:19.9383317Z * [new branch] gh/kwen2501/221/orig -> origin/gh/kwen2501/221/orig 2025-09-07T07:36:19.9385450Z * [new branch] gh/kwen2501/222/base -> origin/gh/kwen2501/222/base 2025-09-07T07:36:19.9386736Z * [new branch] gh/kwen2501/222/head -> origin/gh/kwen2501/222/head 2025-09-07T07:36:19.9387901Z * [new branch] gh/kwen2501/222/orig -> origin/gh/kwen2501/222/orig 2025-09-07T07:36:19.9389626Z * [new branch] gh/kwen2501/223/base -> origin/gh/kwen2501/223/base 2025-09-07T07:36:19.9390805Z * [new branch] gh/kwen2501/223/head -> origin/gh/kwen2501/223/head 2025-09-07T07:36:19.9391983Z * [new branch] gh/kwen2501/223/orig -> origin/gh/kwen2501/223/orig 2025-09-07T07:36:19.9393670Z * [new branch] gh/kwen2501/224/base -> origin/gh/kwen2501/224/base 2025-09-07T07:36:19.9394868Z * [new branch] gh/kwen2501/224/head -> origin/gh/kwen2501/224/head 2025-09-07T07:36:19.9396025Z * [new branch] gh/kwen2501/224/orig -> origin/gh/kwen2501/224/orig 2025-09-07T07:36:19.9397873Z * [new branch] gh/kwen2501/225/base -> origin/gh/kwen2501/225/base 2025-09-07T07:36:19.9399045Z * [new branch] gh/kwen2501/225/head -> origin/gh/kwen2501/225/head 2025-09-07T07:36:19.9400249Z * [new branch] gh/kwen2501/225/orig -> origin/gh/kwen2501/225/orig 2025-09-07T07:36:19.9401925Z * [new branch] gh/kwen2501/226/base -> origin/gh/kwen2501/226/base 2025-09-07T07:36:19.9403112Z * [new branch] gh/kwen2501/226/head -> origin/gh/kwen2501/226/head 2025-09-07T07:36:19.9404404Z * [new branch] gh/kwen2501/226/orig -> origin/gh/kwen2501/226/orig 2025-09-07T07:36:19.9406119Z * [new branch] gh/kwen2501/227/base -> origin/gh/kwen2501/227/base 2025-09-07T07:36:19.9407286Z * [new branch] gh/kwen2501/227/head -> origin/gh/kwen2501/227/head 2025-09-07T07:36:19.9408459Z * [new branch] gh/kwen2501/227/orig -> origin/gh/kwen2501/227/orig 2025-09-07T07:36:19.9413177Z * [new branch] gh/kwen2501/228/base -> origin/gh/kwen2501/228/base 2025-09-07T07:36:19.9414416Z * [new branch] gh/kwen2501/228/head -> origin/gh/kwen2501/228/head 2025-09-07T07:36:19.9415590Z * [new branch] gh/kwen2501/228/orig -> origin/gh/kwen2501/228/orig 2025-09-07T07:36:19.9417600Z * [new branch] gh/kwen2501/229/base -> origin/gh/kwen2501/229/base 2025-09-07T07:36:19.9418782Z * [new branch] gh/kwen2501/229/head -> origin/gh/kwen2501/229/head 2025-09-07T07:36:19.9419937Z * [new branch] gh/kwen2501/229/orig -> origin/gh/kwen2501/229/orig 2025-09-07T07:36:19.9421682Z * [new branch] gh/kwen2501/230/base -> origin/gh/kwen2501/230/base 2025-09-07T07:36:19.9422838Z * [new branch] gh/kwen2501/230/head -> origin/gh/kwen2501/230/head 2025-09-07T07:36:19.9424714Z * [new branch] gh/kwen2501/230/orig -> origin/gh/kwen2501/230/orig 2025-09-07T07:36:19.9426171Z * [new branch] gh/kwen2501/231/base -> origin/gh/kwen2501/231/base 2025-09-07T07:36:19.9427185Z * [new branch] gh/kwen2501/231/head -> origin/gh/kwen2501/231/head 2025-09-07T07:36:19.9428284Z * [new branch] gh/kwen2501/231/orig -> origin/gh/kwen2501/231/orig 2025-09-07T07:36:19.9430150Z * [new branch] gh/kwen2501/232/base -> origin/gh/kwen2501/232/base 2025-09-07T07:36:19.9431302Z * [new branch] gh/kwen2501/232/head -> origin/gh/kwen2501/232/head 2025-09-07T07:36:19.9432567Z * [new branch] gh/kwen2501/232/orig -> origin/gh/kwen2501/232/orig 2025-09-07T07:36:19.9435154Z * [new branch] gh/laithsakka/156/base -> origin/gh/laithsakka/156/base 2025-09-07T07:36:19.9435923Z * [new branch] gh/laithsakka/156/head -> origin/gh/laithsakka/156/head 2025-09-07T07:36:19.9437190Z * [new branch] gh/laithsakka/156/orig -> origin/gh/laithsakka/156/orig 2025-09-07T07:36:19.9439037Z * [new branch] gh/laithsakka/160/base -> origin/gh/laithsakka/160/base 2025-09-07T07:36:19.9440249Z * [new branch] gh/laithsakka/160/head -> origin/gh/laithsakka/160/head 2025-09-07T07:36:19.9441362Z * [new branch] gh/laithsakka/160/orig -> origin/gh/laithsakka/160/orig 2025-09-07T07:36:19.9443108Z * [new branch] gh/laithsakka/178/base -> origin/gh/laithsakka/178/base 2025-09-07T07:36:19.9444370Z * [new branch] gh/laithsakka/178/head -> origin/gh/laithsakka/178/head 2025-09-07T07:36:19.9445438Z * [new branch] gh/laithsakka/178/orig -> origin/gh/laithsakka/178/orig 2025-09-07T07:36:19.9447244Z * [new branch] gh/laithsakka/191/base -> origin/gh/laithsakka/191/base 2025-09-07T07:36:19.9449080Z * [new branch] gh/laithsakka/191/head -> origin/gh/laithsakka/191/head 2025-09-07T07:36:19.9450385Z * [new branch] gh/laithsakka/191/orig -> origin/gh/laithsakka/191/orig 2025-09-07T07:36:19.9452094Z * [new branch] gh/laithsakka/237/base -> origin/gh/laithsakka/237/base 2025-09-07T07:36:19.9453288Z * [new branch] gh/laithsakka/237/head -> origin/gh/laithsakka/237/head 2025-09-07T07:36:19.9454587Z * [new branch] gh/laithsakka/237/orig -> origin/gh/laithsakka/237/orig 2025-09-07T07:36:19.9456329Z * [new branch] gh/laithsakka/249/base -> origin/gh/laithsakka/249/base 2025-09-07T07:36:19.9457485Z * [new branch] gh/laithsakka/249/head -> origin/gh/laithsakka/249/head 2025-09-07T07:36:19.9458753Z * [new branch] gh/laithsakka/249/orig -> origin/gh/laithsakka/249/orig 2025-09-07T07:36:19.9461030Z * [new branch] gh/laithsakka/251/base -> origin/gh/laithsakka/251/base 2025-09-07T07:36:19.9462171Z * [new branch] gh/laithsakka/251/head -> origin/gh/laithsakka/251/head 2025-09-07T07:36:19.9463327Z * [new branch] gh/laithsakka/251/orig -> origin/gh/laithsakka/251/orig 2025-09-07T07:36:19.9465088Z * [new branch] gh/laithsakka/254/base -> origin/gh/laithsakka/254/base 2025-09-07T07:36:19.9466352Z * [new branch] gh/laithsakka/254/head -> origin/gh/laithsakka/254/head 2025-09-07T07:36:19.9468063Z * [new branch] gh/laithsakka/254/orig -> origin/gh/laithsakka/254/orig 2025-09-07T07:36:19.9469883Z * [new branch] gh/laithsakka/255/base -> origin/gh/laithsakka/255/base 2025-09-07T07:36:19.9471028Z * [new branch] gh/laithsakka/255/head -> origin/gh/laithsakka/255/head 2025-09-07T07:36:19.9471988Z * [new branch] gh/laithsakka/255/orig -> origin/gh/laithsakka/255/orig 2025-09-07T07:36:19.9473708Z * [new branch] gh/laithsakka/256/base -> origin/gh/laithsakka/256/base 2025-09-07T07:36:19.9474943Z * [new branch] gh/laithsakka/256/head -> origin/gh/laithsakka/256/head 2025-09-07T07:36:19.9476124Z * [new branch] gh/laithsakka/256/orig -> origin/gh/laithsakka/256/orig 2025-09-07T07:36:19.9477843Z * [new branch] gh/laithsakka/257/base -> origin/gh/laithsakka/257/base 2025-09-07T07:36:19.9479035Z * [new branch] gh/laithsakka/257/head -> origin/gh/laithsakka/257/head 2025-09-07T07:36:19.9480213Z * [new branch] gh/laithsakka/257/orig -> origin/gh/laithsakka/257/orig 2025-09-07T07:36:19.9481851Z * [new branch] gh/laithsakka/258/base -> origin/gh/laithsakka/258/base 2025-09-07T07:36:19.9483095Z * [new branch] gh/laithsakka/258/head -> origin/gh/laithsakka/258/head 2025-09-07T07:36:19.9484279Z * [new branch] gh/laithsakka/258/orig -> origin/gh/laithsakka/258/orig 2025-09-07T07:36:19.9486082Z * [new branch] gh/laithsakka/259/base -> origin/gh/laithsakka/259/base 2025-09-07T07:36:19.9487285Z * [new branch] gh/laithsakka/259/head -> origin/gh/laithsakka/259/head 2025-09-07T07:36:19.9488368Z * [new branch] gh/laithsakka/259/orig -> origin/gh/laithsakka/259/orig 2025-09-07T07:36:19.9490100Z * [new branch] gh/laithsakka/260/base -> origin/gh/laithsakka/260/base 2025-09-07T07:36:19.9491368Z * [new branch] gh/laithsakka/260/head -> origin/gh/laithsakka/260/head 2025-09-07T07:36:19.9492592Z * [new branch] gh/laithsakka/260/orig -> origin/gh/laithsakka/260/orig 2025-09-07T07:36:19.9494245Z * [new branch] gh/laithsakka/261/base -> origin/gh/laithsakka/261/base 2025-09-07T07:36:19.9495500Z * [new branch] gh/laithsakka/261/head -> origin/gh/laithsakka/261/head 2025-09-07T07:36:19.9496659Z * [new branch] gh/laithsakka/261/orig -> origin/gh/laithsakka/261/orig 2025-09-07T07:36:19.9498619Z * [new branch] gh/laithsakka/262/base -> origin/gh/laithsakka/262/base 2025-09-07T07:36:19.9500162Z * [new branch] gh/laithsakka/262/head -> origin/gh/laithsakka/262/head 2025-09-07T07:36:19.9501384Z * [new branch] gh/laithsakka/262/orig -> origin/gh/laithsakka/262/orig 2025-09-07T07:36:19.9503615Z * [new branch] gh/laithsakka/263/base -> origin/gh/laithsakka/263/base 2025-09-07T07:36:19.9504857Z * [new branch] gh/laithsakka/263/head -> origin/gh/laithsakka/263/head 2025-09-07T07:36:19.9505982Z * [new branch] gh/laithsakka/263/orig -> origin/gh/laithsakka/263/orig 2025-09-07T07:36:19.9507772Z * [new branch] gh/laithsakka/264/base -> origin/gh/laithsakka/264/base 2025-09-07T07:36:19.9508964Z * [new branch] gh/laithsakka/264/head -> origin/gh/laithsakka/264/head 2025-09-07T07:36:19.9510675Z * [new branch] gh/laithsakka/264/orig -> origin/gh/laithsakka/264/orig 2025-09-07T07:36:19.9512513Z * [new branch] gh/laithsakka/265/base -> origin/gh/laithsakka/265/base 2025-09-07T07:36:19.9513838Z * [new branch] gh/laithsakka/265/head -> origin/gh/laithsakka/265/head 2025-09-07T07:36:19.9514871Z * [new branch] gh/laithsakka/265/orig -> origin/gh/laithsakka/265/orig 2025-09-07T07:36:19.9516741Z * [new branch] gh/laithsakka/266/base -> origin/gh/laithsakka/266/base 2025-09-07T07:36:19.9517834Z * [new branch] gh/laithsakka/266/head -> origin/gh/laithsakka/266/head 2025-09-07T07:36:19.9519135Z * [new branch] gh/laithsakka/266/orig -> origin/gh/laithsakka/266/orig 2025-09-07T07:36:19.9520814Z * [new branch] gh/laithsakka/267/base -> origin/gh/laithsakka/267/base 2025-09-07T07:36:19.9521985Z * [new branch] gh/laithsakka/267/head -> origin/gh/laithsakka/267/head 2025-09-07T07:36:19.9523215Z * [new branch] gh/laithsakka/267/orig -> origin/gh/laithsakka/267/orig 2025-09-07T07:36:19.9524934Z * [new branch] gh/laithsakka/268/base -> origin/gh/laithsakka/268/base 2025-09-07T07:36:19.9526251Z * [new branch] gh/laithsakka/268/head -> origin/gh/laithsakka/268/head 2025-09-07T07:36:19.9527419Z * [new branch] gh/laithsakka/268/orig -> origin/gh/laithsakka/268/orig 2025-09-07T07:36:19.9529356Z * [new branch] gh/laithsakka/28/base -> origin/gh/laithsakka/28/base 2025-09-07T07:36:19.9530944Z * [new branch] gh/laithsakka/29/base -> origin/gh/laithsakka/29/base 2025-09-07T07:36:19.9532703Z * [new branch] gh/laithsakka/30/base -> origin/gh/laithsakka/30/base 2025-09-07T07:36:19.9533875Z * [new branch] gh/laithsakka/30/head -> origin/gh/laithsakka/30/head 2025-09-07T07:36:19.9535586Z * [new branch] gh/laithsakka/31/base -> origin/gh/laithsakka/31/base 2025-09-07T07:36:19.9537029Z * [new branch] gh/laithsakka/31/head -> origin/gh/laithsakka/31/head 2025-09-07T07:36:19.9538635Z * [new branch] gh/laithsakka/32/base -> origin/gh/laithsakka/32/base 2025-09-07T07:36:19.9539749Z * [new branch] gh/laithsakka/32/head -> origin/gh/laithsakka/32/head 2025-09-07T07:36:19.9543311Z * [new branch] gh/lucaskabela/1/base -> origin/gh/lucaskabela/1/base 2025-09-07T07:36:19.9544511Z * [new branch] gh/lucaskabela/1/head -> origin/gh/lucaskabela/1/head 2025-09-07T07:36:19.9546329Z * [new branch] gh/lucaskabela/10/base -> origin/gh/lucaskabela/10/base 2025-09-07T07:36:19.9547520Z * [new branch] gh/lucaskabela/10/head -> origin/gh/lucaskabela/10/head 2025-09-07T07:36:19.9548688Z * [new branch] gh/lucaskabela/10/orig -> origin/gh/lucaskabela/10/orig 2025-09-07T07:36:19.9550280Z * [new branch] gh/lucaskabela/11/base -> origin/gh/lucaskabela/11/base 2025-09-07T07:36:19.9552011Z * [new branch] gh/lucaskabela/11/head -> origin/gh/lucaskabela/11/head 2025-09-07T07:36:19.9553313Z * [new branch] gh/lucaskabela/11/orig -> origin/gh/lucaskabela/11/orig 2025-09-07T07:36:19.9554812Z * [new branch] gh/lucaskabela/12/base -> origin/gh/lucaskabela/12/base 2025-09-07T07:36:19.9555947Z * [new branch] gh/lucaskabela/12/head -> origin/gh/lucaskabela/12/head 2025-09-07T07:36:19.9557161Z * [new branch] gh/lucaskabela/12/orig -> origin/gh/lucaskabela/12/orig 2025-09-07T07:36:19.9559015Z * [new branch] gh/lucaskabela/13/base -> origin/gh/lucaskabela/13/base 2025-09-07T07:36:19.9559858Z * [new branch] gh/lucaskabela/13/head -> origin/gh/lucaskabela/13/head 2025-09-07T07:36:19.9561100Z * [new branch] gh/lucaskabela/13/orig -> origin/gh/lucaskabela/13/orig 2025-09-07T07:36:19.9563092Z * [new branch] gh/lucaskabela/14/base -> origin/gh/lucaskabela/14/base 2025-09-07T07:36:19.9564527Z * [new branch] gh/lucaskabela/14/head -> origin/gh/lucaskabela/14/head 2025-09-07T07:36:19.9565765Z * [new branch] gh/lucaskabela/14/orig -> origin/gh/lucaskabela/14/orig 2025-09-07T07:36:19.9567340Z * [new branch] gh/lucaskabela/15/base -> origin/gh/lucaskabela/15/base 2025-09-07T07:36:19.9568628Z * [new branch] gh/lucaskabela/15/head -> origin/gh/lucaskabela/15/head 2025-09-07T07:36:19.9569836Z * [new branch] gh/lucaskabela/15/orig -> origin/gh/lucaskabela/15/orig 2025-09-07T07:36:19.9571525Z * [new branch] gh/lucaskabela/16/base -> origin/gh/lucaskabela/16/base 2025-09-07T07:36:19.9572640Z * [new branch] gh/lucaskabela/16/head -> origin/gh/lucaskabela/16/head 2025-09-07T07:36:19.9573823Z * [new branch] gh/lucaskabela/16/orig -> origin/gh/lucaskabela/16/orig 2025-09-07T07:36:19.9575439Z * [new branch] gh/lucaskabela/17/base -> origin/gh/lucaskabela/17/base 2025-09-07T07:36:19.9576571Z * [new branch] gh/lucaskabela/17/head -> origin/gh/lucaskabela/17/head 2025-09-07T07:36:19.9577658Z * [new branch] gh/lucaskabela/17/orig -> origin/gh/lucaskabela/17/orig 2025-09-07T07:36:19.9579483Z * [new branch] gh/lucaskabela/2/base -> origin/gh/lucaskabela/2/base 2025-09-07T07:36:19.9580576Z * [new branch] gh/lucaskabela/2/head -> origin/gh/lucaskabela/2/head 2025-09-07T07:36:19.9581759Z * [new branch] gh/lucaskabela/2/orig -> origin/gh/lucaskabela/2/orig 2025-09-07T07:36:19.9583605Z * [new branch] gh/lucaskabela/3/base -> origin/gh/lucaskabela/3/base 2025-09-07T07:36:19.9584762Z * [new branch] gh/lucaskabela/3/head -> origin/gh/lucaskabela/3/head 2025-09-07T07:36:19.9586119Z * [new branch] gh/lucaskabela/3/orig -> origin/gh/lucaskabela/3/orig 2025-09-07T07:36:19.9587691Z * [new branch] gh/lucaskabela/4/base -> origin/gh/lucaskabela/4/base 2025-09-07T07:36:19.9588900Z * [new branch] gh/lucaskabela/4/head -> origin/gh/lucaskabela/4/head 2025-09-07T07:36:19.9590086Z * [new branch] gh/lucaskabela/4/orig -> origin/gh/lucaskabela/4/orig 2025-09-07T07:36:19.9591896Z * [new branch] gh/lucaskabela/5/base -> origin/gh/lucaskabela/5/base 2025-09-07T07:36:19.9592988Z * [new branch] gh/lucaskabela/5/head -> origin/gh/lucaskabela/5/head 2025-09-07T07:36:19.9594298Z * [new branch] gh/lucaskabela/5/orig -> origin/gh/lucaskabela/5/orig 2025-09-07T07:36:19.9595799Z * [new branch] gh/lucaskabela/6/base -> origin/gh/lucaskabela/6/base 2025-09-07T07:36:19.9597025Z * [new branch] gh/lucaskabela/6/head -> origin/gh/lucaskabela/6/head 2025-09-07T07:36:19.9598352Z * [new branch] gh/lucaskabela/6/orig -> origin/gh/lucaskabela/6/orig 2025-09-07T07:36:19.9600163Z * [new branch] gh/lucaskabela/7/base -> origin/gh/lucaskabela/7/base 2025-09-07T07:36:19.9601353Z * [new branch] gh/lucaskabela/7/head -> origin/gh/lucaskabela/7/head 2025-09-07T07:36:19.9602576Z * [new branch] gh/lucaskabela/7/orig -> origin/gh/lucaskabela/7/orig 2025-09-07T07:36:19.9604306Z * [new branch] gh/lucaskabela/8/base -> origin/gh/lucaskabela/8/base 2025-09-07T07:36:19.9605371Z * [new branch] gh/lucaskabela/8/head -> origin/gh/lucaskabela/8/head 2025-09-07T07:36:19.9606653Z * [new branch] gh/lucaskabela/8/orig -> origin/gh/lucaskabela/8/orig 2025-09-07T07:36:19.9608353Z * [new branch] gh/lucaskabela/9/base -> origin/gh/lucaskabela/9/base 2025-09-07T07:36:19.9609793Z * [new branch] gh/lucaskabela/9/head -> origin/gh/lucaskabela/9/head 2025-09-07T07:36:19.9610985Z * [new branch] gh/lucaskabela/9/orig -> origin/gh/lucaskabela/9/orig 2025-09-07T07:36:19.9613110Z * [new branch] gh/lw/3/base -> origin/gh/lw/3/base 2025-09-07T07:36:19.9614264Z * [new branch] gh/lw/3/head -> origin/gh/lw/3/head 2025-09-07T07:36:19.9615716Z * [new branch] gh/lw/3/orig -> origin/gh/lw/3/orig 2025-09-07T07:36:19.9617626Z * [new branch] gh/malfet/14/base -> origin/gh/malfet/14/base 2025-09-07T07:36:19.9619327Z * [new branch] gh/malfet/330/base -> origin/gh/malfet/330/base 2025-09-07T07:36:19.9620503Z * [new branch] gh/malfet/330/head -> origin/gh/malfet/330/head 2025-09-07T07:36:19.9621841Z * [new branch] gh/malfet/330/orig -> origin/gh/malfet/330/orig 2025-09-07T07:36:19.9623355Z * [new branch] gh/malfet/396/base -> origin/gh/malfet/396/base 2025-09-07T07:36:19.9624529Z * [new branch] gh/malfet/396/head -> origin/gh/malfet/396/head 2025-09-07T07:36:19.9625762Z * [new branch] gh/malfet/396/orig -> origin/gh/malfet/396/orig 2025-09-07T07:36:19.9627457Z * [new branch] gh/malfet/397/base -> origin/gh/malfet/397/base 2025-09-07T07:36:19.9628702Z * [new branch] gh/malfet/397/head -> origin/gh/malfet/397/head 2025-09-07T07:36:19.9629851Z * [new branch] gh/malfet/397/orig -> origin/gh/malfet/397/orig 2025-09-07T07:36:19.9631614Z * [new branch] gh/malfet/398/base -> origin/gh/malfet/398/base 2025-09-07T07:36:19.9632965Z * [new branch] gh/malfet/398/head -> origin/gh/malfet/398/head 2025-09-07T07:36:19.9634212Z * [new branch] gh/malfet/398/orig -> origin/gh/malfet/398/orig 2025-09-07T07:36:19.9635846Z * [new branch] gh/malfet/399/base -> origin/gh/malfet/399/base 2025-09-07T07:36:19.9637024Z * [new branch] gh/malfet/399/head -> origin/gh/malfet/399/head 2025-09-07T07:36:19.9638184Z * [new branch] gh/malfet/399/orig -> origin/gh/malfet/399/orig 2025-09-07T07:36:19.9640317Z * [new branch] gh/malfet/414/base -> origin/gh/malfet/414/base 2025-09-07T07:36:19.9641523Z * [new branch] gh/malfet/414/head -> origin/gh/malfet/414/head 2025-09-07T07:36:19.9644451Z * [new branch] gh/malfet/414/orig -> origin/gh/malfet/414/orig 2025-09-07T07:36:19.9645715Z * [new branch] gh/malfet/417/base -> origin/gh/malfet/417/base 2025-09-07T07:36:19.9646335Z * [new branch] gh/malfet/417/head -> origin/gh/malfet/417/head 2025-09-07T07:36:19.9647146Z * [new branch] gh/malfet/417/orig -> origin/gh/malfet/417/orig 2025-09-07T07:36:19.9648368Z * [new branch] gh/malfet/418/base -> origin/gh/malfet/418/base 2025-09-07T07:36:19.9649575Z * [new branch] gh/malfet/418/head -> origin/gh/malfet/418/head 2025-09-07T07:36:19.9650859Z * [new branch] gh/malfet/418/orig -> origin/gh/malfet/418/orig 2025-09-07T07:36:19.9652533Z * [new branch] gh/malfet/475/base -> origin/gh/malfet/475/base 2025-09-07T07:36:19.9653729Z * [new branch] gh/malfet/475/head -> origin/gh/malfet/475/head 2025-09-07T07:36:19.9655023Z * [new branch] gh/malfet/475/orig -> origin/gh/malfet/475/orig 2025-09-07T07:36:19.9656618Z * [new branch] gh/malfet/476/base -> origin/gh/malfet/476/base 2025-09-07T07:36:19.9657890Z * [new branch] gh/malfet/476/head -> origin/gh/malfet/476/head 2025-09-07T07:36:19.9658986Z * [new branch] gh/malfet/476/orig -> origin/gh/malfet/476/orig 2025-09-07T07:36:19.9660642Z * [new branch] gh/malfet/477/base -> origin/gh/malfet/477/base 2025-09-07T07:36:19.9661888Z * [new branch] gh/malfet/477/head -> origin/gh/malfet/477/head 2025-09-07T07:36:19.9663161Z * [new branch] gh/malfet/477/orig -> origin/gh/malfet/477/orig 2025-09-07T07:36:19.9664658Z * [new branch] gh/malfet/478/base -> origin/gh/malfet/478/base 2025-09-07T07:36:19.9665992Z * [new branch] gh/malfet/478/head -> origin/gh/malfet/478/head 2025-09-07T07:36:19.9667251Z * [new branch] gh/malfet/478/orig -> origin/gh/malfet/478/orig 2025-09-07T07:36:19.9669353Z * [new branch] gh/malfet/479/base -> origin/gh/malfet/479/base 2025-09-07T07:36:19.9670716Z * [new branch] gh/malfet/479/head -> origin/gh/malfet/479/head 2025-09-07T07:36:19.9671940Z * [new branch] gh/malfet/479/orig -> origin/gh/malfet/479/orig 2025-09-07T07:36:19.9673633Z * [new branch] gh/malfet/480/base -> origin/gh/malfet/480/base 2025-09-07T07:36:19.9674747Z * [new branch] gh/malfet/480/head -> origin/gh/malfet/480/head 2025-09-07T07:36:19.9675955Z * [new branch] gh/malfet/480/orig -> origin/gh/malfet/480/orig 2025-09-07T07:36:19.9677674Z * [new branch] gh/malfet/481/base -> origin/gh/malfet/481/base 2025-09-07T07:36:19.9678848Z * [new branch] gh/malfet/481/head -> origin/gh/malfet/481/head 2025-09-07T07:36:19.9679952Z * [new branch] gh/malfet/481/orig -> origin/gh/malfet/481/orig 2025-09-07T07:36:19.9681622Z * [new branch] gh/malfet/482/base -> origin/gh/malfet/482/base 2025-09-07T07:36:19.9682926Z * [new branch] gh/malfet/482/head -> origin/gh/malfet/482/head 2025-09-07T07:36:19.9684154Z * [new branch] gh/malfet/482/orig -> origin/gh/malfet/482/orig 2025-09-07T07:36:19.9686215Z * [new branch] gh/malfet/483/base -> origin/gh/malfet/483/base 2025-09-07T07:36:19.9687362Z * [new branch] gh/malfet/483/head -> origin/gh/malfet/483/head 2025-09-07T07:36:19.9688515Z * [new branch] gh/malfet/483/orig -> origin/gh/malfet/483/orig 2025-09-07T07:36:19.9690253Z * [new branch] gh/malfet/484/base -> origin/gh/malfet/484/base 2025-09-07T07:36:19.9691565Z * [new branch] gh/malfet/484/head -> origin/gh/malfet/484/head 2025-09-07T07:36:19.9693191Z * [new branch] gh/malfet/484/orig -> origin/gh/malfet/484/orig 2025-09-07T07:36:19.9695002Z * [new branch] gh/malfet/485/base -> origin/gh/malfet/485/base 2025-09-07T07:36:19.9696206Z * [new branch] gh/malfet/485/head -> origin/gh/malfet/485/head 2025-09-07T07:36:19.9697484Z * [new branch] gh/malfet/485/orig -> origin/gh/malfet/485/orig 2025-09-07T07:36:19.9699173Z * [new branch] gh/malfet/486/base -> origin/gh/malfet/486/base 2025-09-07T07:36:19.9700526Z * [new branch] gh/malfet/486/head -> origin/gh/malfet/486/head 2025-09-07T07:36:19.9701597Z * [new branch] gh/malfet/486/orig -> origin/gh/malfet/486/orig 2025-09-07T07:36:19.9703312Z * [new branch] gh/malfet/487/base -> origin/gh/malfet/487/base 2025-09-07T07:36:19.9704492Z * [new branch] gh/malfet/487/head -> origin/gh/malfet/487/head 2025-09-07T07:36:19.9705871Z * [new branch] gh/malfet/487/orig -> origin/gh/malfet/487/orig 2025-09-07T07:36:19.9708244Z * [new branch] gh/malfet/488/base -> origin/gh/malfet/488/base 2025-09-07T07:36:19.9717885Z * [new branch] gh/malfet/488/head -> origin/gh/malfet/488/head 2025-09-07T07:36:19.9718060Z * [new branch] gh/malfet/488/orig -> origin/gh/malfet/488/orig 2025-09-07T07:36:19.9718190Z * [new branch] gh/malfet/489/base -> origin/gh/malfet/489/base 2025-09-07T07:36:19.9718314Z * [new branch] gh/malfet/489/head -> origin/gh/malfet/489/head 2025-09-07T07:36:19.9718444Z * [new branch] gh/malfet/489/orig -> origin/gh/malfet/489/orig 2025-09-07T07:36:19.9718563Z * [new branch] gh/malfet/490/base -> origin/gh/malfet/490/base 2025-09-07T07:36:19.9718686Z * [new branch] gh/malfet/490/head -> origin/gh/malfet/490/head 2025-09-07T07:36:19.9719432Z * [new branch] gh/malfet/490/orig -> origin/gh/malfet/490/orig 2025-09-07T07:36:19.9721299Z * [new branch] gh/malfet/491/base -> origin/gh/malfet/491/base 2025-09-07T07:36:19.9722532Z * [new branch] gh/malfet/491/head -> origin/gh/malfet/491/head 2025-09-07T07:36:19.9723751Z * [new branch] gh/malfet/491/orig -> origin/gh/malfet/491/orig 2025-09-07T07:36:19.9725407Z * [new branch] gh/malfet/492/base -> origin/gh/malfet/492/base 2025-09-07T07:36:19.9726638Z * [new branch] gh/malfet/492/head -> origin/gh/malfet/492/head 2025-09-07T07:36:19.9727841Z * [new branch] gh/malfet/492/orig -> origin/gh/malfet/492/orig 2025-09-07T07:36:19.9729624Z * [new branch] gh/malfet/493/base -> origin/gh/malfet/493/base 2025-09-07T07:36:19.9730777Z * [new branch] gh/malfet/493/head -> origin/gh/malfet/493/head 2025-09-07T07:36:19.9732066Z * [new branch] gh/malfet/493/orig -> origin/gh/malfet/493/orig 2025-09-07T07:36:19.9733911Z * [new branch] gh/malfet/494/base -> origin/gh/malfet/494/base 2025-09-07T07:36:19.9734975Z * [new branch] gh/malfet/494/head -> origin/gh/malfet/494/head 2025-09-07T07:36:19.9736203Z * [new branch] gh/malfet/494/orig -> origin/gh/malfet/494/orig 2025-09-07T07:36:19.9737842Z * [new branch] gh/malfet/495/base -> origin/gh/malfet/495/base 2025-09-07T07:36:19.9739070Z * [new branch] gh/malfet/495/head -> origin/gh/malfet/495/head 2025-09-07T07:36:19.9740251Z * [new branch] gh/malfet/495/orig -> origin/gh/malfet/495/orig 2025-09-07T07:36:19.9742250Z * [new branch] gh/malfet/496/base -> origin/gh/malfet/496/base 2025-09-07T07:36:19.9743421Z * [new branch] gh/malfet/496/head -> origin/gh/malfet/496/head 2025-09-07T07:36:19.9744571Z * [new branch] gh/malfet/496/orig -> origin/gh/malfet/496/orig 2025-09-07T07:36:19.9746390Z * [new branch] gh/malfet/497/base -> origin/gh/malfet/497/base 2025-09-07T07:36:19.9747559Z * [new branch] gh/malfet/497/head -> origin/gh/malfet/497/head 2025-09-07T07:36:19.9748808Z * [new branch] gh/malfet/497/orig -> origin/gh/malfet/497/orig 2025-09-07T07:36:19.9750581Z * [new branch] gh/malfet/498/base -> origin/gh/malfet/498/base 2025-09-07T07:36:19.9751798Z * [new branch] gh/malfet/498/head -> origin/gh/malfet/498/head 2025-09-07T07:36:19.9752977Z * [new branch] gh/malfet/498/orig -> origin/gh/malfet/498/orig 2025-09-07T07:36:19.9754608Z * [new branch] gh/malfet/499/base -> origin/gh/malfet/499/base 2025-09-07T07:36:19.9755780Z * [new branch] gh/malfet/499/head -> origin/gh/malfet/499/head 2025-09-07T07:36:19.9756944Z * [new branch] gh/malfet/499/orig -> origin/gh/malfet/499/orig 2025-09-07T07:36:19.9758686Z * [new branch] gh/malfet/500/base -> origin/gh/malfet/500/base 2025-09-07T07:36:19.9759831Z * [new branch] gh/malfet/500/head -> origin/gh/malfet/500/head 2025-09-07T07:36:19.9761016Z * [new branch] gh/malfet/500/orig -> origin/gh/malfet/500/orig 2025-09-07T07:36:19.9762772Z * [new branch] gh/malfet/501/base -> origin/gh/malfet/501/base 2025-09-07T07:36:19.9764022Z * [new branch] gh/malfet/501/head -> origin/gh/malfet/501/head 2025-09-07T07:36:19.9765185Z * [new branch] gh/malfet/501/orig -> origin/gh/malfet/501/orig 2025-09-07T07:36:19.9767447Z * [new branch] gh/malfet/502/base -> origin/gh/malfet/502/base 2025-09-07T07:36:19.9768784Z * [new branch] gh/malfet/502/head -> origin/gh/malfet/502/head 2025-09-07T07:36:19.9770024Z * [new branch] gh/malfet/502/orig -> origin/gh/malfet/502/orig 2025-09-07T07:36:19.9771823Z * [new branch] gh/malfet/503/base -> origin/gh/malfet/503/base 2025-09-07T07:36:19.9772982Z * [new branch] gh/malfet/503/head -> origin/gh/malfet/503/head 2025-09-07T07:36:19.9774290Z * [new branch] gh/malfet/503/orig -> origin/gh/malfet/503/orig 2025-09-07T07:36:19.9776010Z * [new branch] gh/malfet/504/base -> origin/gh/malfet/504/base 2025-09-07T07:36:19.9777344Z * [new branch] gh/malfet/504/head -> origin/gh/malfet/504/head 2025-09-07T07:36:19.9778523Z * [new branch] gh/malfet/504/orig -> origin/gh/malfet/504/orig 2025-09-07T07:36:19.9780299Z * [new branch] gh/malfet/505/base -> origin/gh/malfet/505/base 2025-09-07T07:36:19.9781476Z * [new branch] gh/malfet/505/head -> origin/gh/malfet/505/head 2025-09-07T07:36:19.9782652Z * [new branch] gh/malfet/505/orig -> origin/gh/malfet/505/orig 2025-09-07T07:36:19.9784517Z * [new branch] gh/malfet/506/base -> origin/gh/malfet/506/base 2025-09-07T07:36:19.9786192Z * [new branch] gh/malfet/506/head -> origin/gh/malfet/506/head 2025-09-07T07:36:19.9787413Z * [new branch] gh/malfet/506/orig -> origin/gh/malfet/506/orig 2025-09-07T07:36:19.9789119Z * [new branch] gh/malfet/507/base -> origin/gh/malfet/507/base 2025-09-07T07:36:19.9790305Z * [new branch] gh/malfet/507/head -> origin/gh/malfet/507/head 2025-09-07T07:36:19.9791516Z * [new branch] gh/malfet/507/orig -> origin/gh/malfet/507/orig 2025-09-07T07:36:19.9793351Z * [new branch] gh/malfet/508/base -> origin/gh/malfet/508/base 2025-09-07T07:36:19.9794535Z * [new branch] gh/malfet/508/head -> origin/gh/malfet/508/head 2025-09-07T07:36:19.9795733Z * [new branch] gh/malfet/508/orig -> origin/gh/malfet/508/orig 2025-09-07T07:36:19.9797339Z * [new branch] gh/malfet/509/base -> origin/gh/malfet/509/base 2025-09-07T07:36:19.9798566Z * [new branch] gh/malfet/509/head -> origin/gh/malfet/509/head 2025-09-07T07:36:19.9799792Z * [new branch] gh/malfet/509/orig -> origin/gh/malfet/509/orig 2025-09-07T07:36:19.9801590Z * [new branch] gh/malfet/510/base -> origin/gh/malfet/510/base 2025-09-07T07:36:19.9802861Z * [new branch] gh/malfet/510/head -> origin/gh/malfet/510/head 2025-09-07T07:36:19.9804021Z * [new branch] gh/malfet/510/orig -> origin/gh/malfet/510/orig 2025-09-07T07:36:19.9805752Z * [new branch] gh/malfet/511/base -> origin/gh/malfet/511/base 2025-09-07T07:36:19.9806953Z * [new branch] gh/malfet/511/head -> origin/gh/malfet/511/head 2025-09-07T07:36:19.9808195Z * [new branch] gh/malfet/511/orig -> origin/gh/malfet/511/orig 2025-09-07T07:36:19.9810061Z * [new branch] gh/malfet/512/base -> origin/gh/malfet/512/base 2025-09-07T07:36:19.9814705Z * [new branch] gh/malfet/512/head -> origin/gh/malfet/512/head 2025-09-07T07:36:19.9816056Z * [new branch] gh/malfet/512/orig -> origin/gh/malfet/512/orig 2025-09-07T07:36:19.9818287Z * [new branch] gh/malfet/513/base -> origin/gh/malfet/513/base 2025-09-07T07:36:19.9819575Z * [new branch] gh/malfet/513/head -> origin/gh/malfet/513/head 2025-09-07T07:36:19.9820752Z * [new branch] gh/malfet/513/orig -> origin/gh/malfet/513/orig 2025-09-07T07:36:19.9822498Z * [new branch] gh/malfet/64/base -> origin/gh/malfet/64/base 2025-09-07T07:36:19.9823753Z * [new branch] gh/malfet/64/head -> origin/gh/malfet/64/head 2025-09-07T07:36:19.9825960Z * [new branch] gh/manuelcandales/10/base -> origin/gh/manuelcandales/10/base 2025-09-07T07:36:19.9827171Z * [new branch] gh/manuelcandales/10/head -> origin/gh/manuelcandales/10/head 2025-09-07T07:36:19.9828345Z * [new branch] gh/manuelcandales/10/orig -> origin/gh/manuelcandales/10/orig 2025-09-07T07:36:19.9830030Z * [new branch] gh/manuelcandales/11/base -> origin/gh/manuelcandales/11/base 2025-09-07T07:36:19.9831220Z * [new branch] gh/manuelcandales/11/head -> origin/gh/manuelcandales/11/head 2025-09-07T07:36:19.9832396Z * [new branch] gh/manuelcandales/11/orig -> origin/gh/manuelcandales/11/orig 2025-09-07T07:36:19.9834449Z * [new branch] gh/manuelcandales/9/base -> origin/gh/manuelcandales/9/base 2025-09-07T07:36:19.9835623Z * [new branch] gh/manuelcandales/9/head -> origin/gh/manuelcandales/9/head 2025-09-07T07:36:19.9836869Z * [new branch] gh/manuelcandales/9/orig -> origin/gh/manuelcandales/9/orig 2025-09-07T07:36:19.9839257Z * [new branch] gh/markkm/1/base -> origin/gh/markkm/1/base 2025-09-07T07:36:19.9841421Z * [new branch] gh/masnesral/204/base -> origin/gh/masnesral/204/base 2025-09-07T07:36:19.9842709Z * [new branch] gh/masnesral/204/head -> origin/gh/masnesral/204/head 2025-09-07T07:36:19.9843939Z * [new branch] gh/masnesral/204/orig -> origin/gh/masnesral/204/orig 2025-09-07T07:36:19.9845724Z * [new branch] gh/masnesral/235/base -> origin/gh/masnesral/235/base 2025-09-07T07:36:19.9847254Z * [new branch] gh/masnesral/235/head -> origin/gh/masnesral/235/head 2025-09-07T07:36:19.9848148Z * [new branch] gh/masnesral/235/orig -> origin/gh/masnesral/235/orig 2025-09-07T07:36:19.9849874Z * [new branch] gh/masnesral/34/base -> origin/gh/masnesral/34/base 2025-09-07T07:36:19.9852455Z * [new branch] gh/mhorowitz/0/base -> origin/gh/mhorowitz/0/base 2025-09-07T07:36:19.9853757Z * [new branch] gh/mhorowitz/0/head -> origin/gh/mhorowitz/0/head 2025-09-07T07:36:19.9855534Z * [new branch] gh/mhorowitz/1/base -> origin/gh/mhorowitz/1/base 2025-09-07T07:36:19.9856727Z * [new branch] gh/mhorowitz/1/head -> origin/gh/mhorowitz/1/head 2025-09-07T07:36:19.9858345Z * [new branch] gh/mhorowitz/2/base -> origin/gh/mhorowitz/2/base 2025-09-07T07:36:19.9859592Z * [new branch] gh/mhorowitz/2/head -> origin/gh/mhorowitz/2/head 2025-09-07T07:36:19.9861153Z * [new branch] gh/mhorowitz/3/base -> origin/gh/mhorowitz/3/base 2025-09-07T07:36:19.9862794Z * [new branch] gh/mhorowitz/3/head -> origin/gh/mhorowitz/3/head 2025-09-07T07:36:19.9863974Z * [new branch] gh/mhorowitz/4/base -> origin/gh/mhorowitz/4/base 2025-09-07T07:36:19.9865097Z * [new branch] gh/mhorowitz/4/head -> origin/gh/mhorowitz/4/head 2025-09-07T07:36:19.9866739Z * [new branch] gh/mhorowitz/5/base -> origin/gh/mhorowitz/5/base 2025-09-07T07:36:19.9867857Z * [new branch] gh/mhorowitz/5/head -> origin/gh/mhorowitz/5/head 2025-09-07T07:36:19.9869500Z * [new branch] gh/mhorowitz/6/base -> origin/gh/mhorowitz/6/base 2025-09-07T07:36:19.9870615Z * [new branch] gh/mhorowitz/6/head -> origin/gh/mhorowitz/6/head 2025-09-07T07:36:19.9872803Z * [new branch] gh/mikaylagawarecki/234/base -> origin/gh/mikaylagawarecki/234/base 2025-09-07T07:36:19.9873993Z * [new branch] gh/mikaylagawarecki/234/head -> origin/gh/mikaylagawarecki/234/head 2025-09-07T07:36:19.9875643Z * [new branch] gh/mikaylagawarecki/235/base -> origin/gh/mikaylagawarecki/235/base 2025-09-07T07:36:19.9877164Z * [new branch] gh/mikaylagawarecki/235/head -> origin/gh/mikaylagawarecki/235/head 2025-09-07T07:36:19.9878857Z * [new branch] gh/mikaylagawarecki/236/base -> origin/gh/mikaylagawarecki/236/base 2025-09-07T07:36:19.9879988Z * [new branch] gh/mikaylagawarecki/236/head -> origin/gh/mikaylagawarecki/236/head 2025-09-07T07:36:19.9881612Z * [new branch] gh/mikaylagawarecki/237/base -> origin/gh/mikaylagawarecki/237/base 2025-09-07T07:36:19.9882711Z * [new branch] gh/mikaylagawarecki/237/head -> origin/gh/mikaylagawarecki/237/head 2025-09-07T07:36:19.9884482Z * [new branch] gh/mikaylagawarecki/238/base -> origin/gh/mikaylagawarecki/238/base 2025-09-07T07:36:19.9885644Z * [new branch] gh/mikaylagawarecki/238/head -> origin/gh/mikaylagawarecki/238/head 2025-09-07T07:36:19.9887359Z * [new branch] gh/mikaylagawarecki/317/base -> origin/gh/mikaylagawarecki/317/base 2025-09-07T07:36:19.9888556Z * [new branch] gh/mikaylagawarecki/317/head -> origin/gh/mikaylagawarecki/317/head 2025-09-07T07:36:19.9890255Z * [new branch] gh/mikaylagawarecki/317/orig -> origin/gh/mikaylagawarecki/317/orig 2025-09-07T07:36:19.9892002Z * [new branch] gh/mikaylagawarecki/320/base -> origin/gh/mikaylagawarecki/320/base 2025-09-07T07:36:19.9893180Z * [new branch] gh/mikaylagawarecki/320/head -> origin/gh/mikaylagawarecki/320/head 2025-09-07T07:36:19.9894342Z * [new branch] gh/mikaylagawarecki/320/orig -> origin/gh/mikaylagawarecki/320/orig 2025-09-07T07:36:19.9896018Z * [new branch] gh/mikaylagawarecki/329/base -> origin/gh/mikaylagawarecki/329/base 2025-09-07T07:36:19.9897793Z * [new branch] gh/mikaylagawarecki/329/head -> origin/gh/mikaylagawarecki/329/head 2025-09-07T07:36:19.9899039Z * [new branch] gh/mikaylagawarecki/329/orig -> origin/gh/mikaylagawarecki/329/orig 2025-09-07T07:36:19.9901185Z * [new branch] gh/mikaylagawarecki/330/base -> origin/gh/mikaylagawarecki/330/base 2025-09-07T07:36:19.9902443Z * [new branch] gh/mikaylagawarecki/330/head -> origin/gh/mikaylagawarecki/330/head 2025-09-07T07:36:19.9903642Z * [new branch] gh/mikaylagawarecki/330/orig -> origin/gh/mikaylagawarecki/330/orig 2025-09-07T07:36:19.9905411Z * [new branch] gh/mikaylagawarecki/331/base -> origin/gh/mikaylagawarecki/331/base 2025-09-07T07:36:19.9906696Z * [new branch] gh/mikaylagawarecki/331/head -> origin/gh/mikaylagawarecki/331/head 2025-09-07T07:36:19.9907918Z * [new branch] gh/mikaylagawarecki/331/orig -> origin/gh/mikaylagawarecki/331/orig 2025-09-07T07:36:19.9909909Z * [new branch] gh/mikaylagawarecki/332/base -> origin/gh/mikaylagawarecki/332/base 2025-09-07T07:36:19.9911144Z * [new branch] gh/mikaylagawarecki/332/head -> origin/gh/mikaylagawarecki/332/head 2025-09-07T07:36:19.9912288Z * [new branch] gh/mikaylagawarecki/332/orig -> origin/gh/mikaylagawarecki/332/orig 2025-09-07T07:36:19.9914032Z * [new branch] gh/mikaylagawarecki/334/base -> origin/gh/mikaylagawarecki/334/base 2025-09-07T07:36:19.9915172Z * [new branch] gh/mikaylagawarecki/334/head -> origin/gh/mikaylagawarecki/334/head 2025-09-07T07:36:19.9916371Z * [new branch] gh/mikaylagawarecki/334/orig -> origin/gh/mikaylagawarecki/334/orig 2025-09-07T07:36:19.9918056Z * [new branch] gh/mikaylagawarecki/335/base -> origin/gh/mikaylagawarecki/335/base 2025-09-07T07:36:19.9919376Z * [new branch] gh/mikaylagawarecki/335/head -> origin/gh/mikaylagawarecki/335/head 2025-09-07T07:36:19.9920663Z * [new branch] gh/mikaylagawarecki/335/orig -> origin/gh/mikaylagawarecki/335/orig 2025-09-07T07:36:19.9922265Z * [new branch] gh/mikaylagawarecki/336/base -> origin/gh/mikaylagawarecki/336/base 2025-09-07T07:36:19.9923428Z * [new branch] gh/mikaylagawarecki/336/head -> origin/gh/mikaylagawarecki/336/head 2025-09-07T07:36:19.9924638Z * [new branch] gh/mikaylagawarecki/336/orig -> origin/gh/mikaylagawarecki/336/orig 2025-09-07T07:36:19.9926197Z * [new branch] gh/mikaylagawarecki/337/base -> origin/gh/mikaylagawarecki/337/base 2025-09-07T07:36:19.9927357Z * [new branch] gh/mikaylagawarecki/337/head -> origin/gh/mikaylagawarecki/337/head 2025-09-07T07:36:19.9928645Z * [new branch] gh/mikaylagawarecki/337/orig -> origin/gh/mikaylagawarecki/337/orig 2025-09-07T07:36:19.9930409Z * [new branch] gh/mikaylagawarecki/338/base -> origin/gh/mikaylagawarecki/338/base 2025-09-07T07:36:19.9931588Z * [new branch] gh/mikaylagawarecki/338/head -> origin/gh/mikaylagawarecki/338/head 2025-09-07T07:36:19.9932776Z * [new branch] gh/mikaylagawarecki/338/orig -> origin/gh/mikaylagawarecki/338/orig 2025-09-07T07:36:19.9934795Z * [new branch] gh/mikaylagawarecki/339/base -> origin/gh/mikaylagawarecki/339/base 2025-09-07T07:36:19.9936109Z * [new branch] gh/mikaylagawarecki/339/head -> origin/gh/mikaylagawarecki/339/head 2025-09-07T07:36:19.9937419Z * [new branch] gh/mikaylagawarecki/339/orig -> origin/gh/mikaylagawarecki/339/orig 2025-09-07T07:36:19.9939515Z * [new branch] gh/mlazos/1/base -> origin/gh/mlazos/1/base 2025-09-07T07:36:19.9940767Z * [new branch] gh/mlazos/1/head -> origin/gh/mlazos/1/head 2025-09-07T07:36:19.9941952Z * [new branch] gh/mlazos/1/orig -> origin/gh/mlazos/1/orig 2025-09-07T07:36:19.9943672Z * [new branch] gh/mlazos/12/base -> origin/gh/mlazos/12/base 2025-09-07T07:36:19.9944942Z * [new branch] gh/mlazos/12/head -> origin/gh/mlazos/12/head 2025-09-07T07:36:19.9946225Z * [new branch] gh/mlazos/12/orig -> origin/gh/mlazos/12/orig 2025-09-07T07:36:19.9948018Z * [new branch] gh/mlazos/13/base -> origin/gh/mlazos/13/base 2025-09-07T07:36:19.9949199Z * [new branch] gh/mlazos/13/head -> origin/gh/mlazos/13/head 2025-09-07T07:36:19.9950389Z * [new branch] gh/mlazos/13/orig -> origin/gh/mlazos/13/orig 2025-09-07T07:36:19.9952158Z * [new branch] gh/mlazos/14/base -> origin/gh/mlazos/14/base 2025-09-07T07:36:19.9953346Z * [new branch] gh/mlazos/14/head -> origin/gh/mlazos/14/head 2025-09-07T07:36:19.9954532Z * [new branch] gh/mlazos/14/orig -> origin/gh/mlazos/14/orig 2025-09-07T07:36:19.9956319Z * [new branch] gh/mlazos/15/base -> origin/gh/mlazos/15/base 2025-09-07T07:36:19.9957512Z * [new branch] gh/mlazos/15/head -> origin/gh/mlazos/15/head 2025-09-07T07:36:19.9958713Z * [new branch] gh/mlazos/15/orig -> origin/gh/mlazos/15/orig 2025-09-07T07:36:19.9960405Z * [new branch] gh/mlazos/16/base -> origin/gh/mlazos/16/base 2025-09-07T07:36:19.9961666Z * [new branch] gh/mlazos/16/head -> origin/gh/mlazos/16/head 2025-09-07T07:36:19.9962824Z * [new branch] gh/mlazos/16/orig -> origin/gh/mlazos/16/orig 2025-09-07T07:36:19.9964595Z * [new branch] gh/mlazos/17/base -> origin/gh/mlazos/17/base 2025-09-07T07:36:19.9965694Z * [new branch] gh/mlazos/17/head -> origin/gh/mlazos/17/head 2025-09-07T07:36:19.9966835Z * [new branch] gh/mlazos/17/orig -> origin/gh/mlazos/17/orig 2025-09-07T07:36:19.9968619Z * [new branch] gh/mlazos/2/base -> origin/gh/mlazos/2/base 2025-09-07T07:36:19.9969757Z * [new branch] gh/mlazos/2/head -> origin/gh/mlazos/2/head 2025-09-07T07:36:19.9970905Z * [new branch] gh/mlazos/2/orig -> origin/gh/mlazos/2/orig 2025-09-07T07:36:19.9972684Z * [new branch] gh/mlazos/3/base -> origin/gh/mlazos/3/base 2025-09-07T07:36:19.9973788Z * [new branch] gh/mlazos/3/head -> origin/gh/mlazos/3/head 2025-09-07T07:36:19.9974923Z * [new branch] gh/mlazos/3/orig -> origin/gh/mlazos/3/orig 2025-09-07T07:36:19.9977181Z * [new branch] gh/mrmiywj/1/base -> origin/gh/mrmiywj/1/base 2025-09-07T07:36:19.9978447Z * [new branch] gh/mrmiywj/1/head -> origin/gh/mrmiywj/1/head 2025-09-07T07:36:19.9980586Z * [new branch] gh/muchulee8/62/base -> origin/gh/muchulee8/62/base 2025-09-07T07:36:19.9981841Z * [new branch] gh/muchulee8/62/head -> origin/gh/muchulee8/62/head 2025-09-07T07:36:19.9983080Z * [new branch] gh/muchulee8/62/orig -> origin/gh/muchulee8/62/orig 2025-09-07T07:36:19.9985303Z * [new branch] gh/muchulee8/63/base -> origin/gh/muchulee8/63/base 2025-09-07T07:36:19.9986591Z * [new branch] gh/muchulee8/63/head -> origin/gh/muchulee8/63/head 2025-09-07T07:36:19.9987892Z * [new branch] gh/muchulee8/63/orig -> origin/gh/muchulee8/63/orig 2025-09-07T07:36:19.9989728Z * [new branch] gh/muchulee8/64/base -> origin/gh/muchulee8/64/base 2025-09-07T07:36:19.9990882Z * [new branch] gh/muchulee8/64/head -> origin/gh/muchulee8/64/head 2025-09-07T07:36:19.9992101Z * [new branch] gh/muchulee8/64/orig -> origin/gh/muchulee8/64/orig 2025-09-07T07:36:19.9993905Z * [new branch] gh/muchulee8/65/base -> origin/gh/muchulee8/65/base 2025-09-07T07:36:19.9995150Z * [new branch] gh/muchulee8/65/head -> origin/gh/muchulee8/65/head 2025-09-07T07:36:19.9996415Z * [new branch] gh/muchulee8/65/orig -> origin/gh/muchulee8/65/orig 2025-09-07T07:36:19.9998576Z * [new branch] gh/naveenthangudu/1/base -> origin/gh/naveenthangudu/1/base 2025-09-07T07:36:19.9999720Z * [new branch] gh/naveenthangudu/1/head -> origin/gh/naveenthangudu/1/head 2025-09-07T07:36:20.0001190Z * [new branch] gh/naveenthangudu/1/orig -> origin/gh/naveenthangudu/1/orig 2025-09-07T07:36:20.0002864Z * [new branch] gh/naveenthangudu/2/base -> origin/gh/naveenthangudu/2/base 2025-09-07T07:36:20.0004051Z * [new branch] gh/naveenthangudu/2/head -> origin/gh/naveenthangudu/2/head 2025-09-07T07:36:20.0005329Z * [new branch] gh/naveenthangudu/2/orig -> origin/gh/naveenthangudu/2/orig 2025-09-07T07:36:20.0006991Z * [new branch] gh/naveenthangudu/3/base -> origin/gh/naveenthangudu/3/base 2025-09-07T07:36:20.0008166Z * [new branch] gh/naveenthangudu/3/head -> origin/gh/naveenthangudu/3/head 2025-09-07T07:36:20.0009381Z * [new branch] gh/naveenthangudu/3/orig -> origin/gh/naveenthangudu/3/orig 2025-09-07T07:36:20.0011213Z * [new branch] gh/naveenthangudu/4/base -> origin/gh/naveenthangudu/4/base 2025-09-07T07:36:20.0012394Z * [new branch] gh/naveenthangudu/4/head -> origin/gh/naveenthangudu/4/head 2025-09-07T07:36:20.0013679Z * [new branch] gh/naveenthangudu/4/orig -> origin/gh/naveenthangudu/4/orig 2025-09-07T07:36:20.0015397Z * [new branch] gh/naveenthangudu/5/base -> origin/gh/naveenthangudu/5/base 2025-09-07T07:36:20.0016552Z * [new branch] gh/naveenthangudu/5/head -> origin/gh/naveenthangudu/5/head 2025-09-07T07:36:20.0017885Z * [new branch] gh/naveenthangudu/5/orig -> origin/gh/naveenthangudu/5/orig 2025-09-07T07:36:20.0019538Z * [new branch] gh/naveenthangudu/6/base -> origin/gh/naveenthangudu/6/base 2025-09-07T07:36:20.0020732Z * [new branch] gh/naveenthangudu/6/head -> origin/gh/naveenthangudu/6/head 2025-09-07T07:36:20.0021866Z * [new branch] gh/naveenthangudu/6/orig -> origin/gh/naveenthangudu/6/orig 2025-09-07T07:36:20.0024141Z * [new branch] gh/oulgen/35/base -> origin/gh/oulgen/35/base 2025-09-07T07:36:20.0025339Z * [new branch] gh/oulgen/35/head -> origin/gh/oulgen/35/head 2025-09-07T07:36:20.0026614Z * [new branch] gh/oulgen/35/orig -> origin/gh/oulgen/35/orig 2025-09-07T07:36:20.0028342Z * [new branch] gh/oulgen/48/base -> origin/gh/oulgen/48/base 2025-09-07T07:36:20.0029493Z * [new branch] gh/oulgen/48/head -> origin/gh/oulgen/48/head 2025-09-07T07:36:20.0030674Z * [new branch] gh/oulgen/48/orig -> origin/gh/oulgen/48/orig 2025-09-07T07:36:20.0032271Z * [new branch] gh/oulgen/49/base -> origin/gh/oulgen/49/base 2025-09-07T07:36:20.0033525Z * [new branch] gh/oulgen/49/head -> origin/gh/oulgen/49/head 2025-09-07T07:36:20.0034745Z * [new branch] gh/oulgen/49/orig -> origin/gh/oulgen/49/orig 2025-09-07T07:36:20.0037360Z * [new branch] gh/pearu/108/base -> origin/gh/pearu/108/base 2025-09-07T07:36:20.0038599Z * [new branch] gh/pearu/108/head -> origin/gh/pearu/108/head 2025-09-07T07:36:20.0039727Z * [new branch] gh/pearu/108/orig -> origin/gh/pearu/108/orig 2025-09-07T07:36:20.0041490Z * [new branch] gh/pearu/109/base -> origin/gh/pearu/109/base 2025-09-07T07:36:20.0042657Z * [new branch] gh/pearu/109/head -> origin/gh/pearu/109/head 2025-09-07T07:36:20.0043839Z * [new branch] gh/pearu/109/orig -> origin/gh/pearu/109/orig 2025-09-07T07:36:20.0045486Z * [new branch] gh/pearu/110/base -> origin/gh/pearu/110/base 2025-09-07T07:36:20.0046692Z * [new branch] gh/pearu/110/head -> origin/gh/pearu/110/head 2025-09-07T07:36:20.0047926Z * [new branch] gh/pearu/110/orig -> origin/gh/pearu/110/orig 2025-09-07T07:36:20.0049814Z * [new branch] gh/pearu/111/base -> origin/gh/pearu/111/base 2025-09-07T07:36:20.0050955Z * [new branch] gh/pearu/111/head -> origin/gh/pearu/111/head 2025-09-07T07:36:20.0052178Z * [new branch] gh/pearu/111/orig -> origin/gh/pearu/111/orig 2025-09-07T07:36:20.0054225Z * [new branch] gh/pearu/112/base -> origin/gh/pearu/112/base 2025-09-07T07:36:20.0055417Z * [new branch] gh/pearu/112/head -> origin/gh/pearu/112/head 2025-09-07T07:36:20.0056647Z * [new branch] gh/pearu/112/orig -> origin/gh/pearu/112/orig 2025-09-07T07:36:20.0058341Z * [new branch] gh/pearu/113/base -> origin/gh/pearu/113/base 2025-09-07T07:36:20.0059542Z * [new branch] gh/pearu/113/head -> origin/gh/pearu/113/head 2025-09-07T07:36:20.0060697Z * [new branch] gh/pearu/113/orig -> origin/gh/pearu/113/orig 2025-09-07T07:36:20.0062424Z * [new branch] gh/pearu/114/base -> origin/gh/pearu/114/base 2025-09-07T07:36:20.0063607Z * [new branch] gh/pearu/114/head -> origin/gh/pearu/114/head 2025-09-07T07:36:20.0064931Z * [new branch] gh/pearu/114/orig -> origin/gh/pearu/114/orig 2025-09-07T07:36:20.0066859Z * [new branch] gh/pearu/115/base -> origin/gh/pearu/115/base 2025-09-07T07:36:20.0068083Z * [new branch] gh/pearu/115/head -> origin/gh/pearu/115/head 2025-09-07T07:36:20.0069228Z * [new branch] gh/pearu/115/orig -> origin/gh/pearu/115/orig 2025-09-07T07:36:20.0070912Z * [new branch] gh/pearu/116/base -> origin/gh/pearu/116/base 2025-09-07T07:36:20.0072202Z * [new branch] gh/pearu/116/head -> origin/gh/pearu/116/head 2025-09-07T07:36:20.0073399Z * [new branch] gh/pearu/116/orig -> origin/gh/pearu/116/orig 2025-09-07T07:36:20.0075183Z * [new branch] gh/pearu/117/base -> origin/gh/pearu/117/base 2025-09-07T07:36:20.0076294Z * [new branch] gh/pearu/117/head -> origin/gh/pearu/117/head 2025-09-07T07:36:20.0077409Z * [new branch] gh/pearu/117/orig -> origin/gh/pearu/117/orig 2025-09-07T07:36:20.0079446Z * [new branch] gh/pearu/56/base -> origin/gh/pearu/56/base 2025-09-07T07:36:20.0080802Z * [new branch] gh/pearu/56/head -> origin/gh/pearu/56/head 2025-09-07T07:36:20.0082003Z * [new branch] gh/pearu/56/orig -> origin/gh/pearu/56/orig 2025-09-07T07:36:20.0083920Z * [new branch] gh/pearu/97/base -> origin/gh/pearu/97/base 2025-09-07T07:36:20.0085139Z * [new branch] gh/pearu/97/head -> origin/gh/pearu/97/head 2025-09-07T07:36:20.0086299Z * [new branch] gh/pearu/97/orig -> origin/gh/pearu/97/orig 2025-09-07T07:36:20.0088421Z * [new branch] gh/qqaatw/29/base -> origin/gh/qqaatw/29/base 2025-09-07T07:36:20.0089693Z * [new branch] gh/qqaatw/29/head -> origin/gh/qqaatw/29/head 2025-09-07T07:36:20.0090811Z * [new branch] gh/qqaatw/29/orig -> origin/gh/qqaatw/29/orig 2025-09-07T07:36:20.0092530Z * [new branch] gh/raymo/refresh-script -> origin/gh/raymo/refresh-script 2025-09-07T07:36:20.0095015Z * [new branch] gh/rec/141/base -> origin/gh/rec/141/base 2025-09-07T07:36:20.0096624Z * [new branch] gh/rec/141/head -> origin/gh/rec/141/head 2025-09-07T07:36:20.0098312Z * [new branch] gh/rec/153/base -> origin/gh/rec/153/base 2025-09-07T07:36:20.0099557Z * [new branch] gh/rec/153/head -> origin/gh/rec/153/head 2025-09-07T07:36:20.0100754Z * [new branch] gh/rec/153/orig -> origin/gh/rec/153/orig 2025-09-07T07:36:20.0102455Z * [new branch] gh/rec/154/base -> origin/gh/rec/154/base 2025-09-07T07:36:20.0103614Z * [new branch] gh/rec/154/head -> origin/gh/rec/154/head 2025-09-07T07:36:20.0104891Z * [new branch] gh/rec/154/orig -> origin/gh/rec/154/orig 2025-09-07T07:36:20.0106611Z * [new branch] gh/rec/156/base -> origin/gh/rec/156/base 2025-09-07T07:36:20.0107841Z * [new branch] gh/rec/156/head -> origin/gh/rec/156/head 2025-09-07T07:36:20.0109132Z * [new branch] gh/rec/156/orig -> origin/gh/rec/156/orig 2025-09-07T07:36:20.0111050Z * [new branch] gh/rec/160/base -> origin/gh/rec/160/base 2025-09-07T07:36:20.0112697Z * [new branch] gh/rec/160/head -> origin/gh/rec/160/head 2025-09-07T07:36:20.0113921Z * [new branch] gh/rec/160/orig -> origin/gh/rec/160/orig 2025-09-07T07:36:20.0115619Z * [new branch] gh/rec/162/base -> origin/gh/rec/162/base 2025-09-07T07:36:20.0116873Z * [new branch] gh/rec/162/head -> origin/gh/rec/162/head 2025-09-07T07:36:20.0118076Z * [new branch] gh/rec/162/orig -> origin/gh/rec/162/orig 2025-09-07T07:36:20.0119710Z * [new branch] gh/rec/163/base -> origin/gh/rec/163/base 2025-09-07T07:36:20.0120900Z * [new branch] gh/rec/163/head -> origin/gh/rec/163/head 2025-09-07T07:36:20.0122131Z * [new branch] gh/rec/163/orig -> origin/gh/rec/163/orig 2025-09-07T07:36:20.0123772Z * [new branch] gh/rec/164/base -> origin/gh/rec/164/base 2025-09-07T07:36:20.0124885Z * [new branch] gh/rec/164/head -> origin/gh/rec/164/head 2025-09-07T07:36:20.0126046Z * [new branch] gh/rec/164/orig -> origin/gh/rec/164/orig 2025-09-07T07:36:20.0127771Z * [new branch] gh/rec/165/base -> origin/gh/rec/165/base 2025-09-07T07:36:20.0128974Z * [new branch] gh/rec/165/head -> origin/gh/rec/165/head 2025-09-07T07:36:20.0130156Z * [new branch] gh/rec/165/orig -> origin/gh/rec/165/orig 2025-09-07T07:36:20.0131818Z * [new branch] gh/rec/166/base -> origin/gh/rec/166/base 2025-09-07T07:36:20.0133558Z * [new branch] gh/rec/166/head -> origin/gh/rec/166/head 2025-09-07T07:36:20.0134807Z * [new branch] gh/rec/166/orig -> origin/gh/rec/166/orig 2025-09-07T07:36:20.0136974Z * [new branch] gh/robert-hardwick/1/base -> origin/gh/robert-hardwick/1/base 2025-09-07T07:36:20.0138147Z * [new branch] gh/robert-hardwick/1/head -> origin/gh/robert-hardwick/1/head 2025-09-07T07:36:20.0139320Z * [new branch] gh/robert-hardwick/1/orig -> origin/gh/robert-hardwick/1/orig 2025-09-07T07:36:20.0141032Z * [new branch] gh/robert-hardwick/2/base -> origin/gh/robert-hardwick/2/base 2025-09-07T07:36:20.0142301Z * [new branch] gh/robert-hardwick/2/head -> origin/gh/robert-hardwick/2/head 2025-09-07T07:36:20.0143787Z * [new branch] gh/robert-hardwick/2/orig -> origin/gh/robert-hardwick/2/orig 2025-09-07T07:36:20.0145500Z * [new branch] gh/robert-hardwick/3/base -> origin/gh/robert-hardwick/3/base 2025-09-07T07:36:20.0147180Z * [new branch] gh/robert-hardwick/3/head -> origin/gh/robert-hardwick/3/head 2025-09-07T07:36:20.0148382Z * [new branch] gh/robert-hardwick/3/orig -> origin/gh/robert-hardwick/3/orig 2025-09-07T07:36:20.0150121Z * [new branch] gh/robert-hardwick/4/base -> origin/gh/robert-hardwick/4/base 2025-09-07T07:36:20.0151298Z * [new branch] gh/robert-hardwick/4/head -> origin/gh/robert-hardwick/4/head 2025-09-07T07:36:20.0152508Z * [new branch] gh/robert-hardwick/4/orig -> origin/gh/robert-hardwick/4/orig 2025-09-07T07:36:20.0154557Z * [new branch] gh/rtimpe/1/base -> origin/gh/rtimpe/1/base 2025-09-07T07:36:20.0155769Z * [new branch] gh/rtimpe/1/head -> origin/gh/rtimpe/1/head 2025-09-07T07:36:20.0157449Z * [new branch] gh/rtimpe/10/base -> origin/gh/rtimpe/10/base 2025-09-07T07:36:20.0158664Z * [new branch] gh/rtimpe/10/head -> origin/gh/rtimpe/10/head 2025-09-07T07:36:20.0159849Z * [new branch] gh/rtimpe/10/orig -> origin/gh/rtimpe/10/orig 2025-09-07T07:36:20.0161589Z * [new branch] gh/rtimpe/11/base -> origin/gh/rtimpe/11/base 2025-09-07T07:36:20.0162775Z * [new branch] gh/rtimpe/11/head -> origin/gh/rtimpe/11/head 2025-09-07T07:36:20.0163929Z * [new branch] gh/rtimpe/11/orig -> origin/gh/rtimpe/11/orig 2025-09-07T07:36:20.0165664Z * [new branch] gh/rtimpe/12/base -> origin/gh/rtimpe/12/base 2025-09-07T07:36:20.0166836Z * [new branch] gh/rtimpe/12/head -> origin/gh/rtimpe/12/head 2025-09-07T07:36:20.0167996Z * [new branch] gh/rtimpe/12/orig -> origin/gh/rtimpe/12/orig 2025-09-07T07:36:20.0169665Z * [new branch] gh/rtimpe/13/base -> origin/gh/rtimpe/13/base 2025-09-07T07:36:20.0170842Z * [new branch] gh/rtimpe/13/head -> origin/gh/rtimpe/13/head 2025-09-07T07:36:20.0172005Z * [new branch] gh/rtimpe/13/orig -> origin/gh/rtimpe/13/orig 2025-09-07T07:36:20.0173658Z * [new branch] gh/rtimpe/14/base -> origin/gh/rtimpe/14/base 2025-09-07T07:36:20.0174849Z * [new branch] gh/rtimpe/14/head -> origin/gh/rtimpe/14/head 2025-09-07T07:36:20.0176046Z * [new branch] gh/rtimpe/14/orig -> origin/gh/rtimpe/14/orig 2025-09-07T07:36:20.0177713Z * [new branch] gh/rtimpe/15/base -> origin/gh/rtimpe/15/base 2025-09-07T07:36:20.0178888Z * [new branch] gh/rtimpe/15/head -> origin/gh/rtimpe/15/head 2025-09-07T07:36:20.0180130Z * [new branch] gh/rtimpe/15/orig -> origin/gh/rtimpe/15/orig 2025-09-07T07:36:20.0181981Z * [new branch] gh/rtimpe/2/base -> origin/gh/rtimpe/2/base 2025-09-07T07:36:20.0183935Z * [new branch] gh/rtimpe/2/head -> origin/gh/rtimpe/2/head 2025-09-07T07:36:20.0185561Z * [new branch] gh/rtimpe/3/base -> origin/gh/rtimpe/3/base 2025-09-07T07:36:20.0186755Z * [new branch] gh/rtimpe/3/head -> origin/gh/rtimpe/3/head 2025-09-07T07:36:20.0188398Z * [new branch] gh/rtimpe/4/base -> origin/gh/rtimpe/4/base 2025-09-07T07:36:20.0189732Z * [new branch] gh/rtimpe/4/head -> origin/gh/rtimpe/4/head 2025-09-07T07:36:20.0191466Z * [new branch] gh/rtimpe/9/base -> origin/gh/rtimpe/9/base 2025-09-07T07:36:20.0192595Z * [new branch] gh/rtimpe/9/head -> origin/gh/rtimpe/9/head 2025-09-07T07:36:20.0193834Z * [new branch] gh/rtimpe/9/orig -> origin/gh/rtimpe/9/orig 2025-09-07T07:36:20.0195922Z * [new branch] gh/ruisizhang123/1/base -> origin/gh/ruisizhang123/1/base 2025-09-07T07:36:20.0197123Z * [new branch] gh/ruisizhang123/1/head -> origin/gh/ruisizhang123/1/head 2025-09-07T07:36:20.0198337Z * [new branch] gh/ruisizhang123/1/orig -> origin/gh/ruisizhang123/1/orig 2025-09-07T07:36:20.0199981Z * [new branch] gh/ruisizhang123/4/base -> origin/gh/ruisizhang123/4/base 2025-09-07T07:36:20.0201159Z * [new branch] gh/ruisizhang123/4/head -> origin/gh/ruisizhang123/4/head 2025-09-07T07:36:20.0202344Z * [new branch] gh/ruisizhang123/4/orig -> origin/gh/ruisizhang123/4/orig 2025-09-07T07:36:20.0204023Z * [new branch] gh/ruisizhang123/5/base -> origin/gh/ruisizhang123/5/base 2025-09-07T07:36:20.0205256Z * [new branch] gh/ruisizhang123/5/head -> origin/gh/ruisizhang123/5/head 2025-09-07T07:36:20.0206400Z * [new branch] gh/ruisizhang123/5/orig -> origin/gh/ruisizhang123/5/orig 2025-09-07T07:36:20.0208073Z * [new branch] gh/ruisizhang123/6/base -> origin/gh/ruisizhang123/6/base 2025-09-07T07:36:20.0209225Z * [new branch] gh/ruisizhang123/6/head -> origin/gh/ruisizhang123/6/head 2025-09-07T07:36:20.0210621Z * [new branch] gh/ruisizhang123/6/orig -> origin/gh/ruisizhang123/6/orig 2025-09-07T07:36:20.0212287Z * [new branch] gh/ruisizhang123/7/base -> origin/gh/ruisizhang123/7/base 2025-09-07T07:36:20.0213514Z * [new branch] gh/ruisizhang123/7/head -> origin/gh/ruisizhang123/7/head 2025-09-07T07:36:20.0214739Z * [new branch] gh/ruisizhang123/7/orig -> origin/gh/ruisizhang123/7/orig 2025-09-07T07:36:20.0216365Z * [new branch] gh/ruisizhang123/8/base -> origin/gh/ruisizhang123/8/base 2025-09-07T07:36:20.0217695Z * [new branch] gh/ruisizhang123/8/head -> origin/gh/ruisizhang123/8/head 2025-09-07T07:36:20.0218876Z * [new branch] gh/ruisizhang123/8/orig -> origin/gh/ruisizhang123/8/orig 2025-09-07T07:36:20.0220586Z * [new branch] gh/ruisizhang123/9/base -> origin/gh/ruisizhang123/9/base 2025-09-07T07:36:20.0221781Z * [new branch] gh/ruisizhang123/9/head -> origin/gh/ruisizhang123/9/head 2025-09-07T07:36:20.0222996Z * [new branch] gh/ruisizhang123/9/orig -> origin/gh/ruisizhang123/9/orig 2025-09-07T07:36:20.0225116Z * [new branch] gh/sarckk/2/base -> origin/gh/sarckk/2/base 2025-09-07T07:36:20.0226360Z * [new branch] gh/sarckk/2/head -> origin/gh/sarckk/2/head 2025-09-07T07:36:20.0227635Z * [new branch] gh/sarckk/2/orig -> origin/gh/sarckk/2/orig 2025-09-07T07:36:20.0229848Z * [new branch] gh/seemethere/35/base -> origin/gh/seemethere/35/base 2025-09-07T07:36:20.0231037Z * [new branch] gh/seemethere/35/head -> origin/gh/seemethere/35/head 2025-09-07T07:36:20.0232265Z * [new branch] gh/seemethere/35/orig -> origin/gh/seemethere/35/orig 2025-09-07T07:36:20.0233967Z * [new branch] gh/seemethere/37/base -> origin/gh/seemethere/37/base 2025-09-07T07:36:20.0235106Z * [new branch] gh/seemethere/37/head -> origin/gh/seemethere/37/head 2025-09-07T07:36:20.0236296Z * [new branch] gh/seemethere/37/orig -> origin/gh/seemethere/37/orig 2025-09-07T07:36:20.0237964Z * [new branch] gh/seemethere/43/base -> origin/gh/seemethere/43/base 2025-09-07T07:36:20.0239154Z * [new branch] gh/seemethere/43/head -> origin/gh/seemethere/43/head 2025-09-07T07:36:20.0240368Z * [new branch] gh/seemethere/43/orig -> origin/gh/seemethere/43/orig 2025-09-07T07:36:20.0242083Z * [new branch] gh/seemethere/44/base -> origin/gh/seemethere/44/base 2025-09-07T07:36:20.0243170Z * [new branch] gh/seemethere/44/head -> origin/gh/seemethere/44/head 2025-09-07T07:36:20.0244361Z * [new branch] gh/seemethere/44/orig -> origin/gh/seemethere/44/orig 2025-09-07T07:36:20.0246144Z * [new branch] gh/seemethere/48/base -> origin/gh/seemethere/48/base 2025-09-07T07:36:20.0247341Z * [new branch] gh/seemethere/48/head -> origin/gh/seemethere/48/head 2025-09-07T07:36:20.0248524Z * [new branch] gh/seemethere/48/orig -> origin/gh/seemethere/48/orig 2025-09-07T07:36:20.0250167Z * [new branch] gh/seemethere/49/base -> origin/gh/seemethere/49/base 2025-09-07T07:36:20.0251333Z * [new branch] gh/seemethere/49/head -> origin/gh/seemethere/49/head 2025-09-07T07:36:20.0252674Z * [new branch] gh/seemethere/49/orig -> origin/gh/seemethere/49/orig 2025-09-07T07:36:20.0254412Z * [new branch] gh/seemethere/52/base -> origin/gh/seemethere/52/base 2025-09-07T07:36:20.0255615Z * [new branch] gh/seemethere/52/head -> origin/gh/seemethere/52/head 2025-09-07T07:36:20.0256857Z * [new branch] gh/seemethere/52/orig -> origin/gh/seemethere/52/orig 2025-09-07T07:36:20.0258511Z * [new branch] gh/seemethere/53/base -> origin/gh/seemethere/53/base 2025-09-07T07:36:20.0259669Z * [new branch] gh/seemethere/53/head -> origin/gh/seemethere/53/head 2025-09-07T07:36:20.0260830Z * [new branch] gh/seemethere/53/orig -> origin/gh/seemethere/53/orig 2025-09-07T07:36:20.0262572Z * [new branch] gh/seemethere/54/base -> origin/gh/seemethere/54/base 2025-09-07T07:36:20.0263751Z * [new branch] gh/seemethere/54/head -> origin/gh/seemethere/54/head 2025-09-07T07:36:20.0264997Z * [new branch] gh/seemethere/54/orig -> origin/gh/seemethere/54/orig 2025-09-07T07:36:20.0267173Z * [new branch] gh/seemethere/55/base -> origin/gh/seemethere/55/base 2025-09-07T07:36:20.0268351Z * [new branch] gh/seemethere/55/head -> origin/gh/seemethere/55/head 2025-09-07T07:36:20.0269665Z * [new branch] gh/seemethere/55/orig -> origin/gh/seemethere/55/orig 2025-09-07T07:36:20.0271382Z * [new branch] gh/seemethere/56/base -> origin/gh/seemethere/56/base 2025-09-07T07:36:20.0272553Z * [new branch] gh/seemethere/56/head -> origin/gh/seemethere/56/head 2025-09-07T07:36:20.0273760Z * [new branch] gh/seemethere/56/orig -> origin/gh/seemethere/56/orig 2025-09-07T07:36:20.0275452Z * [new branch] gh/seemethere/57/base -> origin/gh/seemethere/57/base 2025-09-07T07:36:20.0276582Z * [new branch] gh/seemethere/57/head -> origin/gh/seemethere/57/head 2025-09-07T07:36:20.0277776Z * [new branch] gh/seemethere/57/orig -> origin/gh/seemethere/57/orig 2025-09-07T07:36:20.0279548Z * [new branch] gh/seemethere/58/base -> origin/gh/seemethere/58/base 2025-09-07T07:36:20.0280685Z * [new branch] gh/seemethere/58/head -> origin/gh/seemethere/58/head 2025-09-07T07:36:20.0281872Z * [new branch] gh/seemethere/58/orig -> origin/gh/seemethere/58/orig 2025-09-07T07:36:20.0283551Z * [new branch] gh/seemethere/59/base -> origin/gh/seemethere/59/base 2025-09-07T07:36:20.0284708Z * [new branch] gh/seemethere/59/head -> origin/gh/seemethere/59/head 2025-09-07T07:36:20.0285895Z * [new branch] gh/seemethere/59/orig -> origin/gh/seemethere/59/orig 2025-09-07T07:36:20.0287787Z * [new branch] gh/seemethere/60/base -> origin/gh/seemethere/60/base 2025-09-07T07:36:20.0289034Z * [new branch] gh/seemethere/60/head -> origin/gh/seemethere/60/head 2025-09-07T07:36:20.0290362Z * [new branch] gh/seemethere/60/orig -> origin/gh/seemethere/60/orig 2025-09-07T07:36:20.0291938Z * [new branch] gh/seemethere/61/base -> origin/gh/seemethere/61/base 2025-09-07T07:36:20.0293564Z * [new branch] gh/seemethere/61/head -> origin/gh/seemethere/61/head 2025-09-07T07:36:20.0294780Z * [new branch] gh/seemethere/61/orig -> origin/gh/seemethere/61/orig 2025-09-07T07:36:20.0296538Z * [new branch] gh/seemethere/62/base -> origin/gh/seemethere/62/base 2025-09-07T07:36:20.0297735Z * [new branch] gh/seemethere/62/head -> origin/gh/seemethere/62/head 2025-09-07T07:36:20.0298901Z * [new branch] gh/seemethere/62/orig -> origin/gh/seemethere/62/orig 2025-09-07T07:36:20.0300554Z * [new branch] gh/seemethere/63/base -> origin/gh/seemethere/63/base 2025-09-07T07:36:20.0301707Z * [new branch] gh/seemethere/63/head -> origin/gh/seemethere/63/head 2025-09-07T07:36:20.0302899Z * [new branch] gh/seemethere/63/orig -> origin/gh/seemethere/63/orig 2025-09-07T07:36:20.0305162Z * [new branch] gh/shunting314/145/base -> origin/gh/shunting314/145/base 2025-09-07T07:36:20.0306554Z * [new branch] gh/shunting314/145/head -> origin/gh/shunting314/145/head 2025-09-07T07:36:20.0307847Z * [new branch] gh/shunting314/145/orig -> origin/gh/shunting314/145/orig 2025-09-07T07:36:20.0309927Z * [new branch] gh/shunting314/176/base -> origin/gh/shunting314/176/base 2025-09-07T07:36:20.0313645Z * [new branch] gh/shunting314/176/head -> origin/gh/shunting314/176/head 2025-09-07T07:36:20.0314874Z * [new branch] gh/shunting314/176/orig -> origin/gh/shunting314/176/orig 2025-09-07T07:36:20.0316642Z * [new branch] gh/shunting314/211/base -> origin/gh/shunting314/211/base 2025-09-07T07:36:20.0317841Z * [new branch] gh/shunting314/211/head -> origin/gh/shunting314/211/head 2025-09-07T07:36:20.0319041Z * [new branch] gh/shunting314/211/orig -> origin/gh/shunting314/211/orig 2025-09-07T07:36:20.0320651Z * [new branch] gh/shunting314/212/base -> origin/gh/shunting314/212/base 2025-09-07T07:36:20.0321826Z * [new branch] gh/shunting314/212/head -> origin/gh/shunting314/212/head 2025-09-07T07:36:20.0323002Z * [new branch] gh/shunting314/212/orig -> origin/gh/shunting314/212/orig 2025-09-07T07:36:20.0324752Z * [new branch] gh/shunting314/213/base -> origin/gh/shunting314/213/base 2025-09-07T07:36:20.0326541Z * [new branch] gh/shunting314/213/head -> origin/gh/shunting314/213/head 2025-09-07T07:36:20.0327740Z * [new branch] gh/shunting314/213/orig -> origin/gh/shunting314/213/orig 2025-09-07T07:36:20.0329793Z * [new branch] gh/shunting314/214/base -> origin/gh/shunting314/214/base 2025-09-07T07:36:20.0330970Z * [new branch] gh/shunting314/214/head -> origin/gh/shunting314/214/head 2025-09-07T07:36:20.0332142Z * [new branch] gh/shunting314/214/orig -> origin/gh/shunting314/214/orig 2025-09-07T07:36:20.0334028Z * [new branch] gh/shunting314/215/base -> origin/gh/shunting314/215/base 2025-09-07T07:36:20.0335225Z * [new branch] gh/shunting314/215/head -> origin/gh/shunting314/215/head 2025-09-07T07:36:20.0336411Z * [new branch] gh/shunting314/215/orig -> origin/gh/shunting314/215/orig 2025-09-07T07:36:20.0338068Z * [new branch] gh/shunting314/216/base -> origin/gh/shunting314/216/base 2025-09-07T07:36:20.0339206Z * [new branch] gh/shunting314/216/head -> origin/gh/shunting314/216/head 2025-09-07T07:36:20.0340407Z * [new branch] gh/shunting314/216/orig -> origin/gh/shunting314/216/orig 2025-09-07T07:36:20.0342226Z * [new branch] gh/shunting314/217/base -> origin/gh/shunting314/217/base 2025-09-07T07:36:20.0343321Z * [new branch] gh/shunting314/217/head -> origin/gh/shunting314/217/head 2025-09-07T07:36:20.0344481Z * [new branch] gh/shunting314/217/orig -> origin/gh/shunting314/217/orig 2025-09-07T07:36:20.0346397Z * [new branch] gh/shunting314/218/base -> origin/gh/shunting314/218/base 2025-09-07T07:36:20.0347540Z * [new branch] gh/shunting314/218/head -> origin/gh/shunting314/218/head 2025-09-07T07:36:20.0348711Z * [new branch] gh/shunting314/218/orig -> origin/gh/shunting314/218/orig 2025-09-07T07:36:20.0350357Z * [new branch] gh/shunting314/219/base -> origin/gh/shunting314/219/base 2025-09-07T07:36:20.0351601Z * [new branch] gh/shunting314/219/head -> origin/gh/shunting314/219/head 2025-09-07T07:36:20.0352821Z * [new branch] gh/shunting314/219/orig -> origin/gh/shunting314/219/orig 2025-09-07T07:36:20.0354659Z * [new branch] gh/shunting314/220/base -> origin/gh/shunting314/220/base 2025-09-07T07:36:20.0356010Z * [new branch] gh/shunting314/220/head -> origin/gh/shunting314/220/head 2025-09-07T07:36:20.0357184Z * [new branch] gh/shunting314/220/orig -> origin/gh/shunting314/220/orig 2025-09-07T07:36:20.0358828Z * [new branch] gh/shunting314/221/base -> origin/gh/shunting314/221/base 2025-09-07T07:36:20.0359949Z * [new branch] gh/shunting314/221/head -> origin/gh/shunting314/221/head 2025-09-07T07:36:20.0361187Z * [new branch] gh/shunting314/221/orig -> origin/gh/shunting314/221/orig 2025-09-07T07:36:20.0362932Z * [new branch] gh/shunting314/222/base -> origin/gh/shunting314/222/base 2025-09-07T07:36:20.0364094Z * [new branch] gh/shunting314/222/head -> origin/gh/shunting314/222/head 2025-09-07T07:36:20.0365263Z * [new branch] gh/shunting314/222/orig -> origin/gh/shunting314/222/orig 2025-09-07T07:36:20.0366880Z * [new branch] gh/shunting314/223/base -> origin/gh/shunting314/223/base 2025-09-07T07:36:20.0368065Z * [new branch] gh/shunting314/223/head -> origin/gh/shunting314/223/head 2025-09-07T07:36:20.0369227Z * [new branch] gh/shunting314/223/orig -> origin/gh/shunting314/223/orig 2025-09-07T07:36:20.0371384Z * [new branch] gh/silverguo/1/base -> origin/gh/silverguo/1/base 2025-09-07T07:36:20.0372578Z * [new branch] gh/silverguo/1/head -> origin/gh/silverguo/1/head 2025-09-07T07:36:20.0374140Z * [new branch] gh/silverguo/2/base -> origin/gh/silverguo/2/base 2025-09-07T07:36:20.0375273Z * [new branch] gh/silverguo/2/head -> origin/gh/silverguo/2/head 2025-09-07T07:36:20.0376808Z * [new branch] gh/silverguo/3/base -> origin/gh/silverguo/3/base 2025-09-07T07:36:20.0377993Z * [new branch] gh/silverguo/3/head -> origin/gh/silverguo/3/head 2025-09-07T07:36:20.0379545Z * [new branch] gh/silverguo/4/base -> origin/gh/silverguo/4/base 2025-09-07T07:36:20.0380807Z * [new branch] gh/silverguo/4/head -> origin/gh/silverguo/4/head 2025-09-07T07:36:20.0382832Z * [new branch] gh/sinhaanhsul/1/base -> origin/gh/sinhaanhsul/1/base 2025-09-07T07:36:20.0384059Z * [new branch] gh/sinhaanhsul/1/head -> origin/gh/sinhaanhsul/1/head 2025-09-07T07:36:20.0386258Z * [new branch] gh/skarjala/17/base -> origin/gh/skarjala/17/base 2025-09-07T07:36:20.0387464Z * [new branch] gh/skarjala/17/head -> origin/gh/skarjala/17/head 2025-09-07T07:36:20.0388629Z * [new branch] gh/skarjala/17/orig -> origin/gh/skarjala/17/orig 2025-09-07T07:36:20.0390366Z * [new branch] gh/skarjala/18/base -> origin/gh/skarjala/18/base 2025-09-07T07:36:20.0391575Z * [new branch] gh/skarjala/18/head -> origin/gh/skarjala/18/head 2025-09-07T07:36:20.0392782Z * [new branch] gh/skarjala/18/orig -> origin/gh/skarjala/18/orig 2025-09-07T07:36:20.0394485Z * [new branch] gh/skarjala/19/base -> origin/gh/skarjala/19/base 2025-09-07T07:36:20.0395730Z * [new branch] gh/skarjala/19/head -> origin/gh/skarjala/19/head 2025-09-07T07:36:20.0396960Z * [new branch] gh/skarjala/19/orig -> origin/gh/skarjala/19/orig 2025-09-07T07:36:20.0399130Z * [new branch] gh/slayton58/1/base -> origin/gh/slayton58/1/base 2025-09-07T07:36:20.0400318Z * [new branch] gh/slayton58/1/head -> origin/gh/slayton58/1/head 2025-09-07T07:36:20.0401519Z * [new branch] gh/slayton58/1/orig -> origin/gh/slayton58/1/orig 2025-09-07T07:36:20.0403218Z * [new branch] gh/slayton58/2/base -> origin/gh/slayton58/2/base 2025-09-07T07:36:20.0404389Z * [new branch] gh/slayton58/2/head -> origin/gh/slayton58/2/head 2025-09-07T07:36:20.0405619Z * [new branch] gh/slayton58/2/orig -> origin/gh/slayton58/2/orig 2025-09-07T07:36:20.0407247Z * [new branch] gh/slayton58/3/base -> origin/gh/slayton58/3/base 2025-09-07T07:36:20.0408398Z * [new branch] gh/slayton58/3/head -> origin/gh/slayton58/3/head 2025-09-07T07:36:20.0409721Z * [new branch] gh/slayton58/3/orig -> origin/gh/slayton58/3/orig 2025-09-07T07:36:20.0411582Z * [new branch] gh/slayton58/4/base -> origin/gh/slayton58/4/base 2025-09-07T07:36:20.0412797Z * [new branch] gh/slayton58/4/head -> origin/gh/slayton58/4/head 2025-09-07T07:36:20.0413978Z * [new branch] gh/slayton58/4/orig -> origin/gh/slayton58/4/orig 2025-09-07T07:36:20.0415603Z * [new branch] gh/slayton58/5/base -> origin/gh/slayton58/5/base 2025-09-07T07:36:20.0416743Z * [new branch] gh/slayton58/5/head -> origin/gh/slayton58/5/head 2025-09-07T07:36:20.0417944Z * [new branch] gh/slayton58/5/orig -> origin/gh/slayton58/5/orig 2025-09-07T07:36:20.0420109Z * [new branch] gh/soulitzer/269/base -> origin/gh/soulitzer/269/base 2025-09-07T07:36:20.0421259Z * [new branch] gh/soulitzer/269/head -> origin/gh/soulitzer/269/head 2025-09-07T07:36:20.0422526Z * [new branch] gh/soulitzer/269/orig -> origin/gh/soulitzer/269/orig 2025-09-07T07:36:20.0424275Z * [new branch] gh/soulitzer/276/base -> origin/gh/soulitzer/276/base 2025-09-07T07:36:20.0425508Z * [new branch] gh/soulitzer/276/head -> origin/gh/soulitzer/276/head 2025-09-07T07:36:20.0426814Z * [new branch] gh/soulitzer/276/orig -> origin/gh/soulitzer/276/orig 2025-09-07T07:36:20.0428755Z * [new branch] gh/soulitzer/287/base -> origin/gh/soulitzer/287/base 2025-09-07T07:36:20.0429950Z * [new branch] gh/soulitzer/287/head -> origin/gh/soulitzer/287/head 2025-09-07T07:36:20.0431194Z * [new branch] gh/soulitzer/287/orig -> origin/gh/soulitzer/287/orig 2025-09-07T07:36:20.0433136Z * [new branch] gh/soulitzer/296/base -> origin/gh/soulitzer/296/base 2025-09-07T07:36:20.0434455Z * [new branch] gh/soulitzer/296/head -> origin/gh/soulitzer/296/head 2025-09-07T07:36:20.0435619Z * [new branch] gh/soulitzer/296/orig -> origin/gh/soulitzer/296/orig 2025-09-07T07:36:20.0437379Z * [new branch] gh/soulitzer/299/base -> origin/gh/soulitzer/299/base 2025-09-07T07:36:20.0438577Z * [new branch] gh/soulitzer/299/head -> origin/gh/soulitzer/299/head 2025-09-07T07:36:20.0439758Z * [new branch] gh/soulitzer/299/orig -> origin/gh/soulitzer/299/orig 2025-09-07T07:36:20.0441803Z * [new branch] gh/soulitzer/300/base -> origin/gh/soulitzer/300/base 2025-09-07T07:36:20.0442682Z * [new branch] gh/soulitzer/300/head -> origin/gh/soulitzer/300/head 2025-09-07T07:36:20.0443854Z * [new branch] gh/soulitzer/300/orig -> origin/gh/soulitzer/300/orig 2025-09-07T07:36:20.0445767Z * [new branch] gh/soulitzer/301/base -> origin/gh/soulitzer/301/base 2025-09-07T07:36:20.0446942Z * [new branch] gh/soulitzer/301/head -> origin/gh/soulitzer/301/head 2025-09-07T07:36:20.0448158Z * [new branch] gh/soulitzer/301/orig -> origin/gh/soulitzer/301/orig 2025-09-07T07:36:20.0449848Z * [new branch] gh/soulitzer/313/base -> origin/gh/soulitzer/313/base 2025-09-07T07:36:20.0451018Z * [new branch] gh/soulitzer/313/head -> origin/gh/soulitzer/313/head 2025-09-07T07:36:20.0452172Z * [new branch] gh/soulitzer/313/orig -> origin/gh/soulitzer/313/orig 2025-09-07T07:36:20.0453884Z * [new branch] gh/soulitzer/319/base -> origin/gh/soulitzer/319/base 2025-09-07T07:36:20.0455059Z * [new branch] gh/soulitzer/319/head -> origin/gh/soulitzer/319/head 2025-09-07T07:36:20.0456235Z * [new branch] gh/soulitzer/319/orig -> origin/gh/soulitzer/319/orig 2025-09-07T07:36:20.0458027Z * [new branch] gh/soulitzer/320/base -> origin/gh/soulitzer/320/base 2025-09-07T07:36:20.0459161Z * [new branch] gh/soulitzer/320/head -> origin/gh/soulitzer/320/head 2025-09-07T07:36:20.0460288Z * [new branch] gh/soulitzer/320/orig -> origin/gh/soulitzer/320/orig 2025-09-07T07:36:20.0462116Z * [new branch] gh/soulitzer/336/base -> origin/gh/soulitzer/336/base 2025-09-07T07:36:20.0463229Z * [new branch] gh/soulitzer/336/head -> origin/gh/soulitzer/336/head 2025-09-07T07:36:20.0464415Z * [new branch] gh/soulitzer/336/orig -> origin/gh/soulitzer/336/orig 2025-09-07T07:36:20.0466207Z * [new branch] gh/soulitzer/347/base -> origin/gh/soulitzer/347/base 2025-09-07T07:36:20.0467352Z * [new branch] gh/soulitzer/347/head -> origin/gh/soulitzer/347/head 2025-09-07T07:36:20.0468638Z * [new branch] gh/soulitzer/347/orig -> origin/gh/soulitzer/347/orig 2025-09-07T07:36:20.0470580Z * [new branch] gh/soulitzer/349/base -> origin/gh/soulitzer/349/base 2025-09-07T07:36:20.0471752Z * [new branch] gh/soulitzer/349/head -> origin/gh/soulitzer/349/head 2025-09-07T07:36:20.0472968Z * [new branch] gh/soulitzer/349/orig -> origin/gh/soulitzer/349/orig 2025-09-07T07:36:20.0474607Z * [new branch] gh/soulitzer/350/base -> origin/gh/soulitzer/350/base 2025-09-07T07:36:20.0475728Z * [new branch] gh/soulitzer/350/head -> origin/gh/soulitzer/350/head 2025-09-07T07:36:20.0476940Z * [new branch] gh/soulitzer/350/orig -> origin/gh/soulitzer/350/orig 2025-09-07T07:36:20.0478743Z * [new branch] gh/soulitzer/351/base -> origin/gh/soulitzer/351/base 2025-09-07T07:36:20.0479958Z * [new branch] gh/soulitzer/351/head -> origin/gh/soulitzer/351/head 2025-09-07T07:36:20.0481111Z * [new branch] gh/soulitzer/351/orig -> origin/gh/soulitzer/351/orig 2025-09-07T07:36:20.0482815Z * [new branch] gh/soulitzer/353/base -> origin/gh/soulitzer/353/base 2025-09-07T07:36:20.0484057Z * [new branch] gh/soulitzer/353/head -> origin/gh/soulitzer/353/head 2025-09-07T07:36:20.0485225Z * [new branch] gh/soulitzer/353/orig -> origin/gh/soulitzer/353/orig 2025-09-07T07:36:20.0487502Z * [new branch] gh/soulitzer/358/base -> origin/gh/soulitzer/358/base 2025-09-07T07:36:20.0488787Z * [new branch] gh/soulitzer/358/head -> origin/gh/soulitzer/358/head 2025-09-07T07:36:20.0490022Z * [new branch] gh/soulitzer/358/orig -> origin/gh/soulitzer/358/orig 2025-09-07T07:36:20.0492014Z * [new branch] gh/soulitzer/359/base -> origin/gh/soulitzer/359/base 2025-09-07T07:36:20.0493220Z * [new branch] gh/soulitzer/359/head -> origin/gh/soulitzer/359/head 2025-09-07T07:36:20.0494445Z * [new branch] gh/soulitzer/359/orig -> origin/gh/soulitzer/359/orig 2025-09-07T07:36:20.0496305Z * [new branch] gh/soulitzer/362/base -> origin/gh/soulitzer/362/base 2025-09-07T07:36:20.0497573Z * [new branch] gh/soulitzer/362/head -> origin/gh/soulitzer/362/head 2025-09-07T07:36:20.0498734Z * [new branch] gh/soulitzer/362/orig -> origin/gh/soulitzer/362/orig 2025-09-07T07:36:20.0500435Z * [new branch] gh/soulitzer/372/base -> origin/gh/soulitzer/372/base 2025-09-07T07:36:20.0501602Z * [new branch] gh/soulitzer/372/head -> origin/gh/soulitzer/372/head 2025-09-07T07:36:20.0502792Z * [new branch] gh/soulitzer/372/orig -> origin/gh/soulitzer/372/orig 2025-09-07T07:36:20.0504691Z * [new branch] gh/soulitzer/373/base -> origin/gh/soulitzer/373/base 2025-09-07T07:36:20.0505946Z * [new branch] gh/soulitzer/373/head -> origin/gh/soulitzer/373/head 2025-09-07T07:36:20.0507249Z * [new branch] gh/soulitzer/373/orig -> origin/gh/soulitzer/373/orig 2025-09-07T07:36:20.0509040Z * [new branch] gh/soulitzer/374/base -> origin/gh/soulitzer/374/base 2025-09-07T07:36:20.0510418Z * [new branch] gh/soulitzer/374/head -> origin/gh/soulitzer/374/head 2025-09-07T07:36:20.0511628Z * [new branch] gh/soulitzer/374/orig -> origin/gh/soulitzer/374/orig 2025-09-07T07:36:20.0513405Z * [new branch] gh/soulitzer/375/base -> origin/gh/soulitzer/375/base 2025-09-07T07:36:20.0514589Z * [new branch] gh/soulitzer/375/head -> origin/gh/soulitzer/375/head 2025-09-07T07:36:20.0515778Z * [new branch] gh/soulitzer/375/orig -> origin/gh/soulitzer/375/orig 2025-09-07T07:36:20.0517632Z * [new branch] gh/soulitzer/376/base -> origin/gh/soulitzer/376/base 2025-09-07T07:36:20.0518706Z * [new branch] gh/soulitzer/376/head -> origin/gh/soulitzer/376/head 2025-09-07T07:36:20.0519878Z * [new branch] gh/soulitzer/376/orig -> origin/gh/soulitzer/376/orig 2025-09-07T07:36:20.0521659Z * [new branch] gh/soulitzer/377/base -> origin/gh/soulitzer/377/base 2025-09-07T07:36:20.0522799Z * [new branch] gh/soulitzer/377/head -> origin/gh/soulitzer/377/head 2025-09-07T07:36:20.0523976Z * [new branch] gh/soulitzer/377/orig -> origin/gh/soulitzer/377/orig 2025-09-07T07:36:20.0526246Z * [new branch] gh/soulitzer/378/base -> origin/gh/soulitzer/378/base 2025-09-07T07:36:20.0526905Z * [new branch] gh/soulitzer/378/head -> origin/gh/soulitzer/378/head 2025-09-07T07:36:20.0528669Z * [new branch] gh/soulitzer/378/orig -> origin/gh/soulitzer/378/orig 2025-09-07T07:36:20.0530520Z * [new branch] gh/soulitzer/379/base -> origin/gh/soulitzer/379/base 2025-09-07T07:36:20.0531699Z * [new branch] gh/soulitzer/379/head -> origin/gh/soulitzer/379/head 2025-09-07T07:36:20.0532890Z * [new branch] gh/soulitzer/379/orig -> origin/gh/soulitzer/379/orig 2025-09-07T07:36:20.0534989Z * [new branch] gh/swolchok/728/next -> origin/gh/swolchok/728/next 2025-09-07T07:36:20.0536938Z * [new branch] gh/swolchok/767/base -> origin/gh/swolchok/767/base 2025-09-07T07:36:20.0538279Z * [new branch] gh/swolchok/767/head -> origin/gh/swolchok/767/head 2025-09-07T07:36:20.0540011Z * [new branch] gh/swolchok/767/orig -> origin/gh/swolchok/767/orig 2025-09-07T07:36:20.0541679Z * [new branch] gh/swolchok/768/base -> origin/gh/swolchok/768/base 2025-09-07T07:36:20.0542917Z * [new branch] gh/swolchok/768/head -> origin/gh/swolchok/768/head 2025-09-07T07:36:20.0544194Z * [new branch] gh/swolchok/768/orig -> origin/gh/swolchok/768/orig 2025-09-07T07:36:20.0546166Z * [new branch] gh/swolchok/769/base -> origin/gh/swolchok/769/base 2025-09-07T07:36:20.0547589Z * [new branch] gh/swolchok/769/head -> origin/gh/swolchok/769/head 2025-09-07T07:36:20.0548964Z * [new branch] gh/swolchok/769/orig -> origin/gh/swolchok/769/orig 2025-09-07T07:36:20.0550712Z * [new branch] gh/swolchok/771/base -> origin/gh/swolchok/771/base 2025-09-07T07:36:20.0551954Z * [new branch] gh/swolchok/771/head -> origin/gh/swolchok/771/head 2025-09-07T07:36:20.0553172Z * [new branch] gh/swolchok/771/orig -> origin/gh/swolchok/771/orig 2025-09-07T07:36:20.0554880Z * [new branch] gh/swolchok/772/base -> origin/gh/swolchok/772/base 2025-09-07T07:36:20.0556092Z * [new branch] gh/swolchok/772/head -> origin/gh/swolchok/772/head 2025-09-07T07:36:20.0557356Z * [new branch] gh/swolchok/772/orig -> origin/gh/swolchok/772/orig 2025-09-07T07:36:20.0559217Z * [new branch] gh/swolchok/773/base -> origin/gh/swolchok/773/base 2025-09-07T07:36:20.0560434Z * [new branch] gh/swolchok/773/head -> origin/gh/swolchok/773/head 2025-09-07T07:36:20.0561712Z * [new branch] gh/swolchok/773/orig -> origin/gh/swolchok/773/orig 2025-09-07T07:36:20.0563483Z * [new branch] gh/swolchok/786/base -> origin/gh/swolchok/786/base 2025-09-07T07:36:20.0564635Z * [new branch] gh/swolchok/786/head -> origin/gh/swolchok/786/head 2025-09-07T07:36:20.0565825Z * [new branch] gh/swolchok/786/orig -> origin/gh/swolchok/786/orig 2025-09-07T07:36:20.0567407Z * [new branch] gh/swolchok/787/base -> origin/gh/swolchok/787/base 2025-09-07T07:36:20.0568567Z * [new branch] gh/swolchok/787/head -> origin/gh/swolchok/787/head 2025-09-07T07:36:20.0569759Z * [new branch] gh/swolchok/787/orig -> origin/gh/swolchok/787/orig 2025-09-07T07:36:20.0571503Z * [new branch] gh/swolchok/788/base -> origin/gh/swolchok/788/base 2025-09-07T07:36:20.0572691Z * [new branch] gh/swolchok/788/head -> origin/gh/swolchok/788/head 2025-09-07T07:36:20.0573880Z * [new branch] gh/swolchok/788/orig -> origin/gh/swolchok/788/orig 2025-09-07T07:36:20.0575509Z * [new branch] gh/swolchok/789/base -> origin/gh/swolchok/789/base 2025-09-07T07:36:20.0576665Z * [new branch] gh/swolchok/789/head -> origin/gh/swolchok/789/head 2025-09-07T07:36:20.0578062Z * [new branch] gh/swolchok/789/orig -> origin/gh/swolchok/789/orig 2025-09-07T07:36:20.0579931Z * [new branch] gh/swolchok/790/base -> origin/gh/swolchok/790/base 2025-09-07T07:36:20.0581120Z * [new branch] gh/swolchok/790/head -> origin/gh/swolchok/790/head 2025-09-07T07:36:20.0582358Z * [new branch] gh/swolchok/790/orig -> origin/gh/swolchok/790/orig 2025-09-07T07:36:20.0584087Z * [new branch] gh/swolchok/791/base -> origin/gh/swolchok/791/base 2025-09-07T07:36:20.0585234Z * [new branch] gh/swolchok/791/head -> origin/gh/swolchok/791/head 2025-09-07T07:36:20.0587041Z * [new branch] gh/swolchok/791/orig -> origin/gh/swolchok/791/orig 2025-09-07T07:36:20.0588821Z * [new branch] gh/swolchok/792/base -> origin/gh/swolchok/792/base 2025-09-07T07:36:20.0590005Z * [new branch] gh/swolchok/792/head -> origin/gh/swolchok/792/head 2025-09-07T07:36:20.0591120Z * [new branch] gh/swolchok/792/orig -> origin/gh/swolchok/792/orig 2025-09-07T07:36:20.0592854Z * [new branch] gh/swolchok/793/base -> origin/gh/swolchok/793/base 2025-09-07T07:36:20.0594017Z * [new branch] gh/swolchok/793/head -> origin/gh/swolchok/793/head 2025-09-07T07:36:20.0595193Z * [new branch] gh/swolchok/793/orig -> origin/gh/swolchok/793/orig 2025-09-07T07:36:20.0596977Z * [new branch] gh/swolchok/794/base -> origin/gh/swolchok/794/base 2025-09-07T07:36:20.0598210Z * [new branch] gh/swolchok/794/head -> origin/gh/swolchok/794/head 2025-09-07T07:36:20.0599345Z * [new branch] gh/swolchok/794/orig -> origin/gh/swolchok/794/orig 2025-09-07T07:36:20.0601520Z * [new branch] gh/swolchok/795/base -> origin/gh/swolchok/795/base 2025-09-07T07:36:20.0602740Z * [new branch] gh/swolchok/795/head -> origin/gh/swolchok/795/head 2025-09-07T07:36:20.0603983Z * [new branch] gh/swolchok/795/orig -> origin/gh/swolchok/795/orig 2025-09-07T07:36:20.0605747Z * [new branch] gh/swolchok/796/base -> origin/gh/swolchok/796/base 2025-09-07T07:36:20.0607008Z * [new branch] gh/swolchok/796/head -> origin/gh/swolchok/796/head 2025-09-07T07:36:20.0608255Z * [new branch] gh/swolchok/796/orig -> origin/gh/swolchok/796/orig 2025-09-07T07:36:20.0610382Z * [new branch] gh/swolchok/797/base -> origin/gh/swolchok/797/base 2025-09-07T07:36:20.0611653Z * [new branch] gh/swolchok/797/head -> origin/gh/swolchok/797/head 2025-09-07T07:36:20.0612920Z * [new branch] gh/swolchok/797/orig -> origin/gh/swolchok/797/orig 2025-09-07T07:36:20.0614987Z * [new branch] gh/swolchok/798/base -> origin/gh/swolchok/798/base 2025-09-07T07:36:20.0616146Z * [new branch] gh/swolchok/798/head -> origin/gh/swolchok/798/head 2025-09-07T07:36:20.0617461Z * [new branch] gh/swolchok/798/orig -> origin/gh/swolchok/798/orig 2025-09-07T07:36:20.0619317Z * [new branch] gh/swolchok/799/base -> origin/gh/swolchok/799/base 2025-09-07T07:36:20.0620466Z * [new branch] gh/swolchok/799/head -> origin/gh/swolchok/799/head 2025-09-07T07:36:20.0621772Z * [new branch] gh/swolchok/799/orig -> origin/gh/swolchok/799/orig 2025-09-07T07:36:20.0623648Z * [new branch] gh/swolchok/800/base -> origin/gh/swolchok/800/base 2025-09-07T07:36:20.0624829Z * [new branch] gh/swolchok/800/head -> origin/gh/swolchok/800/head 2025-09-07T07:36:20.0626240Z * [new branch] gh/swolchok/800/orig -> origin/gh/swolchok/800/orig 2025-09-07T07:36:20.0628142Z * [new branch] gh/swolchok/801/base -> origin/gh/swolchok/801/base 2025-09-07T07:36:20.0629296Z * [new branch] gh/swolchok/801/head -> origin/gh/swolchok/801/head 2025-09-07T07:36:20.0630549Z * [new branch] gh/swolchok/801/orig -> origin/gh/swolchok/801/orig 2025-09-07T07:36:20.0632377Z * [new branch] gh/swolchok/802/base -> origin/gh/swolchok/802/base 2025-09-07T07:36:20.0633522Z * [new branch] gh/swolchok/802/head -> origin/gh/swolchok/802/head 2025-09-07T07:36:20.0634788Z * [new branch] gh/swolchok/802/orig -> origin/gh/swolchok/802/orig 2025-09-07T07:36:20.0636586Z * [new branch] gh/swolchok/803/base -> origin/gh/swolchok/803/base 2025-09-07T07:36:20.0637759Z * [new branch] gh/swolchok/803/head -> origin/gh/swolchok/803/head 2025-09-07T07:36:20.0639021Z * [new branch] gh/swolchok/803/orig -> origin/gh/swolchok/803/orig 2025-09-07T07:36:20.0641033Z * [new branch] gh/swolchok/804/base -> origin/gh/swolchok/804/base 2025-09-07T07:36:20.0642026Z * [new branch] gh/swolchok/804/head -> origin/gh/swolchok/804/head 2025-09-07T07:36:20.0643325Z * [new branch] gh/swolchok/804/orig -> origin/gh/swolchok/804/orig 2025-09-07T07:36:20.0645111Z * [new branch] gh/swolchok/805/base -> origin/gh/swolchok/805/base 2025-09-07T07:36:20.0646321Z * [new branch] gh/swolchok/805/head -> origin/gh/swolchok/805/head 2025-09-07T07:36:20.0647512Z * [new branch] gh/swolchok/805/orig -> origin/gh/swolchok/805/orig 2025-09-07T07:36:20.0649247Z * [new branch] gh/swolchok/806/base -> origin/gh/swolchok/806/base 2025-09-07T07:36:20.0650647Z * [new branch] gh/swolchok/806/head -> origin/gh/swolchok/806/head 2025-09-07T07:36:20.0651830Z * [new branch] gh/swolchok/806/orig -> origin/gh/swolchok/806/orig 2025-09-07T07:36:20.0654016Z * [new branch] gh/swolchok/807/base -> origin/gh/swolchok/807/base 2025-09-07T07:36:20.0655213Z * [new branch] gh/swolchok/807/head -> origin/gh/swolchok/807/head 2025-09-07T07:36:20.0656585Z * [new branch] gh/swolchok/807/orig -> origin/gh/swolchok/807/orig 2025-09-07T07:36:20.0658398Z * [new branch] gh/swolchok/808/base -> origin/gh/swolchok/808/base 2025-09-07T07:36:20.0659605Z * [new branch] gh/swolchok/808/head -> origin/gh/swolchok/808/head 2025-09-07T07:36:20.0660846Z * [new branch] gh/swolchok/808/orig -> origin/gh/swolchok/808/orig 2025-09-07T07:36:20.0662615Z * [new branch] gh/swolchok/809/base -> origin/gh/swolchok/809/base 2025-09-07T07:36:20.0663796Z * [new branch] gh/swolchok/809/head -> origin/gh/swolchok/809/head 2025-09-07T07:36:20.0664975Z * [new branch] gh/swolchok/809/orig -> origin/gh/swolchok/809/orig 2025-09-07T07:36:20.0666993Z * [new branch] gh/swolchok/810/base -> origin/gh/swolchok/810/base 2025-09-07T07:36:20.0668172Z * [new branch] gh/swolchok/810/head -> origin/gh/swolchok/810/head 2025-09-07T07:36:20.0669375Z * [new branch] gh/swolchok/810/orig -> origin/gh/swolchok/810/orig 2025-09-07T07:36:20.0671142Z * [new branch] gh/swolchok/811/base -> origin/gh/swolchok/811/base 2025-09-07T07:36:20.0672412Z * [new branch] gh/swolchok/811/head -> origin/gh/swolchok/811/head 2025-09-07T07:36:20.0673621Z * [new branch] gh/swolchok/811/orig -> origin/gh/swolchok/811/orig 2025-09-07T07:36:20.0675440Z * [new branch] gh/swolchok/812/base -> origin/gh/swolchok/812/base 2025-09-07T07:36:20.0676583Z * [new branch] gh/swolchok/812/head -> origin/gh/swolchok/812/head 2025-09-07T07:36:20.0677811Z * [new branch] gh/swolchok/812/orig -> origin/gh/swolchok/812/orig 2025-09-07T07:36:20.0679690Z * [new branch] gh/swolchok/813/base -> origin/gh/swolchok/813/base 2025-09-07T07:36:20.0680830Z * [new branch] gh/swolchok/813/head -> origin/gh/swolchok/813/head 2025-09-07T07:36:20.0682011Z * [new branch] gh/swolchok/813/orig -> origin/gh/swolchok/813/orig 2025-09-07T07:36:20.0683928Z * [new branch] gh/swolchok/814/base -> origin/gh/swolchok/814/base 2025-09-07T07:36:20.0685049Z * [new branch] gh/swolchok/814/head -> origin/gh/swolchok/814/head 2025-09-07T07:36:20.0686393Z * [new branch] gh/swolchok/814/orig -> origin/gh/swolchok/814/orig 2025-09-07T07:36:20.0688188Z * [new branch] gh/swolchok/815/base -> origin/gh/swolchok/815/base 2025-09-07T07:36:20.0689346Z * [new branch] gh/swolchok/815/head -> origin/gh/swolchok/815/head 2025-09-07T07:36:20.0690660Z * [new branch] gh/swolchok/815/orig -> origin/gh/swolchok/815/orig 2025-09-07T07:36:20.0692345Z * [new branch] gh/swolchok/816/base -> origin/gh/swolchok/816/base 2025-09-07T07:36:20.0693573Z * [new branch] gh/swolchok/816/head -> origin/gh/swolchok/816/head 2025-09-07T07:36:20.0694837Z * [new branch] gh/swolchok/816/orig -> origin/gh/swolchok/816/orig 2025-09-07T07:36:20.0696662Z * [new branch] gh/swolchok/817/base -> origin/gh/swolchok/817/base 2025-09-07T07:36:20.0697794Z * [new branch] gh/swolchok/817/head -> origin/gh/swolchok/817/head 2025-09-07T07:36:20.0698953Z * [new branch] gh/swolchok/817/orig -> origin/gh/swolchok/817/orig 2025-09-07T07:36:20.0700866Z * [new branch] gh/swolchok/818/base -> origin/gh/swolchok/818/base 2025-09-07T07:36:20.0702004Z * [new branch] gh/swolchok/818/head -> origin/gh/swolchok/818/head 2025-09-07T07:36:20.0703226Z * [new branch] gh/swolchok/818/orig -> origin/gh/swolchok/818/orig 2025-09-07T07:36:20.0705604Z * [new branch] gh/swolchok/819/base -> origin/gh/swolchok/819/base 2025-09-07T07:36:20.0706832Z * [new branch] gh/swolchok/819/head -> origin/gh/swolchok/819/head 2025-09-07T07:36:20.0708041Z * [new branch] gh/swolchok/819/orig -> origin/gh/swolchok/819/orig 2025-09-07T07:36:20.0709994Z * [new branch] gh/swolchok/820/base -> origin/gh/swolchok/820/base 2025-09-07T07:36:20.0711202Z * [new branch] gh/swolchok/820/head -> origin/gh/swolchok/820/head 2025-09-07T07:36:20.0712434Z * [new branch] gh/swolchok/820/orig -> origin/gh/swolchok/820/orig 2025-09-07T07:36:20.0714258Z * [new branch] gh/swolchok/821/base -> origin/gh/swolchok/821/base 2025-09-07T07:36:20.0715392Z * [new branch] gh/swolchok/821/head -> origin/gh/swolchok/821/head 2025-09-07T07:36:20.0716539Z * [new branch] gh/swolchok/821/orig -> origin/gh/swolchok/821/orig 2025-09-07T07:36:20.0718541Z * [new branch] gh/swolchok/822/base -> origin/gh/swolchok/822/base 2025-09-07T07:36:20.0719669Z * [new branch] gh/swolchok/822/head -> origin/gh/swolchok/822/head 2025-09-07T07:36:20.0720846Z * [new branch] gh/swolchok/822/orig -> origin/gh/swolchok/822/orig 2025-09-07T07:36:20.0722871Z * [new branch] gh/swolchok/823/base -> origin/gh/swolchok/823/base 2025-09-07T07:36:20.0724082Z * [new branch] gh/swolchok/823/head -> origin/gh/swolchok/823/head 2025-09-07T07:36:20.0725279Z * [new branch] gh/swolchok/823/orig -> origin/gh/swolchok/823/orig 2025-09-07T07:36:20.0727007Z * [new branch] gh/swolchok/824/base -> origin/gh/swolchok/824/base 2025-09-07T07:36:20.0728190Z * [new branch] gh/swolchok/824/head -> origin/gh/swolchok/824/head 2025-09-07T07:36:20.0729363Z * [new branch] gh/swolchok/824/orig -> origin/gh/swolchok/824/orig 2025-09-07T07:36:20.0731101Z * [new branch] gh/swolchok/825/base -> origin/gh/swolchok/825/base 2025-09-07T07:36:20.0732797Z * [new branch] gh/swolchok/825/head -> origin/gh/swolchok/825/head 2025-09-07T07:36:20.0734084Z * [new branch] gh/swolchok/825/orig -> origin/gh/swolchok/825/orig 2025-09-07T07:36:20.0735992Z * [new branch] gh/swolchok/826/base -> origin/gh/swolchok/826/base 2025-09-07T07:36:20.0737097Z * [new branch] gh/swolchok/826/head -> origin/gh/swolchok/826/head 2025-09-07T07:36:20.0738243Z * [new branch] gh/swolchok/826/orig -> origin/gh/swolchok/826/orig 2025-09-07T07:36:20.0740178Z * [new branch] gh/swolchok/827/base -> origin/gh/swolchok/827/base 2025-09-07T07:36:20.0741406Z * [new branch] gh/swolchok/827/head -> origin/gh/swolchok/827/head 2025-09-07T07:36:20.0742421Z * [new branch] gh/swolchok/827/orig -> origin/gh/swolchok/827/orig 2025-09-07T07:36:20.0744312Z * [new branch] gh/swolchok/828/base -> origin/gh/swolchok/828/base 2025-09-07T07:36:20.0745445Z * [new branch] gh/swolchok/828/head -> origin/gh/swolchok/828/head 2025-09-07T07:36:20.0746709Z * [new branch] gh/swolchok/828/orig -> origin/gh/swolchok/828/orig 2025-09-07T07:36:20.0748290Z * [new branch] gh/swolchok/829/base -> origin/gh/swolchok/829/base 2025-09-07T07:36:20.0749508Z * [new branch] gh/swolchok/829/head -> origin/gh/swolchok/829/head 2025-09-07T07:36:20.0750701Z * [new branch] gh/swolchok/829/orig -> origin/gh/swolchok/829/orig 2025-09-07T07:36:20.0752628Z * [new branch] gh/swolchok/830/base -> origin/gh/swolchok/830/base 2025-09-07T07:36:20.0753779Z * [new branch] gh/swolchok/830/head -> origin/gh/swolchok/830/head 2025-09-07T07:36:20.0754902Z * [new branch] gh/swolchok/830/orig -> origin/gh/swolchok/830/orig 2025-09-07T07:36:20.0756536Z * [new branch] gh/swolchok/831/base -> origin/gh/swolchok/831/base 2025-09-07T07:36:20.0757958Z * [new branch] gh/swolchok/831/head -> origin/gh/swolchok/831/head 2025-09-07T07:36:20.0759127Z * [new branch] gh/swolchok/831/orig -> origin/gh/swolchok/831/orig 2025-09-07T07:36:20.0760770Z * [new branch] gh/swolchok/832/base -> origin/gh/swolchok/832/base 2025-09-07T07:36:20.0762025Z * [new branch] gh/swolchok/832/head -> origin/gh/swolchok/832/head 2025-09-07T07:36:20.0763142Z * [new branch] gh/swolchok/832/orig -> origin/gh/swolchok/832/orig 2025-09-07T07:36:20.0765280Z * [new branch] gh/syed-ahmed/3/base -> origin/gh/syed-ahmed/3/base 2025-09-07T07:36:20.0766458Z * [new branch] gh/syed-ahmed/3/head -> origin/gh/syed-ahmed/3/head 2025-09-07T07:36:20.0767634Z * [new branch] gh/syed-ahmed/3/orig -> origin/gh/syed-ahmed/3/orig 2025-09-07T07:36:20.0769473Z * [new branch] gh/syed-ahmed/4/base -> origin/gh/syed-ahmed/4/base 2025-09-07T07:36:20.0770639Z * [new branch] gh/syed-ahmed/4/head -> origin/gh/syed-ahmed/4/head 2025-09-07T07:36:20.0771799Z * [new branch] gh/syed-ahmed/4/orig -> origin/gh/syed-ahmed/4/orig 2025-09-07T07:36:20.0773512Z * [new branch] gh/syed-ahmed/5/base -> origin/gh/syed-ahmed/5/base 2025-09-07T07:36:20.0774721Z * [new branch] gh/syed-ahmed/5/head -> origin/gh/syed-ahmed/5/head 2025-09-07T07:36:20.0775897Z * [new branch] gh/syed-ahmed/5/orig -> origin/gh/syed-ahmed/5/orig 2025-09-07T07:36:20.0778108Z * [new branch] gh/teja-rao/4/base -> origin/gh/teja-rao/4/base 2025-09-07T07:36:20.0779301Z * [new branch] gh/teja-rao/4/head -> origin/gh/teja-rao/4/head 2025-09-07T07:36:20.0780588Z * [new branch] gh/teja-rao/4/orig -> origin/gh/teja-rao/4/orig 2025-09-07T07:36:20.0782685Z * [new branch] gh/tianyu-l/2/base -> origin/gh/tianyu-l/2/base 2025-09-07T07:36:20.0783981Z * [new branch] gh/tianyu-l/2/head -> origin/gh/tianyu-l/2/head 2025-09-07T07:36:20.0785140Z * [new branch] gh/tianyu-l/2/orig -> origin/gh/tianyu-l/2/orig 2025-09-07T07:36:20.0786909Z * [new branch] gh/tianyu-l/3/base -> origin/gh/tianyu-l/3/base 2025-09-07T07:36:20.0788079Z * [new branch] gh/tianyu-l/3/head -> origin/gh/tianyu-l/3/head 2025-09-07T07:36:20.0789260Z * [new branch] gh/tianyu-l/3/orig -> origin/gh/tianyu-l/3/orig 2025-09-07T07:36:20.0790951Z * [new branch] gh/tianyu-l/4/base -> origin/gh/tianyu-l/4/base 2025-09-07T07:36:20.0792225Z * [new branch] gh/tianyu-l/4/head -> origin/gh/tianyu-l/4/head 2025-09-07T07:36:20.0793304Z * [new branch] gh/tianyu-l/4/orig -> origin/gh/tianyu-l/4/orig 2025-09-07T07:36:20.0795695Z * [new branch] gh/tugsbayasgalan/1/base -> origin/gh/tugsbayasgalan/1/base 2025-09-07T07:36:20.0796825Z * [new branch] gh/tugsbayasgalan/1/head -> origin/gh/tugsbayasgalan/1/head 2025-09-07T07:36:20.0798081Z * [new branch] gh/tugsbayasgalan/1/orig -> origin/gh/tugsbayasgalan/1/orig 2025-09-07T07:36:20.0800083Z * [new branch] gh/tugsbayasgalan/10/base -> origin/gh/tugsbayasgalan/10/base 2025-09-07T07:36:20.0801281Z * [new branch] gh/tugsbayasgalan/10/head -> origin/gh/tugsbayasgalan/10/head 2025-09-07T07:36:20.0802465Z * [new branch] gh/tugsbayasgalan/10/orig -> origin/gh/tugsbayasgalan/10/orig 2025-09-07T07:36:20.0804032Z * [new branch] gh/tugsbayasgalan/11/base -> origin/gh/tugsbayasgalan/11/base 2025-09-07T07:36:20.0805275Z * [new branch] gh/tugsbayasgalan/11/head -> origin/gh/tugsbayasgalan/11/head 2025-09-07T07:36:20.0806456Z * [new branch] gh/tugsbayasgalan/11/orig -> origin/gh/tugsbayasgalan/11/orig 2025-09-07T07:36:20.0808194Z * [new branch] gh/tugsbayasgalan/12/base -> origin/gh/tugsbayasgalan/12/base 2025-09-07T07:36:20.0809332Z * [new branch] gh/tugsbayasgalan/12/head -> origin/gh/tugsbayasgalan/12/head 2025-09-07T07:36:20.0813606Z * [new branch] gh/tugsbayasgalan/12/orig -> origin/gh/tugsbayasgalan/12/orig 2025-09-07T07:36:20.0815390Z * [new branch] gh/tugsbayasgalan/13/base -> origin/gh/tugsbayasgalan/13/base 2025-09-07T07:36:20.0816607Z * [new branch] gh/tugsbayasgalan/13/head -> origin/gh/tugsbayasgalan/13/head 2025-09-07T07:36:20.0817820Z * [new branch] gh/tugsbayasgalan/13/orig -> origin/gh/tugsbayasgalan/13/orig 2025-09-07T07:36:20.0819678Z * [new branch] gh/tugsbayasgalan/14/base -> origin/gh/tugsbayasgalan/14/base 2025-09-07T07:36:20.0820845Z * [new branch] gh/tugsbayasgalan/14/head -> origin/gh/tugsbayasgalan/14/head 2025-09-07T07:36:20.0822046Z * [new branch] gh/tugsbayasgalan/14/orig -> origin/gh/tugsbayasgalan/14/orig 2025-09-07T07:36:20.0823946Z * [new branch] gh/tugsbayasgalan/15/base -> origin/gh/tugsbayasgalan/15/base 2025-09-07T07:36:20.0825094Z * [new branch] gh/tugsbayasgalan/15/head -> origin/gh/tugsbayasgalan/15/head 2025-09-07T07:36:20.0826306Z * [new branch] gh/tugsbayasgalan/15/orig -> origin/gh/tugsbayasgalan/15/orig 2025-09-07T07:36:20.0828126Z * [new branch] gh/tugsbayasgalan/2/base -> origin/gh/tugsbayasgalan/2/base 2025-09-07T07:36:20.0829243Z * [new branch] gh/tugsbayasgalan/2/head -> origin/gh/tugsbayasgalan/2/head 2025-09-07T07:36:20.0830425Z * [new branch] gh/tugsbayasgalan/2/orig -> origin/gh/tugsbayasgalan/2/orig 2025-09-07T07:36:20.0832002Z * [new branch] gh/tugsbayasgalan/3/base -> origin/gh/tugsbayasgalan/3/base 2025-09-07T07:36:20.0833461Z * [new branch] gh/tugsbayasgalan/3/head -> origin/gh/tugsbayasgalan/3/head 2025-09-07T07:36:20.0834659Z * [new branch] gh/tugsbayasgalan/3/orig -> origin/gh/tugsbayasgalan/3/orig 2025-09-07T07:36:20.0836412Z * [new branch] gh/tugsbayasgalan/4/base -> origin/gh/tugsbayasgalan/4/base 2025-09-07T07:36:20.0837752Z * [new branch] gh/tugsbayasgalan/4/head -> origin/gh/tugsbayasgalan/4/head 2025-09-07T07:36:20.0838937Z * [new branch] gh/tugsbayasgalan/4/orig -> origin/gh/tugsbayasgalan/4/orig 2025-09-07T07:36:20.0840649Z * [new branch] gh/tugsbayasgalan/5/base -> origin/gh/tugsbayasgalan/5/base 2025-09-07T07:36:20.0842017Z * [new branch] gh/tugsbayasgalan/5/head -> origin/gh/tugsbayasgalan/5/head 2025-09-07T07:36:20.0843071Z * [new branch] gh/tugsbayasgalan/5/orig -> origin/gh/tugsbayasgalan/5/orig 2025-09-07T07:36:20.0844684Z * [new branch] gh/tugsbayasgalan/6/base -> origin/gh/tugsbayasgalan/6/base 2025-09-07T07:36:20.0845803Z * [new branch] gh/tugsbayasgalan/6/head -> origin/gh/tugsbayasgalan/6/head 2025-09-07T07:36:20.0847014Z * [new branch] gh/tugsbayasgalan/6/orig -> origin/gh/tugsbayasgalan/6/orig 2025-09-07T07:36:20.0848737Z * [new branch] gh/tugsbayasgalan/7/base -> origin/gh/tugsbayasgalan/7/base 2025-09-07T07:36:20.0849961Z * [new branch] gh/tugsbayasgalan/7/head -> origin/gh/tugsbayasgalan/7/head 2025-09-07T07:36:20.0851186Z * [new branch] gh/tugsbayasgalan/7/orig -> origin/gh/tugsbayasgalan/7/orig 2025-09-07T07:36:20.0852952Z * [new branch] gh/tugsbayasgalan/8/base -> origin/gh/tugsbayasgalan/8/base 2025-09-07T07:36:20.0854132Z * [new branch] gh/tugsbayasgalan/8/head -> origin/gh/tugsbayasgalan/8/head 2025-09-07T07:36:20.0855287Z * [new branch] gh/tugsbayasgalan/8/orig -> origin/gh/tugsbayasgalan/8/orig 2025-09-07T07:36:20.0856992Z * [new branch] gh/tugsbayasgalan/9/base -> origin/gh/tugsbayasgalan/9/base 2025-09-07T07:36:20.0858106Z * [new branch] gh/tugsbayasgalan/9/head -> origin/gh/tugsbayasgalan/9/head 2025-09-07T07:36:20.0859298Z * [new branch] gh/tugsbayasgalan/9/orig -> origin/gh/tugsbayasgalan/9/orig 2025-09-07T07:36:20.0861632Z * [new branch] gh/v0i0/1/base -> origin/gh/v0i0/1/base 2025-09-07T07:36:20.0863242Z * [new branch] gh/v0i0/1/head -> origin/gh/v0i0/1/head 2025-09-07T07:36:20.0864432Z * [new branch] gh/v0i0/1/orig -> origin/gh/v0i0/1/orig 2025-09-07T07:36:20.0866227Z * [new branch] gh/v0i0/4/base -> origin/gh/v0i0/4/base 2025-09-07T07:36:20.0867380Z * [new branch] gh/v0i0/4/head -> origin/gh/v0i0/4/head 2025-09-07T07:36:20.0868635Z * [new branch] gh/v0i0/4/orig -> origin/gh/v0i0/4/orig 2025-09-07T07:36:20.0870491Z * [new branch] gh/v0i0/6/base -> origin/gh/v0i0/6/base 2025-09-07T07:36:20.0871710Z * [new branch] gh/v0i0/6/head -> origin/gh/v0i0/6/head 2025-09-07T07:36:20.0872882Z * [new branch] gh/v0i0/6/orig -> origin/gh/v0i0/6/orig 2025-09-07T07:36:20.0874603Z * [new branch] gh/v0i0/7/base -> origin/gh/v0i0/7/base 2025-09-07T07:36:20.0876209Z * [new branch] gh/v0i0/7/head -> origin/gh/v0i0/7/head 2025-09-07T07:36:20.0877432Z * [new branch] gh/v0i0/7/orig -> origin/gh/v0i0/7/orig 2025-09-07T07:36:20.0879061Z * [new branch] gh/v0i0/8/base -> origin/gh/v0i0/8/base 2025-09-07T07:36:20.0880209Z * [new branch] gh/v0i0/8/head -> origin/gh/v0i0/8/head 2025-09-07T07:36:20.0881375Z * [new branch] gh/v0i0/8/orig -> origin/gh/v0i0/8/orig 2025-09-07T07:36:20.0883042Z * [new branch] gh/v0i0/9/base -> origin/gh/v0i0/9/base 2025-09-07T07:36:20.0884214Z * [new branch] gh/v0i0/9/head -> origin/gh/v0i0/9/head 2025-09-07T07:36:20.0885479Z * [new branch] gh/v0i0/9/orig -> origin/gh/v0i0/9/orig 2025-09-07T07:36:20.0887739Z * [new branch] gh/vkuzo/1/next -> origin/gh/vkuzo/1/next 2025-09-07T07:36:20.0889455Z * [new branch] gh/vkuzo/2/next -> origin/gh/vkuzo/2/next 2025-09-07T07:36:20.0891093Z * [new branch] gh/vkuzo/3/next -> origin/gh/vkuzo/3/next 2025-09-07T07:36:20.0892816Z * [new branch] gh/vkuzo/4/base -> origin/gh/vkuzo/4/base 2025-09-07T07:36:20.0894154Z * [new branch] gh/vkuzo/4/head -> origin/gh/vkuzo/4/head 2025-09-07T07:36:20.0895395Z * [new branch] gh/vkuzo/4/orig -> origin/gh/vkuzo/4/orig 2025-09-07T07:36:20.0897205Z * [new branch] gh/vkuzo/5/base -> origin/gh/vkuzo/5/base 2025-09-07T07:36:20.0898496Z * [new branch] gh/vkuzo/5/head -> origin/gh/vkuzo/5/head 2025-09-07T07:36:20.0899739Z * [new branch] gh/vkuzo/5/orig -> origin/gh/vkuzo/5/orig 2025-09-07T07:36:20.0901585Z * [new branch] gh/vkuzo/6/base -> origin/gh/vkuzo/6/base 2025-09-07T07:36:20.0902774Z * [new branch] gh/vkuzo/6/head -> origin/gh/vkuzo/6/head 2025-09-07T07:36:20.0903985Z * [new branch] gh/vkuzo/6/orig -> origin/gh/vkuzo/6/orig 2025-09-07T07:36:20.0905780Z * [new branch] gh/vkuzo/7/base -> origin/gh/vkuzo/7/base 2025-09-07T07:36:20.0907068Z * [new branch] gh/vkuzo/7/head -> origin/gh/vkuzo/7/head 2025-09-07T07:36:20.0908254Z * [new branch] gh/vkuzo/7/orig -> origin/gh/vkuzo/7/orig 2025-09-07T07:36:20.0911247Z * [new branch] gh/wconstab/419/base -> origin/gh/wconstab/419/base 2025-09-07T07:36:20.0912372Z * [new branch] gh/wconstab/419/head -> origin/gh/wconstab/419/head 2025-09-07T07:36:20.0913654Z * [new branch] gh/wconstab/419/orig -> origin/gh/wconstab/419/orig 2025-09-07T07:36:20.0915424Z * [new branch] gh/wconstab/424/base -> origin/gh/wconstab/424/base 2025-09-07T07:36:20.0916551Z * [new branch] gh/wconstab/424/head -> origin/gh/wconstab/424/head 2025-09-07T07:36:20.0917730Z * [new branch] gh/wconstab/424/orig -> origin/gh/wconstab/424/orig 2025-09-07T07:36:20.0919505Z * [new branch] gh/wconstab/435/base -> origin/gh/wconstab/435/base 2025-09-07T07:36:20.0920750Z * [new branch] gh/wconstab/435/head -> origin/gh/wconstab/435/head 2025-09-07T07:36:20.0921926Z * [new branch] gh/wconstab/435/orig -> origin/gh/wconstab/435/orig 2025-09-07T07:36:20.0923661Z * [new branch] gh/wconstab/438/base -> origin/gh/wconstab/438/base 2025-09-07T07:36:20.0924825Z * [new branch] gh/wconstab/438/head -> origin/gh/wconstab/438/head 2025-09-07T07:36:20.0925996Z * [new branch] gh/wconstab/438/orig -> origin/gh/wconstab/438/orig 2025-09-07T07:36:20.0928118Z * [new branch] gh/wconstab/440/base -> origin/gh/wconstab/440/base 2025-09-07T07:36:20.0929871Z * [new branch] gh/wconstab/440/head -> origin/gh/wconstab/440/head 2025-09-07T07:36:20.0931132Z * [new branch] gh/wconstab/440/orig -> origin/gh/wconstab/440/orig 2025-09-07T07:36:20.0933026Z * [new branch] gh/wconstab/441/base -> origin/gh/wconstab/441/base 2025-09-07T07:36:20.0934569Z * [new branch] gh/wconstab/441/head -> origin/gh/wconstab/441/head 2025-09-07T07:36:20.0935835Z * [new branch] gh/wconstab/441/orig -> origin/gh/wconstab/441/orig 2025-09-07T07:36:20.0938144Z * [new branch] gh/wconstab/442/base -> origin/gh/wconstab/442/base 2025-09-07T07:36:20.0939454Z * [new branch] gh/wconstab/442/head -> origin/gh/wconstab/442/head 2025-09-07T07:36:20.0940683Z * [new branch] gh/wconstab/442/orig -> origin/gh/wconstab/442/orig 2025-09-07T07:36:20.0942396Z * [new branch] gh/wconstab/443/base -> origin/gh/wconstab/443/base 2025-09-07T07:36:20.0943814Z * [new branch] gh/wconstab/443/head -> origin/gh/wconstab/443/head 2025-09-07T07:36:20.0945004Z * [new branch] gh/wconstab/443/orig -> origin/gh/wconstab/443/orig 2025-09-07T07:36:20.0946892Z * [new branch] gh/wconstab/444/base -> origin/gh/wconstab/444/base 2025-09-07T07:36:20.0948376Z * [new branch] gh/wconstab/444/head -> origin/gh/wconstab/444/head 2025-09-07T07:36:20.0949674Z * [new branch] gh/wconstab/444/orig -> origin/gh/wconstab/444/orig 2025-09-07T07:36:20.0951387Z * [new branch] gh/wconstab/445/base -> origin/gh/wconstab/445/base 2025-09-07T07:36:20.0952622Z * [new branch] gh/wconstab/445/head -> origin/gh/wconstab/445/head 2025-09-07T07:36:20.0953796Z * [new branch] gh/wconstab/445/orig -> origin/gh/wconstab/445/orig 2025-09-07T07:36:20.0955991Z * [new branch] gh/wconstab/446/base -> origin/gh/wconstab/446/base 2025-09-07T07:36:20.0957307Z * [new branch] gh/wconstab/446/head -> origin/gh/wconstab/446/head 2025-09-07T07:36:20.0958775Z * [new branch] gh/wconstab/446/orig -> origin/gh/wconstab/446/orig 2025-09-07T07:36:20.0960452Z * [new branch] gh/wconstab/447/base -> origin/gh/wconstab/447/base 2025-09-07T07:36:20.0961614Z * [new branch] gh/wconstab/447/head -> origin/gh/wconstab/447/head 2025-09-07T07:36:20.0962855Z * [new branch] gh/wconstab/447/orig -> origin/gh/wconstab/447/orig 2025-09-07T07:36:20.0964984Z * [new branch] gh/weifengpy/27/base -> origin/gh/weifengpy/27/base 2025-09-07T07:36:20.0966192Z * [new branch] gh/weifengpy/27/head -> origin/gh/weifengpy/27/head 2025-09-07T07:36:20.0967319Z * [new branch] gh/weifengpy/27/orig -> origin/gh/weifengpy/27/orig 2025-09-07T07:36:20.0969049Z * [new branch] gh/weifengpy/30/base -> origin/gh/weifengpy/30/base 2025-09-07T07:36:20.0970166Z * [new branch] gh/weifengpy/30/head -> origin/gh/weifengpy/30/head 2025-09-07T07:36:20.0971435Z * [new branch] gh/weifengpy/30/orig -> origin/gh/weifengpy/30/orig 2025-09-07T07:36:20.0973595Z * [new branch] gh/williamwen42/196/base -> origin/gh/williamwen42/196/base 2025-09-07T07:36:20.0974808Z * [new branch] gh/williamwen42/196/head -> origin/gh/williamwen42/196/head 2025-09-07T07:36:20.0976080Z * [new branch] gh/williamwen42/196/orig -> origin/gh/williamwen42/196/orig 2025-09-07T07:36:20.0977829Z * [new branch] gh/williamwen42/250/base -> origin/gh/williamwen42/250/base 2025-09-07T07:36:20.0978982Z * [new branch] gh/williamwen42/250/head -> origin/gh/williamwen42/250/head 2025-09-07T07:36:20.0980337Z * [new branch] gh/williamwen42/250/orig -> origin/gh/williamwen42/250/orig 2025-09-07T07:36:20.0982271Z * [new branch] gh/williamwen42/258/base -> origin/gh/williamwen42/258/base 2025-09-07T07:36:20.0983511Z * [new branch] gh/williamwen42/258/head -> origin/gh/williamwen42/258/head 2025-09-07T07:36:20.0984677Z * [new branch] gh/williamwen42/258/orig -> origin/gh/williamwen42/258/orig 2025-09-07T07:36:20.0986458Z * [new branch] gh/williamwen42/266/base -> origin/gh/williamwen42/266/base 2025-09-07T07:36:20.0987710Z * [new branch] gh/williamwen42/266/head -> origin/gh/williamwen42/266/head 2025-09-07T07:36:20.0988926Z * [new branch] gh/williamwen42/266/orig -> origin/gh/williamwen42/266/orig 2025-09-07T07:36:20.0990609Z * [new branch] gh/williamwen42/267/base -> origin/gh/williamwen42/267/base 2025-09-07T07:36:20.0991847Z * [new branch] gh/williamwen42/267/head -> origin/gh/williamwen42/267/head 2025-09-07T07:36:20.0993047Z * [new branch] gh/williamwen42/267/orig -> origin/gh/williamwen42/267/orig 2025-09-07T07:36:20.0994777Z * [new branch] gh/williamwen42/270/base -> origin/gh/williamwen42/270/base 2025-09-07T07:36:20.0995986Z * [new branch] gh/williamwen42/270/head -> origin/gh/williamwen42/270/head 2025-09-07T07:36:20.0997260Z * [new branch] gh/williamwen42/270/orig -> origin/gh/williamwen42/270/orig 2025-09-07T07:36:20.0998920Z * [new branch] gh/williamwen42/271/base -> origin/gh/williamwen42/271/base 2025-09-07T07:36:20.1000174Z * [new branch] gh/williamwen42/271/head -> origin/gh/williamwen42/271/head 2025-09-07T07:36:20.1001361Z * [new branch] gh/williamwen42/271/orig -> origin/gh/williamwen42/271/orig 2025-09-07T07:36:20.1003042Z * [new branch] gh/williamwen42/272/base -> origin/gh/williamwen42/272/base 2025-09-07T07:36:20.1004298Z * [new branch] gh/williamwen42/272/head -> origin/gh/williamwen42/272/head 2025-09-07T07:36:20.1005548Z * [new branch] gh/williamwen42/272/orig -> origin/gh/williamwen42/272/orig 2025-09-07T07:36:20.1007224Z * [new branch] gh/williamwen42/274/base -> origin/gh/williamwen42/274/base 2025-09-07T07:36:20.1008503Z * [new branch] gh/williamwen42/274/head -> origin/gh/williamwen42/274/head 2025-09-07T07:36:20.1009793Z * [new branch] gh/williamwen42/274/orig -> origin/gh/williamwen42/274/orig 2025-09-07T07:36:20.1011586Z * [new branch] gh/williamwen42/275/base -> origin/gh/williamwen42/275/base 2025-09-07T07:36:20.1012732Z * [new branch] gh/williamwen42/275/head -> origin/gh/williamwen42/275/head 2025-09-07T07:36:20.1014371Z * [new branch] gh/williamwen42/276/base -> origin/gh/williamwen42/276/base 2025-09-07T07:36:20.1015687Z * [new branch] gh/williamwen42/276/head -> origin/gh/williamwen42/276/head 2025-09-07T07:36:20.1016886Z * [new branch] gh/williamwen42/276/orig -> origin/gh/williamwen42/276/orig 2025-09-07T07:36:20.1018694Z * [new branch] gh/williamwen42/277/base -> origin/gh/williamwen42/277/base 2025-09-07T07:36:20.1019955Z * [new branch] gh/williamwen42/277/head -> origin/gh/williamwen42/277/head 2025-09-07T07:36:20.1021194Z * [new branch] gh/williamwen42/277/orig -> origin/gh/williamwen42/277/orig 2025-09-07T07:36:20.1024617Z * [new branch] gh/williamwen42/278/base -> origin/gh/williamwen42/278/base 2025-09-07T07:36:20.1024760Z * [new branch] gh/williamwen42/278/head -> origin/gh/williamwen42/278/head 2025-09-07T07:36:20.1026434Z * [new branch] gh/williamwen42/278/orig -> origin/gh/williamwen42/278/orig 2025-09-07T07:36:20.1026980Z * [new branch] gh/williamwen42/279/base -> origin/gh/williamwen42/279/base 2025-09-07T07:36:20.1028266Z * [new branch] gh/williamwen42/279/head -> origin/gh/williamwen42/279/head 2025-09-07T07:36:20.1029458Z * [new branch] gh/williamwen42/279/orig -> origin/gh/williamwen42/279/orig 2025-09-07T07:36:20.1031217Z * [new branch] gh/williamwen42/280/base -> origin/gh/williamwen42/280/base 2025-09-07T07:36:20.1032379Z * [new branch] gh/williamwen42/280/head -> origin/gh/williamwen42/280/head 2025-09-07T07:36:20.1033556Z * [new branch] gh/williamwen42/280/orig -> origin/gh/williamwen42/280/orig 2025-09-07T07:36:20.1035293Z * [new branch] gh/williamwen42/281/base -> origin/gh/williamwen42/281/base 2025-09-07T07:36:20.1036412Z * [new branch] gh/williamwen42/281/head -> origin/gh/williamwen42/281/head 2025-09-07T07:36:20.1037613Z * [new branch] gh/williamwen42/281/orig -> origin/gh/williamwen42/281/orig 2025-09-07T07:36:20.1039627Z * [new branch] gh/williamwen42/282/base -> origin/gh/williamwen42/282/base 2025-09-07T07:36:20.1040870Z * [new branch] gh/williamwen42/282/head -> origin/gh/williamwen42/282/head 2025-09-07T07:36:20.1042038Z * [new branch] gh/williamwen42/282/orig -> origin/gh/williamwen42/282/orig 2025-09-07T07:36:20.1043897Z * [new branch] gh/williamwen42/283/base -> origin/gh/williamwen42/283/base 2025-09-07T07:36:20.1045247Z * [new branch] gh/williamwen42/283/head -> origin/gh/williamwen42/283/head 2025-09-07T07:36:20.1046339Z * [new branch] gh/williamwen42/283/orig -> origin/gh/williamwen42/283/orig 2025-09-07T07:36:20.1048307Z * [new branch] gh/williamwen42/284/base -> origin/gh/williamwen42/284/base 2025-09-07T07:36:20.1049499Z * [new branch] gh/williamwen42/284/head -> origin/gh/williamwen42/284/head 2025-09-07T07:36:20.1051331Z * [new branch] gh/williamwen42/284/orig -> origin/gh/williamwen42/284/orig 2025-09-07T07:36:20.1053172Z * [new branch] gh/williamwen42/285/base -> origin/gh/williamwen42/285/base 2025-09-07T07:36:20.1054353Z * [new branch] gh/williamwen42/285/head -> origin/gh/williamwen42/285/head 2025-09-07T07:36:20.1055619Z * [new branch] gh/williamwen42/285/orig -> origin/gh/williamwen42/285/orig 2025-09-07T07:36:20.1057222Z * [new branch] gh/williamwen42/286/base -> origin/gh/williamwen42/286/base 2025-09-07T07:36:20.1058391Z * [new branch] gh/williamwen42/286/head -> origin/gh/williamwen42/286/head 2025-09-07T07:36:20.1059601Z * [new branch] gh/williamwen42/286/orig -> origin/gh/williamwen42/286/orig 2025-09-07T07:36:20.1061435Z * [new branch] gh/williamwen42/287/base -> origin/gh/williamwen42/287/base 2025-09-07T07:36:20.1062667Z * [new branch] gh/williamwen42/287/head -> origin/gh/williamwen42/287/head 2025-09-07T07:36:20.1063869Z * [new branch] gh/williamwen42/287/orig -> origin/gh/williamwen42/287/orig 2025-09-07T07:36:20.1065768Z * [new branch] gh/williamwen42/288/base -> origin/gh/williamwen42/288/base 2025-09-07T07:36:20.1066958Z * [new branch] gh/williamwen42/288/head -> origin/gh/williamwen42/288/head 2025-09-07T07:36:20.1068129Z * [new branch] gh/williamwen42/288/orig -> origin/gh/williamwen42/288/orig 2025-09-07T07:36:20.1069879Z * [new branch] gh/williamwen42/289/base -> origin/gh/williamwen42/289/base 2025-09-07T07:36:20.1071054Z * [new branch] gh/williamwen42/289/head -> origin/gh/williamwen42/289/head 2025-09-07T07:36:20.1072289Z * [new branch] gh/williamwen42/289/orig -> origin/gh/williamwen42/289/orig 2025-09-07T07:36:20.1074666Z * [new branch] gh/wychi/1/base -> origin/gh/wychi/1/base 2025-09-07T07:36:20.1075903Z * [new branch] gh/wychi/1/head -> origin/gh/wychi/1/head 2025-09-07T07:36:20.1077151Z * [new branch] gh/wychi/1/orig -> origin/gh/wychi/1/orig 2025-09-07T07:36:20.1079293Z * [new branch] gh/xmfan/169/base -> origin/gh/xmfan/169/base 2025-09-07T07:36:20.1080894Z * [new branch] gh/xmfan/169/head -> origin/gh/xmfan/169/head 2025-09-07T07:36:20.1082528Z * [new branch] gh/xmfan/170/base -> origin/gh/xmfan/170/base 2025-09-07T07:36:20.1083631Z * [new branch] gh/xmfan/170/head -> origin/gh/xmfan/170/head 2025-09-07T07:36:20.1085934Z * [new branch] gh/xmfan/18/base -> origin/gh/xmfan/18/base 2025-09-07T07:36:20.1087105Z * [new branch] gh/xmfan/18/head -> origin/gh/xmfan/18/head 2025-09-07T07:36:20.1088859Z * [new branch] gh/xmfan/229/base -> origin/gh/xmfan/229/base 2025-09-07T07:36:20.1090143Z * [new branch] gh/xmfan/229/head -> origin/gh/xmfan/229/head 2025-09-07T07:36:20.1091356Z * [new branch] gh/xmfan/229/orig -> origin/gh/xmfan/229/orig 2025-09-07T07:36:20.1093030Z * [new branch] gh/xmfan/237/base -> origin/gh/xmfan/237/base 2025-09-07T07:36:20.1094192Z * [new branch] gh/xmfan/237/head -> origin/gh/xmfan/237/head 2025-09-07T07:36:20.1095923Z * [new branch] gh/xmfan/237/orig -> origin/gh/xmfan/237/orig 2025-09-07T07:36:20.1097488Z * [new branch] gh/xmfan/244/base -> origin/gh/xmfan/244/base 2025-09-07T07:36:20.1098650Z * [new branch] gh/xmfan/244/head -> origin/gh/xmfan/244/head 2025-09-07T07:36:20.1100308Z * [new branch] gh/xmfan/244/orig -> origin/gh/xmfan/244/orig 2025-09-07T07:36:20.1102035Z * [new branch] gh/xmfan/246/base -> origin/gh/xmfan/246/base 2025-09-07T07:36:20.1103626Z * [new branch] gh/xmfan/246/head -> origin/gh/xmfan/246/head 2025-09-07T07:36:20.1104813Z * [new branch] gh/xmfan/246/orig -> origin/gh/xmfan/246/orig 2025-09-07T07:36:20.1106696Z * [new branch] gh/xmfan/253/base -> origin/gh/xmfan/253/base 2025-09-07T07:36:20.1107953Z * [new branch] gh/xmfan/253/head -> origin/gh/xmfan/253/head 2025-09-07T07:36:20.1109127Z * [new branch] gh/xmfan/253/orig -> origin/gh/xmfan/253/orig 2025-09-07T07:36:20.1114438Z * [new branch] gh/xmfan/254/base -> origin/gh/xmfan/254/base 2025-09-07T07:36:20.1115583Z * [new branch] gh/xmfan/254/head -> origin/gh/xmfan/254/head 2025-09-07T07:36:20.1116747Z * [new branch] gh/xmfan/254/orig -> origin/gh/xmfan/254/orig 2025-09-07T07:36:20.1118424Z * [new branch] gh/xmfan/260/base -> origin/gh/xmfan/260/base 2025-09-07T07:36:20.1119575Z * [new branch] gh/xmfan/260/head -> origin/gh/xmfan/260/head 2025-09-07T07:36:20.1120754Z * [new branch] gh/xmfan/260/orig -> origin/gh/xmfan/260/orig 2025-09-07T07:36:20.1122503Z * [new branch] gh/xmfan/262/base -> origin/gh/xmfan/262/base 2025-09-07T07:36:20.1123655Z * [new branch] gh/xmfan/262/head -> origin/gh/xmfan/262/head 2025-09-07T07:36:20.1124856Z * [new branch] gh/xmfan/262/orig -> origin/gh/xmfan/262/orig 2025-09-07T07:36:20.1126736Z * [new branch] gh/xmfan/263/base -> origin/gh/xmfan/263/base 2025-09-07T07:36:20.1127972Z * [new branch] gh/xmfan/263/head -> origin/gh/xmfan/263/head 2025-09-07T07:36:20.1129305Z * [new branch] gh/xmfan/263/orig -> origin/gh/xmfan/263/orig 2025-09-07T07:36:20.1130964Z * [new branch] gh/xmfan/264/base -> origin/gh/xmfan/264/base 2025-09-07T07:36:20.1132132Z * [new branch] gh/xmfan/264/head -> origin/gh/xmfan/264/head 2025-09-07T07:36:20.1133313Z * [new branch] gh/xmfan/264/orig -> origin/gh/xmfan/264/orig 2025-09-07T07:36:20.1134949Z * [new branch] gh/xmfan/274/base -> origin/gh/xmfan/274/base 2025-09-07T07:36:20.1136105Z * [new branch] gh/xmfan/274/head -> origin/gh/xmfan/274/head 2025-09-07T07:36:20.1137261Z * [new branch] gh/xmfan/274/orig -> origin/gh/xmfan/274/orig 2025-09-07T07:36:20.1138990Z * [new branch] gh/xmfan/276/base -> origin/gh/xmfan/276/base 2025-09-07T07:36:20.1140201Z * [new branch] gh/xmfan/276/head -> origin/gh/xmfan/276/head 2025-09-07T07:36:20.1141371Z * [new branch] gh/xmfan/276/orig -> origin/gh/xmfan/276/orig 2025-09-07T07:36:20.1143591Z * [new branch] gh/xmfan/277/base -> origin/gh/xmfan/277/base 2025-09-07T07:36:20.1144772Z * [new branch] gh/xmfan/277/head -> origin/gh/xmfan/277/head 2025-09-07T07:36:20.1146141Z * [new branch] gh/xmfan/277/orig -> origin/gh/xmfan/277/orig 2025-09-07T07:36:20.1147853Z * [new branch] gh/xmfan/278/base -> origin/gh/xmfan/278/base 2025-09-07T07:36:20.1149003Z * [new branch] gh/xmfan/278/head -> origin/gh/xmfan/278/head 2025-09-07T07:36:20.1150338Z * [new branch] gh/xmfan/278/orig -> origin/gh/xmfan/278/orig 2025-09-07T07:36:20.1152257Z * [new branch] gh/xmfan/279/base -> origin/gh/xmfan/279/base 2025-09-07T07:36:20.1153431Z * [new branch] gh/xmfan/279/head -> origin/gh/xmfan/279/head 2025-09-07T07:36:20.1154616Z * [new branch] gh/xmfan/279/orig -> origin/gh/xmfan/279/orig 2025-09-07T07:36:20.1156355Z * [new branch] gh/xmfan/280/base -> origin/gh/xmfan/280/base 2025-09-07T07:36:20.1157548Z * [new branch] gh/xmfan/280/head -> origin/gh/xmfan/280/head 2025-09-07T07:36:20.1158709Z * [new branch] gh/xmfan/280/orig -> origin/gh/xmfan/280/orig 2025-09-07T07:36:20.1160544Z * [new branch] gh/xmfan/281/base -> origin/gh/xmfan/281/base 2025-09-07T07:36:20.1161716Z * [new branch] gh/xmfan/281/head -> origin/gh/xmfan/281/head 2025-09-07T07:36:20.1162883Z * [new branch] gh/xmfan/281/orig -> origin/gh/xmfan/281/orig 2025-09-07T07:36:20.1164715Z * [new branch] gh/xmfan/282/base -> origin/gh/xmfan/282/base 2025-09-07T07:36:20.1165930Z * [new branch] gh/xmfan/282/head -> origin/gh/xmfan/282/head 2025-09-07T07:36:20.1167642Z * [new branch] gh/xmfan/283/base -> origin/gh/xmfan/283/base 2025-09-07T07:36:20.1168823Z * [new branch] gh/xmfan/283/head -> origin/gh/xmfan/283/head 2025-09-07T07:36:20.1169993Z * [new branch] gh/xmfan/283/orig -> origin/gh/xmfan/283/orig 2025-09-07T07:36:20.1172123Z * [new branch] gh/xuanzhang816/14/base -> origin/gh/xuanzhang816/14/base 2025-09-07T07:36:20.1176256Z * [new branch] gh/xuanzhang816/14/head -> origin/gh/xuanzhang816/14/head 2025-09-07T07:36:20.1177464Z * [new branch] gh/xuanzhang816/14/orig -> origin/gh/xuanzhang816/14/orig 2025-09-07T07:36:20.1179671Z * [new branch] gh/xuanzhang816/19/base -> origin/gh/xuanzhang816/19/base 2025-09-07T07:36:20.1180859Z * [new branch] gh/xuanzhang816/19/head -> origin/gh/xuanzhang816/19/head 2025-09-07T07:36:20.1182081Z * [new branch] gh/xuanzhang816/19/orig -> origin/gh/xuanzhang816/19/orig 2025-09-07T07:36:20.1183741Z * [new branch] gh/xuanzhang816/22/base -> origin/gh/xuanzhang816/22/base 2025-09-07T07:36:20.1184911Z * [new branch] gh/xuanzhang816/22/head -> origin/gh/xuanzhang816/22/head 2025-09-07T07:36:20.1186174Z * [new branch] gh/xuanzhang816/22/orig -> origin/gh/xuanzhang816/22/orig 2025-09-07T07:36:20.1187857Z * [new branch] gh/xuanzhang816/23/base -> origin/gh/xuanzhang816/23/base 2025-09-07T07:36:20.1189039Z * [new branch] gh/xuanzhang816/23/head -> origin/gh/xuanzhang816/23/head 2025-09-07T07:36:20.1190264Z * [new branch] gh/xuanzhang816/23/orig -> origin/gh/xuanzhang816/23/orig 2025-09-07T07:36:20.1191941Z * [new branch] gh/xuanzhang816/24/base -> origin/gh/xuanzhang816/24/base 2025-09-07T07:36:20.1193081Z * [new branch] gh/xuanzhang816/24/head -> origin/gh/xuanzhang816/24/head 2025-09-07T07:36:20.1194259Z * [new branch] gh/xuanzhang816/24/orig -> origin/gh/xuanzhang816/24/orig 2025-09-07T07:36:20.1195977Z * [new branch] gh/xuanzhang816/25/base -> origin/gh/xuanzhang816/25/base 2025-09-07T07:36:20.1197152Z * [new branch] gh/xuanzhang816/25/head -> origin/gh/xuanzhang816/25/head 2025-09-07T07:36:20.1198297Z * [new branch] gh/xuanzhang816/25/orig -> origin/gh/xuanzhang816/25/orig 2025-09-07T07:36:20.1199979Z * [new branch] gh/xuanzhang816/26/base -> origin/gh/xuanzhang816/26/base 2025-09-07T07:36:20.1201133Z * [new branch] gh/xuanzhang816/26/head -> origin/gh/xuanzhang816/26/head 2025-09-07T07:36:20.1202968Z * [new branch] gh/xuanzhang816/26/orig -> origin/gh/xuanzhang816/26/orig 2025-09-07T07:36:20.1205120Z * [new branch] gh/yanbing-j/11/base -> origin/gh/yanbing-j/11/base 2025-09-07T07:36:20.1206289Z * [new branch] gh/yanbing-j/11/head -> origin/gh/yanbing-j/11/head 2025-09-07T07:36:20.1207537Z * [new branch] gh/yanbing-j/11/orig -> origin/gh/yanbing-j/11/orig 2025-09-07T07:36:20.1209279Z * [new branch] gh/yanbing-j/12/base -> origin/gh/yanbing-j/12/base 2025-09-07T07:36:20.1210672Z * [new branch] gh/yanbing-j/12/head -> origin/gh/yanbing-j/12/head 2025-09-07T07:36:20.1211956Z * [new branch] gh/yanbing-j/12/orig -> origin/gh/yanbing-j/12/orig 2025-09-07T07:36:20.1213691Z * [new branch] gh/yanbing-j/13/base -> origin/gh/yanbing-j/13/base 2025-09-07T07:36:20.1214889Z * [new branch] gh/yanbing-j/13/head -> origin/gh/yanbing-j/13/head 2025-09-07T07:36:20.1216027Z * [new branch] gh/yanbing-j/13/orig -> origin/gh/yanbing-j/13/orig 2025-09-07T07:36:20.1217684Z * [new branch] gh/yanbing-j/14/base -> origin/gh/yanbing-j/14/base 2025-09-07T07:36:20.1218854Z * [new branch] gh/yanbing-j/14/head -> origin/gh/yanbing-j/14/head 2025-09-07T07:36:20.1220053Z * [new branch] gh/yanbing-j/14/orig -> origin/gh/yanbing-j/14/orig 2025-09-07T07:36:20.1221660Z * [new branch] gh/yanbing-j/15/base -> origin/gh/yanbing-j/15/base 2025-09-07T07:36:20.1222870Z * [new branch] gh/yanbing-j/15/head -> origin/gh/yanbing-j/15/head 2025-09-07T07:36:20.1224040Z * [new branch] gh/yanbing-j/15/orig -> origin/gh/yanbing-j/15/orig 2025-09-07T07:36:20.1225713Z * [new branch] gh/yanbing-j/18/base -> origin/gh/yanbing-j/18/base 2025-09-07T07:36:20.1226934Z * [new branch] gh/yanbing-j/18/head -> origin/gh/yanbing-j/18/head 2025-09-07T07:36:20.1228166Z * [new branch] gh/yanbing-j/18/orig -> origin/gh/yanbing-j/18/orig 2025-09-07T07:36:20.1229870Z * [new branch] gh/yanbing-j/19/base -> origin/gh/yanbing-j/19/base 2025-09-07T07:36:20.1231030Z * [new branch] gh/yanbing-j/19/head -> origin/gh/yanbing-j/19/head 2025-09-07T07:36:20.1232187Z * [new branch] gh/yanbing-j/19/orig -> origin/gh/yanbing-j/19/orig 2025-09-07T07:36:20.1233983Z * [new branch] gh/yanbing-j/20/base -> origin/gh/yanbing-j/20/base 2025-09-07T07:36:20.1235151Z * [new branch] gh/yanbing-j/20/head -> origin/gh/yanbing-j/20/head 2025-09-07T07:36:20.1236320Z * [new branch] gh/yanbing-j/20/orig -> origin/gh/yanbing-j/20/orig 2025-09-07T07:36:20.1238143Z * [new branch] gh/yanbing-j/21/base -> origin/gh/yanbing-j/21/base 2025-09-07T07:36:20.1239344Z * [new branch] gh/yanbing-j/21/head -> origin/gh/yanbing-j/21/head 2025-09-07T07:36:20.1241048Z * [new branch] gh/yanbing-j/22/base -> origin/gh/yanbing-j/22/base 2025-09-07T07:36:20.1242231Z * [new branch] gh/yanbing-j/22/head -> origin/gh/yanbing-j/22/head 2025-09-07T07:36:20.1243419Z * [new branch] gh/yanbing-j/22/orig -> origin/gh/yanbing-j/22/orig 2025-09-07T07:36:20.1245155Z * [new branch] gh/yanbing-j/23/base -> origin/gh/yanbing-j/23/base 2025-09-07T07:36:20.1246339Z * [new branch] gh/yanbing-j/23/head -> origin/gh/yanbing-j/23/head 2025-09-07T07:36:20.1247518Z * [new branch] gh/yanbing-j/23/orig -> origin/gh/yanbing-j/23/orig 2025-09-07T07:36:20.1249165Z * [new branch] gh/yanbing-j/24/base -> origin/gh/yanbing-j/24/base 2025-09-07T07:36:20.1250326Z * [new branch] gh/yanbing-j/24/head -> origin/gh/yanbing-j/24/head 2025-09-07T07:36:20.1251590Z * [new branch] gh/yanbing-j/24/orig -> origin/gh/yanbing-j/24/orig 2025-09-07T07:36:20.1253192Z * [new branch] gh/yanbing-j/25/base -> origin/gh/yanbing-j/25/base 2025-09-07T07:36:20.1254381Z * [new branch] gh/yanbing-j/25/head -> origin/gh/yanbing-j/25/head 2025-09-07T07:36:20.1255531Z * [new branch] gh/yanbing-j/25/orig -> origin/gh/yanbing-j/25/orig 2025-09-07T07:36:20.1257161Z * [new branch] gh/yanbing-j/26/base -> origin/gh/yanbing-j/26/base 2025-09-07T07:36:20.1258329Z * [new branch] gh/yanbing-j/26/head -> origin/gh/yanbing-j/26/head 2025-09-07T07:36:20.1259511Z * [new branch] gh/yanbing-j/26/orig -> origin/gh/yanbing-j/26/orig 2025-09-07T07:36:20.1261304Z * [new branch] gh/yanbing-j/36/base -> origin/gh/yanbing-j/36/base 2025-09-07T07:36:20.1262506Z * [new branch] gh/yanbing-j/36/head -> origin/gh/yanbing-j/36/head 2025-09-07T07:36:20.1263722Z * [new branch] gh/yanbing-j/36/orig -> origin/gh/yanbing-j/36/orig 2025-09-07T07:36:20.1265382Z * [new branch] gh/yanbing-j/37/base -> origin/gh/yanbing-j/37/base 2025-09-07T07:36:20.1266626Z * [new branch] gh/yanbing-j/37/head -> origin/gh/yanbing-j/37/head 2025-09-07T07:36:20.1267800Z * [new branch] gh/yanbing-j/37/orig -> origin/gh/yanbing-j/37/orig 2025-09-07T07:36:20.1269887Z * [new branch] gh/yangw-dev/12/base -> origin/gh/yangw-dev/12/base 2025-09-07T07:36:20.1271139Z * [new branch] gh/yangw-dev/12/head -> origin/gh/yangw-dev/12/head 2025-09-07T07:36:20.1272323Z * [new branch] gh/yangw-dev/12/orig -> origin/gh/yangw-dev/12/orig 2025-09-07T07:36:20.1274144Z * [new branch] gh/yangw-dev/13/base -> origin/gh/yangw-dev/13/base 2025-09-07T07:36:20.1275354Z * [new branch] gh/yangw-dev/13/head -> origin/gh/yangw-dev/13/head 2025-09-07T07:36:20.1276589Z * [new branch] gh/yangw-dev/13/orig -> origin/gh/yangw-dev/13/orig 2025-09-07T07:36:20.1278345Z * [new branch] gh/yangw-dev/14/base -> origin/gh/yangw-dev/14/base 2025-09-07T07:36:20.1279524Z * [new branch] gh/yangw-dev/14/head -> origin/gh/yangw-dev/14/head 2025-09-07T07:36:20.1280691Z * [new branch] gh/yangw-dev/14/orig -> origin/gh/yangw-dev/14/orig 2025-09-07T07:36:20.1282368Z * [new branch] gh/yangw-dev/15/base -> origin/gh/yangw-dev/15/base 2025-09-07T07:36:20.1283541Z * [new branch] gh/yangw-dev/15/head -> origin/gh/yangw-dev/15/head 2025-09-07T07:36:20.1284684Z * [new branch] gh/yangw-dev/15/orig -> origin/gh/yangw-dev/15/orig 2025-09-07T07:36:20.1286366Z * [new branch] gh/yangw-dev/16/base -> origin/gh/yangw-dev/16/base 2025-09-07T07:36:20.1287511Z * [new branch] gh/yangw-dev/16/head -> origin/gh/yangw-dev/16/head 2025-09-07T07:36:20.1288671Z * [new branch] gh/yangw-dev/16/orig -> origin/gh/yangw-dev/16/orig 2025-09-07T07:36:20.1290295Z * [new branch] gh/yangw-dev/17/base -> origin/gh/yangw-dev/17/base 2025-09-07T07:36:20.1291483Z * [new branch] gh/yangw-dev/17/head -> origin/gh/yangw-dev/17/head 2025-09-07T07:36:20.1292708Z * [new branch] gh/yangw-dev/17/orig -> origin/gh/yangw-dev/17/orig 2025-09-07T07:36:20.1294794Z * [new branch] gh/yangw-dev/18/base -> origin/gh/yangw-dev/18/base 2025-09-07T07:36:20.1296003Z * [new branch] gh/yangw-dev/18/head -> origin/gh/yangw-dev/18/head 2025-09-07T07:36:20.1297134Z * [new branch] gh/yangw-dev/18/orig -> origin/gh/yangw-dev/18/orig 2025-09-07T07:36:20.1298781Z * [new branch] gh/yangw-dev/19/base -> origin/gh/yangw-dev/19/base 2025-09-07T07:36:20.1300000Z * [new branch] gh/yangw-dev/19/head -> origin/gh/yangw-dev/19/head 2025-09-07T07:36:20.1301117Z * [new branch] gh/yangw-dev/19/orig -> origin/gh/yangw-dev/19/orig 2025-09-07T07:36:20.1302750Z * [new branch] gh/yangw-dev/20/base -> origin/gh/yangw-dev/20/base 2025-09-07T07:36:20.1303973Z * [new branch] gh/yangw-dev/20/head -> origin/gh/yangw-dev/20/head 2025-09-07T07:36:20.1305103Z * [new branch] gh/yangw-dev/20/orig -> origin/gh/yangw-dev/20/orig 2025-09-07T07:36:20.1306933Z * [new branch] gh/yangw-dev/21/base -> origin/gh/yangw-dev/21/base 2025-09-07T07:36:20.1308216Z * [new branch] gh/yangw-dev/21/head -> origin/gh/yangw-dev/21/head 2025-09-07T07:36:20.1309487Z * [new branch] gh/yangw-dev/21/orig -> origin/gh/yangw-dev/21/orig 2025-09-07T07:36:20.1311371Z * [new branch] gh/yangw-dev/22/base -> origin/gh/yangw-dev/22/base 2025-09-07T07:36:20.1312683Z * [new branch] gh/yangw-dev/22/head -> origin/gh/yangw-dev/22/head 2025-09-07T07:36:20.1313818Z * [new branch] gh/yangw-dev/22/orig -> origin/gh/yangw-dev/22/orig 2025-09-07T07:36:20.1315863Z * [new branch] gh/yangw-dev/23/base -> origin/gh/yangw-dev/23/base 2025-09-07T07:36:20.1317084Z * [new branch] gh/yangw-dev/23/head -> origin/gh/yangw-dev/23/head 2025-09-07T07:36:20.1318252Z * [new branch] gh/yangw-dev/23/orig -> origin/gh/yangw-dev/23/orig 2025-09-07T07:36:20.1319987Z * [new branch] gh/yangw-dev/24/base -> origin/gh/yangw-dev/24/base 2025-09-07T07:36:20.1321125Z * [new branch] gh/yangw-dev/24/head -> origin/gh/yangw-dev/24/head 2025-09-07T07:36:20.1322314Z * [new branch] gh/yangw-dev/24/orig -> origin/gh/yangw-dev/24/orig 2025-09-07T07:36:20.1324008Z * [new branch] gh/yangw-dev/25/base -> origin/gh/yangw-dev/25/base 2025-09-07T07:36:20.1325175Z * [new branch] gh/yangw-dev/25/head -> origin/gh/yangw-dev/25/head 2025-09-07T07:36:20.1326868Z * [new branch] gh/yangw-dev/25/orig -> origin/gh/yangw-dev/25/orig 2025-09-07T07:36:20.1328180Z * [new branch] gh/yangw-dev/26/base -> origin/gh/yangw-dev/26/base 2025-09-07T07:36:20.1329314Z * [new branch] gh/yangw-dev/26/head -> origin/gh/yangw-dev/26/head 2025-09-07T07:36:20.1330495Z * [new branch] gh/yangw-dev/26/orig -> origin/gh/yangw-dev/26/orig 2025-09-07T07:36:20.1332165Z * [new branch] gh/yangw-dev/27/base -> origin/gh/yangw-dev/27/base 2025-09-07T07:36:20.1333430Z * [new branch] gh/yangw-dev/27/head -> origin/gh/yangw-dev/27/head 2025-09-07T07:36:20.1334478Z * [new branch] gh/yangw-dev/27/orig -> origin/gh/yangw-dev/27/orig 2025-09-07T07:36:20.1336669Z * [new branch] gh/ydwu4/233/base -> origin/gh/ydwu4/233/base 2025-09-07T07:36:20.1337798Z * [new branch] gh/ydwu4/233/head -> origin/gh/ydwu4/233/head 2025-09-07T07:36:20.1339107Z * [new branch] gh/ydwu4/233/orig -> origin/gh/ydwu4/233/orig 2025-09-07T07:36:20.1341300Z * [new branch] gh/ydwu4/246/base -> origin/gh/ydwu4/246/base 2025-09-07T07:36:20.1342637Z * [new branch] gh/ydwu4/246/head -> origin/gh/ydwu4/246/head 2025-09-07T07:36:20.1344092Z * [new branch] gh/ydwu4/246/orig -> origin/gh/ydwu4/246/orig 2025-09-07T07:36:20.1346099Z * [new branch] gh/ydwu4/253/base -> origin/gh/ydwu4/253/base 2025-09-07T07:36:20.1347299Z * [new branch] gh/ydwu4/253/head -> origin/gh/ydwu4/253/head 2025-09-07T07:36:20.1348374Z * [new branch] gh/ydwu4/253/orig -> origin/gh/ydwu4/253/orig 2025-09-07T07:36:20.1350691Z * [new branch] gh/ydwu4/255/base -> origin/gh/ydwu4/255/base 2025-09-07T07:36:20.1352205Z * [new branch] gh/ydwu4/255/head -> origin/gh/ydwu4/255/head 2025-09-07T07:36:20.1352822Z * [new branch] gh/ydwu4/255/orig -> origin/gh/ydwu4/255/orig 2025-09-07T07:36:20.1354665Z * [new branch] gh/ydwu4/259/base -> origin/gh/ydwu4/259/base 2025-09-07T07:36:20.1355841Z * [new branch] gh/ydwu4/259/head -> origin/gh/ydwu4/259/head 2025-09-07T07:36:20.1357074Z * [new branch] gh/ydwu4/259/orig -> origin/gh/ydwu4/259/orig 2025-09-07T07:36:20.1358791Z * [new branch] gh/ydwu4/262/base -> origin/gh/ydwu4/262/base 2025-09-07T07:36:20.1360085Z * [new branch] gh/ydwu4/262/head -> origin/gh/ydwu4/262/head 2025-09-07T07:36:20.1361348Z * [new branch] gh/ydwu4/262/orig -> origin/gh/ydwu4/262/orig 2025-09-07T07:36:20.1363079Z * [new branch] gh/ydwu4/263/base -> origin/gh/ydwu4/263/base 2025-09-07T07:36:20.1364233Z * [new branch] gh/ydwu4/263/head -> origin/gh/ydwu4/263/head 2025-09-07T07:36:20.1365399Z * [new branch] gh/ydwu4/263/orig -> origin/gh/ydwu4/263/orig 2025-09-07T07:36:20.1367209Z * [new branch] gh/ydwu4/269/base -> origin/gh/ydwu4/269/base 2025-09-07T07:36:20.1368326Z * [new branch] gh/ydwu4/269/head -> origin/gh/ydwu4/269/head 2025-09-07T07:36:20.1369433Z * [new branch] gh/ydwu4/269/orig -> origin/gh/ydwu4/269/orig 2025-09-07T07:36:20.1371157Z * [new branch] gh/ydwu4/270/base -> origin/gh/ydwu4/270/base 2025-09-07T07:36:20.1372389Z * [new branch] gh/ydwu4/270/head -> origin/gh/ydwu4/270/head 2025-09-07T07:36:20.1373590Z * [new branch] gh/ydwu4/270/orig -> origin/gh/ydwu4/270/orig 2025-09-07T07:36:20.1375822Z * [new branch] gh/ydwu4/272/base -> origin/gh/ydwu4/272/base 2025-09-07T07:36:20.1377196Z * [new branch] gh/ydwu4/272/head -> origin/gh/ydwu4/272/head 2025-09-07T07:36:20.1378386Z * [new branch] gh/ydwu4/272/orig -> origin/gh/ydwu4/272/orig 2025-09-07T07:36:20.1380162Z * [new branch] gh/ydwu4/275/base -> origin/gh/ydwu4/275/base 2025-09-07T07:36:20.1381345Z * [new branch] gh/ydwu4/275/head -> origin/gh/ydwu4/275/head 2025-09-07T07:36:20.1382533Z * [new branch] gh/ydwu4/275/orig -> origin/gh/ydwu4/275/orig 2025-09-07T07:36:20.1384091Z * [new branch] gh/ydwu4/276/base -> origin/gh/ydwu4/276/base 2025-09-07T07:36:20.1385299Z * [new branch] gh/ydwu4/276/head -> origin/gh/ydwu4/276/head 2025-09-07T07:36:20.1386599Z * [new branch] gh/ydwu4/276/orig -> origin/gh/ydwu4/276/orig 2025-09-07T07:36:20.1388508Z * [new branch] gh/ydwu4/279/base -> origin/gh/ydwu4/279/base 2025-09-07T07:36:20.1389828Z * [new branch] gh/ydwu4/279/head -> origin/gh/ydwu4/279/head 2025-09-07T07:36:20.1391019Z * [new branch] gh/ydwu4/279/orig -> origin/gh/ydwu4/279/orig 2025-09-07T07:36:20.1392990Z * [new branch] gh/ydwu4/283/base -> origin/gh/ydwu4/283/base 2025-09-07T07:36:20.1394642Z * [new branch] gh/ydwu4/283/head -> origin/gh/ydwu4/283/head 2025-09-07T07:36:20.1395880Z * [new branch] gh/ydwu4/283/orig -> origin/gh/ydwu4/283/orig 2025-09-07T07:36:20.1397598Z * [new branch] gh/ydwu4/289/base -> origin/gh/ydwu4/289/base 2025-09-07T07:36:20.1398796Z * [new branch] gh/ydwu4/289/head -> origin/gh/ydwu4/289/head 2025-09-07T07:36:20.1399975Z * [new branch] gh/ydwu4/289/orig -> origin/gh/ydwu4/289/orig 2025-09-07T07:36:20.1402000Z * [new branch] gh/ydwu4/290/base -> origin/gh/ydwu4/290/base 2025-09-07T07:36:20.1403087Z * [new branch] gh/ydwu4/290/head -> origin/gh/ydwu4/290/head 2025-09-07T07:36:20.1404285Z * [new branch] gh/ydwu4/290/orig -> origin/gh/ydwu4/290/orig 2025-09-07T07:36:20.1406430Z * [new branch] gh/ydwu4/291/base -> origin/gh/ydwu4/291/base 2025-09-07T07:36:20.1407664Z * [new branch] gh/ydwu4/291/head -> origin/gh/ydwu4/291/head 2025-09-07T07:36:20.1408853Z * [new branch] gh/ydwu4/291/orig -> origin/gh/ydwu4/291/orig 2025-09-07T07:36:20.1410928Z * [new branch] gh/ydwu4/292/base -> origin/gh/ydwu4/292/base 2025-09-07T07:36:20.1412118Z * [new branch] gh/ydwu4/292/head -> origin/gh/ydwu4/292/head 2025-09-07T07:36:20.1413262Z * [new branch] gh/ydwu4/292/orig -> origin/gh/ydwu4/292/orig 2025-09-07T07:36:20.1415496Z * [new branch] gh/ydwu4/293/base -> origin/gh/ydwu4/293/base 2025-09-07T07:36:20.1416844Z * [new branch] gh/ydwu4/293/head -> origin/gh/ydwu4/293/head 2025-09-07T07:36:20.1418033Z * [new branch] gh/ydwu4/293/orig -> origin/gh/ydwu4/293/orig 2025-09-07T07:36:20.1419793Z * [new branch] gh/ydwu4/294/base -> origin/gh/ydwu4/294/base 2025-09-07T07:36:20.1420958Z * [new branch] gh/ydwu4/294/head -> origin/gh/ydwu4/294/head 2025-09-07T07:36:20.1422124Z * [new branch] gh/ydwu4/294/orig -> origin/gh/ydwu4/294/orig 2025-09-07T07:36:20.1423941Z * [new branch] gh/ydwu4/295/base -> origin/gh/ydwu4/295/base 2025-09-07T07:36:20.1425179Z * [new branch] gh/ydwu4/295/head -> origin/gh/ydwu4/295/head 2025-09-07T07:36:20.1426454Z * [new branch] gh/ydwu4/295/orig -> origin/gh/ydwu4/295/orig 2025-09-07T07:36:20.1428267Z * [new branch] gh/ydwu4/296/base -> origin/gh/ydwu4/296/base 2025-09-07T07:36:20.1429369Z * [new branch] gh/ydwu4/296/head -> origin/gh/ydwu4/296/head 2025-09-07T07:36:20.1430516Z * [new branch] gh/ydwu4/296/orig -> origin/gh/ydwu4/296/orig 2025-09-07T07:36:20.1432940Z * [new branch] gh/ydwu4/300/base -> origin/gh/ydwu4/300/base 2025-09-07T07:36:20.1434515Z * [new branch] gh/ydwu4/300/head -> origin/gh/ydwu4/300/head 2025-09-07T07:36:20.1435894Z * [new branch] gh/ydwu4/300/orig -> origin/gh/ydwu4/300/orig 2025-09-07T07:36:20.1437858Z * [new branch] gh/ydwu4/301/base -> origin/gh/ydwu4/301/base 2025-09-07T07:36:20.1438993Z * [new branch] gh/ydwu4/301/head -> origin/gh/ydwu4/301/head 2025-09-07T07:36:20.1440154Z * [new branch] gh/ydwu4/301/orig -> origin/gh/ydwu4/301/orig 2025-09-07T07:36:20.1441920Z * [new branch] gh/ydwu4/302/base -> origin/gh/ydwu4/302/base 2025-09-07T07:36:20.1443083Z * [new branch] gh/ydwu4/302/head -> origin/gh/ydwu4/302/head 2025-09-07T07:36:20.1444251Z * [new branch] gh/ydwu4/302/orig -> origin/gh/ydwu4/302/orig 2025-09-07T07:36:20.1445892Z * [new branch] gh/ydwu4/303/base -> origin/gh/ydwu4/303/base 2025-09-07T07:36:20.1447151Z * [new branch] gh/ydwu4/303/head -> origin/gh/ydwu4/303/head 2025-09-07T07:36:20.1448416Z * [new branch] gh/ydwu4/303/orig -> origin/gh/ydwu4/303/orig 2025-09-07T07:36:20.1450032Z * [new branch] gh/ydwu4/304/base -> origin/gh/ydwu4/304/base 2025-09-07T07:36:20.1451262Z * [new branch] gh/ydwu4/304/head -> origin/gh/ydwu4/304/head 2025-09-07T07:36:20.1452592Z * [new branch] gh/ydwu4/304/orig -> origin/gh/ydwu4/304/orig 2025-09-07T07:36:20.1454657Z * [new branch] gh/ydwu4/305/base -> origin/gh/ydwu4/305/base 2025-09-07T07:36:20.1455538Z * [new branch] gh/ydwu4/305/head -> origin/gh/ydwu4/305/head 2025-09-07T07:36:20.1456786Z * [new branch] gh/ydwu4/305/orig -> origin/gh/ydwu4/305/orig 2025-09-07T07:36:20.1458716Z * [new branch] gh/ydwu4/306/base -> origin/gh/ydwu4/306/base 2025-09-07T07:36:20.1459990Z * [new branch] gh/ydwu4/306/head -> origin/gh/ydwu4/306/head 2025-09-07T07:36:20.1461613Z * [new branch] gh/ydwu4/306/orig -> origin/gh/ydwu4/306/orig 2025-09-07T07:36:20.1463321Z * [new branch] gh/ydwu4/307/base -> origin/gh/ydwu4/307/base 2025-09-07T07:36:20.1464517Z * [new branch] gh/ydwu4/307/head -> origin/gh/ydwu4/307/head 2025-09-07T07:36:20.1465801Z * [new branch] gh/ydwu4/307/orig -> origin/gh/ydwu4/307/orig 2025-09-07T07:36:20.1467582Z * [new branch] gh/ydwu4/308/base -> origin/gh/ydwu4/308/base 2025-09-07T07:36:20.1468790Z * [new branch] gh/ydwu4/308/head -> origin/gh/ydwu4/308/head 2025-09-07T07:36:20.1470000Z * [new branch] gh/ydwu4/308/orig -> origin/gh/ydwu4/308/orig 2025-09-07T07:36:20.1471711Z * [new branch] gh/ydwu4/309/base -> origin/gh/ydwu4/309/base 2025-09-07T07:36:20.1472823Z * [new branch] gh/ydwu4/309/head -> origin/gh/ydwu4/309/head 2025-09-07T07:36:20.1474019Z * [new branch] gh/ydwu4/309/orig -> origin/gh/ydwu4/309/orig 2025-09-07T07:36:20.1475965Z * [new branch] gh/ydwu4/310/base -> origin/gh/ydwu4/310/base 2025-09-07T07:36:20.1477302Z * [new branch] gh/ydwu4/310/head -> origin/gh/ydwu4/310/head 2025-09-07T07:36:20.1478487Z * [new branch] gh/ydwu4/310/orig -> origin/gh/ydwu4/310/orig 2025-09-07T07:36:20.1480232Z * [new branch] gh/ydwu4/311/base -> origin/gh/ydwu4/311/base 2025-09-07T07:36:20.1481472Z * [new branch] gh/ydwu4/311/head -> origin/gh/ydwu4/311/head 2025-09-07T07:36:20.1482626Z * [new branch] gh/ydwu4/311/orig -> origin/gh/ydwu4/311/orig 2025-09-07T07:36:20.1484312Z * [new branch] gh/ydwu4/312/base -> origin/gh/ydwu4/312/base 2025-09-07T07:36:20.1485491Z * [new branch] gh/ydwu4/312/head -> origin/gh/ydwu4/312/head 2025-09-07T07:36:20.1486653Z * [new branch] gh/ydwu4/312/orig -> origin/gh/ydwu4/312/orig 2025-09-07T07:36:20.1488586Z * [new branch] gh/ydwu4/313/base -> origin/gh/ydwu4/313/base 2025-09-07T07:36:20.1495480Z * [new branch] gh/ydwu4/313/head -> origin/gh/ydwu4/313/head 2025-09-07T07:36:20.1495805Z * [new branch] gh/ydwu4/313/orig -> origin/gh/ydwu4/313/orig 2025-09-07T07:36:20.1496100Z * [new branch] gh/ydwu4/314/base -> origin/gh/ydwu4/314/base 2025-09-07T07:36:20.1496408Z * [new branch] gh/ydwu4/314/head -> origin/gh/ydwu4/314/head 2025-09-07T07:36:20.1496699Z * [new branch] gh/ydwu4/314/orig -> origin/gh/ydwu4/314/orig 2025-09-07T07:36:20.1497277Z * [new branch] gh/ydwu4/315/base -> origin/gh/ydwu4/315/base 2025-09-07T07:36:20.1498573Z * [new branch] gh/ydwu4/315/head -> origin/gh/ydwu4/315/head 2025-09-07T07:36:20.1499735Z * [new branch] gh/ydwu4/315/orig -> origin/gh/ydwu4/315/orig 2025-09-07T07:36:20.1501563Z * [new branch] gh/ydwu4/316/base -> origin/gh/ydwu4/316/base 2025-09-07T07:36:20.1502791Z * [new branch] gh/ydwu4/316/head -> origin/gh/ydwu4/316/head 2025-09-07T07:36:20.1503992Z * [new branch] gh/ydwu4/316/orig -> origin/gh/ydwu4/316/orig 2025-09-07T07:36:20.1505977Z * [new branch] gh/ydwu4/317/base -> origin/gh/ydwu4/317/base 2025-09-07T07:36:20.1506997Z * [new branch] gh/ydwu4/317/head -> origin/gh/ydwu4/317/head 2025-09-07T07:36:20.1508173Z * [new branch] gh/ydwu4/317/orig -> origin/gh/ydwu4/317/orig 2025-09-07T07:36:20.1510096Z * [new branch] gh/ydwu4/318/base -> origin/gh/ydwu4/318/base 2025-09-07T07:36:20.1514722Z * [new branch] gh/ydwu4/318/head -> origin/gh/ydwu4/318/head 2025-09-07T07:36:20.1515868Z * [new branch] gh/ydwu4/318/orig -> origin/gh/ydwu4/318/orig 2025-09-07T07:36:20.1517596Z * [new branch] gh/ydwu4/319/base -> origin/gh/ydwu4/319/base 2025-09-07T07:36:20.1518824Z * [new branch] gh/ydwu4/319/head -> origin/gh/ydwu4/319/head 2025-09-07T07:36:20.1520025Z * [new branch] gh/ydwu4/319/orig -> origin/gh/ydwu4/319/orig 2025-09-07T07:36:20.1522239Z * [new branch] gh/ydwu4/320/base -> origin/gh/ydwu4/320/base 2025-09-07T07:36:20.1523375Z * [new branch] gh/ydwu4/320/head -> origin/gh/ydwu4/320/head 2025-09-07T07:36:20.1524555Z * [new branch] gh/ydwu4/320/orig -> origin/gh/ydwu4/320/orig 2025-09-07T07:36:20.1526209Z * [new branch] gh/ydwu4/321/base -> origin/gh/ydwu4/321/base 2025-09-07T07:36:20.1527399Z * [new branch] gh/ydwu4/321/head -> origin/gh/ydwu4/321/head 2025-09-07T07:36:20.1528735Z * [new branch] gh/ydwu4/321/orig -> origin/gh/ydwu4/321/orig 2025-09-07T07:36:20.1530498Z * [new branch] gh/ydwu4/322/base -> origin/gh/ydwu4/322/base 2025-09-07T07:36:20.1531686Z * [new branch] gh/ydwu4/322/head -> origin/gh/ydwu4/322/head 2025-09-07T07:36:20.1532875Z * [new branch] gh/ydwu4/322/orig -> origin/gh/ydwu4/322/orig 2025-09-07T07:36:20.1534626Z * [new branch] gh/ydwu4/323/base -> origin/gh/ydwu4/323/base 2025-09-07T07:36:20.1535949Z * [new branch] gh/ydwu4/323/head -> origin/gh/ydwu4/323/head 2025-09-07T07:36:20.1537131Z * [new branch] gh/ydwu4/323/orig -> origin/gh/ydwu4/323/orig 2025-09-07T07:36:20.1538799Z * [new branch] gh/ydwu4/324/base -> origin/gh/ydwu4/324/base 2025-09-07T07:36:20.1539974Z * [new branch] gh/ydwu4/324/head -> origin/gh/ydwu4/324/head 2025-09-07T07:36:20.1541157Z * [new branch] gh/ydwu4/324/orig -> origin/gh/ydwu4/324/orig 2025-09-07T07:36:20.1543723Z * [new branch] gh/yf225/133/base -> origin/gh/yf225/133/base 2025-09-07T07:36:20.1544902Z * [new branch] gh/yf225/133/head -> origin/gh/yf225/133/head 2025-09-07T07:36:20.1546921Z * [new branch] gh/yf225/171/base -> origin/gh/yf225/171/base 2025-09-07T07:36:20.1548182Z * [new branch] gh/yf225/171/head -> origin/gh/yf225/171/head 2025-09-07T07:36:20.1549336Z * [new branch] gh/yf225/171/orig -> origin/gh/yf225/171/orig 2025-09-07T07:36:20.1551124Z * [new branch] gh/yf225/172/base -> origin/gh/yf225/172/base 2025-09-07T07:36:20.1552334Z * [new branch] gh/yf225/172/head -> origin/gh/yf225/172/head 2025-09-07T07:36:20.1553890Z * [new branch] gh/yf225/172/orig -> origin/gh/yf225/172/orig 2025-09-07T07:36:20.1555583Z * [new branch] gh/yf225/93/base -> origin/gh/yf225/93/base 2025-09-07T07:36:20.1556735Z * [new branch] gh/yf225/93/head -> origin/gh/yf225/93/head 2025-09-07T07:36:20.1559418Z * [new branch] gh/yifuwang/152/base -> origin/gh/yifuwang/152/base 2025-09-07T07:36:20.1560815Z * [new branch] gh/yifuwang/152/head -> origin/gh/yifuwang/152/head 2025-09-07T07:36:20.1562091Z * [new branch] gh/yifuwang/152/orig -> origin/gh/yifuwang/152/orig 2025-09-07T07:36:20.1563737Z * [new branch] gh/yifuwang/195/base -> origin/gh/yifuwang/195/base 2025-09-07T07:36:20.1564970Z * [new branch] gh/yifuwang/195/head -> origin/gh/yifuwang/195/head 2025-09-07T07:36:20.1566266Z * [new branch] gh/yifuwang/195/orig -> origin/gh/yifuwang/195/orig 2025-09-07T07:36:20.1568605Z * [new branch] gh/yiming0416/1/base -> origin/gh/yiming0416/1/base 2025-09-07T07:36:20.1570284Z * [new branch] gh/yiming0416/1/head -> origin/gh/yiming0416/1/head 2025-09-07T07:36:20.1571862Z * [new branch] gh/yiming0416/2/base -> origin/gh/yiming0416/2/base 2025-09-07T07:36:20.1573396Z * [new branch] gh/yiming0416/2/head -> origin/gh/yiming0416/2/head 2025-09-07T07:36:20.1575511Z * [new branch] gh/ysiraichi/79/base -> origin/gh/ysiraichi/79/base 2025-09-07T07:36:20.1576693Z * [new branch] gh/ysiraichi/79/head -> origin/gh/ysiraichi/79/head 2025-09-07T07:36:20.1578437Z * [new branch] gh/ysiraichi/79/orig -> origin/gh/ysiraichi/79/orig 2025-09-07T07:36:20.1580132Z * [new branch] gh/ysiraichi/88/base -> origin/gh/ysiraichi/88/base 2025-09-07T07:36:20.1581283Z * [new branch] gh/ysiraichi/88/head -> origin/gh/ysiraichi/88/head 2025-09-07T07:36:20.1582471Z * [new branch] gh/ysiraichi/88/orig -> origin/gh/ysiraichi/88/orig 2025-09-07T07:36:20.1584742Z * [new branch] gh/zhxchen17/25/base -> origin/gh/zhxchen17/25/base 2025-09-07T07:36:20.1585924Z * [new branch] gh/zhxchen17/25/head -> origin/gh/zhxchen17/25/head 2025-09-07T07:36:20.1587150Z * [new branch] gh/zhxchen17/25/orig -> origin/gh/zhxchen17/25/orig 2025-09-07T07:36:20.1589011Z * [new branch] gh/zhxchen17/31/base -> origin/gh/zhxchen17/31/base 2025-09-07T07:36:20.1590235Z * [new branch] gh/zhxchen17/31/head -> origin/gh/zhxchen17/31/head 2025-09-07T07:36:20.1591395Z * [new branch] gh/zhxchen17/31/orig -> origin/gh/zhxchen17/31/orig 2025-09-07T07:36:20.1593063Z * [new branch] gh/zhxchen17/34/base -> origin/gh/zhxchen17/34/base 2025-09-07T07:36:20.1594244Z * [new branch] gh/zhxchen17/34/head -> origin/gh/zhxchen17/34/head 2025-09-07T07:36:20.1595797Z * [new branch] gh/zhxchen17/35/base -> origin/gh/zhxchen17/35/base 2025-09-07T07:36:20.1596994Z * [new branch] gh/zhxchen17/35/head -> origin/gh/zhxchen17/35/head 2025-09-07T07:36:20.1598890Z * [new branch] gh/zhxchen17/37/base -> origin/gh/zhxchen17/37/base 2025-09-07T07:36:20.1600139Z * [new branch] gh/zhxchen17/37/head -> origin/gh/zhxchen17/37/head 2025-09-07T07:36:20.1601392Z * [new branch] gh/zhxchen17/37/orig -> origin/gh/zhxchen17/37/orig 2025-09-07T07:36:20.1603229Z * [new branch] gh/zhxchen17/38/base -> origin/gh/zhxchen17/38/base 2025-09-07T07:36:20.1604501Z * [new branch] gh/zhxchen17/38/head -> origin/gh/zhxchen17/38/head 2025-09-07T07:36:20.1605724Z * [new branch] gh/zhxchen17/38/orig -> origin/gh/zhxchen17/38/orig 2025-09-07T07:36:20.1607318Z * [new branch] gh/zhxchen17/39/base -> origin/gh/zhxchen17/39/base 2025-09-07T07:36:20.1608582Z * [new branch] gh/zhxchen17/39/head -> origin/gh/zhxchen17/39/head 2025-09-07T07:36:20.1609914Z * [new branch] gh/zhxchen17/39/orig -> origin/gh/zhxchen17/39/orig 2025-09-07T07:36:20.1611861Z * [new branch] gh/zhxchen17/40/base -> origin/gh/zhxchen17/40/base 2025-09-07T07:36:20.1613090Z * [new branch] gh/zhxchen17/40/head -> origin/gh/zhxchen17/40/head 2025-09-07T07:36:20.1614538Z * [new branch] gh/zhxchen17/40/orig -> origin/gh/zhxchen17/40/orig 2025-09-07T07:36:20.1616125Z * [new branch] gh/zhxchen17/41/base -> origin/gh/zhxchen17/41/base 2025-09-07T07:36:20.1617408Z * [new branch] gh/zhxchen17/41/head -> origin/gh/zhxchen17/41/head 2025-09-07T07:36:20.1618893Z * [new branch] gh/zhxchen17/41/orig -> origin/gh/zhxchen17/41/orig 2025-09-07T07:36:20.1620677Z * [new branch] gh/zhxchen17/42/base -> origin/gh/zhxchen17/42/base 2025-09-07T07:36:20.1622049Z * [new branch] gh/zhxchen17/42/head -> origin/gh/zhxchen17/42/head 2025-09-07T07:36:20.1623324Z * [new branch] gh/zhxchen17/42/orig -> origin/gh/zhxchen17/42/orig 2025-09-07T07:36:20.1625311Z * [new branch] gh/zhxchen17/43/base -> origin/gh/zhxchen17/43/base 2025-09-07T07:36:20.1626669Z * [new branch] gh/zhxchen17/43/head -> origin/gh/zhxchen17/43/head 2025-09-07T07:36:20.1627920Z * [new branch] gh/zhxchen17/43/orig -> origin/gh/zhxchen17/43/orig 2025-09-07T07:36:20.1629679Z * [new branch] gh/zhxchen17/44/base -> origin/gh/zhxchen17/44/base 2025-09-07T07:36:20.1630811Z * [new branch] gh/zhxchen17/44/head -> origin/gh/zhxchen17/44/head 2025-09-07T07:36:20.1632082Z * [new branch] gh/zhxchen17/44/orig -> origin/gh/zhxchen17/44/orig 2025-09-07T07:36:20.1633775Z * [new branch] gh/zhxchen17/45/base -> origin/gh/zhxchen17/45/base 2025-09-07T07:36:20.1635113Z * [new branch] gh/zhxchen17/45/head -> origin/gh/zhxchen17/45/head 2025-09-07T07:36:20.1636465Z * [new branch] gh/zhxchen17/45/orig -> origin/gh/zhxchen17/45/orig 2025-09-07T07:36:20.1638570Z * [new branch] gh/zklaus/10/base -> origin/gh/zklaus/10/base 2025-09-07T07:36:20.1640157Z * [new branch] gh/zklaus/10/head -> origin/gh/zklaus/10/head 2025-09-07T07:36:20.1641502Z * [new branch] gh/zklaus/10/orig -> origin/gh/zklaus/10/orig 2025-09-07T07:36:20.1643210Z * [new branch] gh/zklaus/11/base -> origin/gh/zklaus/11/base 2025-09-07T07:36:20.1644351Z * [new branch] gh/zklaus/11/head -> origin/gh/zklaus/11/head 2025-09-07T07:36:20.1645546Z * [new branch] gh/zklaus/11/orig -> origin/gh/zklaus/11/orig 2025-09-07T07:36:20.1647200Z * [new branch] gh/zklaus/12/base -> origin/gh/zklaus/12/base 2025-09-07T07:36:20.1648446Z * [new branch] gh/zklaus/12/head -> origin/gh/zklaus/12/head 2025-09-07T07:36:20.1649577Z * [new branch] gh/zklaus/12/orig -> origin/gh/zklaus/12/orig 2025-09-07T07:36:20.1651270Z * [new branch] gh/zklaus/14/base -> origin/gh/zklaus/14/base 2025-09-07T07:36:20.1652535Z * [new branch] gh/zklaus/14/head -> origin/gh/zklaus/14/head 2025-09-07T07:36:20.1653750Z * [new branch] gh/zklaus/14/orig -> origin/gh/zklaus/14/orig 2025-09-07T07:36:20.1655809Z * [new branch] gh/zklaus/15/base -> origin/gh/zklaus/15/base 2025-09-07T07:36:20.1656999Z * [new branch] gh/zklaus/15/head -> origin/gh/zklaus/15/head 2025-09-07T07:36:20.1658196Z * [new branch] gh/zklaus/15/orig -> origin/gh/zklaus/15/orig 2025-09-07T07:36:20.1660313Z * [new branch] gh/zklaus/16/base -> origin/gh/zklaus/16/base 2025-09-07T07:36:20.1661460Z * [new branch] gh/zklaus/16/head -> origin/gh/zklaus/16/head 2025-09-07T07:36:20.1662657Z * [new branch] gh/zklaus/16/orig -> origin/gh/zklaus/16/orig 2025-09-07T07:36:20.1664348Z * [new branch] gh/zklaus/17/base -> origin/gh/zklaus/17/base 2025-09-07T07:36:20.1665538Z * [new branch] gh/zklaus/17/head -> origin/gh/zklaus/17/head 2025-09-07T07:36:20.1666919Z * [new branch] gh/zklaus/17/orig -> origin/gh/zklaus/17/orig 2025-09-07T07:36:20.1668491Z * [new branch] gh/zklaus/18/base -> origin/gh/zklaus/18/base 2025-09-07T07:36:20.1669754Z * [new branch] gh/zklaus/18/head -> origin/gh/zklaus/18/head 2025-09-07T07:36:20.1670957Z * [new branch] gh/zklaus/18/orig -> origin/gh/zklaus/18/orig 2025-09-07T07:36:20.1672592Z * [new branch] gh/zklaus/19/base -> origin/gh/zklaus/19/base 2025-09-07T07:36:20.1673793Z * [new branch] gh/zklaus/19/head -> origin/gh/zklaus/19/head 2025-09-07T07:36:20.1674943Z * [new branch] gh/zklaus/19/orig -> origin/gh/zklaus/19/orig 2025-09-07T07:36:20.1676812Z * [new branch] gh/zklaus/20/base -> origin/gh/zklaus/20/base 2025-09-07T07:36:20.1677983Z * [new branch] gh/zklaus/20/head -> origin/gh/zklaus/20/head 2025-09-07T07:36:20.1679160Z * [new branch] gh/zklaus/20/orig -> origin/gh/zklaus/20/orig 2025-09-07T07:36:20.1680888Z * [new branch] gh/zklaus/7/base -> origin/gh/zklaus/7/base 2025-09-07T07:36:20.1682065Z * [new branch] gh/zklaus/7/head -> origin/gh/zklaus/7/head 2025-09-07T07:36:20.1683226Z * [new branch] gh/zklaus/7/orig -> origin/gh/zklaus/7/orig 2025-09-07T07:36:20.1684832Z * [new branch] gh/zklaus/9/base -> origin/gh/zklaus/9/base 2025-09-07T07:36:20.1686076Z * [new branch] gh/zklaus/9/head -> origin/gh/zklaus/9/head 2025-09-07T07:36:20.1687249Z * [new branch] gh/zklaus/9/orig -> origin/gh/zklaus/9/orig 2025-09-07T07:36:20.1689349Z * [new branch] gh/zou3519/1175/base -> origin/gh/zou3519/1175/base 2025-09-07T07:36:20.1690523Z * [new branch] gh/zou3519/1175/head -> origin/gh/zou3519/1175/head 2025-09-07T07:36:20.1691705Z * [new branch] gh/zou3519/1175/orig -> origin/gh/zou3519/1175/orig 2025-09-07T07:36:20.1693437Z * [new branch] gh/zou3519/1177/base -> origin/gh/zou3519/1177/base 2025-09-07T07:36:20.1694640Z * [new branch] gh/zou3519/1177/head -> origin/gh/zou3519/1177/head 2025-09-07T07:36:20.1695808Z * [new branch] gh/zou3519/1177/orig -> origin/gh/zou3519/1177/orig 2025-09-07T07:36:20.1697556Z * [new branch] gh/zou3519/1191/base -> origin/gh/zou3519/1191/base 2025-09-07T07:36:20.1698819Z * [new branch] gh/zou3519/1191/head -> origin/gh/zou3519/1191/head 2025-09-07T07:36:20.1700054Z * [new branch] gh/zou3519/1191/orig -> origin/gh/zou3519/1191/orig 2025-09-07T07:36:20.1701932Z * [new branch] gh/zou3519/1192/base -> origin/gh/zou3519/1192/base 2025-09-07T07:36:20.1703151Z * [new branch] gh/zou3519/1192/head -> origin/gh/zou3519/1192/head 2025-09-07T07:36:20.1704288Z * [new branch] gh/zou3519/1192/orig -> origin/gh/zou3519/1192/orig 2025-09-07T07:36:20.1705908Z * [new branch] gh/zou3519/1193/base -> origin/gh/zou3519/1193/base 2025-09-07T07:36:20.1707177Z * [new branch] gh/zou3519/1193/head -> origin/gh/zou3519/1193/head 2025-09-07T07:36:20.1708387Z * [new branch] gh/zou3519/1193/orig -> origin/gh/zou3519/1193/orig 2025-09-07T07:36:20.1710156Z * [new branch] gh/zou3519/1194/base -> origin/gh/zou3519/1194/base 2025-09-07T07:36:20.1711453Z * [new branch] gh/zou3519/1194/head -> origin/gh/zou3519/1194/head 2025-09-07T07:36:20.1712779Z * [new branch] gh/zou3519/1194/orig -> origin/gh/zou3519/1194/orig 2025-09-07T07:36:20.1714608Z * [new branch] gh/zou3519/1195/base -> origin/gh/zou3519/1195/base 2025-09-07T07:36:20.1715963Z * [new branch] gh/zou3519/1195/head -> origin/gh/zou3519/1195/head 2025-09-07T07:36:20.1717135Z * [new branch] gh/zou3519/1195/orig -> origin/gh/zou3519/1195/orig 2025-09-07T07:36:20.1718780Z * [new branch] gh/zou3519/1196/base -> origin/gh/zou3519/1196/base 2025-09-07T07:36:20.1720005Z * [new branch] gh/zou3519/1196/head -> origin/gh/zou3519/1196/head 2025-09-07T07:36:20.1721239Z * [new branch] gh/zou3519/1196/orig -> origin/gh/zou3519/1196/orig 2025-09-07T07:36:20.1722835Z * [new branch] gh/zou3519/1197/base -> origin/gh/zou3519/1197/base 2025-09-07T07:36:20.1724071Z * [new branch] gh/zou3519/1197/head -> origin/gh/zou3519/1197/head 2025-09-07T07:36:20.1725279Z * [new branch] gh/zou3519/1197/orig -> origin/gh/zou3519/1197/orig 2025-09-07T07:36:20.1727948Z * [new branch] gh/zpcore/1/base -> origin/gh/zpcore/1/base 2025-09-07T07:36:20.1729129Z * [new branch] gh/zpcore/1/head -> origin/gh/zpcore/1/head 2025-09-07T07:36:20.1730911Z * [new branch] gh/zpcore/10/base -> origin/gh/zpcore/10/base 2025-09-07T07:36:20.1731983Z * [new branch] gh/zpcore/10/head -> origin/gh/zpcore/10/head 2025-09-07T07:36:20.1733187Z * [new branch] gh/zpcore/10/orig -> origin/gh/zpcore/10/orig 2025-09-07T07:36:20.1735017Z * [new branch] gh/zpcore/11/base -> origin/gh/zpcore/11/base 2025-09-07T07:36:20.1736220Z * [new branch] gh/zpcore/11/head -> origin/gh/zpcore/11/head 2025-09-07T07:36:20.1737415Z * [new branch] gh/zpcore/11/orig -> origin/gh/zpcore/11/orig 2025-09-07T07:36:20.1739265Z * [new branch] gh/zpcore/12/base -> origin/gh/zpcore/12/base 2025-09-07T07:36:20.1740618Z * [new branch] gh/zpcore/12/head -> origin/gh/zpcore/12/head 2025-09-07T07:36:20.1741859Z * [new branch] gh/zpcore/12/orig -> origin/gh/zpcore/12/orig 2025-09-07T07:36:20.1743589Z * [new branch] gh/zpcore/13/base -> origin/gh/zpcore/13/base 2025-09-07T07:36:20.1744799Z * [new branch] gh/zpcore/13/head -> origin/gh/zpcore/13/head 2025-09-07T07:36:20.1746066Z * [new branch] gh/zpcore/13/orig -> origin/gh/zpcore/13/orig 2025-09-07T07:36:20.1747840Z * [new branch] gh/zpcore/14/base -> origin/gh/zpcore/14/base 2025-09-07T07:36:20.1749243Z * [new branch] gh/zpcore/14/head -> origin/gh/zpcore/14/head 2025-09-07T07:36:20.1750958Z * [new branch] gh/zpcore/2/base -> origin/gh/zpcore/2/base 2025-09-07T07:36:20.1752267Z * [new branch] gh/zpcore/2/head -> origin/gh/zpcore/2/head 2025-09-07T07:36:20.1753830Z * [new branch] gh/zpcore/3/base -> origin/gh/zpcore/3/base 2025-09-07T07:36:20.1754957Z * [new branch] gh/zpcore/3/head -> origin/gh/zpcore/3/head 2025-09-07T07:36:20.1756518Z * [new branch] gh/zpcore/4/base -> origin/gh/zpcore/4/base 2025-09-07T07:36:20.1757819Z * [new branch] gh/zpcore/4/head -> origin/gh/zpcore/4/head 2025-09-07T07:36:20.1759347Z * [new branch] gh/zpcore/5/base -> origin/gh/zpcore/5/base 2025-09-07T07:36:20.1760488Z * [new branch] gh/zpcore/5/head -> origin/gh/zpcore/5/head 2025-09-07T07:36:20.1762045Z * [new branch] gh/zpcore/6/base -> origin/gh/zpcore/6/base 2025-09-07T07:36:20.1763190Z * [new branch] gh/zpcore/6/head -> origin/gh/zpcore/6/head 2025-09-07T07:36:20.1764750Z * [new branch] gh/zpcore/7/base -> origin/gh/zpcore/7/base 2025-09-07T07:36:20.1765948Z * [new branch] gh/zpcore/7/head -> origin/gh/zpcore/7/head 2025-09-07T07:36:20.1767723Z * [new branch] gh/zpcore/8/base -> origin/gh/zpcore/8/base 2025-09-07T07:36:20.1768808Z * [new branch] gh/zpcore/8/head -> origin/gh/zpcore/8/head 2025-09-07T07:36:20.1770196Z * [new branch] google-main -> origin/google-main 2025-09-07T07:36:20.1772025Z * [new branch] guangyey/external_stream -> origin/guangyey/external_stream 2025-09-07T07:36:20.1773174Z * [new branch] guangyey/host_alloc -> origin/guangyey/host_alloc 2025-09-07T07:36:20.1774266Z * [new branch] guangyey/reimport -> origin/guangyey/reimport 2025-09-07T07:36:20.1775306Z * [new branch] guangyey/test_2025 -> origin/guangyey/test_2025 2025-09-07T07:36:20.1777118Z * [new branch] guilhermeleobas/cherry-pick-55d87d9dfd9 -> origin/guilhermeleobas/cherry-pick-55d87d9dfd9 2025-09-07T07:36:20.1778708Z * [new branch] haozhe/bf16-dynamic-shape -> origin/haozhe/bf16-dynamic-shape 2025-09-07T07:36:20.1779950Z * [new branch] hc_baseline -> origin/hc_baseline 2025-09-07T07:36:20.1781249Z * [new branch] hf_update -> origin/hf_update 2025-09-07T07:36:20.1782432Z * [new branch] hhh_decomp_mul -> origin/hhh_decomp_mul 2025-09-07T07:36:20.1783820Z * [new branch] hhh_rand -> origin/hhh_rand 2025-09-07T07:36:20.1785568Z * [new branch] hoy/mmsplitk -> origin/hoy/mmsplitk 2025-09-07T07:36:20.1786784Z * [new branch] hoy/triton-PR3973 -> origin/hoy/triton-PR3973 2025-09-07T07:36:20.1788005Z * [new branch] hoy/triton-coalescing-baseline -> origin/hoy/triton-coalescing-baseline 2025-09-07T07:36:20.1789122Z * [new branch] hoy/triton-coalescing-new -> origin/hoy/triton-coalescing-new 2025-09-07T07:36:20.1790177Z * [new branch] hoy/triton-coalescing-vec -> origin/hoy/triton-coalescing-vec 2025-09-07T07:36:20.1791510Z * [new branch] inductordecompfix -> origin/inductordecompfix 2025-09-07T07:36:20.1792751Z * [new branch] inline -> origin/inline 2025-09-07T07:36:20.1793986Z * [new branch] inlining -> origin/inlining 2025-09-07T07:36:20.1795248Z * [new branch] inlining-ezyang -> origin/inlining-ezyang 2025-09-07T07:36:20.1796656Z * [new branch] install-torchao-0.13.0 -> origin/install-torchao-0.13.0 2025-09-07T07:36:20.1797802Z * [new branch] int8_sdpa -> origin/int8_sdpa 2025-09-07T07:36:20.1799102Z * [new branch] invoke-subgraph -> origin/invoke-subgraph 2025-09-07T07:36:20.1800360Z * [new branch] issue#58739 -> origin/issue#58739 2025-09-07T07:36:20.1802307Z * [new branch] jcaip/test-cusparselt-version-0.6.2 -> origin/jcaip/test-cusparselt-version-0.6.2 2025-09-07T07:36:20.1803374Z * [new branch] jcaip/update-cusparselt-0.6.2 -> origin/jcaip/update-cusparselt-0.6.2 2025-09-07T07:36:20.1805103Z * [new branch] jeanschmidt/disable_rocm_build_tests -> origin/jeanschmidt/disable_rocm_build_tests 2025-09-07T07:36:20.1806417Z * [new branch] jithunnair-amd-patch-1 -> origin/jithunnair-amd-patch-1 2025-09-07T07:36:20.1808140Z * [new branch] jithunnair-amd-patch-2 -> origin/jithunnair-amd-patch-2 2025-09-07T07:36:20.1809934Z * [new branch] justinchu/attention-tests -> origin/justinchu/attention-tests 2025-09-07T07:36:20.1811160Z * [new branch] justinchu/native-qdq -> origin/justinchu/native-qdq 2025-09-07T07:36:20.1812402Z * [new branch] justinchu/ort-122 -> origin/justinchu/ort-122 2025-09-07T07:36:20.1814077Z * [new branch] justinchuby/dynamo-true -> origin/justinchuby/dynamo-true 2025-09-07T07:36:20.1816334Z * [new branch] kainan666/xlf_debug -> origin/kainan666/xlf_debug 2025-09-07T07:36:20.1817440Z * [new branch] kainan_test -> origin/kainan_test 2025-09-07T07:36:20.1818828Z * [new branch] learnablebias -> origin/learnablebias 2025-09-07T07:36:20.1820621Z * [new branch] leslie/test_group_gemm_epilogues -> origin/leslie/test_group_gemm_epilogues 2025-09-07T07:36:20.1822315Z * [new branch] lessw2020/fix_cutlass_cache_error -> origin/lessw2020/fix_cutlass_cache_error 2025-09-07T07:36:20.1823935Z * [new branch] liaoxuan/shm_all_reduce -> origin/liaoxuan/shm_all_reduce 2025-09-07T07:36:20.1825079Z * [new branch] liaoxuan/test_fa_disable_softmax -> origin/liaoxuan/test_fa_disable_softmax 2025-09-07T07:36:20.1826206Z * [new branch] liaoxuan/test_int8_sdpa -> origin/liaoxuan/test_int8_sdpa 2025-09-07T07:36:20.1827460Z * [new branch] lintbuilddocker -> origin/lintbuilddocker 2025-09-07T07:36:20.1828540Z * [new branch] llama4-stable -> origin/llama4-stable 2025-09-07T07:36:20.1829883Z * [new branch] logdetfix -> origin/logdetfix 2025-09-07T07:36:20.1832068Z * [new branch] lts/release/1.8 -> origin/lts/release/1.8 2025-09-07T07:36:20.1833807Z * [new branch] lucaskabela/#94773 -> origin/lucaskabela/#94773 2025-09-07T07:36:20.1835025Z * [new branch] lucaskabela/flop_counter -> origin/lucaskabela/flop_counter 2025-09-07T07:36:20.1836182Z * [new branch] lucaskabela/func_under_decomp -> origin/lucaskabela/func_under_decomp 2025-09-07T07:36:20.1837356Z * [new branch] lucaskabela/functional_in_dynamo -> origin/lucaskabela/functional_in_dynamo 2025-09-07T07:36:20.1838483Z * [new branch] lucaskabela/install_params_as_graph_attr -> origin/lucaskabela/install_params_as_graph_attr 2025-09-07T07:36:20.1839619Z * [new branch] lucaskabela/issue_120648 -> origin/lucaskabela/issue_120648 2025-09-07T07:36:20.1841105Z * [new branch] lucaskabela/misc_typing_dynamo -> origin/lucaskabela/misc_typing_dynamo 2025-09-07T07:36:20.1842575Z * [new branch] lucaskabela/parameters_as_graph_attr -> origin/lucaskabela/parameters_as_graph_attr 2025-09-07T07:36:20.1843849Z * [new branch] lucaskabela/remove_aot_dispatcher_metadata -> origin/lucaskabela/remove_aot_dispatcher_metadata 2025-09-07T07:36:20.1844985Z * [new branch] lucaskabela/rnn_decomp -> origin/lucaskabela/rnn_decomp 2025-09-07T07:36:20.1846192Z * [new branch] lucaskabela/typing_backends -> origin/lucaskabela/typing_backends 2025-09-07T07:36:20.1847406Z * [new branch] lucaskabela/typing_symbolic_convert -> origin/lucaskabela/typing_symbolic_convert 2025-09-07T07:36:20.1848603Z * [new branch] lucaskabela/typing_utils_improvements -> origin/lucaskabela/typing_utils_improvements 2025-09-07T07:36:20.1849888Z * [new branch] main -> origin/main 2025-09-07T07:36:20.1851282Z * [new branch] main-enable-b200-distributed-tests -> origin/main-enable-b200-distributed-tests 2025-09-07T07:36:20.1852585Z * [new branch] malfet-patch-1 -> origin/malfet-patch-1 2025-09-07T07:36:20.1853927Z * [new branch] malfet-patch-12 -> origin/malfet-patch-12 2025-09-07T07:36:20.1855332Z * [new branch] malfet-patch-14 -> origin/malfet-patch-14 2025-09-07T07:36:20.1856646Z * [new branch] malfet-patch-6 -> origin/malfet-patch-6 2025-09-07T07:36:20.1857939Z * [new branch] malfet-patch-8 -> origin/malfet-patch-8 2025-09-07T07:36:20.1859836Z * [new branch] malfet/be-move-more-settings-to-checkout-pytorch -> origin/malfet/be-move-more-settings-to-checkout-pytorch 2025-09-07T07:36:20.1860853Z * [new branch] malfet/delete-upsteam-cuda -> origin/malfet/delete-upsteam-cuda 2025-09-07T07:36:20.1861940Z * [new branch] malfet/mps-implement-col2im -> origin/malfet/mps-implement-col2im 2025-09-07T07:36:20.1863668Z * [new branch] manuel/test-ops-common-allow-mps -> origin/manuel/test-ops-common-allow-mps 2025-09-07T07:36:20.1864857Z * [new branch] metascroy-patch-1 -> origin/metascroy-patch-1 2025-09-07T07:36:20.1866670Z * [new branch] mlazos/S429861-debug -> origin/mlazos/S429861-debug 2025-09-07T07:36:20.1867767Z * [new branch] mlazos/aa -> origin/mlazos/aa 2025-09-07T07:36:20.1868921Z * [new branch] mlazos/arg-renames -> origin/mlazos/arg-renames 2025-09-07T07:36:20.1870123Z * [new branch] mlazos/backup-test-branch -> origin/mlazos/backup-test-branch 2025-09-07T07:36:20.1871215Z * [new branch] mlazos/bad-cudagraphs -> origin/mlazos/bad-cudagraphs 2025-09-07T07:36:20.1872448Z * [new branch] mlazos/baseline -> origin/mlazos/baseline 2025-09-07T07:36:20.1873598Z * [new branch] mlazos/baseline-graph-breaks -> origin/mlazos/baseline-graph-breaks 2025-09-07T07:36:20.1874661Z * [new branch] mlazos/beta-tensor -> origin/mlazos/beta-tensor 2025-09-07T07:36:20.1876026Z * [new branch] mlazos/better-msg -> origin/mlazos/better-msg 2025-09-07T07:36:20.1877601Z * [new branch] mlazos/buffers -> origin/mlazos/buffers 2025-09-07T07:36:20.1878742Z * [new branch] mlazos/buffers2 -> origin/mlazos/buffers2 2025-09-07T07:36:20.1879952Z * [new branch] mlazos/buffers3 -> origin/mlazos/buffers3 2025-09-07T07:36:20.1881496Z * [new branch] mlazos/ck2 -> origin/mlazos/ck2 2025-09-07T07:36:20.1882781Z * [new branch] mlazos/combokernels -> origin/mlazos/combokernels 2025-09-07T07:36:20.1883988Z * [new branch] mlazos/ctx-cleanup -> origin/mlazos/ctx-cleanup 2025-09-07T07:36:20.1885241Z * [new branch] mlazos/cuda-cmd-log -> origin/mlazos/cuda-cmd-log 2025-09-07T07:36:20.1886488Z * [new branch] mlazos/cudagraph-tests -> origin/mlazos/cudagraph-tests 2025-09-07T07:36:20.1887699Z * [new branch] mlazos/cudagraphs-measurement -> origin/mlazos/cudagraphs-measurement 2025-09-07T07:36:20.1889065Z * [new branch] mlazos/cutlass-test -> origin/mlazos/cutlass-test 2025-09-07T07:36:20.1890270Z * [new branch] mlazos/cutlass-topo-bug -> origin/mlazos/cutlass-topo-bug 2025-09-07T07:36:20.1891410Z * [new branch] mlazos/data-gather -> origin/mlazos/data-gather 2025-09-07T07:36:20.1892678Z * [new branch] mlazos/data-ptrs2 -> origin/mlazos/data-ptrs2 2025-09-07T07:36:20.1893837Z * [new branch] mlazos/data-ptrs3 -> origin/mlazos/data-ptrs3 2025-09-07T07:36:20.1895053Z * [new branch] mlazos/dataclass-proxy -> origin/mlazos/dataclass-proxy 2025-09-07T07:36:20.1896265Z * [new branch] mlazos/dc-attrs -> origin/mlazos/dc-attrs 2025-09-07T07:36:20.1897439Z * [new branch] mlazos/dc-helion -> origin/mlazos/dc-helion 2025-09-07T07:36:20.1898537Z * [new branch] mlazos/dict-fix -> origin/mlazos/dict-fix 2025-09-07T07:36:20.1899841Z * [new branch] mlazos/disable-closures -> origin/mlazos/disable-closures 2025-09-07T07:36:20.1901018Z * [new branch] mlazos/disable-tf -> origin/mlazos/disable-tf 2025-09-07T07:36:20.1902054Z * [new branch] mlazos/dupe-fix -> origin/mlazos/dupe-fix 2025-09-07T07:36:20.1903277Z * [new branch] mlazos/dyn-batch -> origin/mlazos/dyn-batch 2025-09-07T07:36:20.1904566Z * [new branch] mlazos/evt -> origin/mlazos/evt 2025-09-07T07:36:20.1905826Z * [new branch] mlazos/exp_disable -> origin/mlazos/exp_disable 2025-09-07T07:36:20.1907502Z * [new branch] mlazos/extract-examples -> origin/mlazos/extract-examples 2025-09-07T07:36:20.1908704Z * [new branch] mlazos/foreach-op -> origin/mlazos/foreach-op 2025-09-07T07:36:20.1910000Z * [new branch] mlazos/fp8 -> origin/mlazos/fp8 2025-09-07T07:36:20.1911848Z * [new branch] mlazos/fp8-bias -> origin/mlazos/fp8-bias 2025-09-07T07:36:20.1913255Z * [new branch] mlazos/fp8-bias-fusion -> origin/mlazos/fp8-bias-fusion 2025-09-07T07:36:20.1914329Z * [new branch] mlazos/fp8-fixes -> origin/mlazos/fp8-fixes 2025-09-07T07:36:20.1915529Z * [new branch] mlazos/freezing -> origin/mlazos/freezing 2025-09-07T07:36:20.1916729Z * [new branch] mlazos/h-comp -> origin/mlazos/h-comp 2025-09-07T07:36:20.1918026Z * [new branch] mlazos/h-comp2 -> origin/mlazos/h-comp2 2025-09-07T07:36:20.1919221Z * [new branch] mlazos/hash-hop -> origin/mlazos/hash-hop 2025-09-07T07:36:20.1920455Z * [new branch] mlazos/hc -> origin/mlazos/hc 2025-09-07T07:36:20.1921726Z * [new branch] mlazos/hc-cycles -> origin/mlazos/hc-cycles 2025-09-07T07:36:20.1922941Z * [new branch] mlazos/hc-fixes -> origin/mlazos/hc-fixes 2025-09-07T07:36:20.1924153Z * [new branch] mlazos/hc-fixes3 -> origin/mlazos/hc-fixes3 2025-09-07T07:36:20.1925317Z * [new branch] mlazos/hc-fixes4 -> origin/mlazos/hc-fixes4 2025-09-07T07:36:20.1926500Z * [new branch] mlazos/hc-hf -> origin/mlazos/hc-hf 2025-09-07T07:36:20.1927665Z * [new branch] mlazos/hc-mut -> origin/mlazos/hc-mut 2025-09-07T07:36:20.1928913Z * [new branch] mlazos/hc10 -> origin/mlazos/hc10 2025-09-07T07:36:20.1930099Z * [new branch] mlazos/hc11 -> origin/mlazos/hc11 2025-09-07T07:36:20.1931269Z * [new branch] mlazos/hc12 -> origin/mlazos/hc12 2025-09-07T07:36:20.1932533Z * [new branch] mlazos/hc13 -> origin/mlazos/hc13 2025-09-07T07:36:20.1933712Z * [new branch] mlazos/hc14 -> origin/mlazos/hc14 2025-09-07T07:36:20.1934907Z * [new branch] mlazos/hc15 -> origin/mlazos/hc15 2025-09-07T07:36:20.1936174Z * [new branch] mlazos/hc2 -> origin/mlazos/hc2 2025-09-07T07:36:20.1937354Z * [new branch] mlazos/hc4 -> origin/mlazos/hc4 2025-09-07T07:36:20.1938549Z * [new branch] mlazos/hc5 -> origin/mlazos/hc5 2025-09-07T07:36:20.1939741Z * [new branch] mlazos/hc6 -> origin/mlazos/hc6 2025-09-07T07:36:20.1940938Z * [new branch] mlazos/hc7 -> origin/mlazos/hc7 2025-09-07T07:36:20.1942027Z * [new branch] mlazos/hc8 -> origin/mlazos/hc8 2025-09-07T07:36:20.1943209Z * [new branch] mlazos/hc9 -> origin/mlazos/hc9 2025-09-07T07:36:20.1944412Z * [new branch] mlazos/hc_baseline2 -> origin/mlazos/hc_baseline2 2025-09-07T07:36:20.1945601Z * [new branch] mlazos/init-per-param -> origin/mlazos/init-per-param 2025-09-07T07:36:20.1946899Z * [new branch] mlazos/init_per_param -> origin/mlazos/init_per_param 2025-09-07T07:36:20.1948277Z * [new branch] mlazos/less-guards -> origin/mlazos/less-guards 2025-09-07T07:36:20.1949654Z * [new branch] mlazos/lr-composibility -> origin/mlazos/lr-composibility 2025-09-07T07:36:20.1951108Z * [new branch] mlazos/main -> origin/mlazos/main 2025-09-07T07:36:20.1952033Z * [new branch] mlazos/main-test-enablement -> origin/mlazos/main-test-enablement 2025-09-07T07:36:20.1953265Z * [new branch] mlazos/main2 -> origin/mlazos/main2 2025-09-07T07:36:20.1954510Z * [new branch] mlazos/mark-static-update -> origin/mlazos/mark-static-update 2025-09-07T07:36:20.1955664Z * [new branch] mlazos/mcg -> origin/mlazos/mcg 2025-09-07T07:36:20.1956852Z * [new branch] mlazos/mcg2 -> origin/mlazos/mcg2 2025-09-07T07:36:20.1958072Z * [new branch] mlazos/meta-guards -> origin/mlazos/meta-guards 2025-09-07T07:36:20.1959705Z * [new branch] mlazos/mlazos/ck2 -> origin/mlazos/mlazos/ck2 2025-09-07T07:36:20.1960988Z * [new branch] mlazos/mlazos/foreach-map-adam -> origin/mlazos/mlazos/foreach-map-adam 2025-09-07T07:36:20.1962210Z * [new branch] mlazos/mlazos/tf-mode-backup -> origin/mlazos/mlazos/tf-mode-backup 2025-09-07T07:36:20.1963438Z * [new branch] mlazos/mod-fix -> origin/mlazos/mod-fix 2025-09-07T07:36:20.1964743Z * [new branch] mlazos/mode-fix -> origin/mlazos/mode-fix 2025-09-07T07:36:20.1966021Z * [new branch] mlazos/more-tests -> origin/mlazos/more-tests 2025-09-07T07:36:20.1967248Z * [new branch] mlazos/no-cpp -> origin/mlazos/no-cpp 2025-09-07T07:36:20.1968607Z * [new branch] mlazos/no-init-group-handling -> origin/mlazos/no-init-group-handling 2025-09-07T07:36:20.1969747Z * [new branch] mlazos/offsets -> origin/mlazos/offsets 2025-09-07T07:36:20.1971036Z * [new branch] mlazos/opt-bench-exp2 -> origin/mlazos/opt-bench-exp2 2025-09-07T07:36:20.1972215Z * [new branch] mlazos/opt-incr -> origin/mlazos/opt-incr 2025-09-07T07:36:20.1973405Z * [new branch] mlazos/proxy-ctors -> origin/mlazos/proxy-ctors 2025-09-07T07:36:20.1974639Z * [new branch] mlazos/quant-fix -> origin/mlazos/quant-fix 2025-09-07T07:36:20.1975870Z * [new branch] mlazos/resnet-fix -> origin/mlazos/resnet-fix 2025-09-07T07:36:20.1977095Z * [new branch] mlazos/revert-inline -> origin/mlazos/revert-inline 2025-09-07T07:36:20.1978292Z * [new branch] mlazos/rm-buf-names -> origin/mlazos/rm-buf-names 2025-09-07T07:36:20.1979576Z * [new branch] mlazos/rm-code -> origin/mlazos/rm-code 2025-09-07T07:36:20.1980750Z * [new branch] mlazos/rm-spam -> origin/mlazos/rm-spam 2025-09-07T07:36:20.1981956Z * [new branch] mlazos/rtp -> origin/mlazos/rtp 2025-09-07T07:36:20.1983185Z * [new branch] mlazos/static-idx-dbg -> origin/mlazos/static-idx-dbg 2025-09-07T07:36:20.1984403Z * [new branch] mlazos/static-inputs-log -> origin/mlazos/static-inputs-log 2025-09-07T07:36:20.1985687Z * [new branch] mlazos/sub-param-fix -> origin/mlazos/sub-param-fix 2025-09-07T07:36:20.1986926Z * [new branch] mlazos/td-fix2 -> origin/mlazos/td-fix2 2025-09-07T07:36:20.1988124Z * [new branch] mlazos/tensor-hasattr2 -> origin/mlazos/tensor-hasattr2 2025-09-07T07:36:20.1989319Z * [new branch] mlazos/test -> origin/mlazos/test 2025-09-07T07:36:20.1991014Z * [new branch] mlazos/tf-mode -> origin/mlazos/tf-mode 2025-09-07T07:36:20.1992262Z * [new branch] mlazos/tf-mode-backup2 -> origin/mlazos/tf-mode-backup2 2025-09-07T07:36:20.1993499Z * [new branch] mlazos/tf-mode-reland -> origin/mlazos/tf-mode-reland 2025-09-07T07:36:20.1995224Z * [new branch] mlazos/tf-mode-reland2 -> origin/mlazos/tf-mode-reland2 2025-09-07T07:36:20.1996485Z * [new branch] mlazos/tf-mode-reland3 -> origin/mlazos/tf-mode-reland3 2025-09-07T07:36:20.1997578Z * [new branch] mlazos/topo-fix -> origin/mlazos/topo-fix 2025-09-07T07:36:20.1998774Z * [new branch] mlazos/triton-no-epi -> origin/mlazos/triton-no-epi 2025-09-07T07:36:20.1999955Z * [new branch] mlazos/tune-proto -> origin/mlazos/tune-proto 2025-09-07T07:36:20.2001107Z * [new branch] mlazos/tuple-fixes -> origin/mlazos/tuple-fixes 2025-09-07T07:36:20.2002239Z * [new branch] mlazos/tuple-fixes2 -> origin/mlazos/tuple-fixes2 2025-09-07T07:36:20.2003474Z * [new branch] mlazos/tuple-handling -> origin/mlazos/tuple-handling 2025-09-07T07:36:20.2004652Z * [new branch] mlazos/user-streams -> origin/mlazos/user-streams 2025-09-07T07:36:20.2005898Z * [new branch] mlazos/vary-beta -> origin/mlazos/vary-beta 2025-09-07T07:36:20.2007078Z * [new branch] mlazos/vary-beta2 -> origin/mlazos/vary-beta2 2025-09-07T07:36:20.2008267Z * [new branch] mlazos/weird-perf1 -> origin/mlazos/weird-perf1 2025-09-07T07:36:20.2009755Z * [new branch] mm_out_dtype_compile -> origin/mm_out_dtype_compile 2025-09-07T07:36:20.2013533Z * [new branch] modify-setupvllm -> origin/modify-setupvllm 2025-09-07T07:36:20.2014809Z * [new branch] module-shim -> origin/module-shim 2025-09-07T07:36:20.2016102Z * [new branch] move-theme-out-docker -> origin/move-theme-out-docker 2025-09-07T07:36:20.2017862Z * [new branch] msaroufim/be1 -> origin/msaroufim/be1 2025-09-07T07:36:20.2019112Z * [new branch] msaroufim/cn_path -> origin/msaroufim/cn_path 2025-09-07T07:36:20.2020333Z * [new branch] msaroufim/dtensorfusedadam -> origin/msaroufim/dtensorfusedadam 2025-09-07T07:36:20.2021474Z * [new branch] msaroufim/reduce -> origin/msaroufim/reduce 2025-09-07T07:36:20.2023141Z * [new branch] mtia/basic-cmake -> origin/mtia/basic-cmake 2025-09-07T07:36:20.2024418Z * [new branch] muon_dev -> origin/muon_dev 2025-09-07T07:36:20.2025705Z * [new branch] muon_dev_1 -> origin/muon_dev_1 2025-09-07T07:36:20.2027130Z * [new branch] nativert_num_outputs -> origin/nativert_num_outputs 2025-09-07T07:36:20.2028522Z * [new branch] nativert_numoutputs -> origin/nativert_numoutputs 2025-09-07T07:36:20.2029775Z * [new branch] new-modifiy-setupvllm -> origin/new-modifiy-setupvllm 2025-09-07T07:36:20.2031014Z * [new branch] new-setupvllm -> origin/new-setupvllm 2025-09-07T07:36:20.2032354Z * [new branch] new_zeros_dtype -> origin/new_zeros_dtype 2025-09-07T07:36:20.2033605Z * [new branch] newtest-base -> origin/newtest-base 2025-09-07T07:36:20.2035289Z * [new branch] ngimel/cat_perf1 -> origin/ngimel/cat_perf1 2025-09-07T07:36:20.2036428Z * [new branch] ngimel/einsum_fix -> origin/ngimel/einsum_fix 2025-09-07T07:36:20.2037533Z * [new branch] ngimel/error_index_list -> origin/ngimel/error_index_list 2025-09-07T07:36:20.2038594Z * [new branch] ngimel/fabric_check -> origin/ngimel/fabric_check 2025-09-07T07:36:20.2039702Z * [new branch] ngimel/fabric_fix -> origin/ngimel/fabric_fix 2025-09-07T07:36:20.2040826Z * [new branch] ngimel/fix_driver_init_error -> origin/ngimel/fix_driver_init_error 2025-09-07T07:36:20.2042261Z * [new branch] ngimel/fix_nccl_segment_seg -> origin/ngimel/fix_nccl_segment_seg 2025-09-07T07:36:20.2043712Z * [new branch] ngimel/gg_new -> origin/ngimel/gg_new 2025-09-07T07:36:20.2045051Z * [new branch] ngimel/modeguard -> origin/ngimel/modeguard 2025-09-07T07:36:20.2047169Z * [new branch] ngimel/multicast_fix -> origin/ngimel/multicast_fix 2025-09-07T07:36:20.2048524Z * [new branch] ngimel/rocm_handle_type -> origin/ngimel/rocm_handle_type 2025-09-07T07:36:20.2049638Z * [new branch] ngimel/symm_handle_fabric -> origin/ngimel/symm_handle_fabric 2025-09-07T07:36:20.2050797Z * [new branch] ngimel/unbind_multimem -> origin/ngimel/unbind_multimem 2025-09-07T07:36:20.2052132Z * [new branch] nightly -> origin/nightly 2025-09-07T07:36:20.2053505Z * [new branch] nmacchioni-patch-10 -> origin/nmacchioni-patch-10 2025-09-07T07:36:20.2054843Z * [new branch] nmacchioni-patch-7 -> origin/nmacchioni-patch-7 2025-09-07T07:36:20.2056171Z * [new branch] nmacchioni-patch-8 -> origin/nmacchioni-patch-8 2025-09-07T07:36:20.2057512Z * [new branch] nmacchioni-patch-9 -> origin/nmacchioni-patch-9 2025-09-07T07:36:20.2059279Z * [new branch] nullplay/fuse_matmul -> origin/nullplay/fuse_matmul 2025-09-07T07:36:20.2060550Z * [new branch] nullplay_fuse_matmul -> origin/nullplay_fuse_matmul 2025-09-07T07:36:20.2062153Z * [new branch] one-off -> origin/one-off 2025-09-07T07:36:20.2064406Z * [new branch] orig/release/1.10 -> origin/orig/release/1.10 2025-09-07T07:36:20.2065797Z * [new branch] orig/release/1.11 -> origin/orig/release/1.11 2025-09-07T07:36:20.2067093Z * [new branch] orig/release/1.12 -> origin/orig/release/1.12 2025-09-07T07:36:20.2068469Z * [new branch] orig/release/1.13 -> origin/orig/release/1.13 2025-09-07T07:36:20.2069875Z * [new branch] orig/release/1.6 -> origin/orig/release/1.6 2025-09-07T07:36:20.2071284Z * [new branch] orig/release/1.7 -> origin/orig/release/1.7 2025-09-07T07:36:20.2073051Z * [new branch] orig/release/1.8 -> origin/orig/release/1.8 2025-09-07T07:36:20.2074343Z * [new branch] orig/release/1.9 -> origin/orig/release/1.9 2025-09-07T07:36:20.2075556Z * [new branch] orig/release/2.0 -> origin/orig/release/2.0 2025-09-07T07:36:20.2076777Z * [new branch] orig/release/2.1 -> origin/orig/release/2.1 2025-09-07T07:36:20.2078028Z * [new branch] orig/release/2.2 -> origin/orig/release/2.2 2025-09-07T07:36:20.2079206Z * [new branch] orig/release/2.3 -> origin/orig/release/2.3 2025-09-07T07:36:20.2080389Z * [new branch] orig/release/2.4 -> origin/orig/release/2.4 2025-09-07T07:36:20.2081706Z * [new branch] orig/release/2.5 -> origin/orig/release/2.5 2025-09-07T07:36:20.2082883Z * [new branch] orig/release/2.6 -> origin/orig/release/2.6 2025-09-07T07:36:20.2084327Z * [new branch] orig/release/2.7 -> origin/orig/release/2.7 2025-09-07T07:36:20.2085929Z * [new branch] orig/release/2.8 -> origin/orig/release/2.8 2025-09-07T07:36:20.2087706Z * [new branch] oulgen/fx_graph -> origin/oulgen/fx_graph 2025-09-07T07:36:20.2088959Z * [new branch] padded-tensor -> origin/padded-tensor 2025-09-07T07:36:20.2090269Z * [new branch] pca2 -> origin/pca2 2025-09-07T07:36:20.2091672Z * [new branch] pianpwk-patch-1 -> origin/pianpwk-patch-1 2025-09-07T07:36:20.2093489Z * [new branch] pianpwk/backed_size_oblivious_export -> origin/pianpwk/backed_size_oblivious_export 2025-09-07T07:36:20.2094632Z * [new branch] pianpwk/invalidate_fake_memo -> origin/pianpwk/invalidate_fake_memo 2025-09-07T07:36:20.2095658Z * [new branch] pianpwk/max_1_strides -> origin/pianpwk/max_1_strides 2025-09-07T07:36:20.2096775Z * [new branch] pianpwk/maybe_guard_rel -> origin/pianpwk/maybe_guard_rel 2025-09-07T07:36:20.2097879Z * [new branch] pianpwk/nonzero_memo -> origin/pianpwk/nonzero_memo 2025-09-07T07:36:20.2099321Z * [new branch] pianpwk/oblivious_reshape_view_better -> origin/pianpwk/oblivious_reshape_view_better 2025-09-07T07:36:20.2100805Z * [new branch] pianpwk/oblivious_slice_forward -> origin/pianpwk/oblivious_slice_forward 2025-09-07T07:36:20.2101990Z * [new branch] pianpwk/oblivious_where -> origin/pianpwk/oblivious_where 2025-09-07T07:36:20.2103299Z * [new branch] pianpwk/param_static_pgo -> origin/pianpwk/param_static_pgo 2025-09-07T07:36:20.2104476Z * [new branch] pianpwk/pre_forward_hook -> origin/pianpwk/pre_forward_hook 2025-09-07T07:36:20.2105797Z * [new branch] pianpwk/remove_guard_fail_break -> origin/pianpwk/remove_guard_fail_break 2025-09-07T07:36:20.2107069Z * [new branch] pianpwk/slice_fresh_symbols -> origin/pianpwk/slice_fresh_symbols 2025-09-07T07:36:20.2108203Z * [new branch] pianpwk/sym_tokens_draft -> origin/pianpwk/sym_tokens_draft 2025-09-07T07:36:20.2109572Z * [new branch] pianpwk/test_pointwise_guard_or_false -> origin/pianpwk/test_pointwise_guard_or_false 2025-09-07T07:36:20.2111044Z * [new branch] pianpwk/test_slice_fake_impl -> origin/pianpwk/test_slice_fake_impl 2025-09-07T07:36:20.2112256Z * [new branch] pianpwk/totally_draft_sym_wrap -> origin/pianpwk/totally_draft_sym_wrap 2025-09-07T07:36:20.2114448Z * [new branch] pianpwk/unbacked_channels_last -> origin/pianpwk/unbacked_channels_last 2025-09-07T07:36:20.2115716Z * [new branch] pianpwk/unbacked_safe_conv1d -> origin/pianpwk/unbacked_safe_conv1d 2025-09-07T07:36:20.2116870Z * [new branch] pianpwk/unbacked_sdpa_flash -> origin/pianpwk/unbacked_sdpa_flash 2025-09-07T07:36:20.2117273Z * [new branch] pianpwk/unbacked_should_swap -> origin/pianpwk/unbacked_should_swap 2025-09-07T07:36:20.2118500Z * [new branch] pianpwk/unbacked_should_swap_2 -> origin/pianpwk/unbacked_should_swap_2 2025-09-07T07:36:20.2119659Z * [new branch] pianpwk/unbacked_slice_binding -> origin/pianpwk/unbacked_slice_binding 2025-09-07T07:36:20.2120830Z * [new branch] pianpwk/unbacked_slice_forward -> origin/pianpwk/unbacked_slice_forward 2025-09-07T07:36:20.2121974Z * [new branch] pianpwk/user_symints -> origin/pianpwk/user_symints 2025-09-07T07:36:20.2123171Z * [new branch] pianpwk/wan21_reshape -> origin/pianpwk/wan21_reshape 2025-09-07T07:36:20.2124359Z * [new branch] pianpwk/whitelist_optimizer -> origin/pianpwk/whitelist_optimizer 2025-09-07T07:36:20.2125633Z * [new branch] pin-torchao -> origin/pin-torchao 2025-09-07T07:36:20.2127443Z * [new branch] piz/fall_back_missing_0716 -> origin/piz/fall_back_missing_0716 2025-09-07T07:36:20.2128530Z * [new branch] piz/improve_scatter_0808 -> origin/piz/improve_scatter_0808 2025-09-07T07:36:20.2129806Z * [new branch] pool-separate -> origin/pool-separate 2025-09-07T07:36:20.2131070Z * [new branch] pr-156087 -> origin/pr-156087 2025-09-07T07:36:20.2132818Z * [new branch] pr/131860 -> origin/pr/131860 2025-09-07T07:36:20.2134091Z * [new branch] predispatch_to -> origin/predispatch_to 2025-09-07T07:36:20.2135330Z * [new branch] pt-opt-cuda3 -> origin/pt-opt-cuda3 2025-09-07T07:36:20.2136588Z * [new branch] pyobjectslot -> origin/pyobjectslot 2025-09-07T07:36:20.2138135Z * [new branch] python_compiled_autograd -> origin/python_compiled_autograd 2025-09-07T07:36:20.2140165Z * [new branch] qchip/export-D54134695 -> origin/qchip/export-D54134695 2025-09-07T07:36:20.2141411Z * [new branch] quint-bits -> origin/quint-bits 2025-09-07T07:36:20.2143287Z * [new branch] release/1.10 -> origin/release/1.10 2025-09-07T07:36:20.2144511Z * [new branch] release/1.11 -> origin/release/1.11 2025-09-07T07:36:20.2145782Z * [new branch] release/1.12 -> origin/release/1.12 2025-09-07T07:36:20.2147053Z * [new branch] release/1.13 -> origin/release/1.13 2025-09-07T07:36:20.2148289Z * [new branch] release/1.4 -> origin/release/1.4 2025-09-07T07:36:20.2149504Z * [new branch] release/1.4.1 -> origin/release/1.4.1 2025-09-07T07:36:20.2150741Z * [new branch] release/1.5 -> origin/release/1.5 2025-09-07T07:36:20.2151980Z * [new branch] release/1.6 -> origin/release/1.6 2025-09-07T07:36:20.2153205Z * [new branch] release/1.7 -> origin/release/1.7 2025-09-07T07:36:20.2154497Z * [new branch] release/1.8 -> origin/release/1.8 2025-09-07T07:36:20.2155650Z * [new branch] release/1.9 -> origin/release/1.9 2025-09-07T07:36:20.2156876Z * [new branch] release/2.0 -> origin/release/2.0 2025-09-07T07:36:20.2158179Z * [new branch] release/2.1 -> origin/release/2.1 2025-09-07T07:36:20.2159332Z * [new branch] release/2.2 -> origin/release/2.2 2025-09-07T07:36:20.2160871Z * [new branch] release/2.3 -> origin/release/2.3 2025-09-07T07:36:20.2162416Z * [new branch] release/2.4 -> origin/release/2.4 2025-09-07T07:36:20.2164050Z * [new branch] release/2.5 -> origin/release/2.5 2025-09-07T07:36:20.2165794Z * [new branch] release/2.6 -> origin/release/2.6 2025-09-07T07:36:20.2167096Z * [new branch] release/2.7 -> origin/release/2.7 2025-09-07T07:36:20.2168417Z * [new branch] release/2.8 -> origin/release/2.8 2025-09-07T07:36:20.2169766Z * [new branch] release_notes -> origin/release_notes 2025-09-07T07:36:20.2171064Z * [new branch] remove-actionable-label -> origin/remove-actionable-label 2025-09-07T07:36:20.2172267Z * [new branch] remove-ao -> origin/remove-ao 2025-09-07T07:36:20.2173788Z * [new branch] removedeprecatedvllmtest -> origin/removedeprecatedvllmtest 2025-09-07T07:36:20.2175230Z * [new branch] replace-pytorch-labs-20250812-195836 -> origin/replace-pytorch-labs-20250812-195836 2025-09-07T07:36:20.2176364Z * [new branch] replace-pytorch-labs-20250812-200248 -> origin/replace-pytorch-labs-20250812-200248 2025-09-07T07:36:20.2177534Z * [new branch] replace-pytorch-labs-20250812-200324 -> origin/replace-pytorch-labs-20250812-200324 2025-09-07T07:36:20.2178813Z * [new branch] replace-pytorch-labs-20250812-204020 -> origin/replace-pytorch-labs-20250812-204020 2025-09-07T07:36:20.2180065Z * [new branch] replace-pytorch-labs-20250812-204125 -> origin/replace-pytorch-labs-20250812-204125 2025-09-07T07:36:20.2181306Z * [new branch] replace-pytorch-labs-20250812-205624 -> origin/replace-pytorch-labs-20250812-205624 2025-09-07T07:36:20.2184089Z * [new branch] revert-131069-gh/krzysztofjordan/1/head -> origin/revert-131069-gh/krzysztofjordan/1/head 2025-09-07T07:36:20.2187290Z * [new branch] revert-131469-gh/andrewor14/51/head -> origin/revert-131469-gh/andrewor14/51/head 2025-09-07T07:36:20.2190008Z * [new branch] revert-156870-gh/skarjala/3/head -> origin/revert-156870-gh/skarjala/3/head 2025-09-07T07:36:20.2191383Z * [new branch] revert-157914-cherry-pick-157503-by-pytorch_bot_bot_ -> origin/revert-157914-cherry-pick-157503-by-pytorch_bot_bot_ 2025-09-07T07:36:20.2192474Z * [new branch] rocm-monitoring -> origin/rocm-monitoring 2025-09-07T07:36:20.2194222Z * [new branch] ruisi/relax_memory -> origin/ruisi/relax_memory 2025-09-07T07:36:20.2195501Z * [new branch] run-torchbench-smoke-test-h100 -> origin/run-torchbench-smoke-test-h100 2025-09-07T07:36:20.2197344Z * [new branch] ryanguo99/cleanup-dynamo-expected-failures -> origin/ryanguo99/cleanup-dynamo-expected-failures 2025-09-07T07:36:20.2198384Z * [new branch] ryanguo99/fix-closure-var -> origin/ryanguo99/fix-closure-var 2025-09-07T07:36:20.2200233Z * [new branch] rzou/faketensor_bench -> origin/rzou/faketensor_bench 2025-09-07T07:36:20.2201410Z * [new branch] rzou/njt -> origin/rzou/njt 2025-09-07T07:36:20.2202596Z * [new branch] rzou/pca -> origin/rzou/pca 2025-09-07T07:36:20.2203756Z * [new branch] rzou/realprop -> origin/rzou/realprop 2025-09-07T07:36:20.2204852Z * [new branch] rzou/setup_context -> origin/rzou/setup_context 2025-09-07T07:36:20.2206733Z * [new branch] sanchitintel/refactor_aten_int8_woq_gemm -> origin/sanchitintel/refactor_aten_int8_woq_gemm 2025-09-07T07:36:20.2208011Z * [new branch] sanchitintel/weird_thing_with_test_cpu_select_algorithm -> origin/sanchitintel/weird_thing_with_test_cpu_select_algorithm 2025-09-07T07:36:20.2209228Z * [new branch] sapling-pr-archive-SS-JIA -> origin/sapling-pr-archive-SS-JIA 2025-09-07T07:36:20.2210590Z * [new branch] save -> origin/save 2025-09-07T07:36:20.2212288Z * [new branch] sdym/2.5.1 -> origin/sdym/2.5.1 2025-09-07T07:36:20.2213629Z * [new branch] seemethere-patch-1 -> origin/seemethere-patch-1 2025-09-07T07:36:20.2214824Z * [new branch] setupvllm -> origin/setupvllm 2025-09-07T07:36:20.2216538Z * [new branch] share_and_pin_fork -> origin/share_and_pin_fork 2025-09-07T07:36:20.2218269Z * [new branch] shengf/fx-xform-perf -> origin/shengf/fx-xform-perf 2025-09-07T07:36:20.2219643Z * [new branch] shikaili_fp8_allgather -> origin/shikaili_fp8_allgather 2025-09-07T07:36:20.2221006Z * [new branch] shoumikhin-patch-1 -> origin/shoumikhin-patch-1 2025-09-07T07:36:20.2222476Z * [new branch] shoumikhin-patch-12 -> origin/shoumikhin-patch-12 2025-09-07T07:36:20.2223808Z * [new branch] simplify-fq-per-channel -> origin/simplify-fq-per-channel 2025-09-07T07:36:20.2225115Z * [new branch] solve-accuracy-fix -> origin/solve-accuracy-fix 2025-09-07T07:36:20.2226865Z * [new branch] soulitzer/stash-tls-ac -> origin/soulitzer/stash-tls-ac 2025-09-07T07:36:20.2228689Z * [new branch] sqzhang/flight4 -> origin/sqzhang/flight4 2025-09-07T07:36:20.2229888Z * [new branch] sqzhang/flight4plus -> origin/sqzhang/flight4plus 2025-09-07T07:36:20.2231596Z * [new branch] sraikund/record_funct_test -> origin/sraikund/record_funct_test 2025-09-07T07:36:20.2233293Z * [new branch] sraikund16/test -> origin/sraikund16/test 2025-09-07T07:36:20.2234686Z * [new branch] stablize-compilation-time -> origin/stablize-compilation-time 2025-09-07T07:36:20.2235925Z * [new branch] standalone-templates -> origin/standalone-templates 2025-09-07T07:36:20.2237507Z * [new branch] standalone_package_weights -> origin/standalone_package_weights 2025-09-07T07:36:20.2238600Z * [new branch] starterTaskUpdate -> origin/starterTaskUpdate 2025-09-07T07:36:20.2239820Z * [new branch] subgraph_fuse -> origin/subgraph_fuse 2025-09-07T07:36:20.2241198Z * [new branch] support-uv-in-collect_env -> origin/support-uv-in-collect_env 2025-09-07T07:36:20.2242386Z * [new branch] sve-poc -> origin/sve-poc 2025-09-07T07:36:20.2243629Z * [new branch] svekars-patch-1 -> origin/svekars-patch-1 2025-09-07T07:36:20.2244942Z * [new branch] switch-bn -> origin/switch-bn 2025-09-07T07:36:20.2246335Z * [new branch] sympy-bottleneck-repro -> origin/sympy-bottleneck-repro 2025-09-07T07:36:20.2248021Z * [new branch] tenpercent/ck_rocm_ci_v3 -> origin/tenpercent/ck_rocm_ci_v3 2025-09-07T07:36:20.2249318Z * [new branch] tensordict_integration -> origin/tensordict_integration 2025-09-07T07:36:20.2250475Z * [new branch] test-7054 -> origin/test-7054 2025-09-07T07:36:20.2251912Z * [new branch] test-move-conda-builds -> origin/test-move-conda-builds 2025-09-07T07:36:20.2253247Z * [new branch] test-myst-markdown-docstring -> origin/test-myst-markdown-docstring 2025-09-07T07:36:20.2254413Z * [new branch] test-old -> origin/test-old 2025-09-07T07:36:20.2255770Z * [new branch] test-vec-migration-internally -> origin/test-vec-migration-internally 2025-09-07T07:36:20.2257639Z * [new branch] test/bmm_heur -> origin/test/bmm_heur 2025-09-07T07:36:20.2259255Z * [new branch] test/inductor -> origin/test/inductor 2025-09-07T07:36:20.2260991Z * [new branch] tianren/flex_paged_attn_fix -> origin/tianren/flex_paged_attn_fix 2025-09-07T07:36:20.2262253Z * [new branch] tianren/flex_paged_attn_fix_temp -> origin/tianren/flex_paged_attn_fix_temp 2025-09-07T07:36:20.2263281Z * [new branch] tianren/test -> origin/tianren/test 2025-09-07T07:36:20.2264540Z * [new branch] tidy_performance_cyy -> origin/tidy_performance_cyy 2025-09-07T07:36:20.2265813Z * [new branch] torchtitan_ep -> origin/torchtitan_ep 2025-09-07T07:36:20.2267276Z * [new branch] trace_fsdp_torchtune_lora -> origin/trace_fsdp_torchtune_lora 2025-09-07T07:36:20.2268542Z * [new branch] traceable_fsdp_unit_tests -> origin/traceable_fsdp_unit_tests 2025-09-07T07:36:20.2269799Z * [new branch] tree_loop_vec_base -> origin/tree_loop_vec_base 2025-09-07T07:36:20.2271095Z * [new branch] tree_vec_base -> origin/tree_vec_base 2025-09-07T07:36:20.2272403Z * [new branch] triton-update -> origin/triton-update 2025-09-07T07:36:20.2273618Z * [new branch] triton_kernel -> origin/triton_kernel 2025-09-07T07:36:20.2274765Z * [new branch] triton_kernel_perf -> origin/triton_kernel_perf 2025-09-07T07:36:20.2276503Z * [new branch] tt_pkg_1908 -> origin/tt_pkg_1908 2025-09-07T07:36:20.2277882Z * [new branch] tweak-transformer-dependabot -> origin/tweak-transformer-dependabot 2025-09-07T07:36:20.2279046Z * [new branch] type_dec -> origin/type_dec 2025-09-07T07:36:20.2280406Z * [new branch] udate-sphinx-dependancies -> origin/udate-sphinx-dependancies 2025-09-07T07:36:20.2282168Z * [new branch] update-audio-commit-hash/16818882925-1712-1 -> origin/update-audio-commit-hash/16818882925-1712-1 2025-09-07T07:36:20.2283320Z * [new branch] update-audio-commit-hash/16895560422-1720-1 -> origin/update-audio-commit-hash/16895560422-1720-1 2025-09-07T07:36:20.2284544Z * [new branch] update-audio-commit-hash/16924174496-1738-1 -> origin/update-audio-commit-hash/16924174496-1738-1 2025-09-07T07:36:20.2285656Z * [new branch] update-audio-commit-hash/17002010821-1749-1 -> origin/update-audio-commit-hash/17002010821-1749-1 2025-09-07T07:36:20.2286856Z * [new branch] update-audio-commit-hash/17056004427-1766-1 -> origin/update-audio-commit-hash/17056004427-1766-1 2025-09-07T07:36:20.2288278Z * [new branch] update-audio-commit-hash/17085054029-1767-1 -> origin/update-audio-commit-hash/17085054029-1767-1 2025-09-07T07:36:20.2289697Z * [new branch] update-audio-commit-hash/17142507405-1771-1 -> origin/update-audio-commit-hash/17142507405-1771-1 2025-09-07T07:36:20.2291335Z * [new branch] update-audio-commit-hash/17168762740-1773-1 -> origin/update-audio-commit-hash/17168762740-1773-1 2025-09-07T07:36:20.2292516Z * [new branch] update-audio-commit-hash/17311174639-1780-1 -> origin/update-audio-commit-hash/17311174639-1780-1 2025-09-07T07:36:20.2293728Z * [new branch] update-audio-commit-hash/17336898740-1781-1 -> origin/update-audio-commit-hash/17336898740-1781-1 2025-09-07T07:36:20.2294915Z * [new branch] update-audio-commit-hash/17389727684-1786-1 -> origin/update-audio-commit-hash/17389727684-1786-1 2025-09-07T07:36:20.2296188Z * [new branch] update-audio-commit-hash/17449538142-1790-1 -> origin/update-audio-commit-hash/17449538142-1790-1 2025-09-07T07:36:20.2297386Z * [new branch] update-audio-commit-hash/17507351808-1794-1 -> origin/update-audio-commit-hash/17507351808-1794-1 2025-09-07T07:36:20.2298544Z * [new branch] update-dynamic-shapes-doc -> origin/update-dynamic-shapes-doc 2025-09-07T07:36:20.2300419Z * [new branch] update-executorch-commit-hash/15694981040-1626-1 -> origin/update-executorch-commit-hash/15694981040-1626-1 2025-09-07T07:36:20.2302448Z * [new branch] update-triton-commit-hash/13663274526-1487-2 -> origin/update-triton-commit-hash/13663274526-1487-2 2025-09-07T07:36:20.2304122Z * [new branch] update-vision-commit-hash/15336342773-1607-1 -> origin/update-vision-commit-hash/15336342773-1607-1 2025-09-07T07:36:20.2305901Z * [new branch] update-vllm-commit-hash/16737365217-1704-1 -> origin/update-vllm-commit-hash/16737365217-1704-1 2025-09-07T07:36:20.2307060Z * [new branch] update-vllm-commit-hash/16843157111-1713-1 -> origin/update-vllm-commit-hash/16843157111-1713-1 2025-09-07T07:36:20.2308158Z * [new branch] update-vllm-commit-hash/16855312394-1714-1 -> origin/update-vllm-commit-hash/16855312394-1714-1 2025-09-07T07:36:20.2309274Z * [new branch] update-vllm-commit-hash/16924174496-1738-1 -> origin/update-vllm-commit-hash/16924174496-1738-1 2025-09-07T07:36:20.2310613Z * [new branch] update-vllm-commit-hash/16952608705-1745-1 -> origin/update-vllm-commit-hash/16952608705-1745-1 2025-09-07T07:36:20.2312111Z * [new branch] update-vllm-commit-hash/16979836546-1748-1 -> origin/update-vllm-commit-hash/16979836546-1748-1 2025-09-07T07:36:20.2313603Z * [new branch] update-vllm-commit-hash/17014576881-1756-1 -> origin/update-vllm-commit-hash/17014576881-1756-1 2025-09-07T07:36:20.2315149Z * [new branch] update-vllm-commit-hash/17027830869-1761-1 -> origin/update-vllm-commit-hash/17027830869-1761-1 2025-09-07T07:36:20.2316347Z * [new branch] update-vllm-commit-hash/17056004427-1766-1 -> origin/update-vllm-commit-hash/17056004427-1766-1 2025-09-07T07:36:20.2317510Z * [new branch] update-vllm-commit-hash/17085054029-1767-1 -> origin/update-vllm-commit-hash/17085054029-1767-1 2025-09-07T07:36:20.2318692Z * [new branch] update-vllm-commit-hash/17113610216-1768-1 -> origin/update-vllm-commit-hash/17113610216-1768-1 2025-09-07T07:36:20.2319992Z * [new branch] update-vllm-commit-hash/17142507405-1771-1 -> origin/update-vllm-commit-hash/17142507405-1771-1 2025-09-07T07:36:20.2321089Z * [new branch] update-vllm-commit-hash/17181878974-1774-1 -> origin/update-vllm-commit-hash/17181878974-1774-1 2025-09-07T07:36:20.2322272Z * [new branch] update-vllm-commit-hash/17311174639-1780-1 -> origin/update-vllm-commit-hash/17311174639-1780-1 2025-09-07T07:36:20.2323461Z * [new branch] update-vllm-commit-hash/17336898740-1781-1 -> origin/update-vllm-commit-hash/17336898740-1781-1 2025-09-07T07:36:20.2324648Z * [new branch] update-vllm-commit-hash/17364352302-1785-1 -> origin/update-vllm-commit-hash/17364352302-1785-1 2025-09-07T07:36:20.2325944Z * [new branch] update-vllm-commit-hash/17389727684-1786-1 -> origin/update-vllm-commit-hash/17389727684-1786-1 2025-09-07T07:36:20.2327172Z * [new branch] update-vllm-commit-hash/17449538142-1790-1 -> origin/update-vllm-commit-hash/17449538142-1790-1 2025-09-07T07:36:20.2328372Z * [new branch] update-vllm-commit-hash/17480069797-1791-1 -> origin/update-vllm-commit-hash/17480069797-1791-1 2025-09-07T07:36:20.2329503Z * [new branch] update-vllm-commit-hash/17507351808-1794-1 -> origin/update-vllm-commit-hash/17507351808-1794-1 2025-09-07T07:36:20.2331300Z * [new branch] update-xla-commit-hash/16873912760-198-1 -> origin/update-xla-commit-hash/16873912760-198-1 2025-09-07T07:36:20.2332474Z * [new branch] update-xla-commit-hash/17034266655-199-1 -> origin/update-xla-commit-hash/17034266655-199-1 2025-09-07T07:36:20.2333610Z * [new branch] update-xla-commit-hash/17202464405-200-1 -> origin/update-xla-commit-hash/17202464405-200-1 2025-09-07T07:36:20.2334942Z * [new branch] update_docs_torch_multinomial_issue#125388 -> origin/update_docs_torch_multinomial_issue#125388 2025-09-07T07:36:20.2336113Z * [new branch] update_executorch_pin -> origin/update_executorch_pin 2025-09-07T07:36:20.2337484Z * [new branch] update_slow_tests_1722488736 -> origin/update_slow_tests_1722488736 2025-09-07T07:36:20.2338723Z * [new branch] update_slow_tests_1722879173 -> origin/update_slow_tests_1722879173 2025-09-07T07:36:20.2339956Z * [new branch] update_slow_tests_1752478971 -> origin/update_slow_tests_1752478971 2025-09-07T07:36:20.2341205Z * [new branch] update_slow_tests_1755502951 -> origin/update_slow_tests_1755502951 2025-09-07T07:36:20.2342428Z * [new branch] update_slow_tests_1756107664 -> origin/update_slow_tests_1756107664 2025-09-07T07:36:20.2343717Z * [new branch] update_submodule_FBGEMM -> origin/update_submodule_FBGEMM 2025-09-07T07:36:20.2344958Z * [new branch] update_submodule_kineto -> origin/update_submodule_kineto 2025-09-07T07:36:20.2346303Z * [new branch] update_submodule_tensorpipe -> origin/update_submodule_tensorpipe 2025-09-07T07:36:20.2347642Z * [new branch] v0.1.2 -> origin/v0.1.2 2025-09-07T07:36:20.2348993Z * [new branch] v1.0.1 -> origin/v1.0.1 2025-09-07T07:36:20.2350322Z * [new branch] v1.0.3 -> origin/v1.0.3 2025-09-07T07:36:20.2351596Z * [new branch] v1.1.0 -> origin/v1.1.0 2025-09-07T07:36:20.2353008Z * [new branch] v1.2.0 -> origin/v1.2.0 2025-09-07T07:36:20.2354324Z * [new branch] v1.3.0 -> origin/v1.3.0 2025-09-07T07:36:20.2355675Z * [new branch] v1.3.1 -> origin/v1.3.1 2025-09-07T07:36:20.2356978Z * [new branch] validate_fn -> origin/validate_fn 2025-09-07T07:36:20.2358510Z * [new branch] validations_2.6 -> origin/validations_2.6 2025-09-07T07:36:20.2359856Z * [new branch] validations_2.8 -> origin/validations_2.8 2025-09-07T07:36:20.2361701Z * [new branch] viable/strict -> origin/viable/strict 2025-09-07T07:36:20.2362897Z * [new branch] vllmbuildci -> origin/vllmbuildci 2025-09-07T07:36:20.2364223Z * [new branch] vllmpin -> origin/vllmpin 2025-09-07T07:36:20.2365923Z * [new branch] wdvr/conda_devcontainer -> origin/wdvr/conda_devcontainer 2025-09-07T07:36:20.2367025Z * [new branch] wdvr/iss_145259 -> origin/wdvr/iss_145259 2025-09-07T07:36:20.2368445Z * [new branch] weight_sharing_cpp -> origin/weight_sharing_cpp 2025-09-07T07:36:20.2370359Z * [new branch] whc/flight4 -> origin/whc/flight4 2025-09-07T07:36:20.2371714Z * [new branch] whc/flight51 -> origin/whc/flight51 2025-09-07T07:36:20.2372882Z * [new branch] whc/flight53 -> origin/whc/flight53 2025-09-07T07:36:20.2374080Z * [new branch] whc/stage2 -> origin/whc/stage2 2025-09-07T07:36:20.2375205Z * [new branch] whc/uneven -> origin/whc/uneven 2025-09-07T07:36:20.2376725Z * [new branch] whc/uneven-merge -> origin/whc/uneven-merge 2025-09-07T07:36:20.2377968Z * [new branch] win_warnings -> origin/win_warnings 2025-09-07T07:36:20.2379582Z * [new branch] windows_libtorch_free -> origin/windows_libtorch_free 2025-09-07T07:36:20.2380784Z * [new branch] workonoldcommit -> origin/workonoldcommit 2025-09-07T07:36:20.2382280Z * [new branch] wychi-autotune-prune-configs-by-shared-mem -> origin/wychi-autotune-prune-configs-by-shared-mem 2025-09-07T07:36:20.2384271Z * [new branch] xmfan/ca_0516 -> origin/xmfan/ca_0516 2025-09-07T07:36:20.2385450Z * [new branch] xmfan/ca_1051b93192 -> origin/xmfan/ca_1051b93192 2025-09-07T07:36:20.2386739Z * [new branch] xmfan/ca_1a722f62c248391fc4a542e8851a5559aa356ae8 -> origin/xmfan/ca_1a722f62c248391fc4a542e8851a5559aa356ae8 2025-09-07T07:36:20.2387685Z * [new branch] xmfan/ca_5a2be192d1 -> origin/xmfan/ca_5a2be192d1 2025-09-07T07:36:20.2388802Z * [new branch] xmfan/ca_9d59b516e9 -> origin/xmfan/ca_9d59b516e9 2025-09-07T07:36:20.2389992Z * [new branch] xmfan/ca_api -> origin/xmfan/ca_api 2025-09-07T07:36:20.2391158Z * [new branch] xmfan/ca_apr8 -> origin/xmfan/ca_apr8 2025-09-07T07:36:20.2392732Z * [new branch] xmfan/ca_base -> origin/xmfan/ca_base 2025-09-07T07:36:20.2394235Z * [new branch] xmfan/ca_cudagraphs -> origin/xmfan/ca_cudagraphs 2025-09-07T07:36:20.2395440Z * [new branch] xmfan/ca_dynamic -> origin/xmfan/ca_dynamic 2025-09-07T07:36:20.2396587Z * [new branch] xmfan/ca_fix_dyn -> origin/xmfan/ca_fix_dyn 2025-09-07T07:36:20.2397786Z * [new branch] xmfan/ca_fix_lowering -> origin/xmfan/ca_fix_lowering 2025-09-07T07:36:20.2398974Z * [new branch] xmfan/ca_fix_polyfills -> origin/xmfan/ca_fix_polyfills 2025-09-07T07:36:20.2400062Z * [new branch] xmfan/ca_jan3 -> origin/xmfan/ca_jan3 2025-09-07T07:36:20.2401245Z * [new branch] xmfan/ca_jun18 -> origin/xmfan/ca_jun18 2025-09-07T07:36:20.2402513Z * [new branch] xmfan/ca_jun24 -> origin/xmfan/ca_jun24 2025-09-07T07:36:20.2403717Z * [new branch] xmfan/ca_mem_base -> origin/xmfan/ca_mem_base 2025-09-07T07:36:20.2404866Z * [new branch] xmfan/ca_mem_fix -> origin/xmfan/ca_mem_fix 2025-09-07T07:36:20.2406054Z * [new branch] xmfan/ca_memory_fix -> origin/xmfan/ca_memory_fix 2025-09-07T07:36:20.2407269Z * [new branch] xmfan/ca_memory_fix_rebased -> origin/xmfan/ca_memory_fix_rebased 2025-09-07T07:36:20.2408539Z * [new branch] xmfan/ca_memory_fix_rebased2 -> origin/xmfan/ca_memory_fix_rebased2 2025-09-07T07:36:20.2409753Z * [new branch] xmfan/ca_move_to_cuda -> origin/xmfan/ca_move_to_cuda 2025-09-07T07:36:20.2413947Z * [new branch] xmfan/ca_nested -> origin/xmfan/ca_nested 2025-09-07T07:36:20.2415171Z * [new branch] xmfan/ca_overhead -> origin/xmfan/ca_overhead 2025-09-07T07:36:20.2416479Z * [new branch] xmfan/ca_overhead_0eba7e5451 -> origin/xmfan/ca_overhead_0eba7e5451 2025-09-07T07:36:20.2417615Z * [new branch] xmfan/ca_scalar -> origin/xmfan/ca_scalar 2025-09-07T07:36:20.2418841Z * [new branch] xmfan/ca_subclass_mem_fix -> origin/xmfan/ca_subclass_mem_fix 2025-09-07T07:36:20.2419985Z * [new branch] xmfan/ca_warm_mem -> origin/xmfan/ca_warm_mem 2025-09-07T07:36:20.2421169Z * [new branch] xmfan/ca_warm_mem_base -> origin/xmfan/ca_warm_mem_base 2025-09-07T07:36:20.2422313Z * [new branch] xmfan/cacu_jun18 -> origin/xmfan/cacu_jun18 2025-09-07T07:36:20.2423486Z * [new branch] xmfan/cacu_jun19 -> origin/xmfan/cacu_jun19 2025-09-07T07:36:20.2424707Z * [new branch] xmfan/cacu_jun4 -> origin/xmfan/cacu_jun4 2025-09-07T07:36:20.2426129Z * [new branch] xmfan/cacu_may27 -> origin/xmfan/cacu_may27 2025-09-07T07:36:20.2427400Z * [new branch] xmfan/disable_duck_shape -> origin/xmfan/disable_duck_shape 2025-09-07T07:36:20.2428624Z * [new branch] xmfan/fca_cpp_node_passthrough -> origin/xmfan/fca_cpp_node_passthrough 2025-09-07T07:36:20.2429778Z * [new branch] xmfan/issue_123374 -> origin/xmfan/issue_123374 2025-09-07T07:36:20.2431114Z * [new branch] xmfan/post_3945954741e2d37023c5d6954f9483008e0892f9 -> origin/xmfan/post_3945954741e2d37023c5d6954f9483008e0892f9 2025-09-07T07:36:20.2432339Z * [new branch] xmfan/pre_3945954741e2d37023c5d6954f9483008e0892f9 -> origin/xmfan/pre_3945954741e2d37023c5d6954f9483008e0892f9 2025-09-07T07:36:20.2433441Z * [new branch] xmfan/segfault_test -> origin/xmfan/segfault_test 2025-09-07T07:36:20.2434624Z * [new branch] xmfan/single_step -> origin/xmfan/single_step 2025-09-07T07:36:20.2435796Z * [new branch] xmfan/sth_0829 -> origin/xmfan/sth_0829 2025-09-07T07:36:20.2437050Z * [new branch] xmfan/test -> origin/xmfan/test 2025-09-07T07:36:20.2438806Z * [new branch] yguo/debug-0226-constexpr -> origin/yguo/debug-0226-constexpr 2025-09-07T07:36:20.2439921Z * [new branch] yguo/new_latest_changes -> origin/yguo/new_latest_changes 2025-09-07T07:36:20.2441056Z * [new branch] yguo/patch_constexpr_changes -> origin/yguo/patch_constexpr_changes 2025-09-07T07:36:20.2442322Z * [new branch] yihan_quantization -> origin/yihan_quantization 2025-09-07T07:36:20.2444049Z * [new branch] yiming/add_jit_trace_benchmark -> origin/yiming/add_jit_trace_benchmark 2025-09-07T07:36:20.2445146Z * [new branch] yiming/add_nativert_benchmark -> origin/yiming/add_nativert_benchmark 2025-09-07T07:36:20.2446244Z * [new branch] yiming/bootcamp -> origin/yiming/bootcamp 2025-09-07T07:36:20.2447956Z * [new branch] zainr/canary-test -> origin/zainr/canary-test 2025-09-07T07:36:20.2449235Z * [new branch] zainr/cleanup-gh-runners -> origin/zainr/cleanup-gh-runners 2025-09-07T07:36:20.2450418Z * [new branch] zainr/git-push-v2 -> origin/zainr/git-push-v2 2025-09-07T07:36:20.2451550Z * [new branch] zainr/pull-migration-c -> origin/zainr/pull-migration-c 2025-09-07T07:36:20.2452812Z * [new branch] zainr/test -> origin/zainr/test 2025-09-07T07:36:20.2454034Z * [new branch] zainr/test2 -> origin/zainr/test2 2025-09-07T07:36:20.2455052Z * [new branch] zainr/unstable -> origin/zainr/unstable 2025-09-07T07:36:20.2456191Z * [new branch] zainr/unstable-xla -> origin/zainr/unstable-xla 2025-09-07T07:36:20.2457730Z * [new branch] zasdfgbnm-patch-3 -> origin/zasdfgbnm-patch-3 2025-09-07T07:36:20.2458944Z * [new branch] zb2p -> origin/zb2p 2025-09-07T07:36:20.2460255Z * [new branch] zero_grad_optimization -> origin/zero_grad_optimization 2025-09-07T07:36:20.2461489Z * [new branch] zeros-and-scatter-part2 -> origin/zeros-and-scatter-part2 2025-09-07T07:36:20.2463574Z * [new branch] zhxchen17/scratch/0 -> origin/zhxchen17/scratch/0 2025-09-07T07:36:20.2465357Z * [new branch] zhxhcen17/moodycamel -> origin/zhxhcen17/moodycamel 2025-09-07T07:36:20.2467275Z * [new branch] zxiiro/main -> origin/zxiiro/main 2025-09-07T07:36:20.2468458Z * [new tag] bc2caa7fdf006894eff7af936babde69ab5a40f8-huydhn-debug -> bc2caa7fdf006894eff7af936babde69ab5a40f8-huydhn-debug 2025-09-07T07:36:20.2469537Z * [new tag] ci/binaries/77164 -> ci/binaries/77164 2025-09-07T07:36:20.2470687Z * [new tag] ciflow/binaries/156049 -> ciflow/binaries/156049 2025-09-07T07:36:20.2471411Z * [new tag] ciflow/binaries/156712 -> ciflow/binaries/156712 2025-09-07T07:36:20.2472248Z * [new tag] ciflow/binaries/157432 -> ciflow/binaries/157432 2025-09-07T07:36:20.2472969Z * [new tag] ciflow/binaries/157685 -> ciflow/binaries/157685 2025-09-07T07:36:20.2473742Z * [new tag] ciflow/binaries/157689 -> ciflow/binaries/157689 2025-09-07T07:36:20.2474555Z * [new tag] ciflow/binaries/158104 -> ciflow/binaries/158104 2025-09-07T07:36:20.2475474Z * [new tag] ciflow/binaries/160229 -> ciflow/binaries/160229 2025-09-07T07:36:20.2476341Z * [new tag] ciflow/binaries/160720 -> ciflow/binaries/160720 2025-09-07T07:36:20.2477029Z * [new tag] ciflow/binaries/162080 -> ciflow/binaries/162080 2025-09-07T07:36:20.2477751Z * [new tag] ciflow/binaries/162329 -> ciflow/binaries/162329 2025-09-07T07:36:20.2478818Z * [new tag] ciflow/binaries_libtorch/156049 -> ciflow/binaries_libtorch/156049 2025-09-07T07:36:20.2479549Z * [new tag] ciflow/binaries_libtorch/156711 -> ciflow/binaries_libtorch/156711 2025-09-07T07:36:20.2480302Z * [new tag] ciflow/binaries_libtorch/157432 -> ciflow/binaries_libtorch/157432 2025-09-07T07:36:20.2481292Z * [new tag] ciflow/binaries_wheel/156049 -> ciflow/binaries_wheel/156049 2025-09-07T07:36:20.2482015Z * [new tag] ciflow/binaries_wheel/156711 -> ciflow/binaries_wheel/156711 2025-09-07T07:36:20.2482746Z * [new tag] ciflow/binaries_wheel/157432 -> ciflow/binaries_wheel/157432 2025-09-07T07:36:20.2483601Z * [new tag] ciflow/binaries_wheel/162136 -> ciflow/binaries_wheel/162136 2025-09-07T07:36:20.2484339Z * [new tag] ciflow/binaries_wheel/162252 -> ciflow/binaries_wheel/162252 2025-09-07T07:36:20.2485178Z * [new tag] ciflow/binaries_wheel/162325 -> ciflow/binaries_wheel/162325 2025-09-07T07:36:20.2486223Z * [new tag] ciflow/h100-distributed/156703 -> ciflow/h100-distributed/156703 2025-09-07T07:36:20.2487243Z * [new tag] ciflow/h100-symm-mem/157635 -> ciflow/h100-symm-mem/157635 2025-09-07T07:36:20.2488062Z * [new tag] ciflow/h100-symm-mem/161984 -> ciflow/h100-symm-mem/161984 2025-09-07T07:36:20.2488787Z * [new tag] ciflow/h100-symm-mem/162003 -> ciflow/h100-symm-mem/162003 2025-09-07T07:36:20.2489710Z * [new tag] ciflow/h100-symm-mem/162011 -> ciflow/h100-symm-mem/162011 2025-09-07T07:36:20.2490317Z * [new tag] ciflow/h100-symm-mem/162026 -> ciflow/h100-symm-mem/162026 2025-09-07T07:36:20.2491667Z * [new tag] ciflow/h100-symm-mem/162033 -> ciflow/h100-symm-mem/162033 2025-09-07T07:36:20.2492405Z * [new tag] ciflow/h100-symm-mem/162040 -> ciflow/h100-symm-mem/162040 2025-09-07T07:36:20.2493244Z * [new tag] ciflow/h100-symm-mem/162041 -> ciflow/h100-symm-mem/162041 2025-09-07T07:36:20.2493956Z * [new tag] ciflow/h100-symm-mem/162142 -> ciflow/h100-symm-mem/162142 2025-09-07T07:36:20.2494772Z * [new tag] ciflow/h100-symm-mem/162150 -> ciflow/h100-symm-mem/162150 2025-09-07T07:36:20.2495496Z * [new tag] ciflow/h100-symm-mem/162243 -> ciflow/h100-symm-mem/162243 2025-09-07T07:36:20.2496592Z * [new tag] ciflow/h100-symm-mem/162320 -> ciflow/h100-symm-mem/162320 2025-09-07T07:36:20.2497986Z * [new tag] ciflow/h100/159158 -> ciflow/h100/159158 2025-09-07T07:36:20.2499195Z * [new tag] ciflow/h100/160480 -> ciflow/h100/160480 2025-09-07T07:36:20.2500185Z * [new tag] ciflow/h100/161749 -> ciflow/h100/161749 2025-09-07T07:36:20.2501133Z * [new tag] ciflow/h100/162022 -> ciflow/h100/162022 2025-09-07T07:36:20.2501986Z * [new tag] ciflow/h100/162278 -> ciflow/h100/162278 2025-09-07T07:36:20.2503117Z * [new tag] ciflow/inductor-perf-test-nightly-rocm/156592 -> ciflow/inductor-perf-test-nightly-rocm/156592 2025-09-07T07:36:20.2504227Z * [new tag] ciflow/inductor-perf-test-nightly/156592 -> ciflow/inductor-perf-test-nightly/156592 2025-09-07T07:36:20.2505212Z * [new tag] ciflow/inductor-periodic/162063 -> ciflow/inductor-periodic/162063 2025-09-07T07:36:20.2506150Z * [new tag] ciflow/inductor-periodic/162227 -> ciflow/inductor-periodic/162227 2025-09-07T07:36:20.2507026Z * [new tag] ciflow/inductor-periodic/162323 -> ciflow/inductor-periodic/162323 2025-09-07T07:36:20.2508096Z * [new tag] ciflow/inductor-rocm/154170 -> ciflow/inductor-rocm/154170 2025-09-07T07:36:20.2509022Z * [new tag] ciflow/inductor-rocm/159146 -> ciflow/inductor-rocm/159146 2025-09-07T07:36:20.2509838Z * [new tag] ciflow/inductor-rocm/159158 -> ciflow/inductor-rocm/159158 2025-09-07T07:36:20.2510853Z * [new tag] ciflow/inductor-rocm/161715 -> ciflow/inductor-rocm/161715 2025-09-07T07:36:20.2511767Z * [new tag] ciflow/inductor-rocm/162053 -> ciflow/inductor-rocm/162053 2025-09-07T07:36:20.2512792Z * [new tag] ciflow/inductor-rocm/162056 -> ciflow/inductor-rocm/162056 2025-09-07T07:36:20.2513818Z * [new tag] ciflow/inductor/137400 -> ciflow/inductor/137400 2025-09-07T07:36:20.2514532Z * [new tag] ciflow/inductor/148180 -> ciflow/inductor/148180 2025-09-07T07:36:20.2515354Z * [new tag] ciflow/inductor/148328 -> ciflow/inductor/148328 2025-09-07T07:36:20.2516061Z * [new tag] ciflow/inductor/148484 -> ciflow/inductor/148484 2025-09-07T07:36:20.2516908Z * [new tag] ciflow/inductor/148492 -> ciflow/inductor/148492 2025-09-07T07:36:20.2517603Z * [new tag] ciflow/inductor/152624 -> ciflow/inductor/152624 2025-09-07T07:36:20.2518416Z * [new tag] ciflow/inductor/154694 -> ciflow/inductor/154694 2025-09-07T07:36:20.2519128Z * [new tag] ciflow/inductor/156049 -> ciflow/inductor/156049 2025-09-07T07:36:20.2519996Z * [new tag] ciflow/inductor/156592 -> ciflow/inductor/156592 2025-09-07T07:36:20.2520670Z * [new tag] ciflow/inductor/157635 -> ciflow/inductor/157635 2025-09-07T07:36:20.2521500Z * [new tag] ciflow/inductor/157685 -> ciflow/inductor/157685 2025-09-07T07:36:20.2522501Z * [new tag] ciflow/inductor/157686 -> ciflow/inductor/157686 2025-09-07T07:36:20.2523561Z * [new tag] ciflow/inductor/157689 -> ciflow/inductor/157689 2025-09-07T07:36:20.2524584Z * [new tag] ciflow/inductor/157699 -> ciflow/inductor/157699 2025-09-07T07:36:20.2525537Z * [new tag] ciflow/inductor/157743 -> ciflow/inductor/157743 2025-09-07T07:36:20.2526456Z * [new tag] ciflow/inductor/157994 -> ciflow/inductor/157994 2025-09-07T07:36:20.2527289Z * [new tag] ciflow/inductor/158091 -> ciflow/inductor/158091 2025-09-07T07:36:20.2528114Z * [new tag] ciflow/inductor/158104 -> ciflow/inductor/158104 2025-09-07T07:36:20.2529014Z * [new tag] ciflow/inductor/158404 -> ciflow/inductor/158404 2025-09-07T07:36:20.2529859Z * [new tag] ciflow/inductor/158647 -> ciflow/inductor/158647 2025-09-07T07:36:20.2530810Z * [new tag] ciflow/inductor/158932 -> ciflow/inductor/158932 2025-09-07T07:36:20.2531640Z * [new tag] ciflow/inductor/159146 -> ciflow/inductor/159146 2025-09-07T07:36:20.2532452Z * [new tag] ciflow/inductor/159158 -> ciflow/inductor/159158 2025-09-07T07:36:20.2533410Z * [new tag] ciflow/inductor/159274 -> ciflow/inductor/159274 2025-09-07T07:36:20.2534217Z * [new tag] ciflow/inductor/159664 -> ciflow/inductor/159664 2025-09-07T07:36:20.2535187Z * [new tag] ciflow/inductor/159778 -> ciflow/inductor/159778 2025-09-07T07:36:20.2536022Z * [new tag] ciflow/inductor/159835 -> ciflow/inductor/159835 2025-09-07T07:36:20.2536999Z * [new tag] ciflow/inductor/159944 -> ciflow/inductor/159944 2025-09-07T07:36:20.2538008Z * [new tag] ciflow/inductor/160161 -> ciflow/inductor/160161 2025-09-07T07:36:20.2538894Z * [new tag] ciflow/inductor/160174 -> ciflow/inductor/160174 2025-09-07T07:36:20.2539965Z * [new tag] ciflow/inductor/160323 -> ciflow/inductor/160323 2025-09-07T07:36:20.2541000Z * [new tag] ciflow/inductor/160324 -> ciflow/inductor/160324 2025-09-07T07:36:20.2541961Z * [new tag] ciflow/inductor/160325 -> ciflow/inductor/160325 2025-09-07T07:36:20.2542995Z * [new tag] ciflow/inductor/160326 -> ciflow/inductor/160326 2025-09-07T07:36:20.2543867Z * [new tag] ciflow/inductor/160327 -> ciflow/inductor/160327 2025-09-07T07:36:20.2544934Z * [new tag] ciflow/inductor/160328 -> ciflow/inductor/160328 2025-09-07T07:36:20.2545933Z * [new tag] ciflow/inductor/160329 -> ciflow/inductor/160329 2025-09-07T07:36:20.2546735Z * [new tag] ciflow/inductor/160480 -> ciflow/inductor/160480 2025-09-07T07:36:20.2547712Z * [new tag] ciflow/inductor/160532 -> ciflow/inductor/160532 2025-09-07T07:36:20.2549063Z * [new tag] ciflow/inductor/160539 -> ciflow/inductor/160539 2025-09-07T07:36:20.2549887Z * [new tag] ciflow/inductor/160580 -> ciflow/inductor/160580 2025-09-07T07:36:20.2550768Z * [new tag] ciflow/inductor/160685 -> ciflow/inductor/160685 2025-09-07T07:36:20.2551586Z * [new tag] ciflow/inductor/160686 -> ciflow/inductor/160686 2025-09-07T07:36:20.2552411Z * [new tag] ciflow/inductor/160687 -> ciflow/inductor/160687 2025-09-07T07:36:20.2553240Z * [new tag] ciflow/inductor/160688 -> ciflow/inductor/160688 2025-09-07T07:36:20.2554041Z * [new tag] ciflow/inductor/160690 -> ciflow/inductor/160690 2025-09-07T07:36:20.2554865Z * [new tag] ciflow/inductor/160706 -> ciflow/inductor/160706 2025-09-07T07:36:20.2555751Z * [new tag] ciflow/inductor/160729 -> ciflow/inductor/160729 2025-09-07T07:36:20.2556634Z * [new tag] ciflow/inductor/160798 -> ciflow/inductor/160798 2025-09-07T07:36:20.2557553Z * [new tag] ciflow/inductor/160836 -> ciflow/inductor/160836 2025-09-07T07:36:20.2558413Z * [new tag] ciflow/inductor/160843 -> ciflow/inductor/160843 2025-09-07T07:36:20.2559473Z * [new tag] ciflow/inductor/160869 -> ciflow/inductor/160869 2025-09-07T07:36:20.2560302Z * [new tag] ciflow/inductor/160920 -> ciflow/inductor/160920 2025-09-07T07:36:20.2561138Z * [new tag] ciflow/inductor/160943 -> ciflow/inductor/160943 2025-09-07T07:36:20.2561963Z * [new tag] ciflow/inductor/161092 -> ciflow/inductor/161092 2025-09-07T07:36:20.2562822Z * [new tag] ciflow/inductor/161093 -> ciflow/inductor/161093 2025-09-07T07:36:20.2563744Z * [new tag] ciflow/inductor/161109 -> ciflow/inductor/161109 2025-09-07T07:36:20.2564595Z * [new tag] ciflow/inductor/161118 -> ciflow/inductor/161118 2025-09-07T07:36:20.2565608Z * [new tag] ciflow/inductor/161178 -> ciflow/inductor/161178 2025-09-07T07:36:20.2566468Z * [new tag] ciflow/inductor/161246 -> ciflow/inductor/161246 2025-09-07T07:36:20.2567270Z * [new tag] ciflow/inductor/161349 -> ciflow/inductor/161349 2025-09-07T07:36:20.2568093Z * [new tag] ciflow/inductor/161350 -> ciflow/inductor/161350 2025-09-07T07:36:20.2569444Z * [new tag] ciflow/inductor/161351 -> ciflow/inductor/161351 2025-09-07T07:36:20.2570406Z * [new tag] ciflow/inductor/161397 -> ciflow/inductor/161397 2025-09-07T07:36:20.2571171Z * [new tag] ciflow/inductor/161404 -> ciflow/inductor/161404 2025-09-07T07:36:20.2572043Z * [new tag] ciflow/inductor/161405 -> ciflow/inductor/161405 2025-09-07T07:36:20.2572886Z * [new tag] ciflow/inductor/161406 -> ciflow/inductor/161406 2025-09-07T07:36:20.2573868Z * [new tag] ciflow/inductor/161410 -> ciflow/inductor/161410 2025-09-07T07:36:20.2574692Z * [new tag] ciflow/inductor/161414 -> ciflow/inductor/161414 2025-09-07T07:36:20.2575692Z * [new tag] ciflow/inductor/161442 -> ciflow/inductor/161442 2025-09-07T07:36:20.2576538Z * [new tag] ciflow/inductor/161458 -> ciflow/inductor/161458 2025-09-07T07:36:20.2577394Z * [new tag] ciflow/inductor/161468 -> ciflow/inductor/161468 2025-09-07T07:36:20.2578238Z * [new tag] ciflow/inductor/161469 -> ciflow/inductor/161469 2025-09-07T07:36:20.2579130Z * [new tag] ciflow/inductor/161485 -> ciflow/inductor/161485 2025-09-07T07:36:20.2579947Z * [new tag] ciflow/inductor/161499 -> ciflow/inductor/161499 2025-09-07T07:36:20.2580772Z * [new tag] ciflow/inductor/161534 -> ciflow/inductor/161534 2025-09-07T07:36:20.2581610Z * [new tag] ciflow/inductor/161595 -> ciflow/inductor/161595 2025-09-07T07:36:20.2582462Z * [new tag] ciflow/inductor/161596 -> ciflow/inductor/161596 2025-09-07T07:36:20.2583647Z * [new tag] ciflow/inductor/161630 -> ciflow/inductor/161630 2025-09-07T07:36:20.2584483Z * [new tag] ciflow/inductor/161667 -> ciflow/inductor/161667 2025-09-07T07:36:20.2585323Z * [new tag] ciflow/inductor/161670 -> ciflow/inductor/161670 2025-09-07T07:36:20.2586221Z * [new tag] ciflow/inductor/161673 -> ciflow/inductor/161673 2025-09-07T07:36:20.2587074Z * [new tag] ciflow/inductor/161674 -> ciflow/inductor/161674 2025-09-07T07:36:20.2587981Z * [new tag] ciflow/inductor/161675 -> ciflow/inductor/161675 2025-09-07T07:36:20.2588711Z * [new tag] ciflow/inductor/161693 -> ciflow/inductor/161693 2025-09-07T07:36:20.2589703Z * [new tag] ciflow/inductor/161695 -> ciflow/inductor/161695 2025-09-07T07:36:20.2590551Z * [new tag] ciflow/inductor/161715 -> ciflow/inductor/161715 2025-09-07T07:36:20.2591409Z * [new tag] ciflow/inductor/161730 -> ciflow/inductor/161730 2025-09-07T07:36:20.2592274Z * [new tag] ciflow/inductor/161732 -> ciflow/inductor/161732 2025-09-07T07:36:20.2593168Z * [new tag] ciflow/inductor/161744 -> ciflow/inductor/161744 2025-09-07T07:36:20.2593997Z * [new tag] ciflow/inductor/161746 -> ciflow/inductor/161746 2025-09-07T07:36:20.2594808Z * [new tag] ciflow/inductor/161747 -> ciflow/inductor/161747 2025-09-07T07:36:20.2595676Z * [new tag] ciflow/inductor/161819 -> ciflow/inductor/161819 2025-09-07T07:36:20.2596515Z * [new tag] ciflow/inductor/161821 -> ciflow/inductor/161821 2025-09-07T07:36:20.2597400Z * [new tag] ciflow/inductor/161828 -> ciflow/inductor/161828 2025-09-07T07:36:20.2598221Z * [new tag] ciflow/inductor/161879 -> ciflow/inductor/161879 2025-09-07T07:36:20.2599042Z * [new tag] ciflow/inductor/161880 -> ciflow/inductor/161880 2025-09-07T07:36:20.2599889Z * [new tag] ciflow/inductor/161881 -> ciflow/inductor/161881 2025-09-07T07:36:20.2600913Z * [new tag] ciflow/inductor/161907 -> ciflow/inductor/161907 2025-09-07T07:36:20.2601749Z * [new tag] ciflow/inductor/161914 -> ciflow/inductor/161914 2025-09-07T07:36:20.2602663Z * [new tag] ciflow/inductor/161924 -> ciflow/inductor/161924 2025-09-07T07:36:20.2603586Z * [new tag] ciflow/inductor/161936 -> ciflow/inductor/161936 2025-09-07T07:36:20.2604420Z * [new tag] ciflow/inductor/161938 -> ciflow/inductor/161938 2025-09-07T07:36:20.2605251Z * [new tag] ciflow/inductor/161939 -> ciflow/inductor/161939 2025-09-07T07:36:20.2606073Z * [new tag] ciflow/inductor/161940 -> ciflow/inductor/161940 2025-09-07T07:36:20.2606914Z * [new tag] ciflow/inductor/161955 -> ciflow/inductor/161955 2025-09-07T07:36:20.2607734Z * [new tag] ciflow/inductor/161957 -> ciflow/inductor/161957 2025-09-07T07:36:20.2608552Z * [new tag] ciflow/inductor/161975 -> ciflow/inductor/161975 2025-09-07T07:36:20.2609382Z * [new tag] ciflow/inductor/161977 -> ciflow/inductor/161977 2025-09-07T07:36:20.2610400Z * [new tag] ciflow/inductor/161978 -> ciflow/inductor/161978 2025-09-07T07:36:20.2611248Z * [new tag] ciflow/inductor/161979 -> ciflow/inductor/161979 2025-09-07T07:36:20.2612091Z * [new tag] ciflow/inductor/161980 -> ciflow/inductor/161980 2025-09-07T07:36:20.2612930Z * [new tag] ciflow/inductor/161988 -> ciflow/inductor/161988 2025-09-07T07:36:20.2613743Z * [new tag] ciflow/inductor/161994 -> ciflow/inductor/161994 2025-09-07T07:36:20.2614583Z * [new tag] ciflow/inductor/162013 -> ciflow/inductor/162013 2025-09-07T07:36:20.2615386Z * [new tag] ciflow/inductor/162014 -> ciflow/inductor/162014 2025-09-07T07:36:20.2616228Z * [new tag] ciflow/inductor/162017 -> ciflow/inductor/162017 2025-09-07T07:36:20.2617035Z * [new tag] ciflow/inductor/162021 -> ciflow/inductor/162021 2025-09-07T07:36:20.2617864Z * [new tag] ciflow/inductor/162023 -> ciflow/inductor/162023 2025-09-07T07:36:20.2618688Z * [new tag] ciflow/inductor/162027 -> ciflow/inductor/162027 2025-09-07T07:36:20.2619630Z * [new tag] ciflow/inductor/162029 -> ciflow/inductor/162029 2025-09-07T07:36:20.2620287Z * [new tag] ciflow/inductor/162030 -> ciflow/inductor/162030 2025-09-07T07:36:20.2621150Z * [new tag] ciflow/inductor/162031 -> ciflow/inductor/162031 2025-09-07T07:36:20.2621989Z * [new tag] ciflow/inductor/162033 -> ciflow/inductor/162033 2025-09-07T07:36:20.2622997Z * [new tag] ciflow/inductor/162052 -> ciflow/inductor/162052 2025-09-07T07:36:20.2623843Z * [new tag] ciflow/inductor/162053 -> ciflow/inductor/162053 2025-09-07T07:36:20.2625144Z * [new tag] ciflow/inductor/162056 -> ciflow/inductor/162056 2025-09-07T07:36:20.2626076Z * [new tag] ciflow/inductor/162063 -> ciflow/inductor/162063 2025-09-07T07:36:20.2626932Z * [new tag] ciflow/inductor/162066 -> ciflow/inductor/162066 2025-09-07T07:36:20.2627778Z * [new tag] ciflow/inductor/162068 -> ciflow/inductor/162068 2025-09-07T07:36:20.2628832Z * [new tag] ciflow/inductor/162081 -> ciflow/inductor/162081 2025-09-07T07:36:20.2629700Z * [new tag] ciflow/inductor/162088 -> ciflow/inductor/162088 2025-09-07T07:36:20.2630555Z * [new tag] ciflow/inductor/162089 -> ciflow/inductor/162089 2025-09-07T07:36:20.2631394Z * [new tag] ciflow/inductor/162094 -> ciflow/inductor/162094 2025-09-07T07:36:20.2632256Z * [new tag] ciflow/inductor/162098 -> ciflow/inductor/162098 2025-09-07T07:36:20.2633182Z * [new tag] ciflow/inductor/162101 -> ciflow/inductor/162101 2025-09-07T07:36:20.2634000Z * [new tag] ciflow/inductor/162102 -> ciflow/inductor/162102 2025-09-07T07:36:20.2634774Z * [new tag] ciflow/inductor/162104 -> ciflow/inductor/162104 2025-09-07T07:36:20.2635651Z * [new tag] ciflow/inductor/162106 -> ciflow/inductor/162106 2025-09-07T07:36:20.2636487Z * [new tag] ciflow/inductor/162108 -> ciflow/inductor/162108 2025-09-07T07:36:20.2637326Z * [new tag] ciflow/inductor/162126 -> ciflow/inductor/162126 2025-09-07T07:36:20.2638189Z * [new tag] ciflow/inductor/162149 -> ciflow/inductor/162149 2025-09-07T07:36:20.2639035Z * [new tag] ciflow/inductor/162164 -> ciflow/inductor/162164 2025-09-07T07:36:20.2639884Z * [new tag] ciflow/inductor/162166 -> ciflow/inductor/162166 2025-09-07T07:36:20.2640736Z * [new tag] ciflow/inductor/162169 -> ciflow/inductor/162169 2025-09-07T07:36:20.2641440Z * [new tag] ciflow/inductor/162170 -> ciflow/inductor/162170 2025-09-07T07:36:20.2642296Z * [new tag] ciflow/inductor/162171 -> ciflow/inductor/162171 2025-09-07T07:36:20.2643176Z * [new tag] ciflow/inductor/162183 -> ciflow/inductor/162183 2025-09-07T07:36:20.2643884Z * [new tag] ciflow/inductor/162189 -> ciflow/inductor/162189 2025-09-07T07:36:20.2644773Z * [new tag] ciflow/inductor/162190 -> ciflow/inductor/162190 2025-09-07T07:36:20.2645593Z * [new tag] ciflow/inductor/162191 -> ciflow/inductor/162191 2025-09-07T07:36:20.2646454Z * [new tag] ciflow/inductor/162194 -> ciflow/inductor/162194 2025-09-07T07:36:20.2647404Z * [new tag] ciflow/inductor/162200 -> ciflow/inductor/162200 2025-09-07T07:36:20.2648246Z * [new tag] ciflow/inductor/162201 -> ciflow/inductor/162201 2025-09-07T07:36:20.2649105Z * [new tag] ciflow/inductor/162208 -> ciflow/inductor/162208 2025-09-07T07:36:20.2650056Z * [new tag] ciflow/inductor/162211 -> ciflow/inductor/162211 2025-09-07T07:36:20.2650974Z * [new tag] ciflow/inductor/162216 -> ciflow/inductor/162216 2025-09-07T07:36:20.2651671Z * [new tag] ciflow/inductor/162220 -> ciflow/inductor/162220 2025-09-07T07:36:20.2652812Z * [new tag] ciflow/inductor/162222 -> ciflow/inductor/162222 2025-09-07T07:36:20.2653663Z * [new tag] ciflow/inductor/162227 -> ciflow/inductor/162227 2025-09-07T07:36:20.2654469Z * [new tag] ciflow/inductor/162238 -> ciflow/inductor/162238 2025-09-07T07:36:20.2655286Z * [new tag] ciflow/inductor/162239 -> ciflow/inductor/162239 2025-09-07T07:36:20.2656110Z * [new tag] ciflow/inductor/162240 -> ciflow/inductor/162240 2025-09-07T07:36:20.2656937Z * [new tag] ciflow/inductor/162244 -> ciflow/inductor/162244 2025-09-07T07:36:20.2657795Z * [new tag] ciflow/inductor/162245 -> ciflow/inductor/162245 2025-09-07T07:36:20.2658651Z * [new tag] ciflow/inductor/162262 -> ciflow/inductor/162262 2025-09-07T07:36:20.2659365Z * [new tag] ciflow/inductor/162275 -> ciflow/inductor/162275 2025-09-07T07:36:20.2660246Z * [new tag] ciflow/inductor/162278 -> ciflow/inductor/162278 2025-09-07T07:36:20.2661053Z * [new tag] ciflow/inductor/162284 -> ciflow/inductor/162284 2025-09-07T07:36:20.2661931Z * [new tag] ciflow/inductor/162286 -> ciflow/inductor/162286 2025-09-07T07:36:20.2662742Z * [new tag] ciflow/inductor/162288 -> ciflow/inductor/162288 2025-09-07T07:36:20.2663567Z * [new tag] ciflow/inductor/162293 -> ciflow/inductor/162293 2025-09-07T07:36:20.2664401Z * [new tag] ciflow/inductor/162294 -> ciflow/inductor/162294 2025-09-07T07:36:20.2665128Z * [new tag] ciflow/inductor/162295 -> ciflow/inductor/162295 2025-09-07T07:36:20.2666093Z * [new tag] ciflow/inductor/162296 -> ciflow/inductor/162296 2025-09-07T07:36:20.2666922Z * [new tag] ciflow/inductor/162298 -> ciflow/inductor/162298 2025-09-07T07:36:20.2667772Z * [new tag] ciflow/inductor/162307 -> ciflow/inductor/162307 2025-09-07T07:36:20.2668595Z * [new tag] ciflow/inductor/162309 -> ciflow/inductor/162309 2025-09-07T07:36:20.2669425Z * [new tag] ciflow/inductor/162311 -> ciflow/inductor/162311 2025-09-07T07:36:20.2670273Z * [new tag] ciflow/inductor/162312 -> ciflow/inductor/162312 2025-09-07T07:36:20.2671104Z * [new tag] ciflow/inductor/162315 -> ciflow/inductor/162315 2025-09-07T07:36:20.2671915Z * [new tag] ciflow/inductor/162316 -> ciflow/inductor/162316 2025-09-07T07:36:20.2672730Z * [new tag] ciflow/inductor/162318 -> ciflow/inductor/162318 2025-09-07T07:36:20.2673556Z * [new tag] ciflow/inductor/162323 -> ciflow/inductor/162323 2025-09-07T07:36:20.2674564Z * [new tag] ciflow/inductor/162341 -> ciflow/inductor/162341 2025-09-07T07:36:20.2675394Z * [new tag] ciflow/inductor/162345 -> ciflow/inductor/162345 2025-09-07T07:36:20.2676496Z * [new tag] ciflow/inductor/3b9a386 -> ciflow/inductor/3b9a386 2025-09-07T07:36:20.2677458Z * [new tag] ciflow/inductor/3d4b92b -> ciflow/inductor/3d4b92b 2025-09-07T07:36:20.2678397Z * [new tag] ciflow/inductor/d224ac7 -> ciflow/inductor/d224ac7 2025-09-07T07:36:20.2679539Z * [new tag] ciflow/linux-aarch64/157994 -> ciflow/linux-aarch64/157994 2025-09-07T07:36:20.2680274Z * [new tag] ciflow/linux-aarch64/159737 -> ciflow/linux-aarch64/159737 2025-09-07T07:36:20.2681120Z * [new tag] ciflow/linux-aarch64/160078 -> ciflow/linux-aarch64/160078 2025-09-07T07:36:20.2682119Z * [new tag] ciflow/mps/157553 -> ciflow/mps/157553 2025-09-07T07:36:20.2682911Z * [new tag] ciflow/mps/157635 -> ciflow/mps/157635 2025-09-07T07:36:20.2683633Z * [new tag] ciflow/mps/161988 -> ciflow/mps/161988 2025-09-07T07:36:20.2684436Z * [new tag] ciflow/mps/162108 -> ciflow/mps/162108 2025-09-07T07:36:20.2685298Z * [new tag] ciflow/mps/162153 -> ciflow/mps/162153 2025-09-07T07:36:20.2686407Z * [new tag] ciflow/mps/162281 -> ciflow/mps/162281 2025-09-07T07:36:20.2687043Z * [new tag] ciflow/nightly/156049 -> ciflow/nightly/156049 2025-09-07T07:36:20.2687735Z * [new tag] ciflow/nightly/158104 -> ciflow/nightly/158104 2025-09-07T07:36:20.2688800Z * [new tag] ciflow/op-benchmark/157994 -> ciflow/op-benchmark/157994 2025-09-07T07:36:20.2689932Z * [new tag] ciflow/periodic-rocm-mi300/161529 -> ciflow/periodic-rocm-mi300/161529 2025-09-07T07:36:20.2690651Z * [new tag] ciflow/periodic-rocm-mi300/161715 -> ciflow/periodic-rocm-mi300/161715 2025-09-07T07:36:20.2691861Z * [new tag] ciflow/periodic/054a2fd -> ciflow/periodic/054a2fd 2025-09-07T07:36:20.2692577Z * [new tag] ciflow/periodic/156703 -> ciflow/periodic/156703 2025-09-07T07:36:20.2693508Z * [new tag] ciflow/periodic/161715 -> ciflow/periodic/161715 2025-09-07T07:36:20.2694085Z * [new tag] ciflow/periodic/162021 -> ciflow/periodic/162021 2025-09-07T07:36:20.2694983Z * [new tag] ciflow/periodic/162323 -> ciflow/periodic/162323 2025-09-07T07:36:20.2695838Z * [new tag] ciflow/periodic/2a6d37d -> ciflow/periodic/2a6d37d 2025-09-07T07:36:20.2696710Z * [new tag] ciflow/periodic/317eeb8 -> ciflow/periodic/317eeb8 2025-09-07T07:36:20.2697521Z * [new tag] ciflow/periodic/3c32 -> ciflow/periodic/3c32 2025-09-07T07:36:20.2698555Z * [new tag] ciflow/periodic/3e98831 -> ciflow/periodic/3e98831 2025-09-07T07:36:20.2699531Z * [new tag] ciflow/periodic/94512-point -> ciflow/periodic/94512-point 2025-09-07T07:36:20.2700752Z * [new tag] ciflow/periodic/csl/test87519 -> ciflow/periodic/csl/test87519 2025-09-07T07:36:20.2702046Z * [new tag] ciflow/periodic/csltest88275 -> ciflow/periodic/csltest88275 2025-09-07T07:36:20.2703235Z * [new tag] ciflow/periodic/csltest88761 -> ciflow/periodic/csltest88761 2025-09-07T07:36:20.2704397Z * [new tag] ciflow/periodic/release_1.12 -> ciflow/periodic/release_1.12 2025-09-07T07:36:20.2705505Z * [new tag] ciflow/periodic/release_1.12.0 -> ciflow/periodic/release_1.12.0 2025-09-07T07:36:20.2706676Z * [new tag] ciflow/periodic/sha-ec5b83 -> ciflow/periodic/sha-ec5b83 2025-09-07T07:36:20.2707660Z * [new tag] ciflow/rocm-mi300/154170 -> ciflow/rocm-mi300/154170 2025-09-07T07:36:20.2708550Z * [new tag] ciflow/rocm-mi300/158747 -> ciflow/rocm-mi300/158747 2025-09-07T07:36:20.2709236Z * [new tag] ciflow/rocm-mi300/159146 -> ciflow/rocm-mi300/159146 2025-09-07T07:36:20.2710218Z * [new tag] ciflow/rocm-mi300/159158 -> ciflow/rocm-mi300/159158 2025-09-07T07:36:20.2711095Z * [new tag] ciflow/rocm-mi300/161715 -> ciflow/rocm-mi300/161715 2025-09-07T07:36:20.2711794Z * [new tag] ciflow/rocm-mi300/161957 -> ciflow/rocm-mi300/161957 2025-09-07T07:36:20.2712745Z * [new tag] ciflow/rocm-mi300/162053 -> ciflow/rocm-mi300/162053 2025-09-07T07:36:20.2713286Z * [new tag] ciflow/rocm-mi300/162056 -> ciflow/rocm-mi300/162056 2025-09-07T07:36:20.2714230Z * [new tag] ciflow/rocm-mi300/162112 -> ciflow/rocm-mi300/162112 2025-09-07T07:36:20.2714970Z * [new tag] ciflow/rocm-mi300/162245 -> ciflow/rocm-mi300/162245 2025-09-07T07:36:20.2715984Z * [new tag] ciflow/rocm-mi300/162278 -> ciflow/rocm-mi300/162278 2025-09-07T07:36:20.2716827Z * [new tag] ciflow/rocm-mi300/162288 -> ciflow/rocm-mi300/162288 2025-09-07T07:36:20.2717847Z * [new tag] ciflow/rocm-mi355/162053 -> ciflow/rocm-mi355/162053 2025-09-07T07:36:20.2718570Z * [new tag] ciflow/rocm-mi355/162056 -> ciflow/rocm-mi355/162056 2025-09-07T07:36:20.2719620Z * [new tag] ciflow/rocm/148492 -> ciflow/rocm/148492 2025-09-07T07:36:20.2720506Z * [new tag] ciflow/rocm/154170 -> ciflow/rocm/154170 2025-09-07T07:36:20.2721475Z * [new tag] ciflow/rocm/156491 -> ciflow/rocm/156491 2025-09-07T07:36:20.2722187Z * [new tag] ciflow/rocm/156592 -> ciflow/rocm/156592 2025-09-07T07:36:20.2723025Z * [new tag] ciflow/rocm/158747 -> ciflow/rocm/158747 2025-09-07T07:36:20.2723739Z * [new tag] ciflow/rocm/159146 -> ciflow/rocm/159146 2025-09-07T07:36:20.2724775Z * [new tag] ciflow/rocm/159158 -> ciflow/rocm/159158 2025-09-07T07:36:20.2725468Z * [new tag] ciflow/rocm/161715 -> ciflow/rocm/161715 2025-09-07T07:36:20.2726394Z * [new tag] ciflow/rocm/161972 -> ciflow/rocm/161972 2025-09-07T07:36:20.2727099Z * [new tag] ciflow/rocm/162052 -> ciflow/rocm/162052 2025-09-07T07:36:20.2727914Z * [new tag] ciflow/rocm/162053 -> ciflow/rocm/162053 2025-09-07T07:36:20.2729095Z * [new tag] ciflow/rocm/162056 -> ciflow/rocm/162056 2025-09-07T07:36:20.2730155Z * [new tag] ciflow/rocm/162112 -> ciflow/rocm/162112 2025-09-07T07:36:20.2731117Z * [new tag] ciflow/rocm/162278 -> ciflow/rocm/162278 2025-09-07T07:36:20.2731932Z * [new tag] ciflow/rocm/162288 -> ciflow/rocm/162288 2025-09-07T07:36:20.2732761Z * [new tag] ciflow/rocm/162305 -> ciflow/rocm/162305 2025-09-07T07:36:20.2741376Z * [new tag] ciflow/slow/01c7106 -> ciflow/slow/01c7106 2025-09-07T07:36:20.2741594Z * [new tag] ciflow/slow/0577043 -> ciflow/slow/0577043 2025-09-07T07:36:20.2741959Z * [new tag] ciflow/slow/0d5b74da0cab798fbfdb9caa53fad816999c8386-sdym -> ciflow/slow/0d5b74da0cab798fbfdb9caa53fad816999c8386-sdym 2025-09-07T07:36:20.2742077Z * [new tag] ciflow/slow/0e81104 -> ciflow/slow/0e81104 2025-09-07T07:36:20.2742181Z * [new tag] ciflow/slow/161395 -> ciflow/slow/161395 2025-09-07T07:36:20.2742277Z * [new tag] ciflow/slow/1732077 -> ciflow/slow/1732077 2025-09-07T07:36:20.2742395Z * [new tag] ciflow/slow/187eb7c -> ciflow/slow/187eb7c 2025-09-07T07:36:20.2742501Z * [new tag] ciflow/slow/1faef89 -> ciflow/slow/1faef89 2025-09-07T07:36:20.2742608Z * [new tag] ciflow/slow/3920ec1 -> ciflow/slow/3920ec1 2025-09-07T07:36:20.2742713Z * [new tag] ciflow/slow/3b7c6b2 -> ciflow/slow/3b7c6b2 2025-09-07T07:36:20.2743695Z * [new tag] ciflow/slow/59a3759 -> ciflow/slow/59a3759 2025-09-07T07:36:20.2744615Z * [new tag] ciflow/slow/70ef0bb -> ciflow/slow/70ef0bb 2025-09-07T07:36:20.2745565Z * [new tag] ciflow/slow/788ff06 -> ciflow/slow/788ff06 2025-09-07T07:36:20.2746899Z * [new tag] ciflow/slow/8751002215790a3a88750faa8f4366933e296693-sdym -> ciflow/slow/8751002215790a3a88750faa8f4366933e296693-sdym 2025-09-07T07:36:20.2747611Z * [new tag] ciflow/slow/9d85864 -> ciflow/slow/9d85864 2025-09-07T07:36:20.2748600Z * [new tag] ciflow/slow/9ffad5b -> ciflow/slow/9ffad5b 2025-09-07T07:36:20.2749619Z * [new tag] ciflow/slow/a206e8b -> ciflow/slow/a206e8b 2025-09-07T07:36:20.2750462Z * [new tag] ciflow/slow/a837609 -> ciflow/slow/a837609 2025-09-07T07:36:20.2751441Z * [new tag] ciflow/slow/af841f3 -> ciflow/slow/af841f3 2025-09-07T07:36:20.2752669Z * [new tag] ciflow/slow/da3aba1e46157c4df504b067477cdf2b3c96b194-sdym -> ciflow/slow/da3aba1e46157c4df504b067477cdf2b3c96b194-sdym 2025-09-07T07:36:20.2753506Z * [new tag] ciflow/triton_binaries/162329 -> ciflow/triton_binaries/162329 2025-09-07T07:36:20.2754496Z * [new tag] ciflow/trunk/113258 -> ciflow/trunk/113258 2025-09-07T07:36:20.2755215Z * [new tag] ciflow/trunk/137400 -> ciflow/trunk/137400 2025-09-07T07:36:20.2756036Z * [new tag] ciflow/trunk/148180 -> ciflow/trunk/148180 2025-09-07T07:36:20.2756941Z * [new tag] ciflow/trunk/148328 -> ciflow/trunk/148328 2025-09-07T07:36:20.2757653Z * [new tag] ciflow/trunk/148492 -> ciflow/trunk/148492 2025-09-07T07:36:20.2758666Z * [new tag] ciflow/trunk/148919 -> ciflow/trunk/148919 2025-09-07T07:36:20.2759390Z * [new tag] ciflow/trunk/152624 -> ciflow/trunk/152624 2025-09-07T07:36:20.2760230Z * [new tag] ciflow/trunk/154170 -> ciflow/trunk/154170 2025-09-07T07:36:20.2760926Z * [new tag] ciflow/trunk/154694 -> ciflow/trunk/154694 2025-09-07T07:36:20.2761809Z * [new tag] ciflow/trunk/156049 -> ciflow/trunk/156049 2025-09-07T07:36:20.2762498Z * [new tag] ciflow/trunk/156703 -> ciflow/trunk/156703 2025-09-07T07:36:20.2763532Z * [new tag] ciflow/trunk/156711 -> ciflow/trunk/156711 2025-09-07T07:36:20.2764587Z * [new tag] ciflow/trunk/157432 -> ciflow/trunk/157432 2025-09-07T07:36:20.2765573Z * [new tag] ciflow/trunk/157685 -> ciflow/trunk/157685 2025-09-07T07:36:20.2766577Z * [new tag] ciflow/trunk/157689 -> ciflow/trunk/157689 2025-09-07T07:36:20.2767404Z * [new tag] ciflow/trunk/157699 -> ciflow/trunk/157699 2025-09-07T07:36:20.2768223Z * [new tag] ciflow/trunk/157813 -> ciflow/trunk/157813 2025-09-07T07:36:20.2769056Z * [new tag] ciflow/trunk/157994 -> ciflow/trunk/157994 2025-09-07T07:36:20.2769764Z * [new tag] ciflow/trunk/158091 -> ciflow/trunk/158091 2025-09-07T07:36:20.2770620Z * [new tag] ciflow/trunk/158104 -> ciflow/trunk/158104 2025-09-07T07:36:20.2771432Z * [new tag] ciflow/trunk/158404 -> ciflow/trunk/158404 2025-09-07T07:36:20.2772282Z * [new tag] ciflow/trunk/158647 -> ciflow/trunk/158647 2025-09-07T07:36:20.2773301Z * [new tag] ciflow/trunk/158846 -> ciflow/trunk/158846 2025-09-07T07:36:20.2774093Z * [new tag] ciflow/trunk/159158 -> ciflow/trunk/159158 2025-09-07T07:36:20.2775009Z * [new tag] ciflow/trunk/159682 -> ciflow/trunk/159682 2025-09-07T07:36:20.2776239Z * [new tag] ciflow/trunk/159835 -> ciflow/trunk/159835 2025-09-07T07:36:20.2777056Z * [new tag] ciflow/trunk/160161 -> ciflow/trunk/160161 2025-09-07T07:36:20.2777897Z * [new tag] ciflow/trunk/160236 -> ciflow/trunk/160236 2025-09-07T07:36:20.2778703Z * [new tag] ciflow/trunk/160329 -> ciflow/trunk/160329 2025-09-07T07:36:20.2779539Z * [new tag] ciflow/trunk/160480 -> ciflow/trunk/160480 2025-09-07T07:36:20.2780346Z * [new tag] ciflow/trunk/160532 -> ciflow/trunk/160532 2025-09-07T07:36:20.2781175Z * [new tag] ciflow/trunk/160836 -> ciflow/trunk/160836 2025-09-07T07:36:20.2782063Z * [new tag] ciflow/trunk/160843 -> ciflow/trunk/160843 2025-09-07T07:36:20.2782759Z * [new tag] ciflow/trunk/160869 -> ciflow/trunk/160869 2025-09-07T07:36:20.2783756Z * [new tag] ciflow/trunk/160940 -> ciflow/trunk/160940 2025-09-07T07:36:20.2784651Z * [new tag] ciflow/trunk/160943 -> ciflow/trunk/160943 2025-09-07T07:36:20.2785638Z * [new tag] ciflow/trunk/160953 -> ciflow/trunk/160953 2025-09-07T07:36:20.2786695Z * [new tag] ciflow/trunk/161035 -> ciflow/trunk/161035 2025-09-07T07:36:20.2787555Z * [new tag] ciflow/trunk/161178 -> ciflow/trunk/161178 2025-09-07T07:36:20.2788365Z * [new tag] ciflow/trunk/161349 -> ciflow/trunk/161349 2025-09-07T07:36:20.2789171Z * [new tag] ciflow/trunk/161350 -> ciflow/trunk/161350 2025-09-07T07:36:20.2789977Z * [new tag] ciflow/trunk/161351 -> ciflow/trunk/161351 2025-09-07T07:36:20.2790821Z * [new tag] ciflow/trunk/161395 -> ciflow/trunk/161395 2025-09-07T07:36:20.2791623Z * [new tag] ciflow/trunk/161405 -> ciflow/trunk/161405 2025-09-07T07:36:20.2792454Z * [new tag] ciflow/trunk/161406 -> ciflow/trunk/161406 2025-09-07T07:36:20.2793259Z * [new tag] ciflow/trunk/161410 -> ciflow/trunk/161410 2025-09-07T07:36:20.2794070Z * [new tag] ciflow/trunk/161468 -> ciflow/trunk/161468 2025-09-07T07:36:20.2794881Z * [new tag] ciflow/trunk/161499 -> ciflow/trunk/161499 2025-09-07T07:36:20.2795979Z * [new tag] ciflow/trunk/161527 -> ciflow/trunk/161527 2025-09-07T07:36:20.2796780Z * [new tag] ciflow/trunk/161534 -> ciflow/trunk/161534 2025-09-07T07:36:20.2797666Z * [new tag] ciflow/trunk/161591 -> ciflow/trunk/161591 2025-09-07T07:36:20.2798483Z * [new tag] ciflow/trunk/161595 -> ciflow/trunk/161595 2025-09-07T07:36:20.2799362Z * [new tag] ciflow/trunk/161596 -> ciflow/trunk/161596 2025-09-07T07:36:20.2800079Z * [new tag] ciflow/trunk/161633 -> ciflow/trunk/161633 2025-09-07T07:36:20.2800957Z * [new tag] ciflow/trunk/161634 -> ciflow/trunk/161634 2025-09-07T07:36:20.2801781Z * [new tag] ciflow/trunk/161635 -> ciflow/trunk/161635 2025-09-07T07:36:20.2802606Z * [new tag] ciflow/trunk/161667 -> ciflow/trunk/161667 2025-09-07T07:36:20.2803502Z * [new tag] ciflow/trunk/161670 -> ciflow/trunk/161670 2025-09-07T07:36:20.2804340Z * [new tag] ciflow/trunk/161692 -> ciflow/trunk/161692 2025-09-07T07:36:20.2805183Z * [new tag] ciflow/trunk/161693 -> ciflow/trunk/161693 2025-09-07T07:36:20.2806069Z * [new tag] ciflow/trunk/161695 -> ciflow/trunk/161695 2025-09-07T07:36:20.2806903Z * [new tag] ciflow/trunk/161730 -> ciflow/trunk/161730 2025-09-07T07:36:20.2807829Z * [new tag] ciflow/trunk/161744 -> ciflow/trunk/161744 2025-09-07T07:36:20.2808804Z * [new tag] ciflow/trunk/161749 -> ciflow/trunk/161749 2025-09-07T07:36:20.2809807Z * [new tag] ciflow/trunk/161881 -> ciflow/trunk/161881 2025-09-07T07:36:20.2814076Z * [new tag] ciflow/trunk/161924 -> ciflow/trunk/161924 2025-09-07T07:36:20.2815122Z * [new tag] ciflow/trunk/161926 -> ciflow/trunk/161926 2025-09-07T07:36:20.2815967Z * [new tag] ciflow/trunk/161936 -> ciflow/trunk/161936 2025-09-07T07:36:20.2816786Z * [new tag] ciflow/trunk/161952 -> ciflow/trunk/161952 2025-09-07T07:36:20.2817795Z * [new tag] ciflow/trunk/161955 -> ciflow/trunk/161955 2025-09-07T07:36:20.2818397Z * [new tag] ciflow/trunk/161957 -> ciflow/trunk/161957 2025-09-07T07:36:20.2819268Z * [new tag] ciflow/trunk/161959 -> ciflow/trunk/161959 2025-09-07T07:36:20.2820071Z * [new tag] ciflow/trunk/161977 -> ciflow/trunk/161977 2025-09-07T07:36:20.2820888Z * [new tag] ciflow/trunk/161988 -> ciflow/trunk/161988 2025-09-07T07:36:20.2821765Z * [new tag] ciflow/trunk/161994 -> ciflow/trunk/161994 2025-09-07T07:36:20.2822639Z * [new tag] ciflow/trunk/162007 -> ciflow/trunk/162007 2025-09-07T07:36:20.2823447Z * [new tag] ciflow/trunk/162013 -> ciflow/trunk/162013 2025-09-07T07:36:20.2824264Z * [new tag] ciflow/trunk/162017 -> ciflow/trunk/162017 2025-09-07T07:36:20.2825088Z * [new tag] ciflow/trunk/162021 -> ciflow/trunk/162021 2025-09-07T07:36:20.2826097Z * [new tag] ciflow/trunk/162022 -> ciflow/trunk/162022 2025-09-07T07:36:20.2826755Z * [new tag] ciflow/trunk/162040 -> ciflow/trunk/162040 2025-09-07T07:36:20.2827626Z * [new tag] ciflow/trunk/162041 -> ciflow/trunk/162041 2025-09-07T07:36:20.2828616Z * [new tag] ciflow/trunk/162062 -> ciflow/trunk/162062 2025-09-07T07:36:20.2829440Z * [new tag] ciflow/trunk/162066 -> ciflow/trunk/162066 2025-09-07T07:36:20.2830251Z * [new tag] ciflow/trunk/162089 -> ciflow/trunk/162089 2025-09-07T07:36:20.2831093Z * [new tag] ciflow/trunk/162099 -> ciflow/trunk/162099 2025-09-07T07:36:20.2831934Z * [new tag] ciflow/trunk/162104 -> ciflow/trunk/162104 2025-09-07T07:36:20.2832675Z * [new tag] ciflow/trunk/162106 -> ciflow/trunk/162106 2025-09-07T07:36:20.2833542Z * [new tag] ciflow/trunk/162112 -> ciflow/trunk/162112 2025-09-07T07:36:20.2834768Z * [new tag] ciflow/trunk/162119 -> ciflow/trunk/162119 2025-09-07T07:36:20.2835612Z * [new tag] ciflow/trunk/162142 -> ciflow/trunk/162142 2025-09-07T07:36:20.2836422Z * [new tag] ciflow/trunk/162169 -> ciflow/trunk/162169 2025-09-07T07:36:20.2837218Z * [new tag] ciflow/trunk/162183 -> ciflow/trunk/162183 2025-09-07T07:36:20.2838057Z * [new tag] ciflow/trunk/162190 -> ciflow/trunk/162190 2025-09-07T07:36:20.2838972Z * [new tag] ciflow/trunk/162194 -> ciflow/trunk/162194 2025-09-07T07:36:20.2839652Z * [new tag] ciflow/trunk/162200 -> ciflow/trunk/162200 2025-09-07T07:36:20.2840507Z * [new tag] ciflow/trunk/162206 -> ciflow/trunk/162206 2025-09-07T07:36:20.2841324Z * [new tag] ciflow/trunk/162208 -> ciflow/trunk/162208 2025-09-07T07:36:20.2842207Z * [new tag] ciflow/trunk/162222 -> ciflow/trunk/162222 2025-09-07T07:36:20.2843073Z * [new tag] ciflow/trunk/162238 -> ciflow/trunk/162238 2025-09-07T07:36:20.2843888Z * [new tag] ciflow/trunk/162244 -> ciflow/trunk/162244 2025-09-07T07:36:20.2844862Z * [new tag] ciflow/trunk/162267 -> ciflow/trunk/162267 2025-09-07T07:36:20.2845802Z * [new tag] ciflow/trunk/162269 -> ciflow/trunk/162269 2025-09-07T07:36:20.2846588Z * [new tag] ciflow/trunk/162278 -> ciflow/trunk/162278 2025-09-07T07:36:20.2847412Z * [new tag] ciflow/trunk/162286 -> ciflow/trunk/162286 2025-09-07T07:36:20.2848230Z * [new tag] ciflow/trunk/162288 -> ciflow/trunk/162288 2025-09-07T07:36:20.2849087Z * [new tag] ciflow/trunk/162293 -> ciflow/trunk/162293 2025-09-07T07:36:20.2850026Z * [new tag] ciflow/trunk/162310 -> ciflow/trunk/162310 2025-09-07T07:36:20.2850657Z * [new tag] ciflow/trunk/162311 -> ciflow/trunk/162311 2025-09-07T07:36:20.2851540Z * [new tag] ciflow/trunk/162315 -> ciflow/trunk/162315 2025-09-07T07:36:20.2852367Z * [new tag] ciflow/trunk/162325 -> ciflow/trunk/162325 2025-09-07T07:36:20.2853355Z * [new tag] ciflow/trunk/162328 -> ciflow/trunk/162328 2025-09-07T07:36:20.2854167Z * [new tag] ciflow/trunk/162329 -> ciflow/trunk/162329 2025-09-07T07:36:20.2855571Z * [new tag] ciflow/unstable/123 -> ciflow/unstable/123 2025-09-07T07:36:20.2856611Z * [new tag] ciflow/vllm/162292 -> ciflow/vllm/162292 2025-09-07T07:36:20.2857674Z * [new tag] ciflow/win-arm64/156049 -> ciflow/win-arm64/156049 2025-09-07T07:36:20.2858392Z * [new tag] ciflow/win-arm64/158104 -> ciflow/win-arm64/158104 2025-09-07T07:36:20.2859452Z * [new tag] ciflow/xpu/157699 -> ciflow/xpu/157699 2025-09-07T07:36:20.2860165Z * [new tag] ciflow/xpu/157994 -> ciflow/xpu/157994 2025-09-07T07:36:20.2861147Z * [new tag] ciflow/xpu/159459 -> ciflow/xpu/159459 2025-09-07T07:36:20.2861947Z * [new tag] ciflow/xpu/159718 -> ciflow/xpu/159718 2025-09-07T07:36:20.2862776Z * [new tag] ciflow/xpu/159944 -> ciflow/xpu/159944 2025-09-07T07:36:20.2863700Z * [new tag] ciflow/xpu/160867 -> ciflow/xpu/160867 2025-09-07T07:36:20.2864556Z * [new tag] ciflow/xpu/160938 -> ciflow/xpu/160938 2025-09-07T07:36:20.2865467Z * [new tag] ciflow/xpu/160940 -> ciflow/xpu/160940 2025-09-07T07:36:20.2866155Z * [new tag] ciflow/xpu/160953 -> ciflow/xpu/160953 2025-09-07T07:36:20.2867108Z * [new tag] ciflow/xpu/161045 -> ciflow/xpu/161045 2025-09-07T07:36:20.2868131Z * [new tag] ciflow/xpu/161058 -> ciflow/xpu/161058 2025-09-07T07:36:20.2869230Z * [new tag] ciflow/xpu/161246 -> ciflow/xpu/161246 2025-09-07T07:36:20.2870338Z * [new tag] ciflow/xpu/161397 -> ciflow/xpu/161397 2025-09-07T07:36:20.2871349Z * [new tag] ciflow/xpu/161485 -> ciflow/xpu/161485 2025-09-07T07:36:20.2872194Z * [new tag] ciflow/xpu/161988 -> ciflow/xpu/161988 2025-09-07T07:36:20.2872998Z * [new tag] ciflow/xpu/162062 -> ciflow/xpu/162062 2025-09-07T07:36:20.2873908Z * [new tag] cslpull75 -> cslpull75 2025-09-07T07:36:20.2874717Z * [new tag] cslpull76 -> cslpull76 2025-09-07T07:36:20.2875548Z * [new tag] cslpull77 -> cslpull77 2025-09-07T07:36:20.2876413Z * [new tag] cslpull78 -> cslpull78 2025-09-07T07:36:20.2877605Z * [new tag] cslpull79 -> cslpull79 2025-09-07T07:36:20.2878735Z * [new tag] cslpull80 -> cslpull80 2025-09-07T07:36:20.2879712Z * [new tag] cslpull81 -> cslpull81 2025-09-07T07:36:20.2880545Z * [new tag] cslpull82 -> cslpull82 2025-09-07T07:36:20.2881436Z * [new tag] cslpull83 -> cslpull83 2025-09-07T07:36:20.2882324Z * [new tag] cslpull84 -> cslpull84 2025-09-07T07:36:20.2883174Z * [new tag] cslpull85 -> cslpull85 2025-09-07T07:36:20.2884091Z * [new tag] cslpull86 -> cslpull86 2025-09-07T07:36:20.2884964Z * [new tag] cslpull87 -> cslpull87 2025-09-07T07:36:20.2885978Z * [new tag] cslpull88 -> cslpull88 2025-09-07T07:36:20.2886772Z * [new tag] cslpull89 -> cslpull89 2025-09-07T07:36:20.2887477Z * [new tag] cslpull90 -> cslpull90 2025-09-07T07:36:20.2888821Z * [new tag] cslpull91 -> cslpull91 2025-09-07T07:36:20.2889672Z * [new tag] cslpull92 -> cslpull92 2025-09-07T07:36:20.2890576Z * [new tag] flight_5 -> flight_5 2025-09-07T07:36:20.2891526Z * [new tag] flight_5.1 -> flight_5.1 2025-09-07T07:36:20.2892460Z * [new tag] flight_5.2 -> flight_5.2 2025-09-07T07:36:20.2893282Z * [new tag] flight_5.3 -> flight_5.3 2025-09-07T07:36:20.2894173Z * [new tag] forpull1 -> forpull1 2025-09-07T07:36:20.2895373Z * [new tag] malfet/tag-2ef5611 -> malfet/tag-2ef5611 2025-09-07T07:36:20.2896268Z * [new tag] malfet/tag-317b1a0 -> malfet/tag-317b1a0 2025-09-07T07:36:20.2897240Z * [new tag] malfet/tag-ec6f767 -> malfet/tag-ec6f767 2025-09-07T07:36:20.2898221Z * [new tag] nightly-binary -> nightly-binary 2025-09-07T07:36:20.2898942Z * [new tag] sqzhang_flight4_plus -> sqzhang_flight4_plus 2025-09-07T07:36:20.2899951Z * [new tag] sqzhang_flight_3 -> sqzhang_flight_3 2025-09-07T07:36:20.2901235Z * [new tag] trunk/00636e0171e7e733628c408084805442270cf608 -> trunk/00636e0171e7e733628c408084805442270cf608 2025-09-07T07:36:20.2902304Z * [new tag] trunk/019fed39aa6b2dd8c69347378d53423e5efae8d4 -> trunk/019fed39aa6b2dd8c69347378d53423e5efae8d4 2025-09-07T07:36:20.2903877Z * [new tag] trunk/01ab325cc2e0dc221af4d710974e1b9175066544 -> trunk/01ab325cc2e0dc221af4d710974e1b9175066544 2025-09-07T07:36:20.2905001Z * [new tag] trunk/01edcd4df8bf0c7b4cc2d3ec868bd2059eeea83b -> trunk/01edcd4df8bf0c7b4cc2d3ec868bd2059eeea83b 2025-09-07T07:36:20.2906025Z * [new tag] trunk/040d00af048967dde7938d358d7f5988cbd18388 -> trunk/040d00af048967dde7938d358d7f5988cbd18388 2025-09-07T07:36:20.2907112Z * [new tag] trunk/0447f2d99b4351b2ff129dce6eebb371024f73e5 -> trunk/0447f2d99b4351b2ff129dce6eebb371024f73e5 2025-09-07T07:36:20.2908069Z * [new tag] trunk/047603d35bdc70046216384838d6340feab79bf4 -> trunk/047603d35bdc70046216384838d6340feab79bf4 2025-09-07T07:36:20.2909063Z * [new tag] trunk/06da7c0730b3764f178ec3a90dedf4ffa4202d81 -> trunk/06da7c0730b3764f178ec3a90dedf4ffa4202d81 2025-09-07T07:36:20.2910391Z * [new tag] trunk/081cab045472ce045634548cc6c14a4870641e23 -> trunk/081cab045472ce045634548cc6c14a4870641e23 2025-09-07T07:36:20.2911428Z * [new tag] trunk/09587daf8c9f21f5340f73921ce5f23d1a4a4572 -> trunk/09587daf8c9f21f5340f73921ce5f23d1a4a4572 2025-09-07T07:36:20.2912376Z * [new tag] trunk/09be1890d72cc34fc946965dc4a27736bf0ca8c6 -> trunk/09be1890d72cc34fc946965dc4a27736bf0ca8c6 2025-09-07T07:36:20.2913331Z * [new tag] trunk/09d2f1b6315d6d416fbf452793d65795863ebc66 -> trunk/09d2f1b6315d6d416fbf452793d65795863ebc66 2025-09-07T07:36:20.2914172Z * [new tag] trunk/0af70e2353e1dcda83175fd4834ecb7b63e009e0 -> trunk/0af70e2353e1dcda83175fd4834ecb7b63e009e0 2025-09-07T07:36:20.2915641Z * [new tag] trunk/0c0e056a9e20c17271a6144dd32c0c7e3ba26736 -> trunk/0c0e056a9e20c17271a6144dd32c0c7e3ba26736 2025-09-07T07:36:20.2916596Z * [new tag] trunk/0cd6c56bdfa9178ff61be82ce3b178926ddb64a9 -> trunk/0cd6c56bdfa9178ff61be82ce3b178926ddb64a9 2025-09-07T07:36:20.2917547Z * [new tag] trunk/0d421ace32c1605ee8e452ee1eeb03bd243dd96c -> trunk/0d421ace32c1605ee8e452ee1eeb03bd243dd96c 2025-09-07T07:36:20.2918720Z * [new tag] trunk/0d71a9dd5b4b6d1dde58d91c9b71d96bc6a6a171 -> trunk/0d71a9dd5b4b6d1dde58d91c9b71d96bc6a6a171 2025-09-07T07:36:20.2919468Z * [new tag] trunk/0d84ff3b78f55492d3d4708458c92d776274939e -> trunk/0d84ff3b78f55492d3d4708458c92d776274939e 2025-09-07T07:36:20.2920461Z * [new tag] trunk/0f45aaf4414048b17d720d0915ce221a8de8ec63 -> trunk/0f45aaf4414048b17d720d0915ce221a8de8ec63 2025-09-07T07:36:20.2921318Z * [new tag] trunk/0ff8eabf1387de5acd6712a03bda61f1a3dfa27f -> trunk/0ff8eabf1387de5acd6712a03bda61f1a3dfa27f 2025-09-07T07:36:20.2922303Z * [new tag] trunk/104f2680e03d13a4765ca69f905d8f16fc0c822f -> trunk/104f2680e03d13a4765ca69f905d8f16fc0c822f 2025-09-07T07:36:20.2923283Z * [new tag] trunk/12814701555d3e41dfcdf8f9273af5821e322df0 -> trunk/12814701555d3e41dfcdf8f9273af5821e322df0 2025-09-07T07:36:20.2924251Z * [new tag] trunk/13b65196db422bdb394cb482e208c61ed448898c -> trunk/13b65196db422bdb394cb482e208c61ed448898c 2025-09-07T07:36:20.2925073Z * [new tag] trunk/13d66e2a66eceed14b8a8f5a971087df4f688a46 -> trunk/13d66e2a66eceed14b8a8f5a971087df4f688a46 2025-09-07T07:36:20.2926106Z * [new tag] trunk/145a3a7bda15e3963a33eb1b54bba5d4a270b225 -> trunk/145a3a7bda15e3963a33eb1b54bba5d4a270b225 2025-09-07T07:36:20.2927085Z * [new tag] trunk/146371483318e17929daefd37c8e459d9d6d47bb -> trunk/146371483318e17929daefd37c8e459d9d6d47bb 2025-09-07T07:36:20.2928054Z * [new tag] trunk/15c77a8cfd341e74fd124b077492ef2bfa51b339 -> trunk/15c77a8cfd341e74fd124b077492ef2bfa51b339 2025-09-07T07:36:20.2929057Z * [new tag] trunk/17fa8eec4a1e32939ab4d364ee6e75487a79b654 -> trunk/17fa8eec4a1e32939ab4d364ee6e75487a79b654 2025-09-07T07:36:20.2930442Z * [new tag] trunk/190c391a28845a14df26abb228d26aa813efb20c -> trunk/190c391a28845a14df26abb228d26aa813efb20c 2025-09-07T07:36:20.2931430Z * [new tag] trunk/1a588ace4667bde1331fbd8ed957157dca5cee68 -> trunk/1a588ace4667bde1331fbd8ed957157dca5cee68 2025-09-07T07:36:20.2932345Z * [new tag] trunk/1aa7476885e8f6e7b0ec3a5b6383aad9d3f343e7 -> trunk/1aa7476885e8f6e7b0ec3a5b6383aad9d3f343e7 2025-09-07T07:36:20.2933141Z * [new tag] trunk/1aeb421c342c9e9607842f4c87cb46e8e816ee53 -> trunk/1aeb421c342c9e9607842f4c87cb46e8e816ee53 2025-09-07T07:36:20.2934095Z * [new tag] trunk/1c1b28d5b6a942fafe23b2f09302d93c25226d4a -> trunk/1c1b28d5b6a942fafe23b2f09302d93c25226d4a 2025-09-07T07:36:20.2935084Z * [new tag] trunk/1ebd70d0c0d562d3be9abdee2a21906584af7d99 -> trunk/1ebd70d0c0d562d3be9abdee2a21906584af7d99 2025-09-07T07:36:20.2935926Z * [new tag] trunk/1ec2c15914da4ef7bd926ed9aebc8671c75fe965 -> trunk/1ec2c15914da4ef7bd926ed9aebc8671c75fe965 2025-09-07T07:36:20.2936908Z * [new tag] trunk/1f51056bd64e73d1aa81321bc3c098575b1bc78a -> trunk/1f51056bd64e73d1aa81321bc3c098575b1bc78a 2025-09-07T07:36:20.2937866Z * [new tag] trunk/1f820de639c75a1562d3fb03f160439f853ae07b -> trunk/1f820de639c75a1562d3fb03f160439f853ae07b 2025-09-07T07:36:20.2938827Z * [new tag] trunk/204697f0e695d82894c5010fbec664c4391f90cc -> trunk/204697f0e695d82894c5010fbec664c4391f90cc 2025-09-07T07:36:20.2939668Z * [new tag] trunk/20629b1619fe636227d01fc85ba221daa7185a05 -> trunk/20629b1619fe636227d01fc85ba221daa7185a05 2025-09-07T07:36:20.2940639Z * [new tag] trunk/20b47acef845e9c4f71da9429a396d293f50ebe7 -> trunk/20b47acef845e9c4f71da9429a396d293f50ebe7 2025-09-07T07:36:20.2941632Z * [new tag] trunk/20bfb2539d7c5250379648eda35f80b8a7d642dd -> trunk/20bfb2539d7c5250379648eda35f80b8a7d642dd 2025-09-07T07:36:20.2942602Z * [new tag] trunk/21fae99c180d17def562797ea0fb154d8fdf88e3 -> trunk/21fae99c180d17def562797ea0fb154d8fdf88e3 2025-09-07T07:36:20.2943842Z * [new tag] trunk/248355faf53f9f7ba2fd0a367d59600c6d991e7f -> trunk/248355faf53f9f7ba2fd0a367d59600c6d991e7f 2025-09-07T07:36:20.2944397Z * [new tag] trunk/25f4aaed9ec26f39c13862323ff8582006473d23 -> trunk/25f4aaed9ec26f39c13862323ff8582006473d23 2025-09-07T07:36:20.2945471Z * [new tag] trunk/261a84a1764412f8e659c956e3f81997ec3de9d5 -> trunk/261a84a1764412f8e659c956e3f81997ec3de9d5 2025-09-07T07:36:20.2946634Z * [new tag] trunk/28f4ab0737937858730f29f5c4e601e109cf9d5f -> trunk/28f4ab0737937858730f29f5c4e601e109cf9d5f 2025-09-07T07:36:20.2947609Z * [new tag] trunk/291cd11f2d5df6f48d348cce0e4e762f274f4dc4 -> trunk/291cd11f2d5df6f48d348cce0e4e762f274f4dc4 2025-09-07T07:36:20.2948594Z * [new tag] trunk/29280864d941e6108ab57f7298f520c0cf9696e9 -> trunk/29280864d941e6108ab57f7298f520c0cf9696e9 2025-09-07T07:36:20.2949647Z * [new tag] trunk/2a45837e98c63cae9d1a2e2133a727b829e549d5 -> trunk/2a45837e98c63cae9d1a2e2133a727b829e549d5 2025-09-07T07:36:20.2950627Z * [new tag] trunk/2a5c0785e2f975697fd7bdf1411de6e03dcaa1ef -> trunk/2a5c0785e2f975697fd7bdf1411de6e03dcaa1ef 2025-09-07T07:36:20.2951688Z * [new tag] trunk/2b8a83901c58a0858ea9e4ce00055f48e6ed164c -> trunk/2b8a83901c58a0858ea9e4ce00055f48e6ed164c 2025-09-07T07:36:20.2952637Z * [new tag] trunk/2ba65472dd54488a86a50326ea990195fc6732d6 -> trunk/2ba65472dd54488a86a50326ea990195fc6732d6 2025-09-07T07:36:20.2953720Z * [new tag] trunk/2c03f0acc53ed13fe8ebfe809129f25996e009a0 -> trunk/2c03f0acc53ed13fe8ebfe809129f25996e009a0 2025-09-07T07:36:20.2954419Z * [new tag] trunk/2dd529df0092799f68ee7afcf52338276906706a -> trunk/2dd529df0092799f68ee7afcf52338276906706a 2025-09-07T07:36:20.2955454Z * [new tag] trunk/2f6b4b1ad3f82bb3bd984f6e65744ea339ffb8b5 -> trunk/2f6b4b1ad3f82bb3bd984f6e65744ea339ffb8b5 2025-09-07T07:36:20.2956410Z * [new tag] trunk/2fa0520a64ed8aa734a56c4d124958f0b5711ca8 -> trunk/2fa0520a64ed8aa734a56c4d124958f0b5711ca8 2025-09-07T07:36:20.2957414Z * [new tag] trunk/302df2ac5dc4222294c09d48804a2dddb8f4bad8 -> trunk/302df2ac5dc4222294c09d48804a2dddb8f4bad8 2025-09-07T07:36:20.2958246Z * [new tag] trunk/33028597bfa2e0178e28c8cce33cb9b3800cac43 -> trunk/33028597bfa2e0178e28c8cce33cb9b3800cac43 2025-09-07T07:36:20.2959244Z * [new tag] trunk/34aa78274d6770086025a967fa63a86830e08176 -> trunk/34aa78274d6770086025a967fa63a86830e08176 2025-09-07T07:36:20.2960235Z * [new tag] trunk/3559c354ce6a14d11fe29fb12fa2747a2f2af449 -> trunk/3559c354ce6a14d11fe29fb12fa2747a2f2af449 2025-09-07T07:36:20.2960988Z * [new tag] trunk/36d207fcaaede0d1e58a5168084c307b32b6fd8b -> trunk/36d207fcaaede0d1e58a5168084c307b32b6fd8b 2025-09-07T07:36:20.2963213Z * [new tag] trunk/377033757ae5ca524ea842f1b0a5f446ed3d8fe0 -> trunk/377033757ae5ca524ea842f1b0a5f446ed3d8fe0 2025-09-07T07:36:20.2963464Z * [new tag] trunk/3771380f83fcac154a7c89ad679311d8c4818287 -> trunk/3771380f83fcac154a7c89ad679311d8c4818287 2025-09-07T07:36:20.2964262Z * [new tag] trunk/3a207816cc569f78863d86c01f2a3d265350e39f -> trunk/3a207816cc569f78863d86c01f2a3d265350e39f 2025-09-07T07:36:20.2965329Z * [new tag] trunk/3a20a20e7065ec927fdd216d4da3b04f879b3c67 -> trunk/3a20a20e7065ec927fdd216d4da3b04f879b3c67 2025-09-07T07:36:20.2965842Z * [new tag] trunk/3bbc2e3e4f025523eaa5dbff220b3e96bca608d0 -> trunk/3bbc2e3e4f025523eaa5dbff220b3e96bca608d0 2025-09-07T07:36:20.2967043Z * [new tag] trunk/3c0ff1b569c45cfa6935ad8031a9d4cf1551aa3f -> trunk/3c0ff1b569c45cfa6935ad8031a9d4cf1551aa3f 2025-09-07T07:36:20.2967982Z * [new tag] trunk/3c45af079afc92a03b03ddf4f9198902ffcf30cf -> trunk/3c45af079afc92a03b03ddf4f9198902ffcf30cf 2025-09-07T07:36:20.2969085Z * [new tag] trunk/3dde5d7f9bf80dd6623a712bc429e9e4302464b5 -> trunk/3dde5d7f9bf80dd6623a712bc429e9e4302464b5 2025-09-07T07:36:20.2969830Z * [new tag] trunk/403a3a393cda7e60f503f3b04b8805a845dcf45d -> trunk/403a3a393cda7e60f503f3b04b8805a845dcf45d 2025-09-07T07:36:20.2970818Z * [new tag] trunk/420c52ecf36f86d32da0853bfbe074b682b070aa -> trunk/420c52ecf36f86d32da0853bfbe074b682b070aa 2025-09-07T07:36:20.2971844Z * [new tag] trunk/43b7c86a2c0f91320f5c5f4827b111edff06fdb6 -> trunk/43b7c86a2c0f91320f5c5f4827b111edff06fdb6 2025-09-07T07:36:20.2972588Z * [new tag] trunk/451ed931562ec8b46d1f7e6c266a68132a119336 -> trunk/451ed931562ec8b46d1f7e6c266a68132a119336 2025-09-07T07:36:20.2973557Z * [new tag] trunk/480c7391126656154318fabf1d57ebc01e196e63 -> trunk/480c7391126656154318fabf1d57ebc01e196e63 2025-09-07T07:36:20.2974533Z * [new tag] trunk/48bedd753da22634aa94fbafeb731e82025404f3 -> trunk/48bedd753da22634aa94fbafeb731e82025404f3 2025-09-07T07:36:20.2975354Z * [new tag] trunk/494878a11b79071ada0b98f34042d47155be6d1c -> trunk/494878a11b79071ada0b98f34042d47155be6d1c 2025-09-07T07:36:20.2976380Z * [new tag] trunk/4ae57d448c0a7d37e4cfd5c27d977fad2cef4051 -> trunk/4ae57d448c0a7d37e4cfd5c27d977fad2cef4051 2025-09-07T07:36:20.2977319Z * [new tag] trunk/4cdaf8265d86f984254b62052da8c26ef61ef1cf -> trunk/4cdaf8265d86f984254b62052da8c26ef61ef1cf 2025-09-07T07:36:20.2978117Z * [new tag] trunk/4d4abec80f03cd8fdefe1d9cb3a60d3690cd777e -> trunk/4d4abec80f03cd8fdefe1d9cb3a60d3690cd777e 2025-09-07T07:36:20.2979129Z * [new tag] trunk/4e42aa8ffc44b8340eb0eeaf80a2cafc4763a186 -> trunk/4e42aa8ffc44b8340eb0eeaf80a2cafc4763a186 2025-09-07T07:36:20.2980095Z * [new tag] trunk/4f72d932feee0749397fec876dcd43994f50b215 -> trunk/4f72d932feee0749397fec876dcd43994f50b215 2025-09-07T07:36:20.2981001Z * [new tag] trunk/50fc22dedf3c4a27be61fa05551c4f320281b42d -> trunk/50fc22dedf3c4a27be61fa05551c4f320281b42d 2025-09-07T07:36:20.2981994Z * [new tag] trunk/5211f1f908907ffc064b56e43cf8659f7fc22aa9 -> trunk/5211f1f908907ffc064b56e43cf8659f7fc22aa9 2025-09-07T07:36:20.2982929Z * [new tag] trunk/524b78d4f67045b83bb69edc56ab16efe282971c -> trunk/524b78d4f67045b83bb69edc56ab16efe282971c 2025-09-07T07:36:20.2983881Z * [new tag] trunk/54e275e0d81fe1e1ccfa4fb5f2a5a9aaca00ca15 -> trunk/54e275e0d81fe1e1ccfa4fb5f2a5a9aaca00ca15 2025-09-07T07:36:20.2984652Z * [new tag] trunk/5561e45758d59c94605873d5db48ed459c004c3b -> trunk/5561e45758d59c94605873d5db48ed459c004c3b 2025-09-07T07:36:20.2985824Z * [new tag] trunk/57278d45f046d4f89f45d373b1af4dd56934ff24 -> trunk/57278d45f046d4f89f45d373b1af4dd56934ff24 2025-09-07T07:36:20.2986780Z * [new tag] trunk/5927a70934ccf7b70182d364c23245a7dd685503 -> trunk/5927a70934ccf7b70182d364c23245a7dd685503 2025-09-07T07:36:20.2987749Z * [new tag] trunk/5985e28912aeb40b103ebfcf2fd0665eb4a50599 -> trunk/5985e28912aeb40b103ebfcf2fd0665eb4a50599 2025-09-07T07:36:20.2988748Z * [new tag] trunk/5a2da090ed6db88bb657c4e51ec0b310cd08bff6 -> trunk/5a2da090ed6db88bb657c4e51ec0b310cd08bff6 2025-09-07T07:36:20.2989709Z * [new tag] trunk/5c473e9f5ee0ef0fc38e6cf34a95b547f8cdc8d5 -> trunk/5c473e9f5ee0ef0fc38e6cf34a95b547f8cdc8d5 2025-09-07T07:36:20.2990676Z * [new tag] trunk/5c67426d6847667a7c55a2dd01f470fa37238c18 -> trunk/5c67426d6847667a7c55a2dd01f470fa37238c18 2025-09-07T07:36:20.2991680Z * [new tag] trunk/5da573c42c332bc68d4b7946c69f690a876d951a -> trunk/5da573c42c332bc68d4b7946c69f690a876d951a 2025-09-07T07:36:20.2992613Z * [new tag] trunk/5e5870e858f60ff4bf87d03f3592097e934a9580 -> trunk/5e5870e858f60ff4bf87d03f3592097e934a9580 2025-09-07T07:36:20.2993584Z * [new tag] trunk/5f3cbc9442aa55b5afb29f4ac8ca9be569003e84 -> trunk/5f3cbc9442aa55b5afb29f4ac8ca9be569003e84 2025-09-07T07:36:20.2994619Z * [new tag] trunk/600c25e9a17fe56e3dee872be8854db08916ba0c -> trunk/600c25e9a17fe56e3dee872be8854db08916ba0c 2025-09-07T07:36:20.2995394Z * [new tag] trunk/601ae8e4831fc8123fffcfb8fd2e6b6381b42e14 -> trunk/601ae8e4831fc8123fffcfb8fd2e6b6381b42e14 2025-09-07T07:36:20.2996395Z * [new tag] trunk/6087ef41e54c2494b117ffd923faf20f515a6806 -> trunk/6087ef41e54c2494b117ffd923faf20f515a6806 2025-09-07T07:36:20.2997242Z * [new tag] trunk/626cb7df8161dd4ecb4fe43b60f37ce9076f56b1 -> trunk/626cb7df8161dd4ecb4fe43b60f37ce9076f56b1 2025-09-07T07:36:20.2998235Z * [new tag] trunk/62c3f9a97fd3dea7132a93066d32d893ffe101e6 -> trunk/62c3f9a97fd3dea7132a93066d32d893ffe101e6 2025-09-07T07:36:20.2999389Z * [new tag] trunk/63a9c23fe99eacfd09610c36dfe8f01b053c1a35 -> trunk/63a9c23fe99eacfd09610c36dfe8f01b053c1a35 2025-09-07T07:36:20.3000433Z * [new tag] trunk/65985937d97505f648b6ed852c3129f2dd08b251 -> trunk/65985937d97505f648b6ed852c3129f2dd08b251 2025-09-07T07:36:20.3001772Z * [new tag] trunk/66f3b4a682a6153517dd23369fdc3289b6494b07 -> trunk/66f3b4a682a6153517dd23369fdc3289b6494b07 2025-09-07T07:36:20.3002526Z * [new tag] trunk/6737e2c996990024187ba620d2764f3b6f6add2c -> trunk/6737e2c996990024187ba620d2764f3b6f6add2c 2025-09-07T07:36:20.3003526Z * [new tag] trunk/67c31dcd364f10072a55f4a30ffd1151c686283a -> trunk/67c31dcd364f10072a55f4a30ffd1151c686283a 2025-09-07T07:36:20.3004523Z * [new tag] trunk/68738beff73e9c3512e18b4edea811a897ce42db -> trunk/68738beff73e9c3512e18b4edea811a897ce42db 2025-09-07T07:36:20.3005566Z * [new tag] trunk/69a25f68884a168550695fdb1a7c310c54d29536 -> trunk/69a25f68884a168550695fdb1a7c310c54d29536 2025-09-07T07:36:20.3006547Z * [new tag] trunk/6b1900c22f1a07b9519346898d4c71d8a2b0f12f -> trunk/6b1900c22f1a07b9519346898d4c71d8a2b0f12f 2025-09-07T07:36:20.3007365Z * [new tag] trunk/6b8b3ac4403f771bd4a8f9a45d93347304148774 -> trunk/6b8b3ac4403f771bd4a8f9a45d93347304148774 2025-09-07T07:36:20.3008390Z * [new tag] trunk/6f7608d603834d6068b2e7a5d59bec3973b6bb1b -> trunk/6f7608d603834d6068b2e7a5d59bec3973b6bb1b 2025-09-07T07:36:20.3009365Z * [new tag] trunk/70d36e047dfb3488fd6335016711a784d810ebda -> trunk/70d36e047dfb3488fd6335016711a784d810ebda 2025-09-07T07:36:20.3010480Z * [new tag] trunk/71992dd805ff9d6763f77214dfe8b0465e88c87b -> trunk/71992dd805ff9d6763f77214dfe8b0465e88c87b 2025-09-07T07:36:20.3011412Z * [new tag] trunk/734ce8eba9c69381f187359bf0fef1d71d84cd20 -> trunk/734ce8eba9c69381f187359bf0fef1d71d84cd20 2025-09-07T07:36:20.3012411Z * [new tag] trunk/73eb4511fb863a37944342b7e92aae706de603c8 -> trunk/73eb4511fb863a37944342b7e92aae706de603c8 2025-09-07T07:36:20.3013451Z * [new tag] trunk/75bc23cfc345bd4c05e7f97c416c4b3d2d1fa64b -> trunk/75bc23cfc345bd4c05e7f97c416c4b3d2d1fa64b 2025-09-07T07:36:20.3014288Z * [new tag] trunk/771f369448321a387f2018535bc8b8b6e5f12fab -> trunk/771f369448321a387f2018535bc8b8b6e5f12fab 2025-09-07T07:36:20.3015312Z * [new tag] trunk/789d4942127143f2adcb53612c058ce4c9a2cf20 -> trunk/789d4942127143f2adcb53612c058ce4c9a2cf20 2025-09-07T07:36:20.3016083Z * [new tag] trunk/791eff96c85678c950888f9da24650083ee673fe -> trunk/791eff96c85678c950888f9da24650083ee673fe 2025-09-07T07:36:20.3016918Z * [new tag] trunk/793fc12aff1f69fbbf9f4278182fb52bbe350fc9 -> trunk/793fc12aff1f69fbbf9f4278182fb52bbe350fc9 2025-09-07T07:36:20.3017881Z * [new tag] trunk/79fcd5247a9a129eee526a14df30bfc6a22b3f01 -> trunk/79fcd5247a9a129eee526a14df30bfc6a22b3f01 2025-09-07T07:36:20.3018836Z * [new tag] trunk/7f4ff79210eb06924f223ae3a1941ee0e2635348 -> trunk/7f4ff79210eb06924f223ae3a1941ee0e2635348 2025-09-07T07:36:20.3019888Z * [new tag] trunk/8076a185c85112be62be292eb47409c88a585b1c -> trunk/8076a185c85112be62be292eb47409c88a585b1c 2025-09-07T07:36:20.3020667Z * [new tag] trunk/80dd397f1979371a5583fa3d5c7352029522a78d -> trunk/80dd397f1979371a5583fa3d5c7352029522a78d 2025-09-07T07:36:20.3021609Z * [new tag] trunk/8171d6052ec12628eb67e0040839314056014429 -> trunk/8171d6052ec12628eb67e0040839314056014429 2025-09-07T07:36:20.3022567Z * [new tag] trunk/81aeefa657b7ccc26b275c50a9f33b2f056e8071 -> trunk/81aeefa657b7ccc26b275c50a9f33b2f056e8071 2025-09-07T07:36:20.3023509Z * [new tag] trunk/81b7b16618bda250ce55982894a83dc0805eb64c -> trunk/81b7b16618bda250ce55982894a83dc0805eb64c 2025-09-07T07:36:20.3024448Z * [new tag] trunk/827f0d405448de31f79d1089f7d7fceab2f87895 -> trunk/827f0d405448de31f79d1089f7d7fceab2f87895 2025-09-07T07:36:20.3025398Z * [new tag] trunk/82f63c8f6de63c30132a8ac299b6e8c2fd0d3fe8 -> trunk/82f63c8f6de63c30132a8ac299b6e8c2fd0d3fe8 2025-09-07T07:36:20.3026457Z * [new tag] trunk/850e1382a9c56bfde18af09d3e72352d775e9435 -> trunk/850e1382a9c56bfde18af09d3e72352d775e9435 2025-09-07T07:36:20.3027458Z * [new tag] trunk/8678d831c48e616b717bff50f2d03141d2e9f965 -> trunk/8678d831c48e616b717bff50f2d03141d2e9f965 2025-09-07T07:36:20.3028807Z * [new tag] trunk/869cbcc16e489a4f5a14a93d5779b0ea86061c60 -> trunk/869cbcc16e489a4f5a14a93d5779b0ea86061c60 2025-09-07T07:36:20.3029793Z * [new tag] trunk/8703debf669bc2238211bfd039f4ecdd8228b7f7 -> trunk/8703debf669bc2238211bfd039f4ecdd8228b7f7 2025-09-07T07:36:20.3030784Z * [new tag] trunk/874069fbe46e82da5cfa405e6c0deb12e89ff608 -> trunk/874069fbe46e82da5cfa405e6c0deb12e89ff608 2025-09-07T07:36:20.3031821Z * [new tag] trunk/8875d6e394da2fffd04f31b28bf258c94d4776a3 -> trunk/8875d6e394da2fffd04f31b28bf258c94d4776a3 2025-09-07T07:36:20.3032731Z * [new tag] trunk/88d94d17e8c5155451393afa6eb3bab48ab61c16 -> trunk/88d94d17e8c5155451393afa6eb3bab48ab61c16 2025-09-07T07:36:20.3033752Z * [new tag] trunk/890626632def7e0ef95a2d01e87a0e4627824a9f -> trunk/890626632def7e0ef95a2d01e87a0e4627824a9f 2025-09-07T07:36:20.3034856Z * [new tag] trunk/8975cda2520b7b1b5bc3b4d8213edf261fa82570 -> trunk/8975cda2520b7b1b5bc3b4d8213edf261fa82570 2025-09-07T07:36:20.3035787Z * [new tag] trunk/89d41d3f61d04f14730ec26f008a59bef6624610 -> trunk/89d41d3f61d04f14730ec26f008a59bef6624610 2025-09-07T07:36:20.3036718Z * [new tag] trunk/8bb213b6d599ef1273fe52f9b1f6d476056c3a41 -> trunk/8bb213b6d599ef1273fe52f9b1f6d476056c3a41 2025-09-07T07:36:20.3037662Z * [new tag] trunk/8e23a1227b5fb2e39afaa7d57c075a75b640a5af -> trunk/8e23a1227b5fb2e39afaa7d57c075a75b640a5af 2025-09-07T07:36:20.3038909Z * [new tag] trunk/8ec551bb354ab2b85fbbba9d461740a20366d248 -> trunk/8ec551bb354ab2b85fbbba9d461740a20366d248 2025-09-07T07:36:20.3039959Z * [new tag] trunk/8fd3c9ce919c8d5c645fd348bba517e948cbc29d -> trunk/8fd3c9ce919c8d5c645fd348bba517e948cbc29d 2025-09-07T07:36:20.3041084Z * [new tag] trunk/90f50f7e68e120d9574e6e3189e37b4280010ad9 -> trunk/90f50f7e68e120d9574e6e3189e37b4280010ad9 2025-09-07T07:36:20.3042166Z * [new tag] trunk/91f0bcf43fc0bc743350d491ac63b77e92054ac9 -> trunk/91f0bcf43fc0bc743350d491ac63b77e92054ac9 2025-09-07T07:36:20.3043194Z * [new tag] trunk/92576a594b8121f6b0b1b5a3ea16d08792fc68ab -> trunk/92576a594b8121f6b0b1b5a3ea16d08792fc68ab 2025-09-07T07:36:20.3044155Z * [new tag] trunk/92a43025e0baa1f2ce345f28d22913b518a1ab9d -> trunk/92a43025e0baa1f2ce345f28d22913b518a1ab9d 2025-09-07T07:36:20.3044971Z * [new tag] trunk/93fb23d6fae7c4e82c4239a1033e522088742634 -> trunk/93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:36:20.3045971Z * [new tag] trunk/9458d1ac3bd70c2af316a8ba95d2c6c9c1199c9c -> trunk/9458d1ac3bd70c2af316a8ba95d2c6c9c1199c9c 2025-09-07T07:36:20.3047057Z * [new tag] trunk/9480cdc0b61488c89a23c2f64f43b2dcedc8728e -> trunk/9480cdc0b61488c89a23c2f64f43b2dcedc8728e 2025-09-07T07:36:20.3048217Z * [new tag] trunk/9491d289b329e4ba4a9f5f5b1be7960671bb7840 -> trunk/9491d289b329e4ba4a9f5f5b1be7960671bb7840 2025-09-07T07:36:20.3049166Z * [new tag] trunk/9499c8761cd2067feb9877414e818f6fd00290f1 -> trunk/9499c8761cd2067feb9877414e818f6fd00290f1 2025-09-07T07:36:20.3050173Z * [new tag] trunk/95ee0bfea99d3d346d6502b91b497d2b35795504 -> trunk/95ee0bfea99d3d346d6502b91b497d2b35795504 2025-09-07T07:36:20.3051130Z * [new tag] trunk/98374612fc2febd686be20761e56bdc2424bc36a -> trunk/98374612fc2febd686be20761e56bdc2424bc36a 2025-09-07T07:36:20.3052253Z * [new tag] trunk/98efc9e93d8fc61eb53cb91378443617cb550500 -> trunk/98efc9e93d8fc61eb53cb91378443617cb550500 2025-09-07T07:36:20.3053221Z * [new tag] trunk/994f2a5dbcbdc915da39bf6f6ce4d1f5e74835c9 -> trunk/994f2a5dbcbdc915da39bf6f6ce4d1f5e74835c9 2025-09-07T07:36:20.3054272Z * [new tag] trunk/99f356fa58c8d726cef022d8710f5491291158f6 -> trunk/99f356fa58c8d726cef022d8710f5491291158f6 2025-09-07T07:36:20.3055283Z * [new tag] trunk/9a1c5c0a078b94d13ac5c1ae0d754d19fb73bf99 -> trunk/9a1c5c0a078b94d13ac5c1ae0d754d19fb73bf99 2025-09-07T07:36:20.3056318Z * [new tag] trunk/9a665ca3c472384e9d722bddba79e5a7680f1abd -> trunk/9a665ca3c472384e9d722bddba79e5a7680f1abd 2025-09-07T07:36:20.3057323Z * [new tag] trunk/9aedb3cd87b52160872173c177f61053d97bed57 -> trunk/9aedb3cd87b52160872173c177f61053d97bed57 2025-09-07T07:36:20.3058319Z * [new tag] trunk/9b81fe281da41f2421506339d26b027a468902f4 -> trunk/9b81fe281da41f2421506339d26b027a468902f4 2025-09-07T07:36:20.3059209Z * [new tag] trunk/9bdcee01f86e2969cff1140cdecfca13cb51816e -> trunk/9bdcee01f86e2969cff1140cdecfca13cb51816e 2025-09-07T07:36:20.3060237Z * [new tag] trunk/9c03d6be87eedc06e524e202e07a7e776551a839 -> trunk/9c03d6be87eedc06e524e202e07a7e776551a839 2025-09-07T07:36:20.3061214Z * [new tag] trunk/9c957723a0fedd9c637e63e023a613019e2cab60 -> trunk/9c957723a0fedd9c637e63e023a613019e2cab60 2025-09-07T07:36:20.3062174Z * [new tag] trunk/9e5247f51d81735e5f1e65e80588985fa93bccc5 -> trunk/9e5247f51d81735e5f1e65e80588985fa93bccc5 2025-09-07T07:36:20.3063211Z * [new tag] trunk/9eadb37cdd699f7e8e8177a5227bfeb16184ef26 -> trunk/9eadb37cdd699f7e8e8177a5227bfeb16184ef26 2025-09-07T07:36:20.3064253Z * [new tag] trunk/a00cdc1e4159db73c9ffb3f25e93e55877709a29 -> trunk/a00cdc1e4159db73c9ffb3f25e93e55877709a29 2025-09-07T07:36:20.3065230Z * [new tag] trunk/a02ee4a816d11380c6f564c1aba64d56af5ba705 -> trunk/a02ee4a816d11380c6f564c1aba64d56af5ba705 2025-09-07T07:36:20.3066295Z * [new tag] trunk/a3c7f77e50f900721817934120d60c2361b3c40d -> trunk/a3c7f77e50f900721817934120d60c2361b3c40d 2025-09-07T07:36:20.3067301Z * [new tag] trunk/a3d72b09ae12126a2b7d4a63a45ac100a882a802 -> trunk/a3d72b09ae12126a2b7d4a63a45ac100a882a802 2025-09-07T07:36:20.3068273Z * [new tag] trunk/a3e5466002791da609fcb069155d8ee347baee92 -> trunk/a3e5466002791da609fcb069155d8ee347baee92 2025-09-07T07:36:20.3069319Z * [new tag] trunk/a714437093ed196eee28f7de454cf4c41badc098 -> trunk/a714437093ed196eee28f7de454cf4c41badc098 2025-09-07T07:36:20.3070304Z * [new tag] trunk/a75e8cd27098f290de0b7439685d05ce02e91356 -> trunk/a75e8cd27098f290de0b7439685d05ce02e91356 2025-09-07T07:36:20.3071131Z * [new tag] trunk/a8d6943d36c1c2a5f90d3573460695bad4b623ae -> trunk/a8d6943d36c1c2a5f90d3573460695bad4b623ae 2025-09-07T07:36:20.3072151Z * [new tag] trunk/a918bbad6ab20649ff82eefb48417ecbe96bcb34 -> trunk/a918bbad6ab20649ff82eefb48417ecbe96bcb34 2025-09-07T07:36:20.3073273Z * [new tag] trunk/a99d8d39bc842d6ebc3e368b178e4884d24b056e -> trunk/a99d8d39bc842d6ebc3e368b178e4884d24b056e 2025-09-07T07:36:20.3074218Z * [new tag] trunk/aac1a50a191b4102d566c9c1ea22f06d6c2e3f02 -> trunk/aac1a50a191b4102d566c9c1ea22f06d6c2e3f02 2025-09-07T07:36:20.3075191Z * [new tag] trunk/aad96a202244c7d0d120c04ba8db593edd8c0f92 -> trunk/aad96a202244c7d0d120c04ba8db593edd8c0f92 2025-09-07T07:36:20.3076175Z * [new tag] trunk/ab643e4dbbaf7b663d4237514cbf01af9b11565c -> trunk/ab643e4dbbaf7b663d4237514cbf01af9b11565c 2025-09-07T07:36:20.3077172Z * [new tag] trunk/abc447174cd2cf8591edbc70a9f836f9a5779f47 -> trunk/abc447174cd2cf8591edbc70a9f836f9a5779f47 2025-09-07T07:36:20.3078130Z * [new tag] trunk/acece97c3a9dceb63194e314da93fdf37cf15a0d -> trunk/acece97c3a9dceb63194e314da93fdf37cf15a0d 2025-09-07T07:36:20.3079155Z * [new tag] trunk/adae7f66aacf3f248c3101b858cf98d5809119fa -> trunk/adae7f66aacf3f248c3101b858cf98d5809119fa 2025-09-07T07:36:20.3080173Z * [new tag] trunk/ae0edc133e61e3b16caf0b2ee0ff3f33ab72af4c -> trunk/ae0edc133e61e3b16caf0b2ee0ff3f33ab72af4c 2025-09-07T07:36:20.3081127Z * [new tag] trunk/aed33a8fcbd60b052d4559d261390c5797129c6d -> trunk/aed33a8fcbd60b052d4559d261390c5797129c6d 2025-09-07T07:36:20.3082221Z * [new tag] trunk/b04e922712080a3652e438d05e8bb74e0cd2d238 -> trunk/b04e922712080a3652e438d05e8bb74e0cd2d238 2025-09-07T07:36:20.3083237Z * [new tag] trunk/b0a3e58dd71c1a039ac0ef51e5bd8f704f632f6f -> trunk/b0a3e58dd71c1a039ac0ef51e5bd8f704f632f6f 2025-09-07T07:36:20.3084261Z * [new tag] trunk/b16d3f4c8c01d461c2f01064e9ca5fa2b33f5cf1 -> trunk/b16d3f4c8c01d461c2f01064e9ca5fa2b33f5cf1 2025-09-07T07:36:20.3085230Z * [new tag] trunk/b18bb6796f210a183e687d9d64984a5a9d13cf09 -> trunk/b18bb6796f210a183e687d9d64984a5a9d13cf09 2025-09-07T07:36:20.3086296Z * [new tag] trunk/b1bb98ddebdd3e41bf7987372409bdce96ae55de -> trunk/b1bb98ddebdd3e41bf7987372409bdce96ae55de 2025-09-07T07:36:20.3087286Z * [new tag] trunk/b2b4add0e754411372060e1d7b4057a66439172b -> trunk/b2b4add0e754411372060e1d7b4057a66439172b 2025-09-07T07:36:20.3088269Z * [new tag] trunk/b2c7b9ad2dc5a7c0b61febd307761bd5bc2f0f05 -> trunk/b2c7b9ad2dc5a7c0b61febd307761bd5bc2f0f05 2025-09-07T07:36:20.3089247Z * [new tag] trunk/b40d9432be44a6b5974ee62e7d19c3c61c5ece37 -> trunk/b40d9432be44a6b5974ee62e7d19c3c61c5ece37 2025-09-07T07:36:20.3090211Z * [new tag] trunk/b4ad38279b178b7bd14355123c1101e2e853e77b -> trunk/b4ad38279b178b7bd14355123c1101e2e853e77b 2025-09-07T07:36:20.3091182Z * [new tag] trunk/b67c41039835bd9b20b83cd6233e86baaa5f5dde -> trunk/b67c41039835bd9b20b83cd6233e86baaa5f5dde 2025-09-07T07:36:20.3092293Z * [new tag] trunk/b6d0a9ea9056ede4f7024dbf3bd6c43be3aff49c -> trunk/b6d0a9ea9056ede4f7024dbf3bd6c43be3aff49c 2025-09-07T07:36:20.3093723Z * [new tag] trunk/b7dad7dd49448c88d0751fa2e29c70afe985f734 -> trunk/b7dad7dd49448c88d0751fa2e29c70afe985f734 2025-09-07T07:36:20.3094737Z * [new tag] trunk/b7e207ca9f046ddd716076965a0cce403ba99052 -> trunk/b7e207ca9f046ddd716076965a0cce403ba99052 2025-09-07T07:36:20.3095754Z * [new tag] trunk/b919560c4a7010e2d89facee25586269a994746e -> trunk/b919560c4a7010e2d89facee25586269a994746e 2025-09-07T07:36:20.3096818Z * [new tag] trunk/b9ba612f7a968f7b27e121ca8f4d0a4d954f5354 -> trunk/b9ba612f7a968f7b27e121ca8f4d0a4d954f5354 2025-09-07T07:36:20.3097986Z * [new tag] trunk/ba7f546ccccb5e0b36d9070dc25f26a9647f89f8 -> trunk/ba7f546ccccb5e0b36d9070dc25f26a9647f89f8 2025-09-07T07:36:20.3098960Z * [new tag] trunk/bb950284c7e72905994bc25dd436c10e48088d85 -> trunk/bb950284c7e72905994bc25dd436c10e48088d85 2025-09-07T07:36:20.3099967Z * [new tag] trunk/bbedc71fd3267c639c38b4ec25eaa22f973d9c4d -> trunk/bbedc71fd3267c639c38b4ec25eaa22f973d9c4d 2025-09-07T07:36:20.3100861Z * [new tag] trunk/bc4db2c27fce6ff1648bdc5af31ec225d2a31f37 -> trunk/bc4db2c27fce6ff1648bdc5af31ec225d2a31f37 2025-09-07T07:36:20.3101783Z * [new tag] trunk/bc505977fb66677a09c31155c987330fbb18a865 -> trunk/bc505977fb66677a09c31155c987330fbb18a865 2025-09-07T07:36:20.3102807Z * [new tag] trunk/bd39e47feea7326afb5bbb67fcb1e69279239527 -> trunk/bd39e47feea7326afb5bbb67fcb1e69279239527 2025-09-07T07:36:20.3103865Z * [new tag] trunk/be5b03dde96638f25ffd732a4fed7e41b4cf40e1 -> trunk/be5b03dde96638f25ffd732a4fed7e41b4cf40e1 2025-09-07T07:36:20.3104858Z * [new tag] trunk/bffc7dd1f374d8408911cd22c6b3d6df39ded9b3 -> trunk/bffc7dd1f374d8408911cd22c6b3d6df39ded9b3 2025-09-07T07:36:20.3105911Z * [new tag] trunk/c024b1f5a18d5c5aee5cc2acdd4c52b24b93ffcf -> trunk/c024b1f5a18d5c5aee5cc2acdd4c52b24b93ffcf 2025-09-07T07:36:20.3106945Z * [new tag] trunk/c0983e6cc0acf71689e1851d12609e00b3f59371 -> trunk/c0983e6cc0acf71689e1851d12609e00b3f59371 2025-09-07T07:36:20.3108022Z * [new tag] trunk/c10195e723eeeedd099ed8b73eda7184ca618fad -> trunk/c10195e723eeeedd099ed8b73eda7184ca618fad 2025-09-07T07:36:20.3109012Z * [new tag] trunk/c157cf6488ade6a7ee2ce2d25b059e1335630a99 -> trunk/c157cf6488ade6a7ee2ce2d25b059e1335630a99 2025-09-07T07:36:20.3110141Z * [new tag] trunk/c2a30246172fd71d56529907ffd3c27b76b1f3a7 -> trunk/c2a30246172fd71d56529907ffd3c27b76b1f3a7 2025-09-07T07:36:20.3111211Z * [new tag] trunk/c32111149921b48bfef909293f1049e21619ed76 -> trunk/c32111149921b48bfef909293f1049e21619ed76 2025-09-07T07:36:20.3112033Z * [new tag] trunk/c37103234afc832dcad307e9016230810957c9d5 -> trunk/c37103234afc832dcad307e9016230810957c9d5 2025-09-07T07:36:20.3113094Z * [new tag] trunk/c3ceca2995cd35e1376c4b0704669bff1a81e836 -> trunk/c3ceca2995cd35e1376c4b0704669bff1a81e836 2025-09-07T07:36:20.3114078Z * [new tag] trunk/c3d54dea9febb1236d48d19e5d4876a63f2e20fd -> trunk/c3d54dea9febb1236d48d19e5d4876a63f2e20fd 2025-09-07T07:36:20.3115036Z * [new tag] trunk/c465b3d52c5687fe910d35a5c75341b77f821741 -> trunk/c465b3d52c5687fe910d35a5c75341b77f821741 2025-09-07T07:36:20.3116010Z * [new tag] trunk/c5b8a10be5e89396da916d1069ffcb7135f0372b -> trunk/c5b8a10be5e89396da916d1069ffcb7135f0372b 2025-09-07T07:36:20.3116920Z * [new tag] trunk/c7e41071a08f4045bc11ab60ec366d7357d56e30 -> trunk/c7e41071a08f4045bc11ab60ec366d7357d56e30 2025-09-07T07:36:20.3117921Z * [new tag] trunk/c98ddaca6d2e19ca37aff00c4ff0cda1e9a6ff65 -> trunk/c98ddaca6d2e19ca37aff00c4ff0cda1e9a6ff65 2025-09-07T07:36:20.3119113Z * [new tag] trunk/cb1e31362c7b53acf4ac95b9f8878064c184f03b -> trunk/cb1e31362c7b53acf4ac95b9f8878064c184f03b 2025-09-07T07:36:20.3120129Z * [new tag] trunk/cbfb005f7cce79974795b148e265f594f59477c8 -> trunk/cbfb005f7cce79974795b148e265f594f59477c8 2025-09-07T07:36:20.3121129Z * [new tag] trunk/cc5bdd12401bda835291d2f3cb297132ebdbf358 -> trunk/cc5bdd12401bda835291d2f3cb297132ebdbf358 2025-09-07T07:36:20.3122271Z * [new tag] trunk/cd529b686d54bbaa443f5b310140de48422d96c7 -> trunk/cd529b686d54bbaa443f5b310140de48422d96c7 2025-09-07T07:36:20.3123216Z * [new tag] trunk/cec0ff122815582af5302360aff03676558c5c87 -> trunk/cec0ff122815582af5302360aff03676558c5c87 2025-09-07T07:36:20.3124228Z * [new tag] trunk/d11720efdb563d02cf4f7d324311fb15a755268e -> trunk/d11720efdb563d02cf4f7d324311fb15a755268e 2025-09-07T07:36:20.3125182Z * [new tag] trunk/d1706d9128ae24d9048167e80d3fe5196d19035e -> trunk/d1706d9128ae24d9048167e80d3fe5196d19035e 2025-09-07T07:36:20.3126268Z * [new tag] trunk/d1a15abfdcaef138f2d9e93a9f46be44f30b766d -> trunk/d1a15abfdcaef138f2d9e93a9f46be44f30b766d 2025-09-07T07:36:20.3127464Z * [new tag] trunk/d232a95d4a79404ca05c1f52d37fde7339dcdf49 -> trunk/d232a95d4a79404ca05c1f52d37fde7339dcdf49 2025-09-07T07:36:20.3128446Z * [new tag] trunk/d2d4c8e9b2371c9aacfb771d9402ac7427b9778e -> trunk/d2d4c8e9b2371c9aacfb771d9402ac7427b9778e 2025-09-07T07:36:20.3129273Z * [new tag] trunk/d33840c542b387ab08ba49aa6c45aa9567fd9be7 -> trunk/d33840c542b387ab08ba49aa6c45aa9567fd9be7 2025-09-07T07:36:20.3130274Z * [new tag] trunk/d5643e8f3a648a99636bfa1f2a41d54bd3c0d0f1 -> trunk/d5643e8f3a648a99636bfa1f2a41d54bd3c0d0f1 2025-09-07T07:36:20.3131299Z * [new tag] trunk/d5b38410b5b6cf75c7a7389972777a6497926ee7 -> trunk/d5b38410b5b6cf75c7a7389972777a6497926ee7 2025-09-07T07:36:20.3132109Z * [new tag] trunk/d5e0f4202ba14632e4d14862ace096609e763462 -> trunk/d5e0f4202ba14632e4d14862ace096609e763462 2025-09-07T07:36:20.3133177Z * [new tag] trunk/d636c181f9140a7b59be10b36eae23039fc2bb72 -> trunk/d636c181f9140a7b59be10b36eae23039fc2bb72 2025-09-07T07:36:20.3134589Z * [new tag] trunk/d64718503728001a1e78168fd7f2d4ff23e57285 -> trunk/d64718503728001a1e78168fd7f2d4ff23e57285 2025-09-07T07:36:20.3135622Z * [new tag] trunk/d67c29ad22670320d676b02e394274af34e8e643 -> trunk/d67c29ad22670320d676b02e394274af34e8e643 2025-09-07T07:36:20.3136603Z * [new tag] trunk/d6b74568e2c98ce58ecc145b72ac66d4caf7ce95 -> trunk/d6b74568e2c98ce58ecc145b72ac66d4caf7ce95 2025-09-07T07:36:20.3137599Z * [new tag] trunk/d711f27845abd45007ccab6076649ebd896c2661 -> trunk/d711f27845abd45007ccab6076649ebd896c2661 2025-09-07T07:36:20.3138610Z * [new tag] trunk/d9d6dde0f42d4bcc8c97671ac50d5096c7e500ab -> trunk/d9d6dde0f42d4bcc8c97671ac50d5096c7e500ab 2025-09-07T07:36:20.3139583Z * [new tag] trunk/da4db4b33d1fdd046650cf19fdbac581a19bf2f9 -> trunk/da4db4b33d1fdd046650cf19fdbac581a19bf2f9 2025-09-07T07:36:20.3140383Z * [new tag] trunk/dac8a4b91c01c3bbc96f54e621b1ea4ffdbd29d1 -> trunk/dac8a4b91c01c3bbc96f54e621b1ea4ffdbd29d1 2025-09-07T07:36:20.3141484Z * [new tag] trunk/dbec08729fb9848bebed6048c63831b87170d061 -> trunk/dbec08729fb9848bebed6048c63831b87170d061 2025-09-07T07:36:20.3142328Z * [new tag] trunk/dcf385395d838f38c8dca25913578230dd43099a -> trunk/dcf385395d838f38c8dca25913578230dd43099a 2025-09-07T07:36:20.3143347Z * [new tag] trunk/dd2519abe83ec3c40d4797492434e41fe3b47e17 -> trunk/dd2519abe83ec3c40d4797492434e41fe3b47e17 2025-09-07T07:36:20.3144348Z * [new tag] trunk/dec72ea4b006dd0fbcaaaa106ad273d73807ab9d -> trunk/dec72ea4b006dd0fbcaaaa106ad273d73807ab9d 2025-09-07T07:36:20.3145317Z * [new tag] trunk/e0a62b266c021b910ce6dc02a6c9429210487717 -> trunk/e0a62b266c021b910ce6dc02a6c9429210487717 2025-09-07T07:36:20.3146389Z * [new tag] trunk/e19e02c84c9dcc408375e5cae3b0709c18b99228 -> trunk/e19e02c84c9dcc408375e5cae3b0709c18b99228 2025-09-07T07:36:20.3147430Z * [new tag] trunk/e304ea4e69d3a7deeb7e48c7450c214a4c953937 -> trunk/e304ea4e69d3a7deeb7e48c7450c214a4c953937 2025-09-07T07:36:20.3148585Z * [new tag] trunk/e3068cdb446adefb5a875616ba37a60235391439 -> trunk/e3068cdb446adefb5a875616ba37a60235391439 2025-09-07T07:36:20.3149564Z * [new tag] trunk/e381d4b0205d5f126c1de534f867ba776f7c3ee6 -> trunk/e381d4b0205d5f126c1de534f867ba776f7c3ee6 2025-09-07T07:36:20.3150627Z * [new tag] trunk/e4bd0ff4f8981b805df32ea5b3550621965ea4f2 -> trunk/e4bd0ff4f8981b805df32ea5b3550621965ea4f2 2025-09-07T07:36:20.3151545Z * [new tag] trunk/e532c9d4f1cdcbc1ea9628f55b9813e77847bdc7 -> trunk/e532c9d4f1cdcbc1ea9628f55b9813e77847bdc7 2025-09-07T07:36:20.3152536Z * [new tag] trunk/e92cd9415377403b6e90585e764639e2e0b5973b -> trunk/e92cd9415377403b6e90585e764639e2e0b5973b 2025-09-07T07:36:20.3153574Z * [new tag] trunk/e9481b6617b5576b099d8ca5798111592e9ad090 -> trunk/e9481b6617b5576b099d8ca5798111592e9ad090 2025-09-07T07:36:20.3154367Z * [new tag] trunk/ea1883dfd3e42defe37b11202b878bb76defa087 -> trunk/ea1883dfd3e42defe37b11202b878bb76defa087 2025-09-07T07:36:20.3155415Z * [new tag] trunk/eac3d6f04cfbbebe3d470dacd216da7d4b1f95a8 -> trunk/eac3d6f04cfbbebe3d470dacd216da7d4b1f95a8 2025-09-07T07:36:20.3156407Z * [new tag] trunk/eb18d32bda75189494d955aa001ade15f10333de -> trunk/eb18d32bda75189494d955aa001ade15f10333de 2025-09-07T07:36:20.3157234Z * [new tag] trunk/ef3be6726f7ff4b77c22db10cec5b686f9107ea9 -> trunk/ef3be6726f7ff4b77c22db10cec5b686f9107ea9 2025-09-07T07:36:20.3158750Z * [new tag] trunk/ef8aabd42422725026cb4dbf48aafa9efa226a04 -> trunk/ef8aabd42422725026cb4dbf48aafa9efa226a04 2025-09-07T07:36:20.3159874Z * [new tag] trunk/f00445b43eee57e20bb9316fa796ca23bf73373b -> trunk/f00445b43eee57e20bb9316fa796ca23bf73373b 2025-09-07T07:36:20.3160875Z * [new tag] trunk/f0c391102b754e3b145e8c59231d2df563487e37 -> trunk/f0c391102b754e3b145e8c59231d2df563487e37 2025-09-07T07:36:20.3161924Z * [new tag] trunk/f27985b7e796fb66a1b476284ba42d8cb360a751 -> trunk/f27985b7e796fb66a1b476284ba42d8cb360a751 2025-09-07T07:36:20.3162993Z * [new tag] trunk/f36f285953700f971552083a5da9d0ceacb63bbd -> trunk/f36f285953700f971552083a5da9d0ceacb63bbd 2025-09-07T07:36:20.3163968Z * [new tag] trunk/f3cebec39ebc110e1c8b06e741896585f7892dbb -> trunk/f3cebec39ebc110e1c8b06e741896585f7892dbb 2025-09-07T07:36:20.3164800Z * [new tag] trunk/f4c33cd44acac92c0b451a04da20ebe9370e5b0c -> trunk/f4c33cd44acac92c0b451a04da20ebe9370e5b0c 2025-09-07T07:36:20.3165861Z * [new tag] trunk/f612045ce105f008b2b675e2fc870163babeb2e8 -> trunk/f612045ce105f008b2b675e2fc870163babeb2e8 2025-09-07T07:36:20.3166941Z * [new tag] trunk/f8746b878dfc1e9639d42cbde832e9b9e792c86c -> trunk/f8746b878dfc1e9639d42cbde832e9b9e792c86c 2025-09-07T07:36:20.3167784Z * [new tag] trunk/f8ffa9194e26523e5f976d4a824d5cc58922727c -> trunk/f8ffa9194e26523e5f976d4a824d5cc58922727c 2025-09-07T07:36:20.3168793Z * [new tag] trunk/f981a7fa5230b98974291fdde32fe8488bc5d469 -> trunk/f981a7fa5230b98974291fdde32fe8488bc5d469 2025-09-07T07:36:20.3169774Z * [new tag] trunk/fbf3d2027daabbcb44d0af274b139be2a248a4f7 -> trunk/fbf3d2027daabbcb44d0af274b139be2a248a4f7 2025-09-07T07:36:20.3170936Z * [new tag] trunk/fca2601c9d628e1bd2d75c7318cd22c4e8c832aa -> trunk/fca2601c9d628e1bd2d75c7318cd22c4e8c832aa 2025-09-07T07:36:20.3171993Z * [new tag] trunk/fea20775ad96bdca972a1811d7d3372f368614ab -> trunk/fea20775ad96bdca972a1811d7d3372f368614ab 2025-09-07T07:36:20.3172812Z * [new tag] trunk/fefee081642f87419a21dc852f7167d4640443cd -> trunk/fefee081642f87419a21dc852f7167d4640443cd 2025-09-07T07:36:20.3173723Z * [new tag] v0.1.1 -> v0.1.1 2025-09-07T07:36:20.3174638Z * [new tag] v0.1.10 -> v0.1.10 2025-09-07T07:36:20.3175500Z * [new tag] v0.1.11 -> v0.1.11 2025-09-07T07:36:20.3176391Z * [new tag] v0.1.12 -> v0.1.12 2025-09-07T07:36:20.3177266Z * [new tag] v0.1.2 -> v0.1.2 2025-09-07T07:36:20.3178109Z * [new tag] v0.1.3 -> v0.1.3 2025-09-07T07:36:20.3179001Z * [new tag] v0.1.4 -> v0.1.4 2025-09-07T07:36:20.3179908Z * [new tag] v0.1.5 -> v0.1.5 2025-09-07T07:36:20.3180836Z * [new tag] v0.1.6 -> v0.1.6 2025-09-07T07:36:20.3182118Z * [new tag] v0.1.7 -> v0.1.7 2025-09-07T07:36:20.3183110Z * [new tag] v0.1.8 -> v0.1.8 2025-09-07T07:36:20.3184031Z * [new tag] v0.1.9 -> v0.1.9 2025-09-07T07:36:20.3184869Z * [new tag] v0.2.0 -> v0.2.0 2025-09-07T07:36:20.3185847Z * [new tag] v0.3.0 -> v0.3.0 2025-09-07T07:36:20.3186913Z * [new tag] v0.3.1 -> v0.3.1 2025-09-07T07:36:20.3187837Z * [new tag] v0.4.0 -> v0.4.0 2025-09-07T07:36:20.3188744Z * [new tag] v0.4.1 -> v0.4.1 2025-09-07T07:36:20.3189640Z * [new tag] v1.0.0 -> v1.0.0 2025-09-07T07:36:20.3190612Z * [new tag] v1.0.0a0 -> v1.0.0a0 2025-09-07T07:36:20.3191515Z * [new tag] v1.0.1 -> v1.0.1 2025-09-07T07:36:20.3192459Z * [new tag] v1.0rc0 -> v1.0rc0 2025-09-07T07:36:20.3193144Z * [new tag] v1.0rc1 -> v1.0rc1 2025-09-07T07:36:20.3194113Z * [new tag] v1.1.0 -> v1.1.0 2025-09-07T07:36:20.3195012Z * [new tag] v1.1.0a0 -> v1.1.0a0 2025-09-07T07:36:20.3196269Z * [new tag] v1.10.0 -> v1.10.0 2025-09-07T07:36:20.3197294Z * [new tag] v1.10.0-rc1 -> v1.10.0-rc1 2025-09-07T07:36:20.3198212Z * [new tag] v1.10.0-rc2 -> v1.10.0-rc2 2025-09-07T07:36:20.3198922Z * [new tag] v1.10.0-rc3 -> v1.10.0-rc3 2025-09-07T07:36:20.3199977Z * [new tag] v1.10.1 -> v1.10.1 2025-09-07T07:36:20.3200815Z * [new tag] v1.10.1-rc1 -> v1.10.1-rc1 2025-09-07T07:36:20.3201500Z * [new tag] v1.10.2 -> v1.10.2 2025-09-07T07:36:20.3202257Z * [new tag] v1.10.2-rc1 -> v1.10.2-rc1 2025-09-07T07:36:20.3203268Z * [new tag] v1.11.0 -> v1.11.0 2025-09-07T07:36:20.3204174Z * [new tag] v1.11.0-rc1 -> v1.11.0-rc1 2025-09-07T07:36:20.3205192Z * [new tag] v1.11.0-rc2 -> v1.11.0-rc2 2025-09-07T07:36:20.3206162Z * [new tag] v1.11.0-rc3 -> v1.11.0-rc3 2025-09-07T07:36:20.3207239Z * [new tag] v1.11.0-rc4 -> v1.11.0-rc4 2025-09-07T07:36:20.3208157Z * [new tag] v1.11.0-rc5 -> v1.11.0-rc5 2025-09-07T07:36:20.3208850Z * [new tag] v1.11.0-rc6 -> v1.11.0-rc6 2025-09-07T07:36:20.3209754Z * [new tag] v1.11.0-rc7 -> v1.11.0-rc7 2025-09-07T07:36:20.3210860Z * [new tag] v1.12.0 -> v1.12.0 2025-09-07T07:36:20.3211723Z * [new tag] v1.12.0-rc1 -> v1.12.0-rc1 2025-09-07T07:36:20.3212749Z * [new tag] v1.12.0-rc2 -> v1.12.0-rc2 2025-09-07T07:36:20.3213770Z * [new tag] v1.12.0-rc3 -> v1.12.0-rc3 2025-09-07T07:36:20.3214734Z * [new tag] v1.12.0-rc4 -> v1.12.0-rc4 2025-09-07T07:36:20.3215621Z * [new tag] v1.12.0-rc5 -> v1.12.0-rc5 2025-09-07T07:36:20.3216560Z * [new tag] v1.12.0-rc6 -> v1.12.0-rc6 2025-09-07T07:36:20.3217270Z * [new tag] v1.12.0-rc7 -> v1.12.0-rc7 2025-09-07T07:36:20.3218067Z * [new tag] v1.12.0-rc8 -> v1.12.0-rc8 2025-09-07T07:36:20.3218747Z * [new tag] v1.12.1 -> v1.12.1 2025-09-07T07:36:20.3219916Z * [new tag] v1.12.1-rc1 -> v1.12.1-rc1 2025-09-07T07:36:20.3220842Z * [new tag] v1.12.1-rc2 -> v1.12.1-rc2 2025-09-07T07:36:20.3221876Z * [new tag] v1.12.1-rc3 -> v1.12.1-rc3 2025-09-07T07:36:20.3222931Z * [new tag] v1.12.1-rc4 -> v1.12.1-rc4 2025-09-07T07:36:20.3223518Z * [new tag] v1.12.1-rc5 -> v1.12.1-rc5 2025-09-07T07:36:20.3224541Z * [new tag] v1.13.0 -> v1.13.0 2025-09-07T07:36:20.3225457Z * [new tag] v1.13.0-rc1 -> v1.13.0-rc1 2025-09-07T07:36:20.3226393Z * [new tag] v1.13.0-rc2 -> v1.13.0-rc2 2025-09-07T07:36:20.3227368Z * [new tag] v1.13.0-rc3 -> v1.13.0-rc3 2025-09-07T07:36:20.3228364Z * [new tag] v1.13.0-rc4 -> v1.13.0-rc4 2025-09-07T07:36:20.3229054Z * [new tag] v1.13.0-rc5 -> v1.13.0-rc5 2025-09-07T07:36:20.3229881Z * [new tag] v1.13.0-rc6 -> v1.13.0-rc6 2025-09-07T07:36:20.3230744Z * [new tag] v1.13.1 -> v1.13.1 2025-09-07T07:36:20.3231436Z * [new tag] v1.13.1-rc1 -> v1.13.1-rc1 2025-09-07T07:36:20.3232468Z * [new tag] v1.2.0 -> v1.2.0 2025-09-07T07:36:20.3233378Z * [new tag] v1.2.0a0 -> v1.2.0a0 2025-09-07T07:36:20.3234267Z * [new tag] v1.3.0 -> v1.3.0 2025-09-07T07:36:20.3235250Z * [new tag] v1.3.0a0 -> v1.3.0a0 2025-09-07T07:36:20.3236070Z * [new tag] v1.3.1 -> v1.3.1 2025-09-07T07:36:20.3236932Z * [new tag] v1.4.0 -> v1.4.0 2025-09-07T07:36:20.3237857Z * [new tag] v1.4.0a0 -> v1.4.0a0 2025-09-07T07:36:20.3238553Z * [new tag] v1.4.1 -> v1.4.1 2025-09-07T07:36:20.3239645Z * [new tag] v1.5.0 -> v1.5.0 2025-09-07T07:36:20.3241047Z * [new tag] v1.5.0-rc1 -> v1.5.0-rc1 2025-09-07T07:36:20.3242277Z * [new tag] v1.5.0-rc2 -> v1.5.0-rc2 2025-09-07T07:36:20.3243257Z * [new tag] v1.5.0-rc3 -> v1.5.0-rc3 2025-09-07T07:36:20.3244122Z * [new tag] v1.5.0-rc4 -> v1.5.0-rc4 2025-09-07T07:36:20.3244795Z * [new tag] v1.5.0-rc5 -> v1.5.0-rc5 2025-09-07T07:36:20.3245877Z * [new tag] v1.5.1 -> v1.5.1 2025-09-07T07:36:20.3246906Z * [new tag] v1.5.1-rc1 -> v1.5.1-rc1 2025-09-07T07:36:20.3247559Z * [new tag] v1.6.0 -> v1.6.0 2025-09-07T07:36:20.3248269Z * [new tag] v1.6.0-rc1 -> v1.6.0-rc1 2025-09-07T07:36:20.3249338Z * [new tag] v1.6.0-rc2 -> v1.6.0-rc2 2025-09-07T07:36:20.3250293Z * [new tag] v1.6.0-rc3 -> v1.6.0-rc3 2025-09-07T07:36:20.3251254Z * [new tag] v1.6.0-rc4 -> v1.6.0-rc4 2025-09-07T07:36:20.3252145Z * [new tag] v1.6.0-rc5 -> v1.6.0-rc5 2025-09-07T07:36:20.3253101Z * [new tag] v1.6.0-rc6 -> v1.6.0-rc6 2025-09-07T07:36:20.3253781Z * [new tag] v1.6.0-rc7 -> v1.6.0-rc7 2025-09-07T07:36:20.3254836Z * [new tag] v1.7.0 -> v1.7.0 2025-09-07T07:36:20.3255809Z * [new tag] v1.7.0-rc1 -> v1.7.0-rc1 2025-09-07T07:36:20.3256819Z * [new tag] v1.7.0-rc2 -> v1.7.0-rc2 2025-09-07T07:36:20.3257760Z * [new tag] v1.7.0-rc3 -> v1.7.0-rc3 2025-09-07T07:36:20.3258450Z * [new tag] v1.7.0-rc4 -> v1.7.0-rc4 2025-09-07T07:36:20.3259478Z * [new tag] v1.7.1 -> v1.7.1 2025-09-07T07:36:20.3260705Z * [new tag] v1.7.1-rc1 -> v1.7.1-rc1 2025-09-07T07:36:20.3261397Z * [new tag] v1.7.1-rc2 -> v1.7.1-rc2 2025-09-07T07:36:20.3262198Z * [new tag] v1.7.1-rc3 -> v1.7.1-rc3 2025-09-07T07:36:20.3263155Z * [new tag] v1.8.0 -> v1.8.0 2025-09-07T07:36:20.3263831Z * [new tag] v1.8.0-rc1 -> v1.8.0-rc1 2025-09-07T07:36:20.3264835Z * [new tag] v1.8.0-rc2 -> v1.8.0-rc2 2025-09-07T07:36:20.3265818Z * [new tag] v1.8.0-rc3 -> v1.8.0-rc3 2025-09-07T07:36:20.3266785Z * [new tag] v1.8.0-rc4 -> v1.8.0-rc4 2025-09-07T07:36:20.3267483Z * [new tag] v1.8.0-rc5 -> v1.8.0-rc5 2025-09-07T07:36:20.3268294Z * [new tag] v1.8.1 -> v1.8.1 2025-09-07T07:36:20.3269325Z * [new tag] v1.8.1-rc1 -> v1.8.1-rc1 2025-09-07T07:36:20.3269999Z * [new tag] v1.8.1-rc2 -> v1.8.1-rc2 2025-09-07T07:36:20.3270890Z * [new tag] v1.8.1-rc3 -> v1.8.1-rc3 2025-09-07T07:36:20.3272183Z * [new tag] v1.8.2 -> v1.8.2 2025-09-07T07:36:20.3272955Z * [new tag] v1.8.2-rc1 -> v1.8.2-rc1 2025-09-07T07:36:20.3273964Z * [new tag] v1.9.0 -> v1.9.0 2025-09-07T07:36:20.3274844Z * [new tag] v1.9.0-rc1 -> v1.9.0-rc1 2025-09-07T07:36:20.3275822Z * [new tag] v1.9.0-rc2 -> v1.9.0-rc2 2025-09-07T07:36:20.3276784Z * [new tag] v1.9.0-rc3 -> v1.9.0-rc3 2025-09-07T07:36:20.3277478Z * [new tag] v1.9.0-rc4 -> v1.9.0-rc4 2025-09-07T07:36:20.3278564Z * [new tag] v1.9.1 -> v1.9.1 2025-09-07T07:36:20.3279651Z * [new tag] v1.9.1-rc1 -> v1.9.1-rc1 2025-09-07T07:36:20.3280335Z * [new tag] v1.9.1-rc2 -> v1.9.1-rc2 2025-09-07T07:36:20.3281358Z * [new tag] v2.0.0 -> v2.0.0 2025-09-07T07:36:20.3282243Z * [new tag] v2.0.0-rc1 -> v2.0.0-rc1 2025-09-07T07:36:20.3283219Z * [new tag] v2.0.0-rc2 -> v2.0.0-rc2 2025-09-07T07:36:20.3284226Z * [new tag] v2.0.0-rc3 -> v2.0.0-rc3 2025-09-07T07:36:20.3285287Z * [new tag] v2.0.0-rc4 -> v2.0.0-rc4 2025-09-07T07:36:20.3286187Z * [new tag] v2.0.0-rc5 -> v2.0.0-rc5 2025-09-07T07:36:20.3286872Z * [new tag] v2.0.0-rc6 -> v2.0.0-rc6 2025-09-07T07:36:20.3288232Z * [new tag] v2.0.1 -> v2.0.1 2025-09-07T07:36:20.3289173Z * [new tag] v2.0.1-rc1 -> v2.0.1-rc1 2025-09-07T07:36:20.3290006Z * [new tag] v2.0.1-rc2 -> v2.0.1-rc2 2025-09-07T07:36:20.3290837Z * [new tag] v2.0.1-rc3 -> v2.0.1-rc3 2025-09-07T07:36:20.3291631Z * [new tag] v2.0.1-rc4 -> v2.0.1-rc4 2025-09-07T07:36:20.3292959Z * [new tag] v2.1.0 -> v2.1.0 2025-09-07T07:36:20.3293845Z * [new tag] v2.1.0-rc1 -> v2.1.0-rc1 2025-09-07T07:36:20.3294800Z * [new tag] v2.1.0-rc2 -> v2.1.0-rc2 2025-09-07T07:36:20.3295791Z * [new tag] v2.1.0-rc3 -> v2.1.0-rc3 2025-09-07T07:36:20.3296754Z * [new tag] v2.1.0-rc4 -> v2.1.0-rc4 2025-09-07T07:36:20.3297728Z * [new tag] v2.1.0-rc5 -> v2.1.0-rc5 2025-09-07T07:36:20.3298653Z * [new tag] v2.1.0-rc6 -> v2.1.0-rc6 2025-09-07T07:36:20.3299553Z * [new tag] v2.1.1 -> v2.1.1 2025-09-07T07:36:20.3300855Z * [new tag] v2.1.1-rc1 -> v2.1.1-rc1 2025-09-07T07:36:20.3301847Z * [new tag] v2.1.1-rc2 -> v2.1.1-rc2 2025-09-07T07:36:20.3302914Z * [new tag] v2.1.1-rc3 -> v2.1.1-rc3 2025-09-07T07:36:20.3303894Z * [new tag] v2.1.1-rc4 -> v2.1.1-rc4 2025-09-07T07:36:20.3304761Z * [new tag] v2.1.1-rc5 -> v2.1.1-rc5 2025-09-07T07:36:20.3305463Z * [new tag] v2.1.1-rc6 -> v2.1.1-rc6 2025-09-07T07:36:20.3306497Z * [new tag] v2.1.2 -> v2.1.2 2025-09-07T07:36:20.3307533Z * [new tag] v2.1.2-rc1 -> v2.1.2-rc1 2025-09-07T07:36:20.3308484Z * [new tag] v2.1.2-rc2 -> v2.1.2-rc2 2025-09-07T07:36:20.3309299Z * [new tag] v2.1.2-rc3 -> v2.1.2-rc3 2025-09-07T07:36:20.3313330Z * [new tag] v2.2.0 -> v2.2.0 2025-09-07T07:36:20.3314431Z * [new tag] v2.2.0-rc1 -> v2.2.0-rc1 2025-09-07T07:36:20.3315295Z * [new tag] v2.2.0-rc2 -> v2.2.0-rc2 2025-09-07T07:36:20.3316159Z * [new tag] v2.2.0-rc3 -> v2.2.0-rc3 2025-09-07T07:36:20.3317046Z * [new tag] v2.2.0-rc4 -> v2.2.0-rc4 2025-09-07T07:36:20.3317996Z * [new tag] v2.2.0-rc5 -> v2.2.0-rc5 2025-09-07T07:36:20.3318925Z * [new tag] v2.2.0-rc6 -> v2.2.0-rc6 2025-09-07T07:36:20.3319596Z * [new tag] v2.2.0-rc7 -> v2.2.0-rc7 2025-09-07T07:36:20.3320381Z * [new tag] v2.2.0-rc8 -> v2.2.0-rc8 2025-09-07T07:36:20.3321432Z * [new tag] v2.2.1 -> v2.2.1 2025-09-07T07:36:20.3322386Z * [new tag] v2.2.1-rc1 -> v2.2.1-rc1 2025-09-07T07:36:20.3323068Z * [new tag] v2.2.1-rc2 -> v2.2.1-rc2 2025-09-07T07:36:20.3323854Z * [new tag] v2.2.1-rc3 -> v2.2.1-rc3 2025-09-07T07:36:20.3324616Z * [new tag] v2.2.2 -> v2.2.2 2025-09-07T07:36:20.3325658Z * [new tag] v2.2.2-rc1 -> v2.2.2-rc1 2025-09-07T07:36:20.3326353Z * [new tag] v2.2.2-rc2 -> v2.2.2-rc2 2025-09-07T07:36:20.3327155Z * [new tag] v2.2.2-rc3 -> v2.2.2-rc3 2025-09-07T07:36:20.3328088Z * [new tag] v2.3.0 -> v2.3.0 2025-09-07T07:36:20.3328974Z * [new tag] v2.3.0-rc1 -> v2.3.0-rc1 2025-09-07T07:36:20.3329945Z * [new tag] v2.3.0-rc10 -> v2.3.0-rc10 2025-09-07T07:36:20.3330927Z * [new tag] v2.3.0-rc11 -> v2.3.0-rc11 2025-09-07T07:36:20.3331770Z * [new tag] v2.3.0-rc12 -> v2.3.0-rc12 2025-09-07T07:36:20.3332624Z * [new tag] v2.3.0-rc2 -> v2.3.0-rc2 2025-09-07T07:36:20.3333601Z * [new tag] v2.3.0-rc3 -> v2.3.0-rc3 2025-09-07T07:36:20.3334505Z * [new tag] v2.3.0-rc4 -> v2.3.0-rc4 2025-09-07T07:36:20.3335481Z * [new tag] v2.3.0-rc5 -> v2.3.0-rc5 2025-09-07T07:36:20.3336157Z * [new tag] v2.3.0-rc6 -> v2.3.0-rc6 2025-09-07T07:36:20.3337314Z * [new tag] v2.3.0-rc7 -> v2.3.0-rc7 2025-09-07T07:36:20.3338229Z * [new tag] v2.3.0-rc8 -> v2.3.0-rc8 2025-09-07T07:36:20.3339059Z * [new tag] v2.3.0-rc9 -> v2.3.0-rc9 2025-09-07T07:36:20.3339768Z * [new tag] v2.3.1 -> v2.3.1 2025-09-07T07:36:20.3340705Z * [new tag] v2.3.1-rc1 -> v2.3.1-rc1 2025-09-07T07:36:20.3341621Z * [new tag] v2.3.1-rc2 -> v2.3.1-rc2 2025-09-07T07:36:20.3342549Z * [new tag] v2.3.1-rc3 -> v2.3.1-rc3 2025-09-07T07:36:20.3343497Z * [new tag] v2.4.0 -> v2.4.0 2025-09-07T07:36:20.3344419Z * [new tag] v2.4.0-rc1 -> v2.4.0-rc1 2025-09-07T07:36:20.3345309Z * [new tag] v2.4.0-rc2 -> v2.4.0-rc2 2025-09-07T07:36:20.3346314Z * [new tag] v2.4.0-rc3 -> v2.4.0-rc3 2025-09-07T07:36:20.3347353Z * [new tag] v2.4.0-rc4 -> v2.4.0-rc4 2025-09-07T07:36:20.3348308Z * [new tag] v2.4.0-rc5 -> v2.4.0-rc5 2025-09-07T07:36:20.3349281Z * [new tag] v2.4.0-rc6 -> v2.4.0-rc6 2025-09-07T07:36:20.3350258Z * [new tag] v2.4.0-rc7 -> v2.4.0-rc7 2025-09-07T07:36:20.3351151Z * [new tag] v2.4.0-rc8 -> v2.4.0-rc8 2025-09-07T07:36:20.3352173Z * [new tag] v2.4.0-rc9 -> v2.4.0-rc9 2025-09-07T07:36:20.3352959Z * [new tag] v2.4.1 -> v2.4.1 2025-09-07T07:36:20.3354111Z * [new tag] v2.4.1-rc1 -> v2.4.1-rc1 2025-09-07T07:36:20.3354910Z * [new tag] v2.4.1-rc2 -> v2.4.1-rc2 2025-09-07T07:36:20.3355921Z * [new tag] v2.4.1-rc3 -> v2.4.1-rc3 2025-09-07T07:36:20.3356917Z * [new tag] v2.5.0 -> v2.5.0 2025-09-07T07:36:20.3357825Z * [new tag] v2.5.0-rc1 -> v2.5.0-rc1 2025-09-07T07:36:20.3358513Z * [new tag] v2.5.0-rc10 -> v2.5.0-rc10 2025-09-07T07:36:20.3359485Z * [new tag] v2.5.0-rc2 -> v2.5.0-rc2 2025-09-07T07:36:20.3360372Z * [new tag] v2.5.0-rc3 -> v2.5.0-rc3 2025-09-07T07:36:20.3361389Z * [new tag] v2.5.0-rc4 -> v2.5.0-rc4 2025-09-07T07:36:20.3362654Z * [new tag] v2.5.0-rc5 -> v2.5.0-rc5 2025-09-07T07:36:20.3363753Z * [new tag] v2.5.0-rc6 -> v2.5.0-rc6 2025-09-07T07:36:20.3364679Z * [new tag] v2.5.0-rc7 -> v2.5.0-rc7 2025-09-07T07:36:20.3365647Z * [new tag] v2.5.0-rc8 -> v2.5.0-rc8 2025-09-07T07:36:20.3366604Z * [new tag] v2.5.0-rc9 -> v2.5.0-rc9 2025-09-07T07:36:20.3367292Z * [new tag] v2.5.1 -> v2.5.1 2025-09-07T07:36:20.3368115Z * [new tag] v2.5.1-rc1 -> v2.5.1-rc1 2025-09-07T07:36:20.3368871Z * [new tag] v2.6.0 -> v2.6.0 2025-09-07T07:36:20.3369836Z * [new tag] v2.6.0-rc1 -> v2.6.0-rc1 2025-09-07T07:36:20.3370831Z * [new tag] v2.6.0-rc2 -> v2.6.0-rc2 2025-09-07T07:36:20.3371789Z * [new tag] v2.6.0-rc3 -> v2.6.0-rc3 2025-09-07T07:36:20.3372744Z * [new tag] v2.6.0-rc4 -> v2.6.0-rc4 2025-09-07T07:36:20.3373819Z * [new tag] v2.6.0-rc5 -> v2.6.0-rc5 2025-09-07T07:36:20.3374818Z * [new tag] v2.6.0-rc6 -> v2.6.0-rc6 2025-09-07T07:36:20.3375825Z * [new tag] v2.6.0-rc7 -> v2.6.0-rc7 2025-09-07T07:36:20.3376912Z * [new tag] v2.6.0-rc8 -> v2.6.0-rc8 2025-09-07T07:36:20.3377826Z * [new tag] v2.6.0-rc9 -> v2.6.0-rc9 2025-09-07T07:36:20.3379057Z * [new tag] v2.7.0 -> v2.7.0 2025-09-07T07:36:20.3379858Z * [new tag] v2.7.0-rc1 -> v2.7.0-rc1 2025-09-07T07:36:20.3380645Z * [new tag] v2.7.0-rc10 -> v2.7.0-rc10 2025-09-07T07:36:20.3381642Z * [new tag] v2.7.0-rc2 -> v2.7.0-rc2 2025-09-07T07:36:20.3382590Z * [new tag] v2.7.0-rc3 -> v2.7.0-rc3 2025-09-07T07:36:20.3383568Z * [new tag] v2.7.0-rc4 -> v2.7.0-rc4 2025-09-07T07:36:20.3384618Z * [new tag] v2.7.0-rc5 -> v2.7.0-rc5 2025-09-07T07:36:20.3385516Z * [new tag] v2.7.0-rc6 -> v2.7.0-rc6 2025-09-07T07:36:20.3386609Z * [new tag] v2.7.0-rc7 -> v2.7.0-rc7 2025-09-07T07:36:20.3387566Z * [new tag] v2.7.0-rc8 -> v2.7.0-rc8 2025-09-07T07:36:20.3388555Z * [new tag] v2.7.0-rc9 -> v2.7.0-rc9 2025-09-07T07:36:20.3389396Z * [new tag] v2.7.1 -> v2.7.1 2025-09-07T07:36:20.3390377Z * [new tag] v2.7.1-rc1 -> v2.7.1-rc1 2025-09-07T07:36:20.3391356Z * [new tag] v2.7.1-rc2 -> v2.7.1-rc2 2025-09-07T07:36:20.3392469Z * [new tag] v2.7.1-rc3 -> v2.7.1-rc3 2025-09-07T07:36:20.3393448Z * [new tag] v2.7.1-rc4 -> v2.7.1-rc4 2025-09-07T07:36:20.3394479Z * [new tag] v2.7.1-rc5 -> v2.7.1-rc5 2025-09-07T07:36:20.3395299Z * [new tag] v2.8.0 -> v2.8.0 2025-09-07T07:36:20.3396319Z * [new tag] v2.8.0-rc1 -> v2.8.0-rc1 2025-09-07T07:36:20.3397356Z * [new tag] v2.8.0-rc2 -> v2.8.0-rc2 2025-09-07T07:36:20.3398373Z * [new tag] v2.8.0-rc3 -> v2.8.0-rc3 2025-09-07T07:36:20.3399336Z * [new tag] v2.8.0-rc4 -> v2.8.0-rc4 2025-09-07T07:36:20.3400326Z * [new tag] v2.8.0-rc5 -> v2.8.0-rc5 2025-09-07T07:36:20.3401328Z * [new tag] v2.8.0-rc6 -> v2.8.0-rc6 2025-09-07T07:36:20.3402307Z * [new tag] v2.8.0-rc7 -> v2.8.0-rc7 2025-09-07T07:36:20.3403242Z * [new tag] v2.8.0-rc8 -> v2.8.0-rc8 2025-09-07T07:36:20.3404295Z * [new tag] whc_flight_1 -> whc_flight_1 2025-09-07T07:36:20.3405237Z * [new tag] whc_flight_2 -> whc_flight_2 2025-09-07T07:36:20.3406089Z * [new tag] whc_flight_4 -> whc_flight_4 2025-09-07T07:36:20.4237363Z [command]/usr/bin/git rev-parse --verify --quiet 93fb23d6fae7c4e82c4239a1033e522088742634^{object} 2025-09-07T07:36:20.4271870Z 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:36:20.4275724Z ##[endgroup] 2025-09-07T07:36:20.4276002Z ##[group]Determining the checkout info 2025-09-07T07:36:20.4277100Z ##[endgroup] 2025-09-07T07:36:20.4280826Z [command]/usr/bin/git sparse-checkout disable 2025-09-07T07:36:20.4326218Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig 2025-09-07T07:36:20.4357176Z ##[group]Checking out the ref 2025-09-07T07:36:20.4359931Z [command]/usr/bin/git checkout --progress --force 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:36:21.4683392Z Updating files: 85% (16519/19405) 2025-09-07T07:36:21.4812147Z Updating files: 86% (16689/19405) 2025-09-07T07:36:21.4941574Z Updating files: 87% (16883/19405) 2025-09-07T07:36:21.5043494Z Updating files: 88% (17077/19405) 2025-09-07T07:36:21.5174246Z Updating files: 89% (17271/19405) 2025-09-07T07:36:21.5330361Z Updating files: 90% (17465/19405) 2025-09-07T07:36:21.5441672Z Updating files: 91% (17659/19405) 2025-09-07T07:36:21.5576379Z Updating files: 92% (17853/19405) 2025-09-07T07:36:21.5744976Z Updating files: 93% (18047/19405) 2025-09-07T07:36:21.5925548Z Updating files: 94% (18241/19405) 2025-09-07T07:36:21.6069717Z Updating files: 95% (18435/19405) 2025-09-07T07:36:21.6217252Z Updating files: 96% (18629/19405) 2025-09-07T07:36:21.6381199Z Updating files: 97% (18823/19405) 2025-09-07T07:36:21.6607892Z Updating files: 98% (19017/19405) 2025-09-07T07:36:21.6751413Z Updating files: 99% (19211/19405) 2025-09-07T07:36:21.6751608Z Updating files: 100% (19405/19405) 2025-09-07T07:36:21.6751792Z Updating files: 100% (19405/19405), done. 2025-09-07T07:36:21.6955298Z Note: switching to '93fb23d6fae7c4e82c4239a1033e522088742634'. 2025-09-07T07:36:21.6955513Z 2025-09-07T07:36:21.6955655Z You are in 'detached HEAD' state. You can look around, make experimental 2025-09-07T07:36:21.6956008Z changes and commit them, and you can discard any commits you make in this 2025-09-07T07:36:21.6956336Z state without impacting any branches by switching back to a branch. 2025-09-07T07:36:21.6956538Z 2025-09-07T07:36:21.6956662Z If you want to create a new branch to retain commits you create, you may 2025-09-07T07:36:21.6956971Z do so (now or later) by using -c with the switch command. Example: 2025-09-07T07:36:21.6957144Z 2025-09-07T07:36:21.6957220Z git switch -c 2025-09-07T07:36:21.6957347Z 2025-09-07T07:36:21.6957419Z Or undo this operation with: 2025-09-07T07:36:21.6957532Z 2025-09-07T07:36:21.6957603Z git switch - 2025-09-07T07:36:21.6957693Z 2025-09-07T07:36:21.6957843Z Turn off this advice by setting config variable advice.detachedHead to false 2025-09-07T07:36:21.6958055Z 2025-09-07T07:36:21.6958167Z HEAD is now at 93fb23d6fae Build vLLM nightly wheels (#162000) 2025-09-07T07:36:21.7063620Z ##[endgroup] 2025-09-07T07:36:21.7063915Z ##[group]Setting up auth for fetching submodules 2025-09-07T07:36:21.7069256Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-09-07T07:36:21.7129400Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2025-09-07T07:36:21.7160688Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2025-09-07T07:36:21.7192850Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2025-09-07T07:36:21.7222032Z ##[endgroup] 2025-09-07T07:36:21.7222327Z ##[group]Fetching submodules 2025-09-07T07:36:21.7224821Z [command]/usr/bin/git submodule sync --recursive 2025-09-07T07:36:21.7589953Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2025-09-07T07:36:21.7951259Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2025-09-07T07:36:21.7953245Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2025-09-07T07:36:21.7956688Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2025-09-07T07:36:21.8262315Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2025-09-07T07:36:21.8265448Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX' 2025-09-07T07:36:21.8269196Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2025-09-07T07:36:21.8272920Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2025-09-07T07:36:21.8276468Z Submodule 'third_party/aiter' (https://github.com/ROCm/aiter.git) registered for path 'third_party/aiter' 2025-09-07T07:36:21.8280264Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2025-09-07T07:36:21.8284368Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel' 2025-09-07T07:36:21.8293636Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2025-09-07T07:36:21.8297548Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2025-09-07T07:36:21.8301498Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2025-09-07T07:36:21.8305395Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2025-09-07T07:36:21.8309536Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2025-09-07T07:36:21.8314036Z Submodule 'third_party/flash-attention' (https://github.com/Dao-AILab/flash-attention.git) registered for path 'third_party/flash-attention' 2025-09-07T07:36:21.8323393Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2025-09-07T07:36:21.8327536Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2025-09-07T07:36:21.8331984Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2025-09-07T07:36:21.8336256Z Submodule 'third_party/gloo' (https://github.com/pytorch/gloo) registered for path 'third_party/gloo' 2025-09-07T07:36:21.8343309Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2025-09-07T07:36:21.8347894Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2025-09-07T07:36:21.8352458Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2025-09-07T07:36:21.8362011Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2025-09-07T07:36:21.8366586Z Submodule 'third_party/kleidiai' (https://github.com/ARM-software/kleidiai.git) registered for path 'third_party/kleidiai' 2025-09-07T07:36:21.8371265Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2025-09-07T07:36:21.8375963Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2025-09-07T07:36:21.8380716Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2025-09-07T07:36:21.8385857Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2025-09-07T07:36:21.8395561Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2025-09-07T07:36:21.8400608Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2025-09-07T07:36:21.8405963Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2025-09-07T07:36:21.8411361Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2025-09-07T07:36:21.8416492Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2025-09-07T07:36:21.8421695Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2025-09-07T07:36:21.8427020Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2025-09-07T07:36:21.8437620Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2025-09-07T07:36:21.8478514Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2025-09-07T07:36:22.0436212Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2025-09-07T07:36:22.0436711Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2025-09-07T07:36:22.0437126Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2025-09-07T07:36:22.0477696Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2025-09-07T07:36:22.0765520Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'... 2025-09-07T07:36:22.1831688Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2025-09-07T07:36:22.1832246Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2025-09-07T07:36:22.1832744Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2025-09-07T07:36:22.1833174Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2025-09-07T07:36:22.1833568Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2025-09-07T07:36:22.1923778Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2025-09-07T07:36:23.0218904Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2025-09-07T07:36:23.0219471Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2025-09-07T07:36:23.0219894Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2025-09-07T07:36:23.0220583Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2025-09-07T07:36:23.0221019Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kleidiai'... 2025-09-07T07:36:23.0221453Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flash-attention'... 2025-09-07T07:36:23.0221901Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2025-09-07T07:36:23.0222314Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2025-09-07T07:36:23.0222701Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2025-09-07T07:36:23.0223110Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2025-09-07T07:36:23.0223527Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2025-09-07T07:36:23.0223924Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2025-09-07T07:36:23.0224322Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2025-09-07T07:36:23.0224742Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2025-09-07T07:36:23.0225154Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2025-09-07T07:36:23.1218972Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2025-09-07T07:36:30.8294932Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2025-09-07T07:36:30.8295429Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2025-09-07T07:36:30.8295862Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2025-09-07T07:36:30.8296328Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2025-09-07T07:36:30.8296797Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/composable_kernel'... 2025-09-07T07:36:30.8297695Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/aiter'... 2025-09-07T07:36:30.8298130Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2025-09-07T07:36:30.8298568Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2025-09-07T07:36:30.8298973Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2025-09-07T07:36:30.8474736Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2025-09-07T07:36:30.8621804Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2025-09-07T07:36:30.8738205Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2025-09-07T07:36:30.9013604Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2025-09-07T07:36:30.9771918Z Submodule path 'third_party/NVTX': checked out '2942f167cc30c5e3a44a2aecd5b0d9c07ff61a07' 2025-09-07T07:36:31.0274109Z Submodule path 'third_party/VulkanMemoryAllocator': checked out '1d8f600fd424278486eade7ed3e877c99f0846b1' 2025-09-07T07:36:31.7681009Z Submodule path 'third_party/XNNPACK': checked out '51a0103656eff6fc9bfd39a4597923c4b542c883' 2025-09-07T07:36:31.9158245Z Submodule path 'third_party/aiter': checked out '01aae101b9e5e94d6c16a9514c9fb8df99c93150' 2025-09-07T07:36:31.9185572Z Submodule '3rdparty/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T07:36:31.9222169Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/aiter/3rdparty/composable_kernel'... 2025-09-07T07:36:34.9768971Z Submodule path 'third_party/aiter/3rdparty/composable_kernel': checked out 'cffe8fa2a442ac8e80dd236a1a5d24fe3d7e0cbf' 2025-09-07T07:36:35.0038844Z Submodule path 'third_party/benchmark': checked out '299e5928955cc62af9968370293b916f5130916f' 2025-09-07T07:36:35.3284543Z Submodule path 'third_party/composable_kernel': checked out '7fe50dc3da2069d6645d9deb8c017a876472a977' 2025-09-07T07:36:35.3773479Z Submodule path 'third_party/cpp-httplib': checked out '89c932f313c6437c38f2982869beacc89c2f2246' 2025-09-07T07:36:35.4692591Z Submodule path 'third_party/cpuinfo': checked out '5e3d2445e6a84d9599bee2bf78edbb4d80865e1d' 2025-09-07T07:36:35.5132705Z Submodule path 'third_party/cudnn_frontend': checked out 'f937055efc6d414d11f4c6577e3977fe74f35fb6' 2025-09-07T07:36:36.1098729Z Submodule path 'third_party/cutlass': checked out 'e51efbfe18fe4f4cbb66ab814c55bf4aa0185491' 2025-09-07T07:36:36.2556833Z Submodule path 'third_party/fbgemm': checked out '4b39c551efe15e6bbade20565b0ceb2d8ce3352d' 2025-09-07T07:36:36.2584896Z Submodule 'external/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/external/asmjit' 2025-09-07T07:36:36.2586605Z Submodule 'external/composable_kernel' (https://github.com/jwfromm/composable_kernel.git) registered for path 'third_party/fbgemm/external/composable_kernel' 2025-09-07T07:36:36.2589908Z Submodule 'external/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/external/cpuinfo' 2025-09-07T07:36:36.2592800Z Submodule 'external/cutlass' (https://github.com/jwfromm/cutlass) registered for path 'third_party/fbgemm/external/cutlass' 2025-09-07T07:36:36.2595764Z Submodule 'external/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/external/googletest' 2025-09-07T07:36:36.2598756Z Submodule 'external/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/external/hipify_torch' 2025-09-07T07:36:36.2602239Z Submodule 'external/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/fbgemm/external/json' 2025-09-07T07:36:36.2636749Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/external/asmjit'... 2025-09-07T07:36:37.1957425Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/external/hipify_torch'... 2025-09-07T07:36:37.1958037Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/external/cpuinfo'... 2025-09-07T07:36:37.1958552Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/external/googletest'... 2025-09-07T07:36:37.1959095Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/external/composable_kernel'... 2025-09-07T07:36:37.2957310Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/external/cutlass'... 2025-09-07T07:36:37.7861437Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/external/json'... 2025-09-07T07:36:41.1820996Z Submodule path 'third_party/fbgemm/external/asmjit': checked out 'a3199e8857792cd10b7589ff5d58343d2c9008ea' 2025-09-07T07:36:41.4500286Z Submodule path 'third_party/fbgemm/external/composable_kernel': checked out 'b1281b8b08d973a7064f864f47eeb30f3e2596e9' 2025-09-07T07:36:41.5428441Z Submodule path 'third_party/fbgemm/external/cpuinfo': checked out '6543fec09b2f04ac4a666882998b534afc9c1349' 2025-09-07T07:36:42.1417438Z Submodule path 'third_party/fbgemm/external/cutlass': checked out '311f3c8e51dc0eb56310cfc6980bf63d0fbd7917' 2025-09-07T07:36:42.1879304Z Submodule path 'third_party/fbgemm/external/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-09-07T07:36:42.2023955Z Submodule path 'third_party/fbgemm/external/hipify_torch': checked out '63b6a7b541fa7f08f8475ca7d74054db36ff2691' 2025-09-07T07:36:42.3098636Z Submodule path 'third_party/fbgemm/external/json': checked out '9cca280a4d0ccf0c08f47a99aa71d1b0e52f8d03' 2025-09-07T07:36:42.3843942Z Submodule path 'third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5' 2025-09-07T07:36:42.3868520Z Submodule 'csrc/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T07:36:42.3869919Z Submodule 'csrc/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/flash-attention/csrc/cutlass' 2025-09-07T07:36:42.3907977Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flash-attention/csrc/composable_kernel'... 2025-09-07T07:36:45.1196849Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flash-attention/csrc/cutlass'... 2025-09-07T07:36:45.3661133Z Submodule path 'third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33' 2025-09-07T07:36:45.9029136Z Submodule path 'third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420' 2025-09-07T07:36:46.0451601Z Submodule path 'third_party/flatbuffers': checked out 'a2cd1ea3b6d3fee220106b5fed3f7ce8da9eb757' 2025-09-07T07:36:46.0783990Z Submodule path 'third_party/fmt': checked out '40626af88bd7df9a5fb80be7b25ac85b122d6c21' 2025-09-07T07:36:46.1172771Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2025-09-07T07:36:46.1456172Z Submodule path 'third_party/gloo': checked out 'c7b7b022c124d9643957d9bd55f57ac59fce8fa2' 2025-09-07T07:36:46.1903960Z Submodule path 'third_party/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-09-07T07:36:46.2061031Z Submodule path 'third_party/ideep': checked out '719d8e6cd7f7a0e01b155657526d693acf97c2b3' 2025-09-07T07:36:46.2082403Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2025-09-07T07:36:46.2118839Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2025-09-07T07:36:57.0396013Z Submodule path 'third_party/ideep/mkl-dnn': checked out '8d263e693366ef8db40acc569cc7d8edf644556d' 2025-09-07T07:36:57.0633473Z Submodule path 'third_party/ittapi': checked out 'dec1d23ca65ab069d225dfe40dea14f455170959' 2025-09-07T07:36:57.1455506Z Submodule path 'third_party/kineto': checked out '5e7501833f1021ce6f618572d3baf657b6319658' 2025-09-07T07:36:57.1481034Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T07:36:57.1482524Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T07:36:57.1485362Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T07:36:57.1524631Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2025-09-07T07:36:57.7266923Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2025-09-07T07:36:57.9231353Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2025-09-07T07:36:58.0009920Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2025-09-07T07:36:58.0034394Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T07:36:58.0035992Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T07:36:58.0038999Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T07:36:58.0041999Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T07:36:58.0045181Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T07:36:58.0048264Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T07:36:58.0051516Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T07:36:58.0054731Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T07:36:58.0092078Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2025-09-07T07:36:59.0943577Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2025-09-07T07:36:59.0944346Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2025-09-07T07:36:59.0944998Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2025-09-07T07:36:59.0945706Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2025-09-07T07:36:59.0946362Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2025-09-07T07:36:59.0946995Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2025-09-07T07:36:59.1943773Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2025-09-07T07:37:04.3260336Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2025-09-07T07:37:04.3475702Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2025-09-07T07:37:04.3848042Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2025-09-07T07:37:04.4005880Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2025-09-07T07:37:04.4028583Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T07:37:04.4059347Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2025-09-07T07:37:04.6600109Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2025-09-07T07:37:04.6812400Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2025-09-07T07:37:04.7213206Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2025-09-07T07:37:04.8201515Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2025-09-07T07:37:04.8401731Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2025-09-07T07:37:04.8788622Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2025-09-07T07:37:04.9346991Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2025-09-07T07:37:04.9816024Z Submodule path 'third_party/kleidiai': checked out 'cca02c2f69dd18e1f12647c1c0bdc8cf90e680c7' 2025-09-07T07:37:05.0216114Z Submodule path 'third_party/mimalloc': checked out 'fbd8b99c2b828428947d70fdc046bb55609be93e' 2025-09-07T07:37:05.1322100Z Submodule path 'third_party/nlohmann': checked out '55f93686c01528224f448c19128836e7df245f72' 2025-09-07T07:37:05.5833357Z Submodule path 'third_party/onnx': checked out 'e709452ef2bbc1d113faf678c24e6d3467696e83' 2025-09-07T07:37:05.5875334Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2025-09-07T07:37:05.5912291Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2025-09-07T07:37:06.4234813Z Submodule path 'third_party/onnx/third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2025-09-07T07:37:06.4994246Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2025-09-07T07:37:06.5019705Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T07:37:06.5021505Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T07:37:06.5024417Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T07:37:06.5027420Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T07:37:06.5030511Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T07:37:06.5033972Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T07:37:06.5036487Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T07:37:06.5039552Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T07:37:06.5078392Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2025-09-07T07:37:06.8440911Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2025-09-07T07:37:06.8441672Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2025-09-07T07:37:06.8442290Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2025-09-07T07:37:06.8442871Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2025-09-07T07:37:06.9441157Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2025-09-07T07:37:07.3396969Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2025-09-07T07:37:11.5151736Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2025-09-07T07:37:12.2119272Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2025-09-07T07:37:12.2526494Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2025-09-07T07:37:12.2706205Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2025-09-07T07:37:12.3742302Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2025-09-07T07:37:12.3911540Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2025-09-07T07:37:12.4092376Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2025-09-07T07:37:12.4280924Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2025-09-07T07:37:12.4303457Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T07:37:12.4304864Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T07:37:12.4337897Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2025-09-07T07:37:13.7806687Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2025-09-07T07:37:14.0043960Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2025-09-07T07:37:14.0507295Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-09-07T07:37:14.5817993Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2025-09-07T07:37:14.5965863Z Submodule path 'third_party/pocketfft': checked out '0fa0ef591e38c2758e3184c6c23e497b9f732ffa' 2025-09-07T07:37:14.8587434Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2025-09-07T07:37:14.8617997Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2025-09-07T07:37:14.8619643Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2025-09-07T07:37:14.8657890Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2025-09-07T07:37:15.4872755Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2025-09-07T07:37:15.8125919Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2025-09-07T07:37:15.8800183Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2025-09-07T07:37:15.8927175Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2025-09-07T07:37:15.9068114Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2025-09-07T07:37:15.9477486Z Submodule path 'third_party/pybind11': checked out 'f5fbe867d2d26e4a0a9177a51f6e568868ad3dc8' 2025-09-07T07:37:15.9770632Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2025-09-07T07:37:16.0195341Z Submodule path 'third_party/sleef': checked out '5a1d179df9cf652951b59010a2d2075372d67f68' 2025-09-07T07:37:16.0513159Z Submodule path 'third_party/tensorpipe': checked out 'af0118d13e52f5a08841464a768e01a0bf3e3075' 2025-09-07T07:37:16.0536171Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2025-09-07T07:37:16.0537636Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2025-09-07T07:37:16.0540466Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2025-09-07T07:37:16.0543370Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T07:37:16.0581610Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2025-09-07T07:37:17.0591402Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2025-09-07T07:37:17.1262039Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2025-09-07T07:37:17.2521327Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2025-09-07T07:37:17.3215094Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2025-09-07T07:37:17.3404429Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2025-09-07T07:37:17.4228830Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '5152db2cbfeb5582e9c27c5ea1dba2cd9e10759b' 2025-09-07T07:37:17.4538222Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2025-09-07T07:37:17.4561461Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T07:37:17.4598359Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2025-09-07T07:37:17.7297244Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2025-09-07T07:37:17.7344648Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2025-09-07T07:37:17.7701015Z Entering 'android/libs/fbjni' 2025-09-07T07:37:17.7754411Z Entering 'third_party/FP16' 2025-09-07T07:37:17.7806754Z Entering 'third_party/FXdiv' 2025-09-07T07:37:17.7857407Z Entering 'third_party/NNPACK' 2025-09-07T07:37:17.7911876Z Entering 'third_party/NVTX' 2025-09-07T07:37:17.7960898Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T07:37:17.8009801Z Entering 'third_party/XNNPACK' 2025-09-07T07:37:17.8071605Z Entering 'third_party/aiter' 2025-09-07T07:37:17.8124173Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T07:37:17.8179828Z Entering 'third_party/benchmark' 2025-09-07T07:37:17.8232899Z Entering 'third_party/composable_kernel' 2025-09-07T07:37:17.8290055Z Entering 'third_party/cpp-httplib' 2025-09-07T07:37:17.8341010Z Entering 'third_party/cpuinfo' 2025-09-07T07:37:17.8392379Z Entering 'third_party/cudnn_frontend' 2025-09-07T07:37:17.8442332Z Entering 'third_party/cutlass' 2025-09-07T07:37:17.8498921Z Entering 'third_party/fbgemm' 2025-09-07T07:37:17.8553160Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T07:37:17.8599360Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T07:37:17.8653100Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T07:37:17.8700620Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T07:37:17.8754616Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T07:37:17.8801677Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T07:37:17.8852303Z Entering 'third_party/fbgemm/external/json' 2025-09-07T07:37:17.8904942Z Entering 'third_party/flash-attention' 2025-09-07T07:37:17.8955581Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T07:37:17.9008278Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T07:37:17.9065101Z Entering 'third_party/flatbuffers' 2025-09-07T07:37:17.9117219Z Entering 'third_party/fmt' 2025-09-07T07:37:17.9167458Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T07:37:17.9218686Z Entering 'third_party/gloo' 2025-09-07T07:37:17.9270116Z Entering 'third_party/googletest' 2025-09-07T07:37:17.9318554Z Entering 'third_party/ideep' 2025-09-07T07:37:17.9367570Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T07:37:17.9425869Z Entering 'third_party/ittapi' 2025-09-07T07:37:17.9475882Z Entering 'third_party/kineto' 2025-09-07T07:37:17.9527321Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T07:37:17.9574648Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T07:37:17.9623746Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T07:37:17.9671189Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T07:37:17.9721433Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T07:37:17.9769155Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T07:37:17.9818785Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T07:37:17.9865348Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T07:37:17.9918155Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T07:37:17.9966339Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T07:37:18.0017618Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T07:37:18.0063595Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T07:37:18.0114421Z Entering 'third_party/kleidiai' 2025-09-07T07:37:18.0167913Z Entering 'third_party/mimalloc' 2025-09-07T07:37:18.0219176Z Entering 'third_party/nlohmann' 2025-09-07T07:37:18.0269193Z Entering 'third_party/onnx' 2025-09-07T07:37:18.0332451Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T07:37:18.0383766Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T07:37:18.0432450Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T07:37:18.0478909Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T07:37:18.0529374Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T07:37:18.0575891Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T07:37:18.0624809Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T07:37:18.0672369Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T07:37:18.0720850Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T07:37:18.0767045Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T07:37:18.0816515Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T07:37:18.0866258Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T07:37:18.0932560Z Entering 'third_party/pocketfft' 2025-09-07T07:37:18.0982268Z Entering 'third_party/protobuf' 2025-09-07T07:37:18.1033816Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T07:37:18.1082512Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T07:37:18.1135265Z Entering 'third_party/psimd' 2025-09-07T07:37:18.1184109Z Entering 'third_party/pthreadpool' 2025-09-07T07:37:18.1232814Z Entering 'third_party/pybind11' 2025-09-07T07:37:18.1282179Z Entering 'third_party/python-peachpy' 2025-09-07T07:37:18.1332096Z Entering 'third_party/sleef' 2025-09-07T07:37:18.1379677Z Entering 'third_party/tensorpipe' 2025-09-07T07:37:18.1430704Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T07:37:18.1477814Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T07:37:18.1525939Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T07:37:18.1571016Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T07:37:18.1620669Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T07:37:18.1687216Z ##[endgroup] 2025-09-07T07:37:18.1687513Z ##[group]Persisting credentials for submodules 2025-09-07T07:37:18.1693144Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2025-09-07T07:37:18.2040065Z Entering 'android/libs/fbjni' 2025-09-07T07:37:18.2108444Z Entering 'third_party/FP16' 2025-09-07T07:37:18.2173778Z Entering 'third_party/FXdiv' 2025-09-07T07:37:18.2237723Z Entering 'third_party/NNPACK' 2025-09-07T07:37:18.2305176Z Entering 'third_party/NVTX' 2025-09-07T07:37:18.2370995Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T07:37:18.2435104Z Entering 'third_party/XNNPACK' 2025-09-07T07:37:18.2512317Z Entering 'third_party/aiter' 2025-09-07T07:37:18.2579709Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T07:37:18.2653247Z Entering 'third_party/benchmark' 2025-09-07T07:37:18.2718898Z Entering 'third_party/composable_kernel' 2025-09-07T07:37:18.2790338Z Entering 'third_party/cpp-httplib' 2025-09-07T07:37:18.2853327Z Entering 'third_party/cpuinfo' 2025-09-07T07:37:18.2917061Z Entering 'third_party/cudnn_frontend' 2025-09-07T07:37:18.2980326Z Entering 'third_party/cutlass' 2025-09-07T07:37:18.3050970Z Entering 'third_party/fbgemm' 2025-09-07T07:37:18.3116955Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T07:37:18.3178805Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T07:37:18.3251978Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T07:37:18.3315272Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T07:37:18.3386165Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T07:37:18.3450469Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T07:37:18.3516417Z Entering 'third_party/fbgemm/external/json' 2025-09-07T07:37:18.3584132Z Entering 'third_party/flash-attention' 2025-09-07T07:37:18.3650071Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T07:37:18.3718656Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T07:37:18.3791699Z Entering 'third_party/flatbuffers' 2025-09-07T07:37:18.3857739Z Entering 'third_party/fmt' 2025-09-07T07:37:18.3922313Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T07:37:18.3987132Z Entering 'third_party/gloo' 2025-09-07T07:37:18.4050065Z Entering 'third_party/googletest' 2025-09-07T07:37:18.4116309Z Entering 'third_party/ideep' 2025-09-07T07:37:18.4179731Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T07:37:18.4248990Z Entering 'third_party/ittapi' 2025-09-07T07:37:18.4313315Z Entering 'third_party/kineto' 2025-09-07T07:37:18.4377147Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T07:37:18.4441504Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T07:37:18.4506939Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T07:37:18.4574271Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T07:37:18.4637420Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T07:37:18.4701133Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T07:37:18.4769749Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T07:37:18.4833522Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T07:37:18.4899284Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T07:37:18.4963481Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T07:37:18.5031471Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T07:37:18.5097415Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T07:37:18.5164393Z Entering 'third_party/kleidiai' 2025-09-07T07:37:18.5229076Z Entering 'third_party/mimalloc' 2025-09-07T07:37:18.5295446Z Entering 'third_party/nlohmann' 2025-09-07T07:37:18.5360380Z Entering 'third_party/onnx' 2025-09-07T07:37:18.5437819Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T07:37:18.5506474Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T07:37:18.5570549Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T07:37:18.5635117Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T07:37:18.5697730Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T07:37:18.5760229Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T07:37:18.5826316Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T07:37:18.5888985Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T07:37:18.5950872Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T07:37:18.6014165Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T07:37:18.6078366Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T07:37:18.6149830Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T07:37:18.6231556Z Entering 'third_party/pocketfft' 2025-09-07T07:37:18.6294989Z Entering 'third_party/protobuf' 2025-09-07T07:37:18.6362682Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T07:37:18.6425142Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T07:37:18.6494207Z Entering 'third_party/psimd' 2025-09-07T07:37:18.6558877Z Entering 'third_party/pthreadpool' 2025-09-07T07:37:18.6623020Z Entering 'third_party/pybind11' 2025-09-07T07:37:18.6688412Z Entering 'third_party/python-peachpy' 2025-09-07T07:37:18.6753026Z Entering 'third_party/sleef' 2025-09-07T07:37:18.6817815Z Entering 'third_party/tensorpipe' 2025-09-07T07:37:18.6881891Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T07:37:18.6947837Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T07:37:18.7012244Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T07:37:18.7075401Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T07:37:18.7141993Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T07:37:18.7225510Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2025-09-07T07:37:18.7579599Z Entering 'android/libs/fbjni' 2025-09-07T07:37:18.7640464Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-09-07T07:37:18.7659804Z Entering 'third_party/FP16' 2025-09-07T07:37:18.7721229Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-09-07T07:37:18.7741027Z Entering 'third_party/FXdiv' 2025-09-07T07:37:18.7803657Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-09-07T07:37:18.7822707Z Entering 'third_party/NNPACK' 2025-09-07T07:37:18.7883214Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-09-07T07:37:18.7903744Z Entering 'third_party/NVTX' 2025-09-07T07:37:18.7962730Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-09-07T07:37:18.7982022Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T07:37:18.8040087Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-09-07T07:37:18.8059657Z Entering 'third_party/XNNPACK' 2025-09-07T07:37:18.8118162Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-09-07T07:37:18.8150263Z Entering 'third_party/aiter' 2025-09-07T07:37:18.8211165Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config remote.origin.url 2025-09-07T07:37:18.8229760Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T07:37:18.8288422Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config remote.origin.url 2025-09-07T07:37:18.8316283Z Entering 'third_party/benchmark' 2025-09-07T07:37:18.8376449Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-09-07T07:37:18.8396266Z Entering 'third_party/composable_kernel' 2025-09-07T07:37:18.8454311Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-09-07T07:37:18.8480712Z Entering 'third_party/cpp-httplib' 2025-09-07T07:37:18.8544304Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-09-07T07:37:18.8562889Z Entering 'third_party/cpuinfo' 2025-09-07T07:37:18.8622693Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-09-07T07:37:18.8642278Z Entering 'third_party/cudnn_frontend' 2025-09-07T07:37:18.8703357Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-09-07T07:37:18.8722084Z Entering 'third_party/cutlass' 2025-09-07T07:37:18.8781015Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-09-07T07:37:18.8808682Z Entering 'third_party/fbgemm' 2025-09-07T07:37:18.8869019Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-09-07T07:37:18.8889158Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T07:37:18.8947461Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config remote.origin.url 2025-09-07T07:37:18.8967000Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T07:37:18.9025695Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config remote.origin.url 2025-09-07T07:37:18.9051192Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T07:37:18.9113615Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config remote.origin.url 2025-09-07T07:37:18.9131739Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T07:37:18.9192402Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config remote.origin.url 2025-09-07T07:37:18.9218168Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T07:37:18.9278075Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config remote.origin.url 2025-09-07T07:37:18.9296073Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T07:37:18.9358326Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config remote.origin.url 2025-09-07T07:37:18.9376412Z Entering 'third_party/fbgemm/external/json' 2025-09-07T07:37:18.9437281Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config remote.origin.url 2025-09-07T07:37:18.9461171Z Entering 'third_party/flash-attention' 2025-09-07T07:37:18.9521030Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-09-07T07:37:18.9541123Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T07:37:18.9599339Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-09-07T07:37:18.9626072Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T07:37:18.9687233Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-09-07T07:37:18.9715876Z Entering 'third_party/flatbuffers' 2025-09-07T07:37:18.9774685Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-09-07T07:37:18.9797109Z Entering 'third_party/fmt' 2025-09-07T07:37:18.9855770Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-09-07T07:37:18.9875355Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T07:37:18.9934873Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-09-07T07:37:18.9955352Z Entering 'third_party/gloo' 2025-09-07T07:37:19.0016618Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-09-07T07:37:19.0035941Z Entering 'third_party/googletest' 2025-09-07T07:37:19.0094256Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-09-07T07:37:19.0114469Z Entering 'third_party/ideep' 2025-09-07T07:37:19.0175862Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-09-07T07:37:19.0193384Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T07:37:19.0250954Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-09-07T07:37:19.0277492Z Entering 'third_party/ittapi' 2025-09-07T07:37:19.0339955Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-09-07T07:37:19.0359964Z Entering 'third_party/kineto' 2025-09-07T07:37:19.0419468Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-09-07T07:37:19.0438599Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T07:37:19.0498301Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-09-07T07:37:19.0517361Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T07:37:19.0575856Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-09-07T07:37:19.0596748Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T07:37:19.0657108Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-09-07T07:37:19.0676505Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T07:37:19.0742718Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-09-07T07:37:19.0762140Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T07:37:19.0822136Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-09-07T07:37:19.0840322Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T07:37:19.0907407Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-09-07T07:37:19.0927973Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T07:37:19.0988246Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-09-07T07:37:19.1007623Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T07:37:19.1067749Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-09-07T07:37:19.1088345Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T07:37:19.1147422Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-09-07T07:37:19.1167614Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T07:37:19.1228342Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-09-07T07:37:19.1252049Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T07:37:19.1311118Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-09-07T07:37:19.1329239Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T07:37:19.1388432Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-09-07T07:37:19.1410824Z Entering 'third_party/kleidiai' 2025-09-07T07:37:19.1469615Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-09-07T07:37:19.1490647Z Entering 'third_party/mimalloc' 2025-09-07T07:37:19.1550998Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-09-07T07:37:19.1569908Z Entering 'third_party/nlohmann' 2025-09-07T07:37:19.1631562Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-09-07T07:37:19.1652292Z Entering 'third_party/onnx' 2025-09-07T07:37:19.1713578Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-09-07T07:37:19.1746931Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T07:37:19.1806094Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-09-07T07:37:19.1830079Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T07:37:19.1890720Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-09-07T07:37:19.1913298Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T07:37:19.1972308Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-09-07T07:37:19.1991659Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T07:37:19.2050229Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-09-07T07:37:19.2070448Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T07:37:19.2128918Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-09-07T07:37:19.2147827Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T07:37:19.2205128Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-09-07T07:37:19.2227341Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T07:37:19.2285646Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-09-07T07:37:19.2304771Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T07:37:19.2363430Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-09-07T07:37:19.2382311Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T07:37:19.2443467Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-09-07T07:37:19.2460334Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T07:37:19.2518453Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-09-07T07:37:19.2539465Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T07:37:19.2598834Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-09-07T07:37:19.2621517Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T07:37:19.2680520Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-09-07T07:37:19.2717126Z Entering 'third_party/pocketfft' 2025-09-07T07:37:19.2778661Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-09-07T07:37:19.2797531Z Entering 'third_party/protobuf' 2025-09-07T07:37:19.2857627Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-09-07T07:37:19.2879192Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T07:37:19.2940044Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-09-07T07:37:19.2959441Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T07:37:19.3018191Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-09-07T07:37:19.3040131Z Entering 'third_party/psimd' 2025-09-07T07:37:19.3099007Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-09-07T07:37:19.3118643Z Entering 'third_party/pthreadpool' 2025-09-07T07:37:19.3177817Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-09-07T07:37:19.3196851Z Entering 'third_party/pybind11' 2025-09-07T07:37:19.3255709Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-09-07T07:37:19.3276132Z Entering 'third_party/python-peachpy' 2025-09-07T07:37:19.3333660Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-09-07T07:37:19.3352890Z Entering 'third_party/sleef' 2025-09-07T07:37:19.3412670Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-09-07T07:37:19.3432695Z Entering 'third_party/tensorpipe' 2025-09-07T07:37:19.3494238Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-09-07T07:37:19.3514379Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T07:37:19.3571921Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-09-07T07:37:19.3591449Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T07:37:19.3652083Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-09-07T07:37:19.3670087Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T07:37:19.3729509Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-09-07T07:37:19.3748798Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T07:37:19.3807654Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-09-07T07:37:19.3829509Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T07:37:19.3888104Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-09-07T07:37:19.4824297Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2025-09-07T07:37:19.5191694Z Entering 'android/libs/fbjni' 2025-09-07T07:37:19.5241373Z Entering 'third_party/FP16' 2025-09-07T07:37:19.5292039Z Entering 'third_party/FXdiv' 2025-09-07T07:37:19.5345295Z Entering 'third_party/NNPACK' 2025-09-07T07:37:19.5396024Z Entering 'third_party/NVTX' 2025-09-07T07:37:19.5445270Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T07:37:19.5492634Z Entering 'third_party/XNNPACK' 2025-09-07T07:37:19.5552799Z Entering 'third_party/aiter' 2025-09-07T07:37:19.5601608Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T07:37:19.5661749Z Entering 'third_party/benchmark' 2025-09-07T07:37:19.5711290Z Entering 'third_party/composable_kernel' 2025-09-07T07:37:19.5767537Z Entering 'third_party/cpp-httplib' 2025-09-07T07:37:19.5816540Z Entering 'third_party/cpuinfo' 2025-09-07T07:37:19.5865461Z Entering 'third_party/cudnn_frontend' 2025-09-07T07:37:19.5916837Z Entering 'third_party/cutlass' 2025-09-07T07:37:19.5973354Z Entering 'third_party/fbgemm' 2025-09-07T07:37:19.6025033Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T07:37:19.6071425Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T07:37:19.6128203Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T07:37:19.6176551Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T07:37:19.6231879Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T07:37:19.6278126Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T07:37:19.6329981Z Entering 'third_party/fbgemm/external/json' 2025-09-07T07:37:19.6380681Z Entering 'third_party/flash-attention' 2025-09-07T07:37:19.6430982Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T07:37:19.6483997Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T07:37:19.6545198Z Entering 'third_party/flatbuffers' 2025-09-07T07:37:19.6597006Z Entering 'third_party/fmt' 2025-09-07T07:37:19.6646446Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T07:37:19.6693015Z Entering 'third_party/gloo' 2025-09-07T07:37:19.6743445Z Entering 'third_party/googletest' 2025-09-07T07:37:19.6795003Z Entering 'third_party/ideep' 2025-09-07T07:37:19.6845528Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T07:37:19.6899518Z Entering 'third_party/ittapi' 2025-09-07T07:37:19.6948810Z Entering 'third_party/kineto' 2025-09-07T07:37:19.6998425Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T07:37:19.7046922Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T07:37:19.7094625Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T07:37:19.7143805Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T07:37:19.7192688Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T07:37:19.7243040Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T07:37:19.7294472Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T07:37:19.7343528Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T07:37:19.7392482Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T07:37:19.7441754Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T07:37:19.7492115Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T07:37:19.7538950Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T07:37:19.7591516Z Entering 'third_party/kleidiai' 2025-09-07T07:37:19.7641924Z Entering 'third_party/mimalloc' 2025-09-07T07:37:19.7690363Z Entering 'third_party/nlohmann' 2025-09-07T07:37:19.7742803Z Entering 'third_party/onnx' 2025-09-07T07:37:19.7805736Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T07:37:19.7859804Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T07:37:19.7911157Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T07:37:19.7958494Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T07:37:19.8006741Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T07:37:19.8054778Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T07:37:19.8102145Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T07:37:19.8151014Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T07:37:19.8198857Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T07:37:19.8247920Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T07:37:19.8296297Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T07:37:19.8346696Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T07:37:19.8413447Z Entering 'third_party/pocketfft' 2025-09-07T07:37:19.8461809Z Entering 'third_party/protobuf' 2025-09-07T07:37:19.8514968Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T07:37:19.8561981Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T07:37:19.8613953Z Entering 'third_party/psimd' 2025-09-07T07:37:19.8662837Z Entering 'third_party/pthreadpool' 2025-09-07T07:37:19.8712511Z Entering 'third_party/pybind11' 2025-09-07T07:37:19.8759270Z Entering 'third_party/python-peachpy' 2025-09-07T07:37:19.8808442Z Entering 'third_party/sleef' 2025-09-07T07:37:19.8858412Z Entering 'third_party/tensorpipe' 2025-09-07T07:37:19.8907324Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T07:37:19.8956805Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T07:37:19.9003636Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T07:37:19.9052448Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T07:37:19.9100509Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T07:37:19.9174394Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2025-09-07T07:37:19.9525333Z Entering 'android/libs/fbjni' 2025-09-07T07:37:19.9575350Z Entering 'third_party/FP16' 2025-09-07T07:37:19.9629117Z Entering 'third_party/FXdiv' 2025-09-07T07:37:19.9679296Z Entering 'third_party/NNPACK' 2025-09-07T07:37:19.9730268Z Entering 'third_party/NVTX' 2025-09-07T07:37:19.9778841Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T07:37:19.9828632Z Entering 'third_party/XNNPACK' 2025-09-07T07:37:19.9888944Z Entering 'third_party/aiter' 2025-09-07T07:37:19.9970666Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T07:37:20.0027362Z Entering 'third_party/benchmark' 2025-09-07T07:37:20.0076196Z Entering 'third_party/composable_kernel' 2025-09-07T07:37:20.0132725Z Entering 'third_party/cpp-httplib' 2025-09-07T07:37:20.0181562Z Entering 'third_party/cpuinfo' 2025-09-07T07:37:20.0231735Z Entering 'third_party/cudnn_frontend' 2025-09-07T07:37:20.0280816Z Entering 'third_party/cutlass' 2025-09-07T07:37:20.0335704Z Entering 'third_party/fbgemm' 2025-09-07T07:37:20.0388348Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T07:37:20.0435618Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T07:37:20.0490682Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T07:37:20.0539597Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T07:37:20.0593426Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T07:37:20.0640004Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T07:37:20.0689922Z Entering 'third_party/fbgemm/external/json' 2025-09-07T07:37:20.0746270Z Entering 'third_party/flash-attention' 2025-09-07T07:37:20.0797484Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T07:37:20.0849407Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T07:37:20.0906766Z Entering 'third_party/flatbuffers' 2025-09-07T07:37:20.0960910Z Entering 'third_party/fmt' 2025-09-07T07:37:20.1010038Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T07:37:20.1057659Z Entering 'third_party/gloo' 2025-09-07T07:37:20.1107500Z Entering 'third_party/googletest' 2025-09-07T07:37:20.1156394Z Entering 'third_party/ideep' 2025-09-07T07:37:20.1203336Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T07:37:20.1257688Z Entering 'third_party/ittapi' 2025-09-07T07:37:20.1306781Z Entering 'third_party/kineto' 2025-09-07T07:37:20.1354664Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T07:37:20.1400759Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T07:37:20.1450307Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T07:37:20.1500560Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T07:37:20.1551571Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T07:37:20.1599754Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T07:37:20.1648971Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T07:37:20.1696468Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T07:37:20.1749854Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T07:37:20.1797754Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T07:37:20.1849568Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T07:37:20.1897009Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T07:37:20.1948772Z Entering 'third_party/kleidiai' 2025-09-07T07:37:20.1998949Z Entering 'third_party/mimalloc' 2025-09-07T07:37:20.2050557Z Entering 'third_party/nlohmann' 2025-09-07T07:37:20.2099778Z Entering 'third_party/onnx' 2025-09-07T07:37:20.2163717Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T07:37:20.2216049Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T07:37:20.2264819Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T07:37:20.2310763Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T07:37:20.2359983Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T07:37:20.2408650Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T07:37:20.2456187Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T07:37:20.2502651Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T07:37:20.2549215Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T07:37:20.2596629Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T07:37:20.2645980Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T07:37:20.2698065Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T07:37:20.2762990Z Entering 'third_party/pocketfft' 2025-09-07T07:37:20.2811863Z Entering 'third_party/protobuf' 2025-09-07T07:37:20.2863167Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T07:37:20.2913143Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T07:37:20.2964487Z Entering 'third_party/psimd' 2025-09-07T07:37:20.3012988Z Entering 'third_party/pthreadpool' 2025-09-07T07:37:20.3060061Z Entering 'third_party/pybind11' 2025-09-07T07:37:20.3109803Z Entering 'third_party/python-peachpy' 2025-09-07T07:37:20.3157948Z Entering 'third_party/sleef' 2025-09-07T07:37:20.3206538Z Entering 'third_party/tensorpipe' 2025-09-07T07:37:20.3256823Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T07:37:20.3303677Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T07:37:20.3350600Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T07:37:20.3397976Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T07:37:20.3447413Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T07:37:20.3512980Z ##[endgroup] 2025-09-07T07:37:20.3554041Z [command]/usr/bin/git log -1 --format=%H 2025-09-07T07:37:20.3581377Z 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:37:20.3684435Z ##[group]Run cd "${GITHUB_WORKSPACE}" 2025-09-07T07:37:20.3684677Z cd "${GITHUB_WORKSPACE}" 2025-09-07T07:37:20.3684876Z # Clean stale submodule dirs 2025-09-07T07:37:20.3685083Z if [ -z "${NO_SUDO}" ]; then 2025-09-07T07:37:20.3685339Z  sudo git submodule foreach --recursive git clean -ffdx 2025-09-07T07:37:20.3685581Z else 2025-09-07T07:37:20.3685935Z  git submodule foreach --recursive git clean -ffdx 2025-09-07T07:37:20.3686159Z fi 2025-09-07T07:37:20.3697695Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:20.3697940Z env: 2025-09-07T07:37:20.3698087Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:20.3698250Z NO_SUDO: true 2025-09-07T07:37:20.3698402Z ##[endgroup] 2025-09-07T07:37:20.4082278Z Entering 'android/libs/fbjni' 2025-09-07T07:37:20.4122644Z Entering 'third_party/FP16' 2025-09-07T07:37:20.4161780Z Entering 'third_party/FXdiv' 2025-09-07T07:37:20.4199212Z Entering 'third_party/NNPACK' 2025-09-07T07:37:20.4240080Z Entering 'third_party/NVTX' 2025-09-07T07:37:20.4285784Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T07:37:20.4328545Z Entering 'third_party/XNNPACK' 2025-09-07T07:37:20.4449809Z Entering 'third_party/aiter' 2025-09-07T07:37:20.4498261Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T07:37:20.4617320Z Entering 'third_party/benchmark' 2025-09-07T07:37:20.4657441Z Entering 'third_party/composable_kernel' 2025-09-07T07:37:20.4784133Z Entering 'third_party/cpp-httplib' 2025-09-07T07:37:20.4826479Z Entering 'third_party/cpuinfo' 2025-09-07T07:37:20.4868460Z Entering 'third_party/cudnn_frontend' 2025-09-07T07:37:20.4911683Z Entering 'third_party/cutlass' 2025-09-07T07:37:20.5014246Z Entering 'third_party/fbgemm' 2025-09-07T07:37:20.5081492Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T07:37:20.5118693Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T07:37:20.5232647Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T07:37:20.5272558Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T07:37:20.5375236Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T07:37:20.5413622Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T07:37:20.5452367Z Entering 'third_party/fbgemm/external/json' 2025-09-07T07:37:20.5503632Z Entering 'third_party/flash-attention' 2025-09-07T07:37:20.5552933Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T07:37:20.5657876Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T07:37:20.5750818Z Entering 'third_party/flatbuffers' 2025-09-07T07:37:20.5833058Z Entering 'third_party/fmt' 2025-09-07T07:37:20.5871578Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T07:37:20.5911926Z Entering 'third_party/gloo' 2025-09-07T07:37:20.5951147Z Entering 'third_party/googletest' 2025-09-07T07:37:20.5990170Z Entering 'third_party/ideep' 2025-09-07T07:37:20.6027661Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T07:37:20.6117023Z Entering 'third_party/ittapi' 2025-09-07T07:37:20.6155600Z Entering 'third_party/kineto' 2025-09-07T07:37:20.6195977Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T07:37:20.6237675Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T07:37:20.6290182Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T07:37:20.6330041Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T07:37:20.6367459Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T07:37:20.6404894Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T07:37:20.6445228Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T07:37:20.6480414Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T07:37:20.6522154Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T07:37:20.6568615Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T07:37:20.6607781Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T07:37:20.6645713Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T07:37:20.6685925Z Entering 'third_party/kleidiai' 2025-09-07T07:37:20.6730343Z Entering 'third_party/mimalloc' 2025-09-07T07:37:20.6769732Z Entering 'third_party/nlohmann' 2025-09-07T07:37:20.6830796Z Entering 'third_party/onnx' 2025-09-07T07:37:20.7182080Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T07:37:20.7227532Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T07:37:20.7292416Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T07:37:20.7331316Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T07:37:20.7371696Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T07:37:20.7409929Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T07:37:20.7456554Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T07:37:20.7494932Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T07:37:20.7533989Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T07:37:20.7570221Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T07:37:20.7622668Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T07:37:20.7664384Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T07:37:20.7950357Z Entering 'third_party/pocketfft' 2025-09-07T07:37:20.7989457Z Entering 'third_party/protobuf' 2025-09-07T07:37:20.8075966Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T07:37:20.8114664Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T07:37:20.8157225Z Entering 'third_party/psimd' 2025-09-07T07:37:20.8197694Z Entering 'third_party/pthreadpool' 2025-09-07T07:37:20.8235136Z Entering 'third_party/pybind11' 2025-09-07T07:37:20.8278299Z Entering 'third_party/python-peachpy' 2025-09-07T07:37:20.8316515Z Entering 'third_party/sleef' 2025-09-07T07:37:20.8356468Z Entering 'third_party/tensorpipe' 2025-09-07T07:37:20.8397464Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T07:37:20.8435083Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T07:37:20.8470408Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T07:37:20.8511490Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T07:37:20.8547284Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T07:37:20.8684070Z Prepare all required actions 2025-09-07T07:37:20.8684456Z Getting action download info 2025-09-07T07:37:20.9773020Z ##[group]Run ./.github/actions/setup-linux 2025-09-07T07:37:20.9773241Z env: 2025-09-07T07:37:20.9773391Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:20.9773554Z ##[endgroup] 2025-09-07T07:37:20.9803601Z ##[group]Run set -euo pipefail 2025-09-07T07:37:20.9803825Z set -euo pipefail 2025-09-07T07:37:20.9804020Z function get_ec2_metadata() { 2025-09-07T07:37:20.9804261Z  # Pulled from instance metadata endpoint for EC2 2025-09-07T07:37:20.9804664Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2025-09-07T07:37:20.9805026Z  category=$1 2025-09-07T07:37:20.9805260Z  # If it is GCP runner (runner name contains gcp), do not run this 2025-09-07T07:37:20.9805520Z  runner_name_str=i-06b59a500443ed91d 2025-09-07T07:37:20.9805765Z  if [[ -f /.inarc ]]; then 2025-09-07T07:37:20.9805992Z  echo "ARC Runner, no info on ec2 metadata" 2025-09-07T07:37:20.9806226Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2025-09-07T07:37:20.9806507Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2025-09-07T07:37:20.9806765Z  else 2025-09-07T07:37:20.9807277Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2025-09-07T07:37:20.9807790Z  fi 2025-09-07T07:37:20.9807929Z } 2025-09-07T07:37:20.9808101Z echo "ami-id: $(get_ec2_metadata ami-id)" 2025-09-07T07:37:20.9808366Z echo "instance-id: $(get_ec2_metadata instance-id)" 2025-09-07T07:37:20.9808655Z echo "instance-type: $(get_ec2_metadata instance-type)" 2025-09-07T07:37:20.9808901Z echo "system info $(uname -a)" 2025-09-07T07:37:20.9817530Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:20.9817769Z env: 2025-09-07T07:37:20.9817915Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:20.9818076Z ##[endgroup] 2025-09-07T07:37:20.9980153Z ami-id: ami-05ffe3c48a9991133 2025-09-07T07:37:21.0093294Z instance-id: i-06b59a500443ed91d 2025-09-07T07:37:21.0209408Z instance-type: m7a.24xlarge 2025-09-07T07:37:21.0223120Z system info Linux ip-10-0-59-69.ec2.internal 6.1.141-155.222.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 17 10:29:47 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 2025-09-07T07:37:21.0270986Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-09-07T07:37:21.0271577Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-09-07T07:37:21.0279956Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:21.0280210Z env: 2025-09-07T07:37:21.0280357Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:21.0280534Z ##[endgroup] 2025-09-07T07:37:21.0332183Z ##[group]Run if systemctl is-active --quiet docker; then 2025-09-07T07:37:21.0332463Z if systemctl is-active --quiet docker; then 2025-09-07T07:37:21.0332705Z  echo "Docker daemon is running..."; 2025-09-07T07:37:21.0332916Z else 2025-09-07T07:37:21.0333139Z  echo "Starting docker daemon..." && sudo systemctl start docker; 2025-09-07T07:37:21.0333392Z fi 2025-09-07T07:37:21.0340066Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:21.0340456Z env: 2025-09-07T07:37:21.0340600Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:21.0340778Z ##[endgroup] 2025-09-07T07:37:21.0427102Z Docker daemon is running... 2025-09-07T07:37:21.0457969Z ##[group]Run nick-fields/retry@v3.0.0 2025-09-07T07:37:21.0458180Z with: 2025-09-07T07:37:21.0458311Z shell: bash 2025-09-07T07:37:21.0458994Z timeout_minutes: 5 2025-09-07T07:37:21.0459165Z max_attempts: 3 2025-09-07T07:37:21.0459324Z retry_wait_seconds: 30 2025-09-07T07:37:21.0460683Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2025-09-07T07:37:21.0462062Z polling_interval_seconds: 1 2025-09-07T07:37:21.0462246Z warning_on_retry: true 2025-09-07T07:37:21.0462413Z continue_on_error: false 2025-09-07T07:37:21.0462575Z env: 2025-09-07T07:37:21.0462725Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:21.0462887Z AWS_RETRY_MODE: standard 2025-09-07T07:37:21.0463048Z AWS_MAX_ATTEMPTS: 5 2025-09-07T07:37:21.0463206Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T07:37:21.0463382Z ##[endgroup] 2025-09-07T07:37:21.9555483Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-09-07T07:37:21.9555892Z Configure a credential helper to remove this warning. See 2025-09-07T07:37:21.9556269Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-09-07T07:37:21.9556503Z 2025-09-07T07:37:21.9556567Z Login Succeeded 2025-09-07T07:37:22.1122214Z Command completed after 1 attempt(s). 2025-09-07T07:37:22.1177021Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-09-07T07:37:22.1177350Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-09-07T07:37:22.1177629Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-09-07T07:37:22.1186695Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:22.1186927Z env: 2025-09-07T07:37:22.1187074Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:22.1187244Z ##[endgroup] 2025-09-07T07:37:22.1275509Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-09-07T07:37:22.1275871Z # ignore expansion of "docker ps -q" since it could be empty 2025-09-07T07:37:22.1276137Z # shellcheck disable=SC2046 2025-09-07T07:37:22.1276358Z docker stop $(docker ps -q) || true 2025-09-07T07:37:22.1276573Z # Prune all of the docker images 2025-09-07T07:37:22.1276796Z docker system prune -af 2025-09-07T07:37:22.1284559Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:22.1284803Z env: 2025-09-07T07:37:22.1284950Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:22.1285124Z ##[endgroup] 2025-09-07T07:37:22.1824861Z "docker stop" requires at least 1 argument. 2025-09-07T07:37:22.1825437Z See 'docker stop --help'. 2025-09-07T07:37:22.1825640Z 2025-09-07T07:37:22.1825826Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2025-09-07T07:37:22.1826076Z 2025-09-07T07:37:22.1826181Z Stop one or more running containers 2025-09-07T07:37:22.2039282Z Total reclaimed space: 0B 2025-09-07T07:37:22.2084185Z ##[group]Run set +e 2025-09-07T07:37:22.2084388Z set +e 2025-09-07T07:37:22.2084540Z set -x 2025-09-07T07:37:22.2084686Z  2025-09-07T07:37:22.2084850Z PT_DOMAIN=download.pytorch.org 2025-09-07T07:37:22.2085204Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2025-09-07T07:37:22.2085837Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2025-09-07T07:37:22.2086158Z # one is returned at random 2025-09-07T07:37:22.2086422Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2025-09-07T07:37:22.2086651Z  2025-09-07T07:37:22.2086942Z if [ -z "${RESOLVED_IP}" ]; then 2025-09-07T07:37:22.2087481Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2025-09-07T07:37:22.2087811Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2025-09-07T07:37:22.2088054Z  2025-09-07T07:37:22.2088253Z  if [ -z "${RESOLVED_IP}" ]; then 2025-09-07T07:37:22.2088492Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2025-09-07T07:37:22.2088713Z  exit 1 2025-09-07T07:37:22.2088870Z  fi 2025-09-07T07:37:22.2089010Z fi 2025-09-07T07:37:22.2089136Z  2025-09-07T07:37:22.2089306Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2025-09-07T07:37:22.2089536Z  # Clean up any old records first 2025-09-07T07:37:22.2089751Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2025-09-07T07:37:22.2089938Z fi 2025-09-07T07:37:22.2090080Z  2025-09-07T07:37:22.2090279Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2025-09-07T07:37:22.2090526Z cat /etc/hosts 2025-09-07T07:37:22.2097760Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:22.2097992Z env: 2025-09-07T07:37:22.2098137Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:22.2098298Z ##[endgroup] 2025-09-07T07:37:22.2125174Z + PT_DOMAIN=download.pytorch.org 2025-09-07T07:37:22.2131790Z ++ dig -4 +short download.pytorch.org 2025-09-07T07:37:22.2133230Z ++ tail -n1 2025-09-07T07:37:22.2695591Z + RESOLVED_IP=18.160.10.28 2025-09-07T07:37:22.2695839Z + '[' -z 18.160.10.28 ']' 2025-09-07T07:37:22.2696725Z + grep -r download.pytorch.org /etc/hosts 2025-09-07T07:37:22.2717016Z + echo '18.160.10.28 download.pytorch.org' 2025-09-07T07:37:22.2717511Z + sudo tee -a /etc/hosts 2025-09-07T07:37:22.7865909Z 18.160.10.28 download.pytorch.org 2025-09-07T07:37:22.7883412Z + cat /etc/hosts 2025-09-07T07:37:22.7896893Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2025-09-07T07:37:22.7901618Z ::1 localhost6 localhost6.localdomain6 2025-09-07T07:37:22.7901862Z 18.160.10.28 download.pytorch.org 2025-09-07T07:37:22.8007620Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2025-09-07T07:37:22.8007936Z with: 2025-09-07T07:37:22.8008465Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:22.8009032Z use-custom-docker-registry: true 2025-09-07T07:37:22.8009232Z docker-build-dir: .ci/docker 2025-09-07T07:37:22.8009427Z docker-build-script: ./build.sh 2025-09-07T07:37:22.8009826Z working-directory: . 2025-09-07T07:37:22.8010058Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:22.8010299Z force-push: false 2025-09-07T07:37:22.8010453Z env: 2025-09-07T07:37:22.8010592Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:22.8010762Z ##[endgroup] 2025-09-07T07:37:22.8023725Z ##[group]Run set -ex 2025-09-07T07:37:22.8023924Z set -ex 2025-09-07T07:37:22.8024063Z  2025-09-07T07:37:22.8024332Z # If the docker build directory or the build script doesn't exist, the action will 2025-09-07T07:37:22.8024726Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2025-09-07T07:37:22.8025053Z # job could then download the pre-built image as usual 2025-09-07T07:37:22.8025462Z if [[ -d "${DOCKER_BUILD_DIR}" ]] && [[ -f "${DOCKER_BUILD_DIR}/${DOCKER_BUILD_SCRIPT}" ]] && [[ "${USE_CUSTOM_DOCKER_REGISTRY}" == "true" ]]; then 2025-09-07T07:37:22.8026131Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8026337Z else 2025-09-07T07:37:22.8026508Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8026772Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8027020Z  2025-09-07T07:37:22.8027359Z  echo "Not using custom ECR registry. Either it was not requested or there is no Docker build script in the ${REPO_NAME} repo..." 2025-09-07T07:37:22.8027965Z  exit 0 2025-09-07T07:37:22.8028106Z fi 2025-09-07T07:37:22.8028239Z  2025-09-07T07:37:22.8028454Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2025-09-07T07:37:22.8028811Z  # The docker image name already includes the ECR prefix and tag, so we can just 2025-09-07T07:37:22.8029129Z  # use it as it is, but first let's extract the tag 2025-09-07T07:37:22.8029410Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2025-09-07T07:37:22.8029723Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8030026Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8030271Z else 2025-09-07T07:37:22.8030446Z  if [[ "${DOCKER_IMAGE_NAME}" == *:* ]]; then 2025-09-07T07:37:22.8030675Z  CUSTOM_TAG_PREFIX=${DOCKER_IMAGE_NAME#*:} 2025-09-07T07:37:22.8030916Z  DOCKER_IMAGE_NAME=${DOCKER_IMAGE_NAME%%:*} 2025-09-07T07:37:22.8031118Z  fi 2025-09-07T07:37:22.8031393Z  DOCKER_TAG=${CUSTOM_TAG_PREFIX:+${CUSTOM_TAG_PREFIX}-}$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2025-09-07T07:37:22.8031743Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8032110Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8032514Z  echo "custom-tag-prefix=${CUSTOM_TAG_PREFIX}" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8032759Z fi 2025-09-07T07:37:22.8042310Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:22.8042532Z env: 2025-09-07T07:37:22.8042681Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:22.8042859Z REPO_NAME: pytorch 2025-09-07T07:37:22.8043559Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:22.8044135Z DOCKER_BUILD_DIR: .ci/docker 2025-09-07T07:37:22.8044320Z DOCKER_BUILD_SCRIPT: ./build.sh 2025-09-07T07:37:22.8044561Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:22.8044806Z USE_CUSTOM_DOCKER_REGISTRY: true 2025-09-07T07:37:22.8044997Z CUSTOM_TAG_PREFIX: 2025-09-07T07:37:22.8045159Z ##[endgroup] 2025-09-07T07:37:22.8071820Z + [[ -d .ci/docker ]] 2025-09-07T07:37:22.8072005Z + [[ -f .ci/docker/./build.sh ]] 2025-09-07T07:37:22.8072202Z + [[ true == \t\r\u\e ]] 2025-09-07T07:37:22.8072369Z + echo skip=false 2025-09-07T07:37:22.8073307Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2025-09-07T07:37:22.8081138Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:22.8081669Z ++ awk -F '[:,]' '{print $2}' 2025-09-07T07:37:22.8108799Z + DOCKER_TAG=pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:22.8109400Z + echo docker-tag=pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:22.8110424Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:22.8133077Z ##[group]Run set +e 2025-09-07T07:37:22.8133296Z set +e 2025-09-07T07:37:22.8133454Z set -x 2025-09-07T07:37:22.8133589Z  2025-09-07T07:37:22.8133731Z login() { 2025-09-07T07:37:22.8134048Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-09-07T07:37:22.8134391Z } 2025-09-07T07:37:22.8134532Z  2025-09-07T07:37:22.8134669Z retry () { 2025-09-07T07:37:22.8134856Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-09-07T07:37:22.8135057Z } 2025-09-07T07:37:22.8135186Z  2025-09-07T07:37:22.8135340Z retry login "${DOCKER_REGISTRY}" 2025-09-07T07:37:22.8135536Z  2025-09-07T07:37:22.8135678Z START_TIME=$(date +%s) 2025-09-07T07:37:22.8136158Z # Wait up to 120 minutes 2025-09-07T07:37:22.8136413Z while [[ $(( $(date +%s) - 7200 )) -lt $START_TIME ]]; do 2025-09-07T07:37:22.8136707Z  # Check if image already exists, if it does then skip building it 2025-09-07T07:37:22.8137005Z  if docker manifest inspect "${DOCKER_IMAGE}"; then 2025-09-07T07:37:22.8137229Z  exit 0 2025-09-07T07:37:22.8137379Z  fi 2025-09-07T07:37:22.8137515Z  2025-09-07T07:37:22.8137762Z  # NB: This flag is used by Docker build workflow to push the image to ECR, so we can 2025-09-07T07:37:22.8138154Z  # use this to differentiate between the Docker build and regular build jobs. For the 2025-09-07T07:37:22.8138543Z  # latter, it will wait for the Docker images to become available before continuing 2025-09-07T07:37:22.8138864Z  if [ "${DOCKER_PUSH:-false}" == "true" ]; then 2025-09-07T07:37:22.8139111Z  # It's a Docker build job, let's build the image 2025-09-07T07:37:22.8139331Z  break 2025-09-07T07:37:22.8139476Z  else 2025-09-07T07:37:22.8139691Z  # It's a regular build job, wait for the image to become available 2025-09-07T07:37:22.8139936Z  sleep 300 2025-09-07T07:37:22.8140097Z  fi 2025-09-07T07:37:22.8140230Z done 2025-09-07T07:37:22.8140369Z  2025-09-07T07:37:22.8140587Z # NB: This part requires a full checkout. Otherwise, the merge base will 2025-09-07T07:37:22.8141102Z # be empty. The default action would be to continue rebuild the image 2025-09-07T07:37:22.8141424Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2025-09-07T07:37:22.8141693Z  # if we're on the base branch then use the parent commit 2025-09-07T07:37:22.8141937Z  MERGE_BASE=$(git rev-parse HEAD~) 2025-09-07T07:37:22.8142132Z else 2025-09-07T07:37:22.8142332Z  # otherwise we're on a PR, so use the most recent base commit 2025-09-07T07:37:22.8142622Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2025-09-07T07:37:22.8142846Z fi 2025-09-07T07:37:22.8142979Z  2025-09-07T07:37:22.8143132Z if [[ -z "${MERGE_BASE}" ]]; then 2025-09-07T07:37:22.8143359Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8143557Z  2025-09-07T07:37:22.8143845Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2025-09-07T07:37:22.8144174Z  exit 0 2025-09-07T07:37:22.8144313Z fi 2025-09-07T07:37:22.8144443Z  2025-09-07T07:37:22.8144635Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2025-09-07T07:37:22.8145030Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2025-09-07T07:37:22.8145368Z  exit 1 2025-09-07T07:37:22.8145503Z fi 2025-09-07T07:37:22.8145792Z  2025-09-07T07:37:22.8146018Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2025-09-07T07:37:22.8146403Z # If no image exists but the hash is the same as the previous hash then we should error out here 2025-09-07T07:37:22.8146752Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2025-09-07T07:37:22.8147149Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2025-09-07T07:37:22.8147596Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2025-09-07T07:37:22.8147865Z fi 2025-09-07T07:37:22.8147999Z  2025-09-07T07:37:22.8148164Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2025-09-07T07:37:22.8155288Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:22.8155526Z env: 2025-09-07T07:37:22.8155673Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:22.8155857Z DOCKER_BUILD_DIR: .ci/docker 2025-09-07T07:37:22.8156071Z BASE_REVISION: 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:37:22.8156658Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:22.8157381Z DOCKER_TAG: pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:22.8157832Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:22.8158067Z DOCKER_PUSH: 2025-09-07T07:37:22.8158208Z ##[endgroup] 2025-09-07T07:37:22.8185597Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:22.8185958Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:22.8189343Z + aws ecr get-login-password --region us-east-1 2025-09-07T07:37:22.8189703Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:23.2230978Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-09-07T07:37:23.2231372Z Configure a credential helper to remove this warning. See 2025-09-07T07:37:23.2231726Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-09-07T07:37:23.2231954Z 2025-09-07T07:37:23.2232880Z Login Succeeded 2025-09-07T07:37:23.2253027Z ++ date +%s 2025-09-07T07:37:23.2265714Z + START_TIME=1757230643 2025-09-07T07:37:23.2270461Z ++ date +%s 2025-09-07T07:37:23.2282537Z + [[ 1757223443 -lt 1757230643 ]] 2025-09-07T07:37:23.2283132Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:23.4475315Z { 2025-09-07T07:37:23.4475547Z "schemaVersion": 2, 2025-09-07T07:37:23.4475893Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2025-09-07T07:37:23.4476174Z "config": { 2025-09-07T07:37:23.4476409Z "mediaType": "application/vnd.docker.container.image.v1+json", 2025-09-07T07:37:23.4476683Z "size": 30269, 2025-09-07T07:37:23.4476959Z "digest": "sha256:662d8c9dfc7db2f5d004293de4f2b7647941dee4c916479ef082d17fcdfd9c47" 2025-09-07T07:37:23.4477248Z }, 2025-09-07T07:37:23.4477369Z "layers": [ 2025-09-07T07:37:23.4477510Z { 2025-09-07T07:37:23.4477723Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4477977Z "size": 30448359, 2025-09-07T07:37:23.4478254Z "digest": "sha256:e6fdc8487bfe6d764301ef3634bc6c043841dc3ab05ca14f81e69c0f92562d46" 2025-09-07T07:37:23.4478539Z }, 2025-09-07T07:37:23.4478666Z { 2025-09-07T07:37:23.4478866Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4479108Z "size": 1554, 2025-09-07T07:37:23.4479403Z "digest": "sha256:18a5ee5b0e2e283bf6d7b9c4c312b0448c75eff1c43446c22c5139a3aeec97fe" 2025-09-07T07:37:23.4479700Z }, 2025-09-07T07:37:23.4479826Z { 2025-09-07T07:37:23.4480017Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4480623Z "size": 313297813, 2025-09-07T07:37:23.4480959Z "digest": "sha256:572424b92528ee46c84fdf3e9e1f5fd75e302621ad75dcf4257ad06778885094" 2025-09-07T07:37:23.4481230Z }, 2025-09-07T07:37:23.4481348Z { 2025-09-07T07:37:23.4481542Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4481781Z "size": 793, 2025-09-07T07:37:23.4482035Z "digest": "sha256:1c35b7d4b67c6769f59f96a643d69c214c5b00291a4968cdd395eedbce82b9c0" 2025-09-07T07:37:23.4482311Z }, 2025-09-07T07:37:23.4482438Z { 2025-09-07T07:37:23.4482628Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4482860Z "size": 106, 2025-09-07T07:37:23.4483100Z "digest": "sha256:68c20f3c23bb0bddb9b69e6ce2e45bcd5b1fcfd9b37dbe3de26b8a5f0e81ff13" 2025-09-07T07:37:23.4483398Z }, 2025-09-07T07:37:23.4483518Z { 2025-09-07T07:37:23.4483708Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4483943Z "size": 704, 2025-09-07T07:37:23.4484177Z "digest": "sha256:7efa39950d3273a15b20bc5f6659373b2b4eb62e36328d96b289834c48d2e408" 2025-09-07T07:37:23.4484441Z }, 2025-09-07T07:37:23.4484560Z { 2025-09-07T07:37:23.4484740Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4484977Z "size": 1214, 2025-09-07T07:37:23.4485220Z "digest": "sha256:a10eb16a7271e996ea9f1d769ba6bd2ec69358f2a79cf26649595a8cea38275f" 2025-09-07T07:37:23.4485493Z }, 2025-09-07T07:37:23.4485606Z { 2025-09-07T07:37:23.4485794Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4486031Z "size": 485, 2025-09-07T07:37:23.4486261Z "digest": "sha256:7d52cf57965449440c17f257fe4c522f9685019961eaa9853d7c820cfe39f5cc" 2025-09-07T07:37:23.4486514Z }, 2025-09-07T07:37:23.4486631Z { 2025-09-07T07:37:23.4486818Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4487060Z "size": 110343705, 2025-09-07T07:37:23.4487312Z "digest": "sha256:cb6a20fcf4e24ec2e1f72ecf361b26e058f3e6194947a9b3a25312223d43516e" 2025-09-07T07:37:23.4487588Z }, 2025-09-07T07:37:23.4487703Z { 2025-09-07T07:37:23.4487903Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4488139Z "size": 4787, 2025-09-07T07:37:23.4488384Z "digest": "sha256:46fb6a8b3e1d4eac9b3a21577824410003ed38f194b4b1486b747e324b32ef6a" 2025-09-07T07:37:23.4488655Z }, 2025-09-07T07:37:23.4488947Z { 2025-09-07T07:37:23.4489135Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4489371Z "size": 1709, 2025-09-07T07:37:23.4489616Z "digest": "sha256:5ad6977cc38e4ea8a6545d6a4fc0e2fdde705a7af96eb496cfe20f264fbc1e74" 2025-09-07T07:37:23.4489890Z }, 2025-09-07T07:37:23.4490000Z { 2025-09-07T07:37:23.4490186Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4490422Z "size": 724, 2025-09-07T07:37:23.4490659Z "digest": "sha256:da63046995a2e510b7146776371a14bff4b31002cc3ef0322e45a3932fba2031" 2025-09-07T07:37:23.4490916Z }, 2025-09-07T07:37:23.4491035Z { 2025-09-07T07:37:23.4491218Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4491450Z "size": 543, 2025-09-07T07:37:23.4491681Z "digest": "sha256:78243fdb9906cb588921ddaa67a3ca915aa9447ca675faac1a9ebc420a561d83" 2025-09-07T07:37:23.4491952Z }, 2025-09-07T07:37:23.4492070Z { 2025-09-07T07:37:23.4492260Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4492492Z "size": 3395447162, 2025-09-07T07:37:23.4492748Z "digest": "sha256:6f70d5d50abaab8988f460b5590d92b6d1d340575ddee981662c24034d7d20af" 2025-09-07T07:37:23.4493029Z }, 2025-09-07T07:37:23.4493149Z { 2025-09-07T07:37:23.4493341Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4493584Z "size": 32, 2025-09-07T07:37:23.4493833Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4494195Z }, 2025-09-07T07:37:23.4494307Z { 2025-09-07T07:37:23.4494496Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4494743Z "size": 380, 2025-09-07T07:37:23.4494987Z "digest": "sha256:69715d3ad3c493436abde51f5a575e79f7d55b46c653f5607f3c7722ad9a05db" 2025-09-07T07:37:23.4495247Z }, 2025-09-07T07:37:23.4495368Z { 2025-09-07T07:37:23.4495559Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4495802Z "size": 235844, 2025-09-07T07:37:23.4496040Z "digest": "sha256:7ace90c063f3f3ce8f04b541afe935088868930e5c074824af2b2c327779a3b5" 2025-09-07T07:37:23.4496305Z }, 2025-09-07T07:37:23.4496427Z { 2025-09-07T07:37:23.4496617Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4496847Z "size": 230, 2025-09-07T07:37:23.4497089Z "digest": "sha256:acbd5447dd1406dab8e46234f6a034a75ad9794f76c24f817b0ecf28b6a69c78" 2025-09-07T07:37:23.4497360Z }, 2025-09-07T07:37:23.4497482Z { 2025-09-07T07:37:23.4497666Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4497902Z "size": 3396092, 2025-09-07T07:37:23.4498148Z "digest": "sha256:744523d9b7f5a3e7abfc646c2d5222e7379024242430b93cb4b8093574e69022" 2025-09-07T07:37:23.4498417Z }, 2025-09-07T07:37:23.4498532Z { 2025-09-07T07:37:23.4498729Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4498966Z "size": 1477, 2025-09-07T07:37:23.4499209Z "digest": "sha256:5bd615a7b945084e11bcb40190f9d6e50367297237146df7b008fa8c668f29c8" 2025-09-07T07:37:23.4499468Z }, 2025-09-07T07:37:23.4499584Z { 2025-09-07T07:37:23.4499778Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4500021Z "size": 482, 2025-09-07T07:37:23.4500273Z "digest": "sha256:f4986a00e3aecf1d56beaada7aba8c49fbb3683db3c99790ab0aa4caaa34f76f" 2025-09-07T07:37:23.4500561Z }, 2025-09-07T07:37:23.4500765Z { 2025-09-07T07:37:23.4501008Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4501254Z "size": 196, 2025-09-07T07:37:23.4501499Z "digest": "sha256:21902f6e4f8cb76c82e755b8fc9f72e1912bf925ab345ab5b4cc2210f4887a64" 2025-09-07T07:37:23.4501766Z }, 2025-09-07T07:37:23.4501891Z { 2025-09-07T07:37:23.4502085Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4502326Z "size": 608, 2025-09-07T07:37:23.4502651Z "digest": "sha256:d80602abf3ccf0c0b527848a403dfde36e1cf1db1416852385feda5c44bf4363" 2025-09-07T07:37:23.4502926Z }, 2025-09-07T07:37:23.4503044Z { 2025-09-07T07:37:23.4503234Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4503464Z "size": 226, 2025-09-07T07:37:23.4503703Z "digest": "sha256:3c51bf0bc362d34a17911f73c5146cbd668c4d1cf1b944cbf40a604d71cd623a" 2025-09-07T07:37:23.4503973Z }, 2025-09-07T07:37:23.4504090Z { 2025-09-07T07:37:23.4504274Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4504507Z "size": 828, 2025-09-07T07:37:23.4504741Z "digest": "sha256:119ab3bceafa6f2cab4b1f71161195139792990263ee8de82230c6284f0ae20a" 2025-09-07T07:37:23.4505009Z }, 2025-09-07T07:37:23.4505119Z { 2025-09-07T07:37:23.4505308Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4505541Z "size": 32, 2025-09-07T07:37:23.4505856Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4506123Z }, 2025-09-07T07:37:23.4506242Z { 2025-09-07T07:37:23.4506434Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4506672Z "size": 104, 2025-09-07T07:37:23.4506902Z "digest": "sha256:af8eadc9eaabdaf6c5e01031d63061605327153e07568ddd159966ecea75cd07" 2025-09-07T07:37:23.4507173Z }, 2025-09-07T07:37:23.4507296Z { 2025-09-07T07:37:23.4507487Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4507792Z "size": 1495, 2025-09-07T07:37:23.4508032Z "digest": "sha256:e7769b0d7a8262f3cc32a9d96080de5318dac3d2617e10508a167e689016e40c" 2025-09-07T07:37:23.4508299Z }, 2025-09-07T07:37:23.4508418Z { 2025-09-07T07:37:23.4508595Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4508837Z "size": 453908015, 2025-09-07T07:37:23.4509098Z "digest": "sha256:ba263639b0f4634277ef3b8903e3457ac27ce012f1bbeeeeb773191c2c3b222b" 2025-09-07T07:37:23.4509367Z }, 2025-09-07T07:37:23.4509482Z { 2025-09-07T07:37:23.4509856Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4510096Z "size": 164, 2025-09-07T07:37:23.4510335Z "digest": "sha256:a5ab7a280382a797dd5ba6a6716f667a231540ad1e0e7c8ba48bb24d5ab80ef0" 2025-09-07T07:37:23.4510597Z }, 2025-09-07T07:37:23.4510718Z { 2025-09-07T07:37:23.4510929Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4511170Z "size": 346, 2025-09-07T07:37:23.4511401Z "digest": "sha256:80b2232d952f55c3662cffd657ba30fe825f08dfcc5bbea13e2bc6de4482b7e4" 2025-09-07T07:37:23.4511675Z }, 2025-09-07T07:37:23.4511804Z { 2025-09-07T07:37:23.4511997Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4512224Z "size": 32, 2025-09-07T07:37:23.4512466Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4512860Z }, 2025-09-07T07:37:23.4513298Z { 2025-09-07T07:37:23.4513570Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4513934Z "size": 106, 2025-09-07T07:37:23.4514226Z "digest": "sha256:cc93cd65e90f0a9c50194579c93e96897f4e582b9777a1c4d7df7b913ddcdded" 2025-09-07T07:37:23.4514577Z }, 2025-09-07T07:37:23.4514819Z { 2025-09-07T07:37:23.4515108Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4515438Z "size": 425, 2025-09-07T07:37:23.4515750Z "digest": "sha256:0eed4c15712bc470dac7df87e33b3570a1510344019dd9cc0e95b8beb1f98372" 2025-09-07T07:37:23.4516167Z }, 2025-09-07T07:37:23.4516398Z { 2025-09-07T07:37:23.4516709Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4517002Z "size": 19309387, 2025-09-07T07:37:23.4517360Z "digest": "sha256:092516f71fe325518f9737f105bcd65c40cd35c3019098889757e2c84c03c8a8" 2025-09-07T07:37:23.4517747Z }, 2025-09-07T07:37:23.4519481Z { 2025-09-07T07:37:23.4519751Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4532238Z "size": 108, 2025-09-07T07:37:23.4532549Z "digest": "sha256:8c0825014a6270f765ff514da8583d55874f3278bef76e5617e29115f91ee654" 2025-09-07T07:37:23.4532834Z }, 2025-09-07T07:37:23.4532963Z { 2025-09-07T07:37:23.4533175Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4533436Z "size": 636, 2025-09-07T07:37:23.4533709Z "digest": "sha256:8e0d2f63da0a8ff07657d7e06cdbc1ad9d5db95614d640a9f7a9aa8c30c9986d" 2025-09-07T07:37:23.4534008Z }, 2025-09-07T07:37:23.4534124Z { 2025-09-07T07:37:23.4534327Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4534573Z "size": 724, 2025-09-07T07:37:23.4534823Z "digest": "sha256:da63046995a2e510b7146776371a14bff4b31002cc3ef0322e45a3932fba2031" 2025-09-07T07:37:23.4535097Z }, 2025-09-07T07:37:23.4535213Z { 2025-09-07T07:37:23.4535418Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4535659Z "size": 148, 2025-09-07T07:37:23.4535905Z "digest": "sha256:73aae7958ba1a16c5f5625d39b06208e1def8c7816bb75028bf0845f553a5068" 2025-09-07T07:37:23.4536169Z }, 2025-09-07T07:37:23.4536289Z { 2025-09-07T07:37:23.4536479Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4536716Z "size": 136, 2025-09-07T07:37:23.4536949Z "digest": "sha256:ac6077ec9fa50fc0822d387d2ee35e1b6f1f56612402fe7195378180b25087bc" 2025-09-07T07:37:23.4537384Z }, 2025-09-07T07:37:23.4537505Z { 2025-09-07T07:37:23.4537700Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4537930Z "size": 140, 2025-09-07T07:37:23.4538174Z "digest": "sha256:bf4ee4e45e92ef179f7fc64e2c7c6755905a969c37cf82c39aafbadd9290ff04" 2025-09-07T07:37:23.4538448Z }, 2025-09-07T07:37:23.4538569Z { 2025-09-07T07:37:23.4538755Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4539000Z "size": 18617175577, 2025-09-07T07:37:23.4539319Z "digest": "sha256:c1b766f9b961bcc863d6f89d623815fd7dfe9797ddcfd5d15ef06ffe7d177359" 2025-09-07T07:37:23.4539594Z }, 2025-09-07T07:37:23.4539707Z { 2025-09-07T07:37:23.4539897Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4540134Z "size": 223, 2025-09-07T07:37:23.4540385Z "digest": "sha256:6e726ef07b5d5cfe2fb9f06d43fc931fc64c381fd37eaf0c169e0dd84796f152" 2025-09-07T07:37:23.4540664Z }, 2025-09-07T07:37:23.4540782Z { 2025-09-07T07:37:23.4540980Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4541221Z "size": 274477524, 2025-09-07T07:37:23.4541471Z "digest": "sha256:364070434a64fa913f3907ada910a4051707e693e0e6124f57bc97aa57791da1" 2025-09-07T07:37:23.4541739Z }, 2025-09-07T07:37:23.4541858Z { 2025-09-07T07:37:23.4542047Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4542284Z "size": 6451569004, 2025-09-07T07:37:23.4542536Z "digest": "sha256:71f708151a84685fc366b85e914dac9f5279313eff07358d79ecaaeecb0f1c42" 2025-09-07T07:37:23.4542810Z }, 2025-09-07T07:37:23.4542931Z { 2025-09-07T07:37:23.4543117Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4543356Z "size": 129, 2025-09-07T07:37:23.4543603Z "digest": "sha256:622d8cfb39ea4dda608d2819c6a9de45df81b6f8319ee8ab4a24c36d81b9a132" 2025-09-07T07:37:23.4543877Z }, 2025-09-07T07:37:23.4543991Z { 2025-09-07T07:37:23.4544181Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4544416Z "size": 778, 2025-09-07T07:37:23.4544651Z "digest": "sha256:284119a92cb13dacff06926444aab4f99756039acb48abba7b75d35c367ed3f1" 2025-09-07T07:37:23.4544915Z }, 2025-09-07T07:37:23.4545035Z { 2025-09-07T07:37:23.4545220Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4545454Z "size": 724, 2025-09-07T07:37:23.4545849Z "digest": "sha256:da63046995a2e510b7146776371a14bff4b31002cc3ef0322e45a3932fba2031" 2025-09-07T07:37:23.4546122Z }, 2025-09-07T07:37:23.4546243Z { 2025-09-07T07:37:23.4546429Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4546660Z "size": 140, 2025-09-07T07:37:23.4546892Z "digest": "sha256:96695940d842555623cfe4fb7b52e949423e8c8f383e55d02363e7e5c5804afa" 2025-09-07T07:37:23.4547157Z }, 2025-09-07T07:37:23.4547280Z { 2025-09-07T07:37:23.4547467Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4547704Z "size": 32, 2025-09-07T07:37:23.4547949Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4548217Z }, 2025-09-07T07:37:23.4548328Z { 2025-09-07T07:37:23.4548519Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4548767Z "size": 160, 2025-09-07T07:37:23.4549019Z "digest": "sha256:7ddca6c4c050460204097ba875dc0fa03eca6265122a18c0b8dc5504152aea53" 2025-09-07T07:37:23.4549285Z }, 2025-09-07T07:37:23.4549408Z { 2025-09-07T07:37:23.4549610Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4549856Z "size": 1012, 2025-09-07T07:37:23.4550113Z "digest": "sha256:a95e1f2f1aadef03514a7cdbdac1fe83d4eebedbb80df9be868a223f27e1c263" 2025-09-07T07:37:23.4550397Z }, 2025-09-07T07:37:23.4550519Z { 2025-09-07T07:37:23.4550712Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4551025Z "size": 724, 2025-09-07T07:37:23.4551261Z "digest": "sha256:da63046995a2e510b7146776371a14bff4b31002cc3ef0322e45a3932fba2031" 2025-09-07T07:37:23.4551524Z }, 2025-09-07T07:37:23.4551642Z { 2025-09-07T07:37:23.4551823Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4552054Z "size": 135, 2025-09-07T07:37:23.4552294Z "digest": "sha256:8085756b0cc0f9588f23a73c27840a5dff48cc18c3a2f0311e4d1ef291855679" 2025-09-07T07:37:23.4552560Z }, 2025-09-07T07:37:23.4552674Z { 2025-09-07T07:37:23.4552865Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4553102Z "size": 32, 2025-09-07T07:37:23.4553345Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4553611Z }, 2025-09-07T07:37:23.4553730Z { 2025-09-07T07:37:23.4553920Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4554162Z "size": 158, 2025-09-07T07:37:23.4554389Z "digest": "sha256:7e9ff0c6f103b18756f01c60b4d57a951660f17bffb1810b330e3ff703caf216" 2025-09-07T07:37:23.4554669Z }, 2025-09-07T07:37:23.4554791Z { 2025-09-07T07:37:23.4554994Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4555233Z "size": 1369, 2025-09-07T07:37:23.4555492Z "digest": "sha256:a625cbbc05b983aeb4c28702a4a5b65c68191ab1b8d17978f7d98cc17ddf3c52" 2025-09-07T07:37:23.4555769Z }, 2025-09-07T07:37:23.4555895Z { 2025-09-07T07:37:23.4556082Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4556323Z "size": 32, 2025-09-07T07:37:23.4556568Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4556839Z }, 2025-09-07T07:37:23.4556952Z { 2025-09-07T07:37:23.4557145Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4557383Z "size": 136, 2025-09-07T07:37:23.4557623Z "digest": "sha256:4e28486424310870c8d6815524440f17c6e0afe7572eaa173a811b98b4920bed" 2025-09-07T07:37:23.4557880Z }, 2025-09-07T07:37:23.4557999Z { 2025-09-07T07:37:23.4558190Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4558427Z "size": 380, 2025-09-07T07:37:23.4558662Z "digest": "sha256:5e944f1ed1bef9442f5b1b86225d3958ea8f2f7f4c6aa7b92dc5d0c810c260bc" 2025-09-07T07:37:23.4558932Z }, 2025-09-07T07:37:23.4559051Z { 2025-09-07T07:37:23.4559337Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4559574Z "size": 32, 2025-09-07T07:37:23.4559815Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4560085Z }, 2025-09-07T07:37:23.4560207Z { 2025-09-07T07:37:23.4560353Z + exit 0 2025-09-07T07:37:23.4560543Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4560785Z "size": 104, 2025-09-07T07:37:23.4561024Z "digest": "sha256:41619248f604c60e038a02bfd462af96ee2996b77be5f59f05e9ac5fe4790e5a" 2025-09-07T07:37:23.4561291Z }, 2025-09-07T07:37:23.4561403Z { 2025-09-07T07:37:23.4561593Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4561827Z "size": 407, 2025-09-07T07:37:23.4562067Z "digest": "sha256:be86f8c4f654b9ae64a20eb7f960e6ce4baa5b46e0a1f5e1312b11492a40bcd4" 2025-09-07T07:37:23.4562336Z }, 2025-09-07T07:37:23.4562456Z { 2025-09-07T07:37:23.4562651Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4562888Z "size": 32, 2025-09-07T07:37:23.4563116Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4563382Z }, 2025-09-07T07:37:23.4563502Z { 2025-09-07T07:37:23.4563689Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4563917Z "size": 109, 2025-09-07T07:37:23.4564158Z "digest": "sha256:ef1340e22a4bc8cf42e1d40961cb32d183cd3da8f0b785b5425c32ee067690c1" 2025-09-07T07:37:23.4564510Z }, 2025-09-07T07:37:23.4564631Z { 2025-09-07T07:37:23.4564817Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4565058Z "size": 1897, 2025-09-07T07:37:23.4565305Z "digest": "sha256:da8d8b696333cbf6b9f339ab859639c905d6752d7e65fea14c23c3c2dcba553e" 2025-09-07T07:37:23.4565574Z }, 2025-09-07T07:37:23.4565700Z { 2025-09-07T07:37:23.4565886Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4566128Z "size": 243443118, 2025-09-07T07:37:23.4566381Z "digest": "sha256:386b0c49c4982a821fb6f427fbc7d9c7d2012e97c96a514a9c7a09304e76b935" 2025-09-07T07:37:23.4566652Z }, 2025-09-07T07:37:23.4566765Z { 2025-09-07T07:37:23.4566949Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4567184Z "size": 106, 2025-09-07T07:37:23.4567431Z "digest": "sha256:2b1d0ea7efe0bf86e86df804d2cddbf83b113fdecd03f3ddfca728da30546f34" 2025-09-07T07:37:23.4567704Z }, 2025-09-07T07:37:23.4567827Z { 2025-09-07T07:37:23.4568020Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4568255Z "size": 163, 2025-09-07T07:37:23.4568490Z "digest": "sha256:04c04be7408f20625b1bd8454e5a08c91fcf04d4f79ab3ec1b75ae6b1824174d" 2025-09-07T07:37:23.4568761Z }, 2025-09-07T07:37:23.4568879Z { 2025-09-07T07:37:23.4569067Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4569302Z "size": 7943, 2025-09-07T07:37:23.4569550Z "digest": "sha256:f8690caa3ac5e845f2dcc25ad12815b5c7452285c3838a87c780bd03ecf072a3" 2025-09-07T07:37:23.4569823Z }, 2025-09-07T07:37:23.4569935Z { 2025-09-07T07:37:23.4570111Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4570366Z "size": 8074, 2025-09-07T07:37:23.4570606Z "digest": "sha256:2908d6baaa6b21331dee5f210472cae0874d22b98b0a35420cad4fd753ed215f" 2025-09-07T07:37:23.4570879Z }, 2025-09-07T07:37:23.4570990Z { 2025-09-07T07:37:23.4571177Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4571409Z "size": 303, 2025-09-07T07:37:23.4571634Z "digest": "sha256:37e2336101eba2c73995d34431e4fae8782d9e9700c42621777922490b2158ed" 2025-09-07T07:37:23.4571883Z }, 2025-09-07T07:37:23.4571995Z { 2025-09-07T07:37:23.4572191Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4572414Z "size": 32, 2025-09-07T07:37:23.4572729Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4573000Z }, 2025-09-07T07:37:23.4573110Z { 2025-09-07T07:37:23.4573288Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4573509Z "size": 108, 2025-09-07T07:37:23.4573741Z "digest": "sha256:f1ac881fde33994861be4324231269058643168b9aee60c699552d0d92d965da" 2025-09-07T07:37:23.4574021Z }, 2025-09-07T07:37:23.4574144Z { 2025-09-07T07:37:23.4574324Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4574555Z "size": 54145699, 2025-09-07T07:37:23.4574820Z "digest": "sha256:43b14c67347e2813c5f63e928c14db60dbb35c330ccc865510cf79739d8b78a1" 2025-09-07T07:37:23.4575076Z }, 2025-09-07T07:37:23.4575185Z { 2025-09-07T07:37:23.4575362Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T07:37:23.4575588Z "size": 32, 2025-09-07T07:37:23.4575823Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T07:37:23.4576087Z } 2025-09-07T07:37:23.4576196Z ] 2025-09-07T07:37:23.4576326Z } 2025-09-07T07:37:23.4596262Z ##[group]Run set -eux 2025-09-07T07:37:23.4596447Z set -eux 2025-09-07T07:37:23.4596694Z # It's ok if this steps fails, it would then be an anonymous user like what we used to have 2025-09-07T07:37:23.4597380Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin || true 2025-09-07T07:37:23.4605521Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:23.4605752Z env: 2025-09-07T07:37:23.4605893Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:23.4606056Z ##[endgroup] 2025-09-07T07:37:23.4636004Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token 2025-09-07T07:37:23.4637255Z + jq --raw-output .SecretString 2025-09-07T07:37:23.4637982Z + jq -r .docker_hub_readonly_token 2025-09-07T07:37:23.4639536Z + docker login --username pytorchbot --password-stdin 2025-09-07T07:37:23.9098583Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-09-07T07:37:23.9099000Z Configure a credential helper to remove this warning. See 2025-09-07T07:37:23.9099364Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-09-07T07:37:23.9099597Z 2025-09-07T07:37:23.9099871Z Login Succeeded 2025-09-07T07:37:23.9188488Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*:} 2025-09-07T07:37:23.9189010Z tag=${ECR_DOCKER_IMAGE##*:} 2025-09-07T07:37:23.9189265Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2025-09-07T07:37:23.9196420Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:23.9196652Z env: 2025-09-07T07:37:23.9196800Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:23.9197341Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:23.9197874Z ##[endgroup] 2025-09-07T07:37:23.9226613Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:23.9261790Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2025-09-07T07:37:23.9262080Z with: 2025-09-07T07:37:23.9262590Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:23.9263546Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:23.9263786Z env: 2025-09-07T07:37:23.9263928Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:23.9264096Z ##[endgroup] 2025-09-07T07:37:23.9274933Z ##[group]Run set -x 2025-09-07T07:37:23.9275121Z set -x 2025-09-07T07:37:23.9275265Z set +e 2025-09-07T07:37:23.9275406Z  2025-09-07T07:37:23.9275532Z login() { 2025-09-07T07:37:23.9275832Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-09-07T07:37:23.9276142Z } 2025-09-07T07:37:23.9276273Z  2025-09-07T07:37:23.9276424Z retry () { 2025-09-07T07:37:23.9276594Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-09-07T07:37:23.9276784Z } 2025-09-07T07:37:23.9276916Z  2025-09-07T07:37:23.9277066Z retry login "${DOCKER_REGISTRY}" 2025-09-07T07:37:23.9277254Z  2025-09-07T07:37:23.9277547Z IMAGE_SIZE=$(docker manifest inspect "${DOCKER_IMAGE}" | jq '[.layers[].size, .config.size] | add / 1024 / 1024') 2025-09-07T07:37:23.9277954Z echo "Compressed size of image in MB: ${IMAGE_SIZE}" 2025-09-07T07:37:23.9278179Z  2025-09-07T07:37:23.9278311Z set -e 2025-09-07T07:37:23.9278737Z # ignore output since only exit code is used for conditional 2025-09-07T07:37:23.9279041Z # only pull docker image if it's not available locally 2025-09-07T07:37:23.9279369Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2025-09-07T07:37:23.9279682Z  retry docker pull "${DOCKER_IMAGE}" 2025-09-07T07:37:23.9279877Z fi 2025-09-07T07:37:23.9286819Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:37:23.9287051Z env: 2025-09-07T07:37:23.9287348Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:37:23.9287882Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:23.9288472Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:23.9288714Z ##[endgroup] 2025-09-07T07:37:23.9315251Z + set +e 2025-09-07T07:37:23.9315469Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:23.9315745Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:23.9319564Z + aws ecr get-login-password --region us-east-1 2025-09-07T07:37:23.9320901Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T07:37:24.3234972Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-09-07T07:37:24.3235384Z Configure a credential helper to remove this warning. See 2025-09-07T07:37:24.3235737Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-09-07T07:37:24.3235980Z 2025-09-07T07:37:24.3236091Z Login Succeeded 2025-09-07T07:37:24.3263138Z ++ docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:24.3263784Z ++ jq '[.layers[].size, .config.size] | add / 1024 / 1024' 2025-09-07T07:37:24.5361706Z + IMAGE_SIZE=28579.020259857178 2025-09-07T07:37:24.5361984Z + echo 'Compressed size of image in MB: 28579.020259857178' 2025-09-07T07:37:24.5362233Z + set -e 2025-09-07T07:37:24.5363274Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:24.5363892Z Compressed size of image in MB: 28579.020259857178 2025-09-07T07:37:24.5522103Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:24.5523040Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:37:24.7807895Z pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77: Pulling from pytorch/ci-image 2025-09-07T07:37:24.7808456Z e6fdc8487bfe: Pulling fs layer 2025-09-07T07:37:24.7808653Z 18a5ee5b0e2e: Pulling fs layer 2025-09-07T07:37:24.7808836Z 572424b92528: Pulling fs layer 2025-09-07T07:37:24.7809010Z 1c35b7d4b67c: Pulling fs layer 2025-09-07T07:37:24.7809173Z 68c20f3c23bb: Pulling fs layer 2025-09-07T07:37:24.7809357Z 7efa39950d32: Pulling fs layer 2025-09-07T07:37:24.7809796Z a10eb16a7271: Pulling fs layer 2025-09-07T07:37:24.7809985Z 7d52cf579654: Pulling fs layer 2025-09-07T07:37:24.7810157Z cb6a20fcf4e2: Pulling fs layer 2025-09-07T07:37:24.7810344Z 46fb6a8b3e1d: Pulling fs layer 2025-09-07T07:37:24.7810538Z 5ad6977cc38e: Pulling fs layer 2025-09-07T07:37:24.7810709Z da63046995a2: Pulling fs layer 2025-09-07T07:37:24.7810879Z 78243fdb9906: Pulling fs layer 2025-09-07T07:37:24.7811048Z 6f70d5d50aba: Pulling fs layer 2025-09-07T07:37:24.7811220Z 4f4fb700ef54: Pulling fs layer 2025-09-07T07:37:24.7811398Z 69715d3ad3c4: Pulling fs layer 2025-09-07T07:37:24.7811555Z 1c35b7d4b67c: Waiting 2025-09-07T07:37:24.7811717Z 7ace90c063f3: Pulling fs layer 2025-09-07T07:37:24.7811887Z acbd5447dd14: Pulling fs layer 2025-09-07T07:37:24.7812049Z 68c20f3c23bb: Waiting 2025-09-07T07:37:24.7812198Z 744523d9b7f5: Pulling fs layer 2025-09-07T07:37:24.7812367Z 5bd615a7b945: Pulling fs layer 2025-09-07T07:37:24.7812529Z 7d52cf579654: Waiting 2025-09-07T07:37:24.7812684Z f4986a00e3ae: Pulling fs layer 2025-09-07T07:37:24.7812848Z 21902f6e4f8c: Pulling fs layer 2025-09-07T07:37:24.7813011Z 7efa39950d32: Waiting 2025-09-07T07:37:24.7813163Z d80602abf3cc: Pulling fs layer 2025-09-07T07:37:24.7813669Z 3c51bf0bc362: Pulling fs layer 2025-09-07T07:37:24.7813835Z 119ab3bceafa: Pulling fs layer 2025-09-07T07:37:24.7814007Z af8eadc9eaab: Pulling fs layer 2025-09-07T07:37:24.7814169Z 78243fdb9906: Waiting 2025-09-07T07:37:24.7814324Z e7769b0d7a82: Pulling fs layer 2025-09-07T07:37:24.7814484Z ba263639b0f4: Pulling fs layer 2025-09-07T07:37:24.7814650Z 6f70d5d50aba: Waiting 2025-09-07T07:37:24.7814797Z a10eb16a7271: Waiting 2025-09-07T07:37:24.7814940Z 4f4fb700ef54: Waiting 2025-09-07T07:37:24.7815087Z a5ab7a280382: Pulling fs layer 2025-09-07T07:37:24.7815253Z 80b2232d952f: Pulling fs layer 2025-09-07T07:37:24.7815412Z da63046995a2: Waiting 2025-09-07T07:37:24.7815599Z 69715d3ad3c4: Waiting 2025-09-07T07:37:24.7815744Z cc93cd65e90f: Pulling fs layer 2025-09-07T07:37:24.7815914Z 0eed4c15712b: Pulling fs layer 2025-09-07T07:37:24.7816081Z 7ace90c063f3: Waiting 2025-09-07T07:37:24.7816231Z 092516f71fe3: Pulling fs layer 2025-09-07T07:37:24.7816387Z acbd5447dd14: Waiting 2025-09-07T07:37:24.7816539Z 8c0825014a62: Pulling fs layer 2025-09-07T07:37:24.7816705Z 744523d9b7f5: Waiting 2025-09-07T07:37:24.7816859Z 8e0d2f63da0a: Pulling fs layer 2025-09-07T07:37:24.7817018Z 5bd615a7b945: Waiting 2025-09-07T07:37:24.7817162Z f4986a00e3ae: Waiting 2025-09-07T07:37:24.7817314Z 73aae7958ba1: Pulling fs layer 2025-09-07T07:37:24.7817480Z 21902f6e4f8c: Waiting 2025-09-07T07:37:24.7817636Z ac6077ec9fa5: Pulling fs layer 2025-09-07T07:37:24.7817817Z bf4ee4e45e92: Pulling fs layer 2025-09-07T07:37:24.7817990Z c1b766f9b961: Pulling fs layer 2025-09-07T07:37:24.7818158Z af8eadc9eaab: Waiting 2025-09-07T07:37:24.7818311Z 6e726ef07b5d: Pulling fs layer 2025-09-07T07:37:24.7818476Z cb6a20fcf4e2: Waiting 2025-09-07T07:37:24.7818622Z 80b2232d952f: Waiting 2025-09-07T07:37:24.7818764Z e7769b0d7a82: Waiting 2025-09-07T07:37:24.7819113Z 364070434a64: Pulling fs layer 2025-09-07T07:37:24.7819289Z 71f708151a84: Pulling fs layer 2025-09-07T07:37:24.7819452Z ba263639b0f4: Waiting 2025-09-07T07:37:24.7819601Z d80602abf3cc: Waiting 2025-09-07T07:37:24.7819748Z 5ad6977cc38e: Waiting 2025-09-07T07:37:24.7819897Z cc93cd65e90f: Waiting 2025-09-07T07:37:24.7820048Z 622d8cfb39ea: Pulling fs layer 2025-09-07T07:37:24.7820212Z a5ab7a280382: Waiting 2025-09-07T07:37:24.7820356Z 284119a92cb1: Pulling fs layer 2025-09-07T07:37:24.7820514Z 3c51bf0bc362: Waiting 2025-09-07T07:37:24.7820661Z 0eed4c15712b: Waiting 2025-09-07T07:37:24.7820805Z 092516f71fe3: Waiting 2025-09-07T07:37:24.7820946Z 96695940d842: Pulling fs layer 2025-09-07T07:37:24.7821106Z 46fb6a8b3e1d: Waiting 2025-09-07T07:37:24.7821250Z 8c0825014a62: Waiting 2025-09-07T07:37:24.7821402Z 7ddca6c4c050: Pulling fs layer 2025-09-07T07:37:24.7821558Z bf4ee4e45e92: Waiting 2025-09-07T07:37:24.7821712Z a95e1f2f1aad: Pulling fs layer 2025-09-07T07:37:24.7821878Z ac6077ec9fa5: Waiting 2025-09-07T07:37:24.7822025Z 8e0d2f63da0a: Waiting 2025-09-07T07:37:24.7822199Z 73aae7958ba1: Waiting 2025-09-07T07:37:24.7822343Z 8085756b0cc0: Pulling fs layer 2025-09-07T07:37:24.7822507Z 622d8cfb39ea: Waiting 2025-09-07T07:37:24.7822654Z 284119a92cb1: Waiting 2025-09-07T07:37:24.7822791Z 96695940d842: Waiting 2025-09-07T07:37:24.7822942Z 7e9ff0c6f103: Pulling fs layer 2025-09-07T07:37:24.7823105Z a95e1f2f1aad: Waiting 2025-09-07T07:37:24.7823254Z 7ddca6c4c050: Waiting 2025-09-07T07:37:24.7823399Z 6e726ef07b5d: Waiting 2025-09-07T07:37:24.7823547Z a625cbbc05b9: Pulling fs layer 2025-09-07T07:37:24.7823717Z 8085756b0cc0: Waiting 2025-09-07T07:37:24.7823860Z 71f708151a84: Waiting 2025-09-07T07:37:24.7824001Z 364070434a64: Waiting 2025-09-07T07:37:24.7824142Z 4e2848642431: Pulling fs layer 2025-09-07T07:37:24.7824304Z a625cbbc05b9: Waiting 2025-09-07T07:37:24.7824453Z 7e9ff0c6f103: Waiting 2025-09-07T07:37:24.7824608Z 5e944f1ed1be: Pulling fs layer 2025-09-07T07:37:24.7824770Z 41619248f604: Pulling fs layer 2025-09-07T07:37:24.7824943Z be86f8c4f654: Pulling fs layer 2025-09-07T07:37:24.7825111Z 4e2848642431: Waiting 2025-09-07T07:37:24.7825256Z ef1340e22a4b: Pulling fs layer 2025-09-07T07:37:24.7825431Z da8d8b696333: Pulling fs layer 2025-09-07T07:37:24.7825748Z 386b0c49c498: Pulling fs layer 2025-09-07T07:37:24.7825920Z 2b1d0ea7efe0: Pulling fs layer 2025-09-07T07:37:24.7826092Z 04c04be7408f: Pulling fs layer 2025-09-07T07:37:24.7826258Z 5e944f1ed1be: Waiting 2025-09-07T07:37:24.7826499Z f8690caa3ac5: Pulling fs layer 2025-09-07T07:37:24.7826774Z ef1340e22a4b: Waiting 2025-09-07T07:37:24.7827031Z 2b1d0ea7efe0: Waiting 2025-09-07T07:37:24.7827440Z 2908d6baaa6b: Pulling fs layer 2025-09-07T07:37:24.7827718Z 37e2336101eb: Pulling fs layer 2025-09-07T07:37:24.7827934Z 386b0c49c498: Waiting 2025-09-07T07:37:24.7838483Z da8d8b696333: Waiting 2025-09-07T07:37:24.7838652Z f8690caa3ac5: Waiting 2025-09-07T07:37:24.7838824Z f1ac881fde33: Pulling fs layer 2025-09-07T07:37:24.7838998Z 41619248f604: Waiting 2025-09-07T07:37:24.7839167Z 43b14c67347e: Pulling fs layer 2025-09-07T07:37:24.7839337Z 37e2336101eb: Waiting 2025-09-07T07:37:24.7839488Z 2908d6baaa6b: Waiting 2025-09-07T07:37:24.7839629Z f1ac881fde33: Waiting 2025-09-07T07:37:24.7839775Z 43b14c67347e: Waiting 2025-09-07T07:37:24.8630992Z 18a5ee5b0e2e: Download complete 2025-09-07T07:37:24.9282599Z 1c35b7d4b67c: Verifying Checksum 2025-09-07T07:37:24.9282833Z 1c35b7d4b67c: Download complete 2025-09-07T07:37:25.0145351Z 68c20f3c23bb: Verifying Checksum 2025-09-07T07:37:25.0145680Z 68c20f3c23bb: Download complete 2025-09-07T07:37:25.0923195Z 7efa39950d32: Verifying Checksum 2025-09-07T07:37:25.0923449Z 7efa39950d32: Download complete 2025-09-07T07:37:25.1416376Z e6fdc8487bfe: Verifying Checksum 2025-09-07T07:37:25.1416616Z e6fdc8487bfe: Download complete 2025-09-07T07:37:25.1866896Z a10eb16a7271: Verifying Checksum 2025-09-07T07:37:25.1867112Z a10eb16a7271: Download complete 2025-09-07T07:37:25.2059663Z 7d52cf579654: Verifying Checksum 2025-09-07T07:37:25.2059884Z 7d52cf579654: Download complete 2025-09-07T07:37:25.2807400Z 46fb6a8b3e1d: Verifying Checksum 2025-09-07T07:37:25.2807633Z 46fb6a8b3e1d: Download complete 2025-09-07T07:37:25.3729839Z 5ad6977cc38e: Verifying Checksum 2025-09-07T07:37:25.3730093Z 5ad6977cc38e: Download complete 2025-09-07T07:37:25.4469761Z da63046995a2: Verifying Checksum 2025-09-07T07:37:25.4469980Z da63046995a2: Download complete 2025-09-07T07:37:25.5351180Z 78243fdb9906: Verifying Checksum 2025-09-07T07:37:25.5351411Z 78243fdb9906: Download complete 2025-09-07T07:37:25.8191732Z e6fdc8487bfe: Pull complete 2025-09-07T07:37:25.8412946Z 18a5ee5b0e2e: Pull complete 2025-09-07T07:37:26.3246776Z cb6a20fcf4e2: Verifying Checksum 2025-09-07T07:37:26.3247117Z cb6a20fcf4e2: Download complete 2025-09-07T07:37:26.3302758Z 4f4fb700ef54: Verifying Checksum 2025-09-07T07:37:26.3302972Z 4f4fb700ef54: Download complete 2025-09-07T07:37:26.4266858Z 69715d3ad3c4: Verifying Checksum 2025-09-07T07:37:26.4267113Z 69715d3ad3c4: Download complete 2025-09-07T07:37:26.5034227Z 7ace90c063f3: Download complete 2025-09-07T07:37:26.5893087Z acbd5447dd14: Download complete 2025-09-07T07:37:26.6746597Z 744523d9b7f5: Verifying Checksum 2025-09-07T07:37:26.6746863Z 744523d9b7f5: Download complete 2025-09-07T07:37:26.7451998Z 5bd615a7b945: Verifying Checksum 2025-09-07T07:37:26.7452238Z 5bd615a7b945: Download complete 2025-09-07T07:37:26.8315304Z f4986a00e3ae: Verifying Checksum 2025-09-07T07:37:26.8315567Z f4986a00e3ae: Download complete 2025-09-07T07:37:26.8920472Z 21902f6e4f8c: Verifying Checksum 2025-09-07T07:37:26.8920700Z 21902f6e4f8c: Download complete 2025-09-07T07:37:26.9681270Z d80602abf3cc: Verifying Checksum 2025-09-07T07:37:26.9681568Z d80602abf3cc: Download complete 2025-09-07T07:37:27.0514954Z 3c51bf0bc362: Download complete 2025-09-07T07:37:27.1234064Z 119ab3bceafa: Download complete 2025-09-07T07:37:27.2079778Z af8eadc9eaab: Download complete 2025-09-07T07:37:27.2646418Z e7769b0d7a82: Verifying Checksum 2025-09-07T07:37:27.2646667Z e7769b0d7a82: Download complete 2025-09-07T07:37:27.9650981Z 572424b92528: Verifying Checksum 2025-09-07T07:37:27.9651251Z 572424b92528: Download complete 2025-09-07T07:37:28.0552099Z a5ab7a280382: Verifying Checksum 2025-09-07T07:37:28.0552343Z a5ab7a280382: Download complete 2025-09-07T07:37:28.1359978Z 80b2232d952f: Verifying Checksum 2025-09-07T07:37:28.1360203Z 80b2232d952f: Download complete 2025-09-07T07:37:28.2166920Z cc93cd65e90f: Verifying Checksum 2025-09-07T07:37:28.2167164Z cc93cd65e90f: Download complete 2025-09-07T07:37:28.2888055Z 0eed4c15712b: Download complete 2025-09-07T07:37:28.5249783Z 092516f71fe3: Verifying Checksum 2025-09-07T07:37:28.5250085Z 092516f71fe3: Download complete 2025-09-07T07:37:28.6261511Z 8c0825014a62: Verifying Checksum 2025-09-07T07:37:28.6261772Z 8c0825014a62: Download complete 2025-09-07T07:37:28.6855950Z 8e0d2f63da0a: Verifying Checksum 2025-09-07T07:37:28.6856197Z 8e0d2f63da0a: Download complete 2025-09-07T07:37:28.7493913Z 73aae7958ba1: Verifying Checksum 2025-09-07T07:37:28.7494155Z 73aae7958ba1: Download complete 2025-09-07T07:37:28.8067979Z ac6077ec9fa5: Download complete 2025-09-07T07:37:28.8962890Z bf4ee4e45e92: Verifying Checksum 2025-09-07T07:37:28.8963143Z bf4ee4e45e92: Download complete 2025-09-07T07:37:31.8572099Z ba263639b0f4: Verifying Checksum 2025-09-07T07:37:31.8572394Z ba263639b0f4: Download complete 2025-09-07T07:37:31.9539119Z 6e726ef07b5d: Verifying Checksum 2025-09-07T07:37:34.7586643Z 6e726ef07b5d: Download complete 2025-09-07T07:37:34.7586918Z 364070434a64: Verifying Checksum 2025-09-07T07:37:34.7587129Z 364070434a64: Download complete 2025-09-07T07:37:34.7936519Z 572424b92528: Pull complete 2025-09-07T07:37:35.1710122Z 1c35b7d4b67c: Pull complete 2025-09-07T07:37:35.6162003Z 68c20f3c23bb: Pull complete 2025-09-07T07:37:36.0396703Z 7efa39950d32: Pull complete 2025-09-07T07:37:36.5771953Z a10eb16a7271: Pull complete 2025-09-07T07:37:37.0204240Z 7d52cf579654: Pull complete 2025-09-07T07:37:39.0505790Z cb6a20fcf4e2: Pull complete 2025-09-07T07:37:39.4920618Z 46fb6a8b3e1d: Pull complete 2025-09-07T07:37:39.9319907Z 5ad6977cc38e: Pull complete 2025-09-07T07:37:40.4037492Z da63046995a2: Pull complete 2025-09-07T07:37:40.8885988Z 78243fdb9906: Pull complete 2025-09-07T07:37:59.5545631Z 6f70d5d50aba: Verifying Checksum 2025-09-07T07:37:59.5545934Z 6f70d5d50aba: Download complete 2025-09-07T07:37:59.6415611Z 622d8cfb39ea: Verifying Checksum 2025-09-07T07:37:59.6415833Z 622d8cfb39ea: Download complete 2025-09-07T07:37:59.7205279Z 284119a92cb1: Verifying Checksum 2025-09-07T07:37:59.7205510Z 284119a92cb1: Download complete 2025-09-07T07:37:59.8064591Z 96695940d842: Verifying Checksum 2025-09-07T07:37:59.8064814Z 96695940d842: Download complete 2025-09-07T07:37:59.8810100Z 7ddca6c4c050: Download complete 2025-09-07T07:37:59.9525778Z a95e1f2f1aad: Download complete 2025-09-07T07:38:00.0405507Z 8085756b0cc0: Verifying Checksum 2025-09-07T07:38:00.0408382Z 8085756b0cc0: Download complete 2025-09-07T07:38:00.1127797Z 7e9ff0c6f103: Verifying Checksum 2025-09-07T07:38:00.1128055Z 7e9ff0c6f103: Download complete 2025-09-07T07:38:00.2001568Z a625cbbc05b9: Verifying Checksum 2025-09-07T07:38:00.2001805Z a625cbbc05b9: Download complete 2025-09-07T07:38:00.2880950Z 4e2848642431: Verifying Checksum 2025-09-07T07:38:00.2881185Z 4e2848642431: Download complete 2025-09-07T07:38:00.3735615Z 5e944f1ed1be: Download complete 2025-09-07T07:38:00.4470043Z 41619248f604: Verifying Checksum 2025-09-07T07:38:00.4470275Z 41619248f604: Download complete 2025-09-07T07:38:00.5293005Z be86f8c4f654: Verifying Checksum 2025-09-07T07:38:00.5293242Z be86f8c4f654: Download complete 2025-09-07T07:38:00.6065020Z ef1340e22a4b: Verifying Checksum 2025-09-07T07:38:00.6065255Z ef1340e22a4b: Download complete 2025-09-07T07:38:00.6989265Z da8d8b696333: Verifying Checksum 2025-09-07T07:38:00.6989503Z da8d8b696333: Download complete 2025-09-07T07:38:03.1939105Z 386b0c49c498: Verifying Checksum 2025-09-07T07:38:03.1940438Z 386b0c49c498: Download complete 2025-09-07T07:38:03.2889065Z 2b1d0ea7efe0: Verifying Checksum 2025-09-07T07:38:03.2889356Z 2b1d0ea7efe0: Download complete 2025-09-07T07:38:03.3769212Z 04c04be7408f: Download complete 2025-09-07T07:38:03.4538814Z f8690caa3ac5: Verifying Checksum 2025-09-07T07:38:03.4539049Z f8690caa3ac5: Download complete 2025-09-07T07:38:03.5482696Z 2908d6baaa6b: Verifying Checksum 2025-09-07T07:38:03.5482929Z 2908d6baaa6b: Download complete 2025-09-07T07:38:03.6112622Z 37e2336101eb: Verifying Checksum 2025-09-07T07:38:03.6112835Z 37e2336101eb: Download complete 2025-09-07T07:38:03.7000255Z f1ac881fde33: Verifying Checksum 2025-09-07T07:38:03.7000550Z f1ac881fde33: Download complete 2025-09-07T07:38:04.2953888Z 43b14c67347e: Verifying Checksum 2025-09-07T07:38:04.2954145Z 43b14c67347e: Download complete 2025-09-07T07:38:36.3023522Z 6f70d5d50aba: Pull complete 2025-09-07T07:38:36.6538961Z 4f4fb700ef54: Pull complete 2025-09-07T07:38:37.1530851Z 69715d3ad3c4: Pull complete 2025-09-07T07:38:37.6067217Z 7ace90c063f3: Pull complete 2025-09-07T07:38:37.9411844Z acbd5447dd14: Pull complete 2025-09-07T07:38:38.4794852Z 744523d9b7f5: Pull complete 2025-09-07T07:38:38.8809089Z 5bd615a7b945: Pull complete 2025-09-07T07:38:39.1804298Z f4986a00e3ae: Pull complete 2025-09-07T07:38:39.3264281Z 71f708151a84: Verifying Checksum 2025-09-07T07:38:39.3264523Z 71f708151a84: Download complete 2025-09-07T07:38:39.3505367Z 21902f6e4f8c: Pull complete 2025-09-07T07:38:39.7276015Z d80602abf3cc: Pull complete 2025-09-07T07:38:40.0548843Z 3c51bf0bc362: Pull complete 2025-09-07T07:38:40.4786783Z 119ab3bceafa: Pull complete 2025-09-07T07:38:41.4125681Z af8eadc9eaab: Pull complete 2025-09-07T07:38:41.6826871Z e7769b0d7a82: Pull complete 2025-09-07T07:38:48.3921397Z ba263639b0f4: Pull complete 2025-09-07T07:38:48.7957684Z a5ab7a280382: Pull complete 2025-09-07T07:38:49.0816458Z 80b2232d952f: Pull complete 2025-09-07T07:38:49.7509022Z cc93cd65e90f: Pull complete 2025-09-07T07:38:50.0753103Z 0eed4c15712b: Pull complete 2025-09-07T07:38:50.5432202Z 092516f71fe3: Pull complete 2025-09-07T07:38:50.8618114Z 8c0825014a62: Pull complete 2025-09-07T07:38:51.2228754Z 8e0d2f63da0a: Pull complete 2025-09-07T07:38:52.0214934Z 73aae7958ba1: Pull complete 2025-09-07T07:38:52.3597964Z ac6077ec9fa5: Pull complete 2025-09-07T07:38:52.8052243Z bf4ee4e45e92: Pull complete 2025-09-07T07:40:35.1282838Z c1b766f9b961: Verifying Checksum 2025-09-07T07:40:35.1283101Z c1b766f9b961: Download complete 2025-09-07T07:42:28.7029977Z c1b766f9b961: Pull complete 2025-09-07T07:42:29.0459207Z 6e726ef07b5d: Pull complete 2025-09-07T07:42:30.0952968Z 364070434a64: Pull complete 2025-09-07T07:43:37.6058124Z 71f708151a84: Pull complete 2025-09-07T07:43:38.1189055Z 622d8cfb39ea: Pull complete 2025-09-07T07:43:38.4983378Z 284119a92cb1: Pull complete 2025-09-07T07:43:39.3024331Z 96695940d842: Pull complete 2025-09-07T07:43:40.2920783Z 7ddca6c4c050: Pull complete 2025-09-07T07:43:40.6946442Z a95e1f2f1aad: Pull complete 2025-09-07T07:43:41.6363482Z 8085756b0cc0: Pull complete 2025-09-07T07:43:42.6854873Z 7e9ff0c6f103: Pull complete 2025-09-07T07:43:43.2129584Z a625cbbc05b9: Pull complete 2025-09-07T07:43:44.1448010Z 4e2848642431: Pull complete 2025-09-07T07:43:44.6360755Z 5e944f1ed1be: Pull complete 2025-09-07T07:43:45.6936405Z 41619248f604: Pull complete 2025-09-07T07:43:46.2003289Z be86f8c4f654: Pull complete 2025-09-07T07:43:47.2797216Z ef1340e22a4b: Pull complete 2025-09-07T07:43:47.7371640Z da8d8b696333: Pull complete 2025-09-07T07:43:53.0180444Z 386b0c49c498: Pull complete 2025-09-07T07:43:53.4546253Z 2b1d0ea7efe0: Pull complete 2025-09-07T07:43:53.8401182Z 04c04be7408f: Pull complete 2025-09-07T07:43:54.2734747Z f8690caa3ac5: Pull complete 2025-09-07T07:43:54.7980254Z 2908d6baaa6b: Pull complete 2025-09-07T07:43:55.2735876Z 37e2336101eb: Pull complete 2025-09-07T07:43:55.8242810Z f1ac881fde33: Pull complete 2025-09-07T07:43:57.1219814Z 43b14c67347e: Pull complete 2025-09-07T07:43:57.5600134Z Digest: sha256:383efb45082f20b8c808cb0ba4df693a01359592233f641f1f486911ac320a9a 2025-09-07T07:43:57.6574927Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:43:57.6940755Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:43:57.7002581Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-09-07T07:43:57.7003194Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-09-07T07:43:57.7014618Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:43:57.7014851Z env: 2025-09-07T07:43:57.7014999Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:43:57.7015167Z ##[endgroup] 2025-09-07T07:43:57.7098269Z Prepare all required actions 2025-09-07T07:43:57.7147429Z ##[group]Run ./.github/actions/get-workflow-job-id 2025-09-07T07:43:57.7147654Z with: 2025-09-07T07:43:57.7148595Z github-token: *** 2025-09-07T07:43:57.7148761Z env: 2025-09-07T07:43:57.7148901Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:43:57.7149076Z ##[endgroup] 2025-09-07T07:43:57.7261213Z ##[group]Run set -eux 2025-09-07T07:43:57.7261410Z set -eux 2025-09-07T07:43:57.7261689Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2025-09-07T07:43:57.7270005Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:43:57.7270243Z env: 2025-09-07T07:43:57.7270392Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:43:57.7270726Z GITHUB_TOKEN: *** 2025-09-07T07:43:57.7270884Z ##[endgroup] 2025-09-07T07:43:57.7297614Z + python3 .github/scripts/get_workflow_job_id.py 17525294857 i-06b59a500443ed91d 2025-09-07T07:43:58.2913316Z Setting output job-id=49775530521 2025-09-07T07:43:58.2913939Z Setting output job-name=inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:43:58.3027319Z ##[group]Run python3 -m pip install psutil==5.9.8 dataclasses_json==0.6.7 nvidia-ml-py==11.525.84 2025-09-07T07:43:58.3027795Z python3 -m pip install psutil==5.9.8 dataclasses_json==0.6.7 nvidia-ml-py==11.525.84 2025-09-07T07:43:58.3028390Z python3 -m tools.stats.monitor --log-interval "$MONITOR_LOG_INTERVAL" --data-collect-interval "$MONITOR_DATA_COLLECT_INTERVAL" > usage_log.txt 2>&1 & 2025-09-07T07:43:58.3028891Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2025-09-07T07:43:58.3036068Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:43:58.3036298Z env: 2025-09-07T07:43:58.3036452Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:43:58.3036624Z JOB_ID: 49775530521 2025-09-07T07:43:58.3036957Z JOB_NAME: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:43:58.3037323Z WORKFLOW_NAME: inductor-perf-nightly-x86-zen 2025-09-07T07:43:58.3037558Z WORKFLOW_RUN_ID: 17525294857 2025-09-07T07:43:58.3037737Z MONITOR_LOG_INTERVAL: 15 2025-09-07T07:43:58.3037908Z MONITOR_DATA_COLLECT_INTERVAL: 4 2025-09-07T07:43:58.3038101Z ##[endgroup] 2025-09-07T07:43:58.8945487Z Defaulting to user installation because normal site-packages is not writeable 2025-09-07T07:43:59.1503710Z Collecting psutil==5.9.8 2025-09-07T07:43:59.1631460Z Downloading psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (288 kB) 2025-09-07T07:43:59.3616246Z Collecting dataclasses_json==0.6.7 2025-09-07T07:43:59.3647097Z Downloading dataclasses_json-0.6.7-py3-none-any.whl (28 kB) 2025-09-07T07:43:59.4079070Z Collecting nvidia-ml-py==11.525.84 2025-09-07T07:43:59.4115512Z Downloading nvidia_ml_py-11.525.84-py3-none-any.whl (34 kB) 2025-09-07T07:43:59.5273554Z Collecting marshmallow<4.0.0,>=3.18.0 2025-09-07T07:43:59.5303620Z Downloading marshmallow-3.26.1-py3-none-any.whl (50 kB) 2025-09-07T07:43:59.6307034Z Collecting typing-inspect<1,>=0.4.0 2025-09-07T07:43:59.6339548Z Downloading typing_inspect-0.9.0-py3-none-any.whl (8.8 kB) 2025-09-07T07:43:59.7695520Z Collecting packaging>=17.0 2025-09-07T07:43:59.7727470Z Downloading packaging-25.0-py3-none-any.whl (66 kB) 2025-09-07T07:43:59.9096227Z Collecting mypy-extensions>=0.3.0 2025-09-07T07:43:59.9124527Z Downloading mypy_extensions-1.1.0-py3-none-any.whl (5.0 kB) 2025-09-07T07:44:00.0184128Z Collecting typing-extensions>=3.7.4 2025-09-07T07:44:00.0214695Z Downloading typing_extensions-4.15.0-py3-none-any.whl (44 kB) 2025-09-07T07:44:00.3038495Z Installing collected packages: typing-extensions, packaging, mypy-extensions, typing-inspect, marshmallow, psutil, nvidia-ml-py, dataclasses-json 2025-09-07T07:44:00.8683067Z Successfully installed dataclasses-json-0.6.7 marshmallow-3.26.1 mypy-extensions-1.1.0 nvidia-ml-py-11.525.84 packaging-25.0 psutil-5.9.8 typing-extensions-4.15.0 typing-inspect-0.9.0 2025-09-07T07:44:01.0902660Z Prepare all required actions 2025-09-07T07:44:01.0902959Z Getting action download info 2025-09-07T07:44:01.2426095Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2025-09-07T07:44:01.9935824Z Download action repository 'actions/download-artifact@v4' (SHA:d3f86a106a0bac45b974a628896c90dbdf5c8093) 2025-09-07T07:44:03.9971137Z ##[group]Run ./.github/actions/download-build-artifacts 2025-09-07T07:44:03.9971464Z with: 2025-09-07T07:44:03.9971760Z name: linux-jammy-py3.9-gcc11-build 2025-09-07T07:44:03.9972052Z s3-bucket: gha-artifacts 2025-09-07T07:44:03.9972272Z env: 2025-09-07T07:44:03.9972542Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:03.9972795Z ##[endgroup] 2025-09-07T07:44:04.0001962Z ##[group]Run seemethere/download-artifact-s3@v4 2025-09-07T07:44:04.0002177Z with: 2025-09-07T07:44:04.0002343Z name: linux-jammy-py3.9-gcc11-build 2025-09-07T07:44:04.0002550Z s3-bucket: gha-artifacts 2025-09-07T07:44:04.0002753Z region: us-east-1 2025-09-07T07:44:04.0002898Z env: 2025-09-07T07:44:04.0003044Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:04.0003218Z ##[endgroup] 2025-09-07T07:44:04.7295562Z (node:57282) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2025-09-07T07:44:04.7295910Z 2025-09-07T07:44:04.7296038Z Please migrate your code to use AWS SDK for JavaScript (v3). 2025-09-07T07:44:04.7296418Z For more information, check the migration guide at https://a.co/7PzMCcy 2025-09-07T07:44:04.7296781Z (Use `node --trace-warnings ...` to show where the warning was created) 2025-09-07T07:44:05.6970039Z Found 1 objects with prefix pytorch/pytorch/17525294857/linux-jammy-py3.9-gcc11-build/ 2025-09-07T07:44:05.6970534Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2025-09-07T07:44:10.2885775Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2025-09-07T07:44:10.2890321Z Artifact download has finished successfully 2025-09-07T07:44:10.3168911Z ##[group]Run unzip -o artifacts.zip 2025-09-07T07:44:10.3169154Z unzip -o artifacts.zip 2025-09-07T07:44:10.3176450Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:10.3176684Z env: 2025-09-07T07:44:10.3176837Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:10.3177012Z ##[endgroup] 2025-09-07T07:44:10.3816366Z Archive: artifacts.zip 2025-09-07T07:44:10.3817556Z creating: dist/ 2025-09-07T07:44:11.3631493Z inflating: dist/torch-2.9.0a0+git93fb23d-cp39-cp39-linux_x86_64.whl 2025-09-07T07:44:11.3738947Z inflating: dist/.ninja_log 2025-09-07T07:44:11.3739780Z creating: build/custom_test_artifacts/ 2025-09-07T07:44:11.3740121Z creating: build/custom_test_artifacts/custom-op-build/ 2025-09-07T07:44:11.3740441Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2025-09-07T07:44:11.3740805Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2025-09-07T07:44:11.3744552Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2025-09-07T07:44:11.3744959Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/ 2025-09-07T07:44:11.3745371Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeSystem.cmake 2025-09-07T07:44:11.3745853Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdC/ 2025-09-07T07:44:11.3746700Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdC/tmp/ 2025-09-07T07:44:11.3748530Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdC/CMakeCCompilerId.c 2025-09-07T07:44:11.3749917Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdC/a.out 2025-09-07T07:44:11.3750443Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeCCompiler.cmake 2025-09-07T07:44:11.3751123Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdCXX/ 2025-09-07T07:44:11.3751551Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdCXX/tmp/ 2025-09-07T07:44:11.3753503Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-09-07T07:44:11.3754803Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdCXX/a.out 2025-09-07T07:44:11.3755601Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeCXXCompiler.cmake 2025-09-07T07:44:11.3757064Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_C.bin 2025-09-07T07:44:11.3758595Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_CXX.bin 2025-09-07T07:44:11.3759048Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2025-09-07T07:44:11.3759448Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2025-09-07T07:44:11.3759839Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2025-09-07T07:44:11.3760428Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2025-09-07T07:44:11.3760966Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2025-09-07T07:44:11.3761520Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2025-09-07T07:44:11.3762042Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2025-09-07T07:44:11.3762593Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2025-09-07T07:44:11.3763427Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2025-09-07T07:44:11.3764053Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2025-09-07T07:44:11.3764529Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2025-09-07T07:44:11.3765232Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2025-09-07T07:44:11.3782618Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2025-09-07T07:44:11.3949893Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2025-09-07T07:44:11.3950346Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2025-09-07T07:44:11.3950984Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2025-09-07T07:44:11.3951739Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2025-09-07T07:44:11.3952295Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2025-09-07T07:44:11.3952767Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2025-09-07T07:44:11.3953257Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2025-09-07T07:44:11.3954070Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2025-09-07T07:44:11.3954991Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2025-09-07T07:44:11.3955463Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2025-09-07T07:44:11.3956019Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2025-09-07T07:44:11.3973391Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2025-09-07T07:44:11.4040823Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2025-09-07T07:44:11.4041363Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-09-07T07:44:11.4041819Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2025-09-07T07:44:11.4042255Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2025-09-07T07:44:11.4043083Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2025-09-07T07:44:11.4044279Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2025-09-07T07:44:11.4044737Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/InstallScripts.json 2025-09-07T07:44:11.4046056Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2025-09-07T07:44:11.4046846Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2025-09-07T07:44:11.4047444Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2025-09-07T07:44:11.4191400Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2025-09-07T07:44:11.4238259Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2025-09-07T07:44:11.4238577Z creating: build/custom_test_artifacts/jit-hook-build/ 2025-09-07T07:44:11.4238869Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2025-09-07T07:44:11.4239212Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2025-09-07T07:44:11.4242634Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2025-09-07T07:44:11.4243033Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/ 2025-09-07T07:44:11.4244138Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeSystem.cmake 2025-09-07T07:44:11.4244687Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdC/ 2025-09-07T07:44:11.4245109Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdC/tmp/ 2025-09-07T07:44:11.4246388Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdC/CMakeCCompilerId.c 2025-09-07T07:44:11.4247629Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdC/a.out 2025-09-07T07:44:11.4248308Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeCCompiler.cmake 2025-09-07T07:44:11.4248741Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdCXX/ 2025-09-07T07:44:11.4249151Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdCXX/tmp/ 2025-09-07T07:44:11.4251139Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-09-07T07:44:11.4252502Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdCXX/a.out 2025-09-07T07:44:11.4253357Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeCXXCompiler.cmake 2025-09-07T07:44:11.4254666Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_C.bin 2025-09-07T07:44:11.4256202Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_CXX.bin 2025-09-07T07:44:11.4256863Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2025-09-07T07:44:11.4257248Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2025-09-07T07:44:11.4257640Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2025-09-07T07:44:11.4258080Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2025-09-07T07:44:11.4258787Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2025-09-07T07:44:11.4259264Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2025-09-07T07:44:11.4259711Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2025-09-07T07:44:11.4260170Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2025-09-07T07:44:11.4260850Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2025-09-07T07:44:11.4261401Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2025-09-07T07:44:11.4261899Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2025-09-07T07:44:11.4262596Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2025-09-07T07:44:11.4280160Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2025-09-07T07:44:11.4333007Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2025-09-07T07:44:11.4333676Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-09-07T07:44:11.4334398Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2025-09-07T07:44:11.4334857Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2025-09-07T07:44:11.4335637Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2025-09-07T07:44:11.4336930Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2025-09-07T07:44:11.4337360Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/InstallScripts.json 2025-09-07T07:44:11.4338685Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2025-09-07T07:44:11.4339411Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2025-09-07T07:44:11.4339984Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2025-09-07T07:44:11.4372055Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2025-09-07T07:44:11.4372371Z creating: build/custom_test_artifacts/custom-backend-build/ 2025-09-07T07:44:11.4372934Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2025-09-07T07:44:11.4373345Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2025-09-07T07:44:11.4376384Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2025-09-07T07:44:11.4376810Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/ 2025-09-07T07:44:11.4377224Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeSystem.cmake 2025-09-07T07:44:11.4377676Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdC/ 2025-09-07T07:44:11.4378112Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdC/tmp/ 2025-09-07T07:44:11.4380092Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdC/CMakeCCompilerId.c 2025-09-07T07:44:11.4381362Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdC/a.out 2025-09-07T07:44:11.4382201Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeCCompiler.cmake 2025-09-07T07:44:11.4382649Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdCXX/ 2025-09-07T07:44:11.4383072Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdCXX/tmp/ 2025-09-07T07:44:11.4384906Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-09-07T07:44:11.4386955Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdCXX/a.out 2025-09-07T07:44:11.4387657Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeCXXCompiler.cmake 2025-09-07T07:44:11.4388994Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_C.bin 2025-09-07T07:44:11.4390631Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_CXX.bin 2025-09-07T07:44:11.4391109Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2025-09-07T07:44:11.4391523Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2025-09-07T07:44:11.4391947Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2025-09-07T07:44:11.4392433Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2025-09-07T07:44:11.4392973Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2025-09-07T07:44:11.4393490Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2025-09-07T07:44:11.4393972Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2025-09-07T07:44:11.4394886Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2025-09-07T07:44:11.4395700Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2025-09-07T07:44:11.4396335Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2025-09-07T07:44:11.4396853Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2025-09-07T07:44:11.4397440Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2025-09-07T07:44:11.4401118Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2025-09-07T07:44:11.4501164Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2025-09-07T07:44:11.4501664Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2025-09-07T07:44:11.4502183Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2025-09-07T07:44:11.4502737Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2025-09-07T07:44:11.4503277Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2025-09-07T07:44:11.4503784Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2025-09-07T07:44:11.4504307Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2025-09-07T07:44:11.4505277Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2025-09-07T07:44:11.4505870Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2025-09-07T07:44:11.4506557Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2025-09-07T07:44:11.4507178Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2025-09-07T07:44:11.4524798Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2025-09-07T07:44:11.4570238Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2025-09-07T07:44:11.4571136Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-09-07T07:44:11.4571636Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2025-09-07T07:44:11.4572077Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2025-09-07T07:44:11.4572878Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2025-09-07T07:44:11.4574207Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2025-09-07T07:44:11.4574922Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/InstallScripts.json 2025-09-07T07:44:11.4575962Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2025-09-07T07:44:11.4576822Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2025-09-07T07:44:11.4577469Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2025-09-07T07:44:11.4661773Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2025-09-07T07:44:11.4694502Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2025-09-07T07:44:11.4694789Z creating: build/lib/ 2025-09-07T07:44:11.4764329Z inflating: build/lib/libprotobuf-lite.a 2025-09-07T07:44:11.5134743Z inflating: build/lib/libprotobuf.a 2025-09-07T07:44:11.5548975Z inflating: build/lib/libprotoc.a 2025-09-07T07:44:11.5557305Z inflating: build/lib/libpthreadpool.a 2025-09-07T07:44:11.5565033Z inflating: build/lib/libcpuinfo.a 2025-09-07T07:44:11.5571689Z inflating: build/lib/libcpuinfo_internals.a 2025-09-07T07:44:11.5572520Z inflating: build/lib/libclog.a 2025-09-07T07:44:11.5588633Z inflating: build/lib/libpytorch_qnnpack.a 2025-09-07T07:44:11.5590696Z inflating: build/lib/libnnpack_reference_layers.a 2025-09-07T07:44:11.5746411Z inflating: build/lib/libmicrokernels-prod.a 2025-09-07T07:44:11.5761472Z inflating: build/lib/libnnpack.a 2025-09-07T07:44:11.6491552Z inflating: build/lib/libmicrokernels-all.a 2025-09-07T07:44:11.6550557Z inflating: build/lib/libgtest.a 2025-09-07T07:44:11.6564757Z inflating: build/lib/libgmock.a 2025-09-07T07:44:11.6565428Z inflating: build/lib/libgtest_main.a 2025-09-07T07:44:11.6566134Z inflating: build/lib/libgmock_main.a 2025-09-07T07:44:11.6641921Z inflating: build/lib/libXNNPACK.a 2025-09-07T07:44:11.6705163Z inflating: build/lib/libbenchmark.a 2025-09-07T07:44:11.6705965Z inflating: build/lib/libbenchmark_main.a 2025-09-07T07:44:11.6706771Z inflating: build/lib/libjitprofiling.a 2025-09-07T07:44:11.6713965Z inflating: build/lib/libittnotify.a 2025-09-07T07:44:11.6769025Z inflating: build/lib/libasmjit.a 2025-09-07T07:44:11.7755169Z inflating: build/lib/libfbgemm.a 2025-09-07T07:44:11.7780869Z inflating: build/lib/libtensorpipe_uv.a 2025-09-07T07:44:11.8241565Z inflating: build/lib/libtensorpipe.a 2025-09-07T07:44:11.8342466Z inflating: build/lib/libgloo.a 2025-09-07T07:44:11.8381961Z inflating: build/lib/libonnx_proto.a 2025-09-07T07:44:11.8978925Z inflating: build/lib/libonnx.a 2025-09-07T07:44:12.7459253Z inflating: build/lib/libdnnl.a 2025-09-07T07:44:12.7475010Z inflating: build/lib/libfmt.a 2025-09-07T07:44:12.7692823Z inflating: build/lib/libkineto.a 2025-09-07T07:44:12.7786025Z inflating: build/lib/libc10.so 2025-09-07T07:44:12.7787325Z inflating: build/lib/libtorch_global_deps.so 2025-09-07T07:44:15.2724405Z inflating: build/lib/libtorch_cpu.so 2025-09-07T07:44:15.2725759Z inflating: build/lib/libtorch.so 2025-09-07T07:44:15.2784779Z inflating: build/lib/libtorchbind_test.so 2025-09-07T07:44:15.2800482Z inflating: build/lib/libjitbackend_test.so 2025-09-07T07:44:15.2821037Z inflating: build/lib/libbackend_with_compiler.so 2025-09-07T07:44:15.2843121Z inflating: build/lib/libaoti_custom_ops.so 2025-09-07T07:44:15.2846675Z inflating: build/lib/libshm.so 2025-09-07T07:44:15.4559056Z inflating: build/lib/libtorch_python.so 2025-09-07T07:44:15.4589009Z inflating: build/lib/libnnapi_backend.so 2025-09-07T07:44:15.4589354Z creating: build/bin/ 2025-09-07T07:44:15.4590392Z creating: build/bin/CMakeFiles/ 2025-09-07T07:44:15.4590694Z inflating: build/bin/cmake_install.cmake 2025-09-07T07:44:15.4590962Z inflating: build/bin/CTestTestfile.cmake 2025-09-07T07:44:15.4970434Z inflating: build/bin/protoc-3.13.0.0 2025-09-07T07:44:15.5350235Z inflating: build/bin/protoc 2025-09-07T07:44:15.5396359Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2025-09-07T07:44:15.5445527Z inflating: build/bin/c10_AllocatorConfig_test 2025-09-07T07:44:15.5493693Z inflating: build/bin/c10_DeviceGuard_test 2025-09-07T07:44:15.5541652Z inflating: build/bin/c10_Device_test 2025-09-07T07:44:15.5587222Z inflating: build/bin/c10_StreamGuard_test 2025-09-07T07:44:15.5641737Z inflating: build/bin/c10_DispatchKeySet_test 2025-09-07T07:44:15.5691774Z inflating: build/bin/c10_Scalar_test 2025-09-07T07:44:15.5744045Z inflating: build/bin/c10_SymInt_test 2025-09-07T07:44:15.5794825Z inflating: build/bin/c10_InlineDeviceGuard_test 2025-09-07T07:44:15.5846643Z inflating: build/bin/c10_InlineStreamGuard_test 2025-09-07T07:44:15.5898092Z inflating: build/bin/c10_SizesAndStrides_test 2025-09-07T07:44:15.5962136Z inflating: build/bin/c10_cow_test 2025-09-07T07:44:15.6008077Z inflating: build/bin/c10_ArrayRef_test 2025-09-07T07:44:15.6053627Z inflating: build/bin/c10_ConstexprCrc_test 2025-09-07T07:44:15.6102689Z inflating: build/bin/c10_Bitset_test 2025-09-07T07:44:15.6149166Z inflating: build/bin/c10_DeadlockDetection_test 2025-09-07T07:44:15.6201303Z inflating: build/bin/c10_Enumerate_test 2025-09-07T07:44:15.6248200Z inflating: build/bin/c10_Half_test 2025-09-07T07:44:15.6296964Z inflating: build/bin/c10_IntrusiveList_test 2025-09-07T07:44:15.6348561Z inflating: build/bin/c10_LeftRight_test 2025-09-07T07:44:15.6399627Z inflating: build/bin/c10_Metaprogramming_test 2025-09-07T07:44:15.6449097Z inflating: build/bin/c10_NetworkFlow_test 2025-09-07T07:44:15.6495468Z inflating: build/bin/c10_Synchronized_test 2025-09-07T07:44:15.6541637Z inflating: build/bin/c10_Semaphore_test 2025-09-07T07:44:15.6589575Z inflating: build/bin/c10_TypeIndex_test 2025-09-07T07:44:15.6636766Z inflating: build/bin/c10_TypeList_test 2025-09-07T07:44:15.6688142Z inflating: build/bin/c10_ThreadLocal_test 2025-09-07T07:44:15.6733681Z inflating: build/bin/c10_TypeTraits_test 2025-09-07T07:44:15.6781472Z inflating: build/bin/c10_accumulate_test 2025-09-07T07:44:15.6832975Z inflating: build/bin/c10_bfloat16_test 2025-09-07T07:44:15.6879778Z inflating: build/bin/c10_bit_cast_test 2025-09-07T07:44:15.6931965Z inflating: build/bin/c10_complex_math_test 2025-09-07T07:44:15.6982981Z inflating: build/bin/c10_complex_test 2025-09-07T07:44:15.7029004Z inflating: build/bin/c10_error_test 2025-09-07T07:44:15.7077438Z inflating: build/bin/c10_exception_test 2025-09-07T07:44:15.7124067Z inflating: build/bin/c10_flags_test 2025-09-07T07:44:15.7171134Z inflating: build/bin/c10_irange_test 2025-09-07T07:44:15.7217820Z inflating: build/bin/c10_generic_math_test 2025-09-07T07:44:15.7361874Z inflating: build/bin/c10_intrusive_ptr_test 2025-09-07T07:44:15.7411221Z inflating: build/bin/c10_lazy_test 2025-09-07T07:44:15.7463653Z inflating: build/bin/c10_logging_test 2025-09-07T07:44:15.7513113Z inflating: build/bin/c10_registry_test 2025-09-07T07:44:15.7580919Z inflating: build/bin/c10_optional_test 2025-09-07T07:44:15.7638303Z inflating: build/bin/c10_ordered_preserving_dict_test 2025-09-07T07:44:15.7773542Z inflating: build/bin/c10_small_vector_test 2025-09-07T07:44:15.7821517Z inflating: build/bin/c10_ssize_test 2025-09-07T07:44:15.7873789Z inflating: build/bin/c10_string_util_test 2025-09-07T07:44:15.7918893Z inflating: build/bin/c10_string_view_test 2025-09-07T07:44:15.7965454Z inflating: build/bin/c10_tempfile_test 2025-09-07T07:44:15.8005752Z inflating: build/bin/c10_intrusive_ptr_benchmark 2025-09-07T07:44:15.8057640Z inflating: build/bin/c10_typeid_test 2025-09-07T07:44:15.8559366Z inflating: build/bin/vec_test_all_types_DEFAULT 2025-09-07T07:44:15.9075273Z inflating: build/bin/vec_test_all_types_AVX512 2025-09-07T07:44:15.9597245Z inflating: build/bin/vec_test_all_types_AVX2 2025-09-07T07:44:15.9646656Z inflating: build/bin/static_runtime_bench 2025-09-07T07:44:15.9863974Z inflating: build/bin/static_runtime_test 2025-09-07T07:44:15.9931059Z inflating: build/bin/Dict_test 2025-09-07T07:44:15.9979380Z inflating: build/bin/Dimname_test 2025-09-07T07:44:16.0039307Z inflating: build/bin/MaybeOwned_test 2025-09-07T07:44:16.0091419Z inflating: build/bin/NamedTensor_test 2025-09-07T07:44:16.0145345Z inflating: build/bin/apply_utils_test 2025-09-07T07:44:16.0199457Z inflating: build/bin/atest 2025-09-07T07:44:16.0258249Z inflating: build/bin/basic 2025-09-07T07:44:16.0309384Z inflating: build/bin/broadcast_test 2025-09-07T07:44:16.0356638Z inflating: build/bin/cpu_allocator_test 2025-09-07T07:44:16.0410272Z inflating: build/bin/cpu_generator_test 2025-09-07T07:44:16.0459007Z inflating: build/bin/cpu_profiling_allocator_test 2025-09-07T07:44:16.0541447Z inflating: build/bin/cpu_rng_test 2025-09-07T07:44:16.0588873Z inflating: build/bin/dlconvertor_test 2025-09-07T07:44:16.0641621Z inflating: build/bin/extension_backend_test 2025-09-07T07:44:16.0692732Z inflating: build/bin/half_test 2025-09-07T07:44:16.0778559Z inflating: build/bin/ivalue_test 2025-09-07T07:44:16.0825452Z inflating: build/bin/lazy_tensor_test 2025-09-07T07:44:16.0874771Z inflating: build/bin/math_kernel_test 2025-09-07T07:44:16.0924679Z inflating: build/bin/memory_format_test 2025-09-07T07:44:16.0973908Z inflating: build/bin/memory_overlapping_test 2025-09-07T07:44:16.1023017Z inflating: build/bin/mobile_memory_cleanup 2025-09-07T07:44:16.1074623Z inflating: build/bin/native_test 2025-09-07T07:44:16.1121783Z inflating: build/bin/operator_name_test 2025-09-07T07:44:16.1168943Z inflating: build/bin/operators_test 2025-09-07T07:44:16.1217275Z inflating: build/bin/packedtensoraccessor_test 2025-09-07T07:44:16.1277972Z inflating: build/bin/pow_test 2025-09-07T07:44:16.1331134Z inflating: build/bin/quantized_test 2025-09-07T07:44:16.1377343Z inflating: build/bin/reduce_ops_test 2025-09-07T07:44:16.1424801Z inflating: build/bin/reportMemoryUsage_test 2025-09-07T07:44:16.1476963Z inflating: build/bin/scalar_tensor_test 2025-09-07T07:44:16.1530856Z inflating: build/bin/scalar_test 2025-09-07T07:44:16.1578476Z inflating: build/bin/StorageUtils_test 2025-09-07T07:44:16.1626506Z inflating: build/bin/stride_properties_test 2025-09-07T07:44:16.1698033Z inflating: build/bin/tensor_iterator_test 2025-09-07T07:44:16.1748218Z inflating: build/bin/test_parallel 2025-09-07T07:44:16.1794891Z inflating: build/bin/thread_init_test 2025-09-07T07:44:16.1845905Z inflating: build/bin/type_ptr_test 2025-09-07T07:44:16.1900137Z inflating: build/bin/type_test 2025-09-07T07:44:16.1948660Z inflating: build/bin/undefined_tensor_test 2025-09-07T07:44:16.1994699Z inflating: build/bin/verify_api_visibility 2025-09-07T07:44:16.2058382Z inflating: build/bin/legacy_vmap_test 2025-09-07T07:44:16.2105528Z inflating: build/bin/weakref_test 2025-09-07T07:44:16.2153299Z inflating: build/bin/wrapdim_test 2025-09-07T07:44:16.2200945Z inflating: build/bin/xla_tensor_test 2025-09-07T07:44:16.2255988Z inflating: build/bin/IListRef_test 2025-09-07T07:44:16.2350390Z inflating: build/bin/List_test 2025-09-07T07:44:16.2410584Z inflating: build/bin/KernelFunction_test 2025-09-07T07:44:16.2517470Z inflating: build/bin/kernel_function_legacy_test 2025-09-07T07:44:16.2601755Z inflating: build/bin/kernel_function_test 2025-09-07T07:44:16.2712921Z inflating: build/bin/kernel_lambda_legacy_test 2025-09-07T07:44:16.2803269Z inflating: build/bin/kernel_lambda_test 2025-09-07T07:44:16.2858839Z inflating: build/bin/kernel_stackbased_test 2025-09-07T07:44:16.2943489Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2025-09-07T07:44:16.2990573Z inflating: build/bin/CppSignature_test 2025-09-07T07:44:16.3041334Z inflating: build/bin/backend_fallback_test 2025-09-07T07:44:16.3086885Z inflating: build/bin/op_allowlist_test 2025-09-07T07:44:16.3355031Z inflating: build/bin/op_registration_test 2025-09-07T07:44:16.3415993Z inflating: build/bin/inline_container_test 2025-09-07T07:44:16.4350887Z inflating: build/bin/test_jit 2025-09-07T07:44:16.4400099Z inflating: build/bin/FileStoreTest 2025-09-07T07:44:16.4448804Z inflating: build/bin/BackoffTest 2025-09-07T07:44:16.4501307Z inflating: build/bin/TCPStoreTest 2025-09-07T07:44:16.4823101Z inflating: build/bin/test_nativert 2025-09-07T07:44:16.4872749Z inflating: build/bin/HashStoreTest 2025-09-07T07:44:16.4933106Z inflating: build/bin/ProcessGroupGlooTest 2025-09-07T07:44:16.4935625Z inflating: build/bin/example_allreduce 2025-09-07T07:44:16.4986153Z inflating: build/bin/test_dist_autograd 2025-09-07T07:44:16.5047837Z inflating: build/bin/test_cpp_rpc 2025-09-07T07:44:16.6012124Z inflating: build/bin/test_api 2025-09-07T07:44:16.6014367Z inflating: build/bin/parallel_benchmark 2025-09-07T07:44:16.6309401Z inflating: build/bin/test_lazy 2025-09-07T07:44:16.6313096Z inflating: build/bin/torch_shm_manager 2025-09-07T07:44:16.6313437Z creating: .additional_ci_files/ 2025-09-07T07:44:16.6388428Z inflating: .additional_ci_files/test-times.json 2025-09-07T07:44:16.6672430Z inflating: .additional_ci_files/test-class-times.json 2025-09-07T07:44:16.6753525Z ##[group]Run rm artifacts.zip 2025-09-07T07:44:16.6753746Z rm artifacts.zip 2025-09-07T07:44:16.6761194Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:16.6761449Z env: 2025-09-07T07:44:16.6761599Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:16.6761765Z ##[endgroup] 2025-09-07T07:44:16.8451346Z ##[group]Run df -H 2025-09-07T07:44:16.8451541Z df -H 2025-09-07T07:44:16.8458844Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:16.8459076Z env: 2025-09-07T07:44:16.8459225Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:16.8459398Z ##[endgroup] 2025-09-07T07:44:16.8508563Z Filesystem Size Used Avail Use% Mounted on 2025-09-07T07:44:16.8508857Z devtmpfs 4.2M 0 4.2M 0% /dev 2025-09-07T07:44:16.8509084Z tmpfs 199G 0 199G 0% /dev/shm 2025-09-07T07:44:16.8509284Z tmpfs 80G 1.3M 80G 1% /run 2025-09-07T07:44:16.8509482Z /dev/nvme0n1p1 215G 72G 144G 34% / 2025-09-07T07:44:16.8509860Z tmpfs 199G 13k 199G 1% /tmp 2025-09-07T07:44:16.8510100Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2025-09-07T07:44:16.8538147Z Prepare all required actions 2025-09-07T07:44:16.8538951Z Getting action download info 2025-09-07T07:44:16.9926716Z ##[group]Run ./.github/actions/download-td-artifacts 2025-09-07T07:44:16.9926950Z with: 2025-09-07T07:44:16.9927083Z env: 2025-09-07T07:44:16.9927402Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:16.9927565Z ##[endgroup] 2025-09-07T07:44:17.0013098Z ##[group]Run seemethere/download-artifact-s3@v4 2025-09-07T07:44:17.0013314Z with: 2025-09-07T07:44:17.0013454Z name: td_results 2025-09-07T07:44:17.0013613Z s3-bucket: gha-artifacts 2025-09-07T07:44:17.0013786Z region: us-east-1 2025-09-07T07:44:17.0013933Z env: 2025-09-07T07:44:17.0014067Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:17.0014232Z ##[endgroup] 2025-09-07T07:44:17.3634562Z (node:57305) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2025-09-07T07:44:17.3634876Z 2025-09-07T07:44:17.3635053Z Please migrate your code to use AWS SDK for JavaScript (v3). 2025-09-07T07:44:17.3635399Z For more information, check the migration guide at https://a.co/7PzMCcy 2025-09-07T07:44:17.3635732Z (Use `node --trace-warnings ...` to show where the warning was created) 2025-09-07T07:44:17.4425399Z Found 0 objects with prefix pytorch/pytorch/17525294857/td_results/ 2025-09-07T07:44:17.4430301Z Artifact download has finished successfully 2025-09-07T07:44:17.4688563Z ##[group]Run mkdir -p .additional_ci_files 2025-09-07T07:44:17.4688823Z mkdir -p .additional_ci_files 2025-09-07T07:44:17.4689095Z mv td_results.json .additional_ci_files/td_results.json || true 2025-09-07T07:44:17.4697491Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:17.4697733Z env: 2025-09-07T07:44:17.4697884Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:17.4698057Z ##[endgroup] 2025-09-07T07:44:17.4756665Z mv: cannot stat 'td_results.json': No such file or directory 2025-09-07T07:44:17.4902427Z ##[group]Run .github/scripts/parse_ref.py 2025-09-07T07:44:17.4902678Z .github/scripts/parse_ref.py 2025-09-07T07:44:17.4910535Z shell: /usr/bin/bash -e {0} 2025-09-07T07:44:17.4910720Z env: 2025-09-07T07:44:17.4910871Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:17.4911038Z ##[endgroup] 2025-09-07T07:44:17.5610945Z Setting output branch=main 2025-09-07T07:44:17.5698196Z Prepare all required actions 2025-09-07T07:44:17.5698481Z Getting action download info 2025-09-07T07:44:17.6901498Z ##[group]Run ./.github/actions/filter-test-configs 2025-09-07T07:44:17.6901730Z with: 2025-09-07T07:44:17.6902144Z github-token: *** 2025-09-07T07:44:17.6904576Z test-matrix: {"include": [{"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 1, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 2, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 3, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 1, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 2, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 3, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 4, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 5, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 1, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 2, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 3, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 4, "num_shards": 4, "runner": "linux.24xlarge.amd"}]} 2025-09-07T07:44:17.6907369Z job-name: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:44:17.6907710Z env: 2025-09-07T07:44:17.6907854Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:17.6908020Z ##[endgroup] 2025-09-07T07:44:17.6965591Z ##[group]Run nick-fields/retry@v3.0.0 2025-09-07T07:44:17.6965974Z with: 2025-09-07T07:44:17.6966118Z shell: bash 2025-09-07T07:44:17.6966274Z timeout_minutes: 10 2025-09-07T07:44:17.6966438Z max_attempts: 5 2025-09-07T07:44:17.6966593Z retry_wait_seconds: 30 2025-09-07T07:44:17.6967085Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.2 2025-09-07T07:44:17.6967590Z polling_interval_seconds: 1 2025-09-07T07:44:17.6967778Z warning_on_retry: true 2025-09-07T07:44:17.6967949Z continue_on_error: false 2025-09-07T07:44:17.6968122Z env: 2025-09-07T07:44:17.6968257Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:17.6968559Z GITHUB_TOKEN: *** 2025-09-07T07:44:17.6968722Z ##[endgroup] 2025-09-07T07:44:17.8167367Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.2 2025-09-07T07:44:17.9905855Z Defaulting to user installation because normal site-packages is not writeable 2025-09-07T07:44:18.3307684Z Collecting requests==2.27.1 2025-09-07T07:44:18.3603452Z Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB) 2025-09-07T07:44:18.5637200Z Collecting pyyaml==6.0.2 2025-09-07T07:44:18.5718105Z Downloading PyYAML-6.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (737 kB) 2025-09-07T07:44:18.9363366Z Collecting charset-normalizer~=2.0.0 2025-09-07T07:44:18.9444295Z Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB) 2025-09-07T07:44:18.9924486Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2025-09-07T07:44:19.0540600Z Collecting certifi>=2017.4.17 2025-09-07T07:44:19.0620415Z Downloading certifi-2025.8.3-py3-none-any.whl (161 kB) 2025-09-07T07:44:19.1128798Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2025-09-07T07:44:19.1679384Z Installing collected packages: charset-normalizer, certifi, requests, pyyaml 2025-09-07T07:44:19.5672722Z Successfully installed certifi-2025.8.3 charset-normalizer-2.0.12 pyyaml-6.0.2 requests-2.27.1 2025-09-07T07:44:19.7570082Z Command completed after 1 attempt(s). 2025-09-07T07:44:19.7647465Z ##[group]Run set -x 2025-09-07T07:44:19.7647654Z set -x 2025-09-07T07:44:19.7647806Z  2025-09-07T07:44:19.7648050Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-09-07T07:44:19.7648347Z # in runner workspace 2025-09-07T07:44:19.7648596Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2025-09-07T07:44:19.7656432Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:19.7656670Z env: 2025-09-07T07:44:19.7656809Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:19.7656983Z ##[endgroup] 2025-09-07T07:44:19.7684314Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2025-09-07T07:44:19.7833184Z Setting output branch=main 2025-09-07T07:44:19.7887845Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2025-09-07T07:44:19.7888134Z echo "Workflow: ${GITHUB_WORKFLOW}" 2025-09-07T07:44:19.7888355Z echo "Job name: ${JOB_NAME}" 2025-09-07T07:44:19.7888539Z  2025-09-07T07:44:19.7888786Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-09-07T07:44:19.7889086Z # in runner workspace 2025-09-07T07:44:19.7889369Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2025-09-07T07:44:19.7889673Z  --workflow "${GITHUB_WORKFLOW}" \ 2025-09-07T07:44:19.7889882Z  --job-name "${JOB_NAME}" \ 2025-09-07T07:44:19.7892331Z  --test-matrix "{"include": [{"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 1, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 2, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 3, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 1, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 2, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 3, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 4, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 5, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 1, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 2, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 3, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 4, "num_shards": 4, "runner": "linux.24xlarge.amd"}]}" \ 2025-09-07T07:44:19.7895089Z  --selected-test-configs "" \ 2025-09-07T07:44:19.7895311Z  --pr-number "${PR_NUMBER}" \ 2025-09-07T07:44:19.7895520Z  --tag "${TAG}" \ 2025-09-07T07:44:19.7895705Z  --event-name "${EVENT_NAME}" \ 2025-09-07T07:44:19.7895911Z  --schedule "${SCHEDULE}" \ 2025-09-07T07:44:19.7896112Z  --branch "${HEAD_BRANCH}" 2025-09-07T07:44:19.7903005Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:19.7903237Z env: 2025-09-07T07:44:19.7903384Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:19.7903915Z GITHUB_TOKEN: *** 2025-09-07T07:44:19.7904244Z JOB_NAME: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:44:19.7904585Z PR_NUMBER: 2025-09-07T07:44:19.7904728Z TAG: 2025-09-07T07:44:19.7904879Z EVENT_NAME: schedule 2025-09-07T07:44:19.7905047Z SCHEDULE: 0 7 * * * 2025-09-07T07:44:19.7905209Z HEAD_BRANCH: main 2025-09-07T07:44:19.7905526Z ##[endgroup] 2025-09-07T07:44:19.7932371Z Workflow: inductor-perf-nightly-x86-zen 2025-09-07T07:44:19.7932750Z Job name: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:44:19.9590061Z Setting output keep-going=True 2025-09-07T07:44:19.9590348Z Setting output ci-verbose-test-logs=False 2025-09-07T07:44:19.9590580Z Setting output ci-test-showlocals=False 2025-09-07T07:44:19.9590790Z Setting output ci-no-test-timeout=False 2025-09-07T07:44:19.9590985Z Setting output ci-no-td=False 2025-09-07T07:44:19.9591181Z Setting output ci-td-distributed=False 2025-09-07T07:44:19.9591387Z Setting output is-unstable=False 2025-09-07T07:44:19.9591582Z Setting output reenabled-issues= 2025-09-07T07:44:19.9594085Z Setting output test-matrix={"include": [{"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 1, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 2, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 3, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 1, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 2, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 3, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 4, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 5, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 1, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 2, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 3, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 4, "num_shards": 4, "runner": "linux.24xlarge.amd"}]} 2025-09-07T07:44:19.9597137Z Setting output is-test-matrix-empty=False 2025-09-07T07:44:19.9721265Z ##[group]Run echo "Filtered matrix:" 2025-09-07T07:44:19.9721511Z echo "Filtered matrix:" 2025-09-07T07:44:19.9723924Z echo "{"include": [{"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 1, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 2, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_huggingface_perf_cpu_x86_zen", "shard": 3, "num_shards": 3, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 1, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 2, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 3, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 4, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_timm_perf_cpu_x86_zen", "shard": 5, "num_shards": 5, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 1, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 2, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 3, "num_shards": 4, "runner": "linux.24xlarge.amd"}, {"config": "inductor_torchbench_perf_cpu_x86_zen", "shard": 4, "num_shards": 4, "runner": "linux.24xlarge.amd"}]}" 2025-09-07T07:44:19.9726447Z  2025-09-07T07:44:19.9726585Z echo 2025-09-07T07:44:19.9726767Z echo "Is the current job unstable? False" 2025-09-07T07:44:19.9726973Z  2025-09-07T07:44:19.9727112Z echo 2025-09-07T07:44:19.9727286Z echo "Is keep-going label set? True" 2025-09-07T07:44:19.9727671Z  2025-09-07T07:44:19.9727801Z echo 2025-09-07T07:44:19.9727956Z echo "Reenabled issues? " 2025-09-07T07:44:19.9735234Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:19.9735469Z env: 2025-09-07T07:44:19.9735608Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:19.9735776Z ##[endgroup] 2025-09-07T07:44:19.9759934Z Filtered matrix: 2025-09-07T07:44:19.9762819Z {include: [{config: inductor_huggingface_perf_cpu_x86_zen, shard: 1, num_shards: 3, runner: linux.24xlarge.amd}, {config: inductor_huggingface_perf_cpu_x86_zen, shard: 2, num_shards: 3, runner: linux.24xlarge.amd}, {config: inductor_huggingface_perf_cpu_x86_zen, shard: 3, num_shards: 3, runner: linux.24xlarge.amd}, {config: inductor_timm_perf_cpu_x86_zen, shard: 1, num_shards: 5, runner: linux.24xlarge.amd}, {config: inductor_timm_perf_cpu_x86_zen, shard: 2, num_shards: 5, runner: linux.24xlarge.amd}, {config: inductor_timm_perf_cpu_x86_zen, shard: 3, num_shards: 5, runner: linux.24xlarge.amd}, {config: inductor_timm_perf_cpu_x86_zen, shard: 4, num_shards: 5, runner: linux.24xlarge.amd}, {config: inductor_timm_perf_cpu_x86_zen, shard: 5, num_shards: 5, runner: linux.24xlarge.amd}, {config: inductor_torchbench_perf_cpu_x86_zen, shard: 1, num_shards: 4, runner: linux.24xlarge.amd}, {config: inductor_torchbench_perf_cpu_x86_zen, shard: 2, num_shards: 4, runner: linux.24xlarge.amd}, {config: inductor_torchbench_perf_cpu_x86_zen, shard: 3, num_shards: 4, runner: linux.24xlarge.amd}, {config: inductor_torchbench_perf_cpu_x86_zen, shard: 4, num_shards: 4, runner: linux.24xlarge.amd}]} 2025-09-07T07:44:19.9765275Z 2025-09-07T07:44:19.9765362Z Is the current job unstable? False 2025-09-07T07:44:19.9765496Z 2025-09-07T07:44:19.9765567Z Is keep-going label set? True 2025-09-07T07:44:19.9765687Z 2025-09-07T07:44:19.9765748Z Reenabled issues? 2025-09-07T07:44:19.9900549Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2025-09-07T07:44:19.9900901Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2025-09-07T07:44:19.9907525Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:19.9907780Z env: 2025-09-07T07:44:19.9907930Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:19.9908103Z JOB_TIMEOUT: 720 2025-09-07T07:44:19.9908250Z ##[endgroup] 2025-09-07T07:44:20.0049239Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-09-07T07:44:20.0049583Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-09-07T07:44:20.0049859Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-09-07T07:44:20.0056887Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T07:44:20.0057124Z env: 2025-09-07T07:44:20.0057268Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:20.0057433Z ##[endgroup] 2025-09-07T07:44:20.0229878Z ##[group]Run set -x 2025-09-07T07:44:20.0230120Z set -x 2025-09-07T07:44:20.0230260Z  2025-09-07T07:44:20.0230429Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2025-09-07T07:44:20.0230694Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2025-09-07T07:44:20.0230953Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2025-09-07T07:44:20.0231173Z  TEST_COMMAND=.ci/onnx/test.sh 2025-09-07T07:44:20.0231360Z else 2025-09-07T07:44:20.0231528Z  TEST_COMMAND=.ci/pytorch/test.sh 2025-09-07T07:44:20.0231718Z fi 2025-09-07T07:44:20.0231847Z  2025-09-07T07:44:20.0232017Z # Leaving 1GB for the runner and other things 2025-09-07T07:44:20.0232369Z TOTAL_AVAILABLE_MEMORY_IN_GB=$(awk '/MemTotal/ { printf "%.3f \n", $2/1024/1024 - 1 }' /proc/meminfo) 2025-09-07T07:44:20.0232919Z # https://docs.docker.com/engine/containers/resource_constraints/#--memory-swap-details, the 3GB swap 2025-09-07T07:44:20.0233328Z # comes from https://github.com/pytorch/test-infra/pull/6058 2025-09-07T07:44:20.0233657Z TOTAL_MEMORY_WITH_SWAP=$(("${TOTAL_AVAILABLE_MEMORY_IN_GB%.*}" + 3)) 2025-09-07T07:44:20.0233912Z  2025-09-07T07:44:20.0234085Z if [[ ${BUILD_ENVIRONMENT} == *"s390x"* ]]; then 2025-09-07T07:44:20.0234292Z  SHM_OPTS= 2025-09-07T07:44:20.0234457Z  JENKINS_USER= 2025-09-07T07:44:20.0234681Z  # ensure that docker container cleanly exits in 12 hours 2025-09-07T07:44:20.0234970Z  # if for some reason cleanup action doesn't stop container 2025-09-07T07:44:20.0235209Z  # when job is cancelled 2025-09-07T07:44:20.0235401Z  DOCKER_SHELL_CMD="sleep 12h" 2025-09-07T07:44:20.0235585Z else 2025-09-07T07:44:20.0235748Z  SHM_OPTS="--shm-size=${SHM_SIZE}" 2025-09-07T07:44:20.0235959Z  JENKINS_USER="--user jenkins" 2025-09-07T07:44:20.0236150Z  DOCKER_SHELL_CMD= 2025-09-07T07:44:20.0236318Z fi 2025-09-07T07:44:20.0236455Z  2025-09-07T07:44:20.0236664Z # detached container should get cleaned up by teardown_ec2_linux 2025-09-07T07:44:20.0236979Z # TODO: Stop building test binaries as part of the build phase 2025-09-07T07:44:20.0237339Z # Used for GPU_FLAG, SHM_OPTS, JENKINS_USER and DOCKER_SHELL_CMD since that doesn't play nice 2025-09-07T07:44:20.0237653Z # shellcheck disable=SC2086,SC2090 2025-09-07T07:44:20.0237861Z container_name=$(docker run \ 2025-09-07T07:44:20.0238054Z  ${GPU_FLAG:-} \ 2025-09-07T07:44:20.0238242Z  ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \ 2025-09-07T07:44:20.0238457Z  -e BUILD_ENVIRONMENT \ 2025-09-07T07:44:20.0238647Z  -e PR_NUMBER \ 2025-09-07T07:44:20.0238819Z  -e GITHUB_ACTIONS \ 2025-09-07T07:44:20.0238995Z  -e GITHUB_REPOSITORY \ 2025-09-07T07:44:20.0239175Z  -e GITHUB_WORKFLOW \ 2025-09-07T07:44:20.0239356Z  -e GITHUB_JOB \ 2025-09-07T07:44:20.0239522Z  -e GITHUB_RUN_ID \ 2025-09-07T07:44:20.0239689Z  -e GITHUB_RUN_NUMBER \ 2025-09-07T07:44:20.0240018Z  -e GITHUB_RUN_ATTEMPT \ 2025-09-07T07:44:20.0240201Z  -e JOB_ID \ 2025-09-07T07:44:20.0240365Z  -e JOB_NAME \ 2025-09-07T07:44:20.0240522Z  -e BASE_SHA \ 2025-09-07T07:44:20.0240678Z  -e BRANCH \ 2025-09-07T07:44:20.0240833Z  -e SHA1 \ 2025-09-07T07:44:20.0240991Z  -e AWS_DEFAULT_REGION \ 2025-09-07T07:44:20.0241166Z  -e IN_WHEEL_TEST \ 2025-09-07T07:44:20.0241332Z  -e SHARD_NUMBER \ 2025-09-07T07:44:20.0241503Z  -e TEST_CONFIG \ 2025-09-07T07:44:20.0241679Z  -e NUM_TEST_SHARDS \ 2025-09-07T07:44:20.0241864Z  -e REENABLED_ISSUES \ 2025-09-07T07:44:20.0242060Z  -e CONTINUE_THROUGH_ERROR \ 2025-09-07T07:44:20.0242372Z  -e VERBOSE_TEST_LOGS \ 2025-09-07T07:44:20.0242567Z  -e TEST_SHOWLOCALS \ 2025-09-07T07:44:20.0242738Z  -e NO_TEST_TIMEOUT \ 2025-09-07T07:44:20.0242912Z  -e NO_TD \ 2025-09-07T07:44:20.0243088Z  -e TD_DISTRIBUTED \ 2025-09-07T07:44:20.0243264Z  -e PR_LABELS \ 2025-09-07T07:44:20.0243456Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2025-09-07T07:44:20.0243660Z  -e SCCACHE_BUCKET \ 2025-09-07T07:44:20.0243834Z  -e SCCACHE_REGION \ 2025-09-07T07:44:20.0244008Z  -e XLA_CUDA \ 2025-09-07T07:44:20.0244188Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2025-09-07T07:44:20.0244404Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2025-09-07T07:44:20.0244636Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2025-09-07T07:44:20.0244865Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2025-09-07T07:44:20.0245075Z  -e HUGGING_FACE_HUB_TOKEN \ 2025-09-07T07:44:20.0245278Z  -e VLLM_TEST_HUGGING_FACE_TOKEN \ 2025-09-07T07:44:20.0245493Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2025-09-07T07:44:20.0245691Z  -e DASHBOARD_TAG \ 2025-09-07T07:44:20.0245878Z  -e ARTIFACTS_FILE_SUFFIX \ 2025-09-07T07:44:20.0246101Z  --memory="${TOTAL_AVAILABLE_MEMORY_IN_GB%.*}g" \ 2025-09-07T07:44:20.0246363Z  --memory-swap="${TOTAL_MEMORY_WITH_SWAP}g" \ 2025-09-07T07:44:20.0246627Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2025-09-07T07:44:20.0246875Z  --security-opt seccomp=unconfined \ 2025-09-07T07:44:20.0247090Z  --cap-add=SYS_PTRACE \ 2025-09-07T07:44:20.0247271Z  --ipc=host \ 2025-09-07T07:44:20.0247435Z  ${SHM_OPTS} \ 2025-09-07T07:44:20.0247599Z  --tty \ 2025-09-07T07:44:20.0247752Z  --detach \ 2025-09-07T07:44:20.0247918Z  --name="${container_name}" \ 2025-09-07T07:44:20.0248114Z  ${JENKINS_USER} \ 2025-09-07T07:44:20.0248338Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2025-09-07T07:44:20.0248581Z  -w /var/lib/jenkins/workspace \ 2025-09-07T07:44:20.0248772Z  "${DOCKER_IMAGE}" \ 2025-09-07T07:44:20.0248975Z  ${DOCKER_SHELL_CMD} 2025-09-07T07:44:20.0249141Z ) 2025-09-07T07:44:20.0249331Z # Propagate download.pytorch.org IP to container 2025-09-07T07:44:20.0249726Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2025-09-07T07:44:20.0250154Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2025-09-07T07:44:20.0250403Z  2025-09-07T07:44:20.0250578Z if [[ ${BUILD_ENVIRONMENT} == *"s390x"* ]]; then 2025-09-07T07:44:20.0250924Z  docker exec -t "${container_name}" sh -c "python3 -m pip install -r .ci/docker/requirements-ci.txt" 2025-09-07T07:44:20.0251222Z fi 2025-09-07T07:44:20.0251362Z  2025-09-07T07:44:20.0251658Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2025-09-07T07:44:20.0258342Z shell: /usr/bin/bash -e {0} 2025-09-07T07:44:20.0258598Z env: 2025-09-07T07:44:20.0258734Z GIT_DEFAULT_BRANCH: main 2025-09-07T07:44:20.0258945Z BUILD_ENVIRONMENT: linux-jammy-py3.9-gcc11-build 2025-09-07T07:44:20.0259168Z PR_NUMBER: 2025-09-07T07:44:20.0259331Z GITHUB_REPOSITORY: pytorch/pytorch 2025-09-07T07:44:20.0259557Z GITHUB_WORKFLOW: inductor-perf-nightly-x86-zen 2025-09-07T07:44:20.0259772Z GITHUB_JOB: test 2025-09-07T07:44:20.0259930Z GITHUB_RUN_ID: 17525294857 2025-09-07T07:44:20.0260103Z GITHUB_RUN_NUMBER: 91 2025-09-07T07:44:20.0260261Z GITHUB_RUN_ATTEMPT: 1 2025-09-07T07:44:20.0260420Z JOB_ID: 49775530521 2025-09-07T07:44:20.0260733Z JOB_NAME: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:44:20.0261062Z BRANCH: main 2025-09-07T07:44:20.0261323Z SHA1: 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:44:20.0261564Z BASE_SHA: 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:44:20.0261801Z TEST_CONFIG: inductor_huggingface_perf_cpu_x86_zen 2025-09-07T07:44:20.0262013Z SHARD_NUMBER: 1 2025-09-07T07:44:20.0262157Z NUM_TEST_SHARDS: 3 2025-09-07T07:44:20.0262310Z REENABLED_ISSUES: 2025-09-07T07:44:20.0262470Z CONTINUE_THROUGH_ERROR: True 2025-09-07T07:44:20.0262652Z VERBOSE_TEST_LOGS: False 2025-09-07T07:44:20.0262813Z TEST_SHOWLOCALS: False 2025-09-07T07:44:20.0262978Z NO_TEST_TIMEOUT: False 2025-09-07T07:44:20.0263134Z NO_TD: False 2025-09-07T07:44:20.0263276Z TD_DISTRIBUTED: False 2025-09-07T07:44:20.0263466Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2025-09-07T07:44:20.0263687Z SCCACHE_REGION: us-east-1 2025-09-07T07:44:20.0263858Z SHM_SIZE: 1g 2025-09-07T07:44:20.0276057Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:44:20.0276613Z XLA_CUDA: 2025-09-07T07:44:20.0276842Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2025-09-07T07:44:20.0277123Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2025-09-07T07:44:20.0277314Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2025-09-07T07:44:20.0277714Z DASHBOARD_TAG: training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true 2025-09-07T07:44:20.0278262Z VLLM_TEST_HUGGING_FACE_TOKEN: *** 2025-09-07T07:44:20.0278517Z HUGGING_FACE_HUB_TOKEN: *** 2025-09-07T07:44:20.0278770Z SCRIBE_GRAPHQL_ACCESS_TOKEN: *** 2025-09-07T07:44:20.0279092Z ARTIFACTS_FILE_SUFFIX: test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521 2025-09-07T07:44:20.0279407Z ##[endgroup] 2025-09-07T07:44:20.0303976Z + [[ inductor_huggingface_perf_cpu_x86_zen == \m\u\l\t\i\g\p\u ]] 2025-09-07T07:44:20.0304290Z + [[ linux-jammy-py3.9-gcc11-build == *onnx* ]] 2025-09-07T07:44:20.0304529Z + TEST_COMMAND=.ci/pytorch/test.sh 2025-09-07T07:44:20.0307847Z ++ awk '/MemTotal/ { printf "%.3f \n", $2/1024/1024 - 1 }' /proc/meminfo 2025-09-07T07:44:20.0330896Z + TOTAL_AVAILABLE_MEMORY_IN_GB='368.765 ' 2025-09-07T07:44:20.0331140Z + TOTAL_MEMORY_WITH_SWAP=371 2025-09-07T07:44:20.0331373Z + [[ linux-jammy-py3.9-gcc11-build == *\s\3\9\0\x* ]] 2025-09-07T07:44:20.0331595Z + SHM_OPTS=--shm-size=1g 2025-09-07T07:44:20.0331771Z + JENKINS_USER='--user jenkins' 2025-09-07T07:44:20.0331954Z + DOCKER_SHELL_CMD= 2025-09-07T07:44:20.0341627Z +++ nproc --ignore=2 2025-09-07T07:44:20.0787977Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=94 -e SCCACHE_BUCKET -e SCCACHE_REGION -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e VLLM_TEST_HUGGING_FACE_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e ARTIFACTS_FILE_SUFFIX --memory=368g --memory-swap=371g --env-file=/tmp/github_env_17525294857 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T07:47:02.4519391Z + container_name=edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T07:47:02.4525392Z + grep download.pytorch.org /etc/hosts 2025-09-07T07:47:02.4527481Z + docker exec -i edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 sudo bash -c '/bin/cat >> /etc/hosts' 2025-09-07T07:47:02.6402002Z + echo DOCKER_CONTAINER_ID=edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T07:47:02.6403401Z + [[ linux-jammy-py3.9-gcc11-build == *\s\3\9\0\x* ]] 2025-09-07T07:47:02.6408445Z ++ echo dist/torch-2.9.0a0+git93fb23d-cp39-cp39-linux_x86_64.whl 2025-09-07T07:47:02.6411266Z + docker exec -t edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 sh -c 'python3 -m pip install dist/torch-2.9.0a0+git93fb23d-cp39-cp39-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2025-09-07T07:47:02.9969921Z Processing ./dist/torch-2.9.0a0+git93fb23d-cp39-cp39-linux_x86_64.whl (from torch==2.9.0a0+git93fb23d) 2025-09-07T07:47:03.1939624Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (3.19.1) 2025-09-07T07:47:03.1941602Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (4.15.0) 2025-09-07T07:47:03.1944431Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (1.13.3) 2025-09-07T07:47:03.1949269Z Requirement already satisfied: networkx>=2.5.1 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (2.8.8) 2025-09-07T07:47:03.1949983Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (3.1.6) 2025-09-07T07:47:03.1952730Z Requirement already satisfied: fsspec>=0.8.5 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (2025.3.0) 2025-09-07T07:47:03.1961987Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (3.3.0) 2025-09-07T07:47:03.2227085Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from opt-einsum>=3.3->torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (1.22.4) 2025-09-07T07:47:03.2240214Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from sympy>=1.13.3->torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (1.3.0) 2025-09-07T07:47:03.2268535Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from jinja2->torch==2.9.0a0+git93fb23d->torch==2.9.0a0+git93fb23d) (3.0.2) 2025-09-07T07:47:03.9267167Z Installing collected packages: torch 2025-09-07T07:47:11.0231440Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2025-09-07T07:47:11.0232079Z dall-e 0.1 requires torchvision, which is not installed. 2025-09-07T07:47:11.0232373Z effdet 0.4.1 requires torchvision, which is not installed. 2025-09-07T07:47:11.0233299Z pytorch-labs-segment-anything-fast 0.2 requires torchao, which is not installed. 2025-09-07T07:47:11.0233748Z pytorch-labs-segment-anything-fast 0.2 requires torchvision>=0.17.0.dev20231026, which is not installed. 2025-09-07T07:47:11.0234204Z timm 1.0.14 requires torchvision, which is not installed. 2025-09-07T07:47:11.0234513Z Successfully installed torch-2.9.0a0+git93fb23d 2025-09-07T07:47:11.1019021Z + export TERM=vt100 2025-09-07T07:47:11.1019198Z + TERM=vt100 2025-09-07T07:47:11.1020766Z ++ dirname .ci/pytorch/test.sh 2025-09-07T07:47:11.1031227Z + source .ci/pytorch/common.sh 2025-09-07T07:47:11.1035993Z +++ dirname .ci/pytorch/common.sh 2025-09-07T07:47:11.1045447Z ++ source .ci/pytorch/common_utils.sh 2025-09-07T07:47:11.1048514Z +++ declare -f -t trap_add 2025-09-07T07:47:11.1050838Z ++ set -ex -o pipefail 2025-09-07T07:47:11.1051032Z ++ [[ linux-jammy-py3.9-gcc11-build == *rocm* ]] 2025-09-07T07:47:11.1051253Z ++ BUILD_TEST_LIBTORCH=0 2025-09-07T07:47:11.1054781Z ++ dirname .ci/pytorch/test.sh 2025-09-07T07:47:11.1064468Z + source .ci/pytorch/common-build.sh 2025-09-07T07:47:11.1065875Z ++ [[ linux-jammy-py3.9-gcc11-build != *win-* ]] 2025-09-07T07:47:11.1074324Z ++++ dirname .ci/pytorch/common-build.sh 2025-09-07T07:47:11.1083728Z +++ cd .ci/pytorch 2025-09-07T07:47:11.1084355Z +++ pwd -P 2025-09-07T07:47:11.1086687Z ++ script_dir=/var/lib/jenkins/workspace/.ci/pytorch 2025-09-07T07:47:11.1087291Z ++ [[ linux-jammy-py3.9-gcc11-build == *-pch* ]] 2025-09-07T07:47:11.1087492Z ++ which sccache 2025-09-07T07:47:11.1113467Z ++ [[ -z ossci-compiler-cache-circleci-v2 ]] 2025-09-07T07:47:11.1113695Z ++ sccache --stop-server 2025-09-07T07:47:11.1143834Z ++ true 2025-09-07T07:47:11.1143996Z ++ rm -f /var/lib/jenkins/sccache_error.log 2025-09-07T07:47:11.1156596Z ++ trap_add sccache_epilogue EXIT 2025-09-07T07:47:11.1156820Z ++ trap_add_cmd=sccache_epilogue 2025-09-07T07:47:11.1157002Z ++ shift 2025-09-07T07:47:11.1157155Z ++ for trap_add_name in "$@" 2025-09-07T07:47:11.1164217Z ++++ trap -p EXIT 2025-09-07T07:47:11.1166781Z +++ eval 'extract_trap_cmd ' 2025-09-07T07:47:11.1166970Z ++++ extract_trap_cmd 2025-09-07T07:47:11.1167131Z ++++ printf '%s\n' '' 2025-09-07T07:47:11.1167299Z +++ printf '%s\n' sccache_epilogue 2025-09-07T07:47:11.1169040Z ++ trap -- ' 2025-09-07T07:47:11.1169195Z sccache_epilogue' EXIT 2025-09-07T07:47:11.1169499Z ++ [[ -n 1 ]] 2025-09-07T07:47:11.1169801Z ++ echo 'Skipping sccache server initialization, setting environment variables' 2025-09-07T07:47:11.1170164Z Skipping sccache server initialization, setting environment variables 2025-09-07T07:47:11.1170430Z ++ export SCCACHE_IDLE_TIMEOUT=0 2025-09-07T07:47:11.1170610Z ++ SCCACHE_IDLE_TIMEOUT=0 2025-09-07T07:47:11.1170853Z ++ export SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log 2025-09-07T07:47:11.1171143Z ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log 2025-09-07T07:47:11.1171417Z ++ export RUST_LOG=sccache::server=error 2025-09-07T07:47:11.1171624Z ++ RUST_LOG=sccache::server=error 2025-09-07T07:47:11.1171808Z ++ sccache --zero-stats 2025-09-07T07:47:11.2835400Z Statistics zeroed. 2025-09-07T07:47:11.2844079Z ++ which ccache 2025-09-07T07:47:11.2872722Z + [[ linux-jammy-py3.9-gcc11-build != *rocm* ]] 2025-09-07T07:47:11.2872983Z + [[ linux-jammy-py3.9-gcc11-build != *s390x* ]] 2025-09-07T07:47:11.2873212Z + [[ -d /var/lib/jenkins/workspace ]] 2025-09-07T07:47:11.2876622Z ++ stat -c %u /var/lib/jenkins/workspace 2025-09-07T07:47:11.2890874Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2025-09-07T07:47:11.2891128Z + trap_add cleanup_workspace EXIT 2025-09-07T07:47:11.2891324Z + trap_add_cmd=cleanup_workspace 2025-09-07T07:47:11.2891505Z + shift 2025-09-07T07:47:11.2891653Z + for trap_add_name in "$@" 2025-09-07T07:47:11.2900110Z +++ trap -p EXIT 2025-09-07T07:47:11.2903224Z ++ eval 'extract_trap_cmd trap -- '\'' 2025-09-07T07:47:11.2903443Z sccache_epilogue'\'' EXIT' 2025-09-07T07:47:11.2903630Z +++ extract_trap_cmd trap -- ' 2025-09-07T07:47:11.2903809Z sccache_epilogue' EXIT 2025-09-07T07:47:11.2903966Z +++ printf '%s\n' ' 2025-09-07T07:47:11.2904469Z sccache_epilogue' 2025-09-07T07:47:11.2904689Z ++ printf '%s\n' cleanup_workspace 2025-09-07T07:47:11.2906156Z + trap -- ' 2025-09-07T07:47:11.2906304Z sccache_epilogue 2025-09-07T07:47:11.2906462Z cleanup_workspace' EXIT 2025-09-07T07:47:11.2906659Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2025-09-07T07:47:12.0994470Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2025-09-07T07:47:12.1017928Z + echo 'Environment variables:' 2025-09-07T07:47:12.1018133Z Environment variables: 2025-09-07T07:47:12.1018283Z + env 2025-09-07T07:47:12.1029102Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-09-07T07:47:12.1029433Z CONTINUE_THROUGH_ERROR=True 2025-09-07T07:47:12.1029643Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11-build 2025-09-07T07:47:12.1030542Z VLLM_TEST_HUGGING_FACE_TOKEN=*** 2025-09-07T07:47:12.1030728Z HOSTNAME=edcf7e58c22e 2025-09-07T07:47:12.1031086Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1031463Z GITHUB_ACTION=__run_2 2025-09-07T07:47:12.1031636Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2025-09-07T07:47:12.1031818Z GITHUB_RUN_NUMBER=91 2025-09-07T07:47:12.1032007Z TEST_CONFIG=inductor_huggingface_perf_cpu_x86_zen 2025-09-07T07:47:12.1032242Z GITHUB_REPOSITORY_OWNER_ID=21003710 2025-09-07T07:47:12.1032452Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2025-09-07T07:47:12.1032641Z SCCACHE_IDLE_TIMEOUT=0 2025-09-07T07:47:12.1032883Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2025-09-07T07:47:12.1033089Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2025-09-07T07:47:12.1033290Z GITHUB_REF_TYPE=branch 2025-09-07T07:47:12.1033482Z BASE_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:47:12.1033678Z XLA_CUDA= 2025-09-07T07:47:12.1033838Z NCCL_LIB_DIR=/usr/local/cuda/lib64/ 2025-09-07T07:47:12.1034099Z HUGGING_FACE_HUB_TOKEN=*** 2025-09-07T07:47:12.1034447Z *** 2025-09-07T07:47:12.1034606Z GITHUB_REPOSITORY_ID=65600975 2025-09-07T07:47:12.1034795Z GITHUB_ACTIONS=true 2025-09-07T07:47:12.1034990Z SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log 2025-09-07T07:47:12.1035233Z SHA1=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:47:12.1035458Z GITHUB_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:47:12.1035875Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-perf-test-nightly-x86-zen.yml@refs/heads/main 2025-09-07T07:47:12.1036241Z UCC_HOME=/usr 2025-09-07T07:47:12.1036393Z VERBOSE_TEST_LOGS=False 2025-09-07T07:47:12.1036563Z GITHUB_REF=refs/heads/main 2025-09-07T07:47:12.1036721Z SHARD_NUMBER=1 2025-09-07T07:47:12.1036869Z GITHUB_REF_PROTECTED=true 2025-09-07T07:47:12.1037038Z HOME=/var/lib/jenkins 2025-09-07T07:47:12.1037221Z GITHUB_API_URL=https://api.github.com 2025-09-07T07:47:12.1037426Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2025-09-07T07:47:12.1037611Z UCX_COMMIT= 2025-09-07T07:47:12.1037750Z USE_SYSTEM_NCCL=1 2025-09-07T07:47:12.1037891Z NUM_TEST_SHARDS=3 2025-09-07T07:47:12.1038032Z UCX_HOME=/usr 2025-09-07T07:47:12.1038377Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1038903Z JOB_NAME=inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:47:12.1039403Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1039855Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2025-09-07T07:47:12.1040148Z GITHUB_EVENT_NAME=schedule 2025-09-07T07:47:12.1040538Z DASHBOARD_TAG=training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true 2025-09-07T07:47:12.1040940Z GITHUB_RUN_ID=17525294857 2025-09-07T07:47:12.1041097Z INSTALLED_OPENBLAS= 2025-09-07T07:47:12.1041460Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1042014Z GITHUB_ACTOR=pytorchmergebot 2025-09-07T07:47:12.1042189Z PR_NUMBER= 2025-09-07T07:47:12.1042342Z DESIRED_CUDA= 2025-09-07T07:47:12.1042482Z GITHUB_RUN_ATTEMPT=1 2025-09-07T07:47:12.1042647Z ANACONDA_PYTHON_VERSION=3.9 2025-09-07T07:47:12.1042858Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2025-09-07T07:47:12.1043072Z TERM=vt100 2025-09-07T07:47:12.1043201Z INSTALLED_VISION=yes 2025-09-07T07:47:12.1043349Z BRANCH=main 2025-09-07T07:47:12.1043495Z SCCACHE_REGION=us-east-1 2025-09-07T07:47:12.1043666Z OPENSSL_ROOT_DIR=/opt/openssl 2025-09-07T07:47:12.1043837Z CUDA_PATH=/usr/local/cuda 2025-09-07T07:47:12.1044149Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2025-09-07T07:47:12.1044486Z GITHUB_SERVER_URL=https://github.com 2025-09-07T07:47:12.1044670Z UCC_COMMIT= 2025-09-07T07:47:12.1044879Z REENABLED_ISSUES= 2025-09-07T07:47:12.1045024Z DOCS=yes 2025-09-07T07:47:12.1045212Z SHLVL=1 2025-09-07T07:47:12.1045346Z MAX_JOBS=94 2025-09-07T07:47:12.1045485Z GITHUB_ACTOR_ID=97764156 2025-09-07T07:47:12.1045704Z GITHUB_WORKFLOW_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:47:12.1045936Z GITHUB_REF_NAME=main 2025-09-07T07:47:12.1046174Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2025-09-07T07:47:12.1046425Z GITHUB_JOB=test 2025-09-07T07:47:12.1046572Z NO_TEST_TIMEOUT=False 2025-09-07T07:47:12.1046727Z TD_DISTRIBUTED=False 2025-09-07T07:47:12.1046898Z GITHUB_REPOSITORY=pytorch/pytorch 2025-09-07T07:47:12.1047077Z GITHUB_RETENTION_DAYS=90 2025-09-07T07:47:12.1047255Z OPENSSL_DIR=/opt/openssl 2025-09-07T07:47:12.1047423Z GITHUB_ACTION_REPOSITORY= 2025-09-07T07:47:12.1047879Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-09-07T07:47:12.1048327Z GITHUB_BASE_REF= 2025-09-07T07:47:12.1048474Z INSTALLED_ACL= 2025-09-07T07:47:12.1048768Z ARTIFACTS_FILE_SUFFIX=test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521 2025-09-07T07:47:12.1049089Z CI=true 2025-09-07T07:47:12.1049227Z GITHUB_REPOSITORY_OWNER=pytorch 2025-09-07T07:47:12.1049459Z RUST_LOG=sccache::server=error 2025-09-07T07:47:12.1049631Z JOB_ID=49775530521 2025-09-07T07:47:12.1049777Z GITHUB_HEAD_REF= 2025-09-07T07:47:12.1049914Z GITHUB_ACTION_REF= 2025-09-07T07:47:12.1050096Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2025-09-07T07:47:12.1050311Z TEST_SHOWLOCALS=False 2025-09-07T07:47:12.1050500Z GITHUB_WORKFLOW=inductor-perf-nightly-x86-zen 2025-09-07T07:47:12.1050706Z DEBIAN_FRONTEND=noninteractive 2025-09-07T07:47:12.1051079Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1051443Z NO_TD=False 2025-09-07T07:47:12.1051597Z SKIP_SCCACHE_INITIALIZATION=1 2025-09-07T07:47:12.1051784Z NCCL_INCLUDE_DIR=/usr/local/cuda/include/ 2025-09-07T07:47:12.1051975Z _=/usr/bin/env 2025-09-07T07:47:12.1052174Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2025-09-07T07:47:12.1298112Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch 2025-09-07T07:47:12.1298464Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin 2025-09-07T07:47:12.1298790Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib 2025-09-07T07:47:12.1299137Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/test 2025-09-07T07:47:12.1299402Z + BUILD_DIR=build 2025-09-07T07:47:12.1299567Z + BUILD_RENAMED_DIR=build_renamed 2025-09-07T07:47:12.1299748Z + BUILD_BIN_DIR=build/bin 2025-09-07T07:47:12.1299912Z + SHARD_NUMBER=1 2025-09-07T07:47:12.1300060Z + NUM_TEST_SHARDS=3 2025-09-07T07:47:12.1300226Z + export TORCH_SERIALIZATION_DEBUG=1 2025-09-07T07:47:12.1300430Z + TORCH_SERIALIZATION_DEBUG=1 2025-09-07T07:47:12.1300607Z + export VALGRIND=ON 2025-09-07T07:47:12.1300761Z + VALGRIND=ON 2025-09-07T07:47:12.1300935Z + [[ linux-jammy-py3.9-gcc11-build == *clang9* ]] 2025-09-07T07:47:12.1301396Z + [[ linux-jammy-py3.9-gcc11-build == *xpu* ]] 2025-09-07T07:47:12.1301597Z + detect_cuda_arch 2025-09-07T07:47:12.1301769Z + [[ linux-jammy-py3.9-gcc11-build == *cuda* ]] 2025-09-07T07:47:12.1301996Z + [[ linux-jammy-py3.9-gcc11-build == *s390x* ]] 2025-09-07T07:47:12.1302189Z + [[ 0 == \1 ]] 2025-09-07T07:47:12.1302327Z + [[ True == \1 ]] 2025-09-07T07:47:12.1302495Z + [[ linux-jammy-py3.9-gcc11-build != *bazel* ]] 2025-09-07T07:47:12.1304878Z ++ realpath build/custom_test_artifacts 2025-09-07T07:47:12.1314838Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2025-09-07T07:47:12.1315161Z + [[ -n '' ]] 2025-09-07T07:47:12.1315308Z + echo 'Environment variables' 2025-09-07T07:47:12.1315490Z Environment variables 2025-09-07T07:47:12.1315642Z + env 2025-09-07T07:47:12.1337526Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-09-07T07:47:12.1337810Z CONTINUE_THROUGH_ERROR=True 2025-09-07T07:47:12.1338036Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11-build 2025-09-07T07:47:12.1338383Z VLLM_TEST_HUGGING_FACE_TOKEN=*** 2025-09-07T07:47:12.1338570Z HOSTNAME=edcf7e58c22e 2025-09-07T07:47:12.1338920Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1339275Z GITHUB_ACTION=__run_2 2025-09-07T07:47:12.1339457Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2025-09-07T07:47:12.1339648Z GITHUB_RUN_NUMBER=91 2025-09-07T07:47:12.1339842Z TEST_CONFIG=inductor_huggingface_perf_cpu_x86_zen 2025-09-07T07:47:12.1340067Z GITHUB_REPOSITORY_OWNER_ID=21003710 2025-09-07T07:47:12.1340272Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2025-09-07T07:47:12.1340471Z SCCACHE_IDLE_TIMEOUT=0 2025-09-07T07:47:12.1340714Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2025-09-07T07:47:12.1340913Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2025-09-07T07:47:12.1341098Z GITHUB_REF_TYPE=branch 2025-09-07T07:47:12.1341281Z BASE_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:47:12.1341480Z XLA_CUDA= 2025-09-07T07:47:12.1341638Z NCCL_LIB_DIR=/usr/local/cuda/lib64/ 2025-09-07T07:47:12.1341951Z HUGGING_FACE_HUB_TOKEN=*** 2025-09-07T07:47:12.1342149Z *** 2025-09-07T07:47:12.1342287Z GITHUB_REPOSITORY_ID=65600975 2025-09-07T07:47:12.1342466Z GITHUB_ACTIONS=true 2025-09-07T07:47:12.1342649Z SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log 2025-09-07T07:47:12.1342890Z SHA1=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:47:12.1343112Z GITHUB_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:47:12.1343511Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor-perf-test-nightly-x86-zen.yml@refs/heads/main 2025-09-07T07:47:12.1343865Z UCC_HOME=/usr 2025-09-07T07:47:12.1344008Z TORCH_SERIALIZATION_DEBUG=1 2025-09-07T07:47:12.1344182Z VERBOSE_TEST_LOGS=False 2025-09-07T07:47:12.1344350Z GITHUB_REF=refs/heads/main 2025-09-07T07:47:12.1344544Z SHARD_NUMBER=1 2025-09-07T07:47:12.1344697Z GITHUB_REF_PROTECTED=true 2025-09-07T07:47:12.1344857Z HOME=/var/lib/jenkins 2025-09-07T07:47:12.1345040Z GITHUB_API_URL=https://api.github.com 2025-09-07T07:47:12.1345249Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2025-09-07T07:47:12.1345430Z UCX_COMMIT= 2025-09-07T07:47:12.1345560Z USE_SYSTEM_NCCL=1 2025-09-07T07:47:12.1345753Z NUM_TEST_SHARDS=3 2025-09-07T07:47:12.1345907Z UCX_HOME=/usr 2025-09-07T07:47:12.1346245Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1346762Z JOB_NAME=inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T07:47:12.1347273Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1347737Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2025-09-07T07:47:12.1348044Z GITHUB_EVENT_NAME=schedule 2025-09-07T07:47:12.1348432Z DASHBOARD_TAG=training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true 2025-09-07T07:47:12.1350119Z GITHUB_RUN_ID=17525294857 2025-09-07T07:47:12.1350289Z INSTALLED_OPENBLAS= 2025-09-07T07:47:12.1350653Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1351051Z GITHUB_ACTOR=pytorchmergebot 2025-09-07T07:47:12.1351220Z PR_NUMBER= 2025-09-07T07:47:12.1351360Z DESIRED_CUDA= 2025-09-07T07:47:12.1351510Z GITHUB_RUN_ATTEMPT=1 2025-09-07T07:47:12.1351659Z VALGRIND=ON 2025-09-07T07:47:12.1351802Z ANACONDA_PYTHON_VERSION=3.9 2025-09-07T07:47:12.1352014Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2025-09-07T07:47:12.1352227Z TERM=vt100 2025-09-07T07:47:12.1352370Z INSTALLED_VISION=yes 2025-09-07T07:47:12.1352516Z BRANCH=main 2025-09-07T07:47:12.1352661Z SCCACHE_REGION=us-east-1 2025-09-07T07:47:12.1352923Z OPENSSL_ROOT_DIR=/opt/openssl 2025-09-07T07:47:12.1353107Z CUDA_PATH=/usr/local/cuda 2025-09-07T07:47:12.1353418Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2025-09-07T07:47:12.1353764Z GITHUB_SERVER_URL=https://github.com 2025-09-07T07:47:12.1353953Z UCC_COMMIT= 2025-09-07T07:47:12.1354083Z REENABLED_ISSUES= 2025-09-07T07:47:12.1354230Z DOCS=yes 2025-09-07T07:47:12.1354361Z SHLVL=1 2025-09-07T07:47:12.1354485Z MAX_JOBS=94 2025-09-07T07:47:12.1354613Z GITHUB_ACTOR_ID=97764156 2025-09-07T07:47:12.1354823Z GITHUB_WORKFLOW_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T07:47:12.1355053Z GITHUB_REF_NAME=main 2025-09-07T07:47:12.1355293Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2025-09-07T07:47:12.1355541Z GITHUB_JOB=test 2025-09-07T07:47:12.1355688Z NO_TEST_TIMEOUT=False 2025-09-07T07:47:12.1355847Z TD_DISTRIBUTED=False 2025-09-07T07:47:12.1356017Z GITHUB_REPOSITORY=pytorch/pytorch 2025-09-07T07:47:12.1356208Z GITHUB_RETENTION_DAYS=90 2025-09-07T07:47:12.1356371Z OPENSSL_DIR=/opt/openssl 2025-09-07T07:47:12.1356532Z GITHUB_ACTION_REPOSITORY= 2025-09-07T07:47:12.1356981Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-09-07T07:47:12.1357433Z GITHUB_BASE_REF= 2025-09-07T07:47:12.1357575Z INSTALLED_ACL= 2025-09-07T07:47:12.1357869Z ARTIFACTS_FILE_SUFFIX=test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521 2025-09-07T07:47:12.1358186Z CI=true 2025-09-07T07:47:12.1358332Z GITHUB_REPOSITORY_OWNER=pytorch 2025-09-07T07:47:12.1358531Z RUST_LOG=sccache::server=error 2025-09-07T07:47:12.1358708Z JOB_ID=49775530521 2025-09-07T07:47:12.1358851Z GITHUB_HEAD_REF= 2025-09-07T07:47:12.1358988Z GITHUB_ACTION_REF= 2025-09-07T07:47:12.1359174Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2025-09-07T07:47:12.1359389Z TEST_SHOWLOCALS=False 2025-09-07T07:47:12.1359582Z GITHUB_WORKFLOW=inductor-perf-nightly-x86-zen 2025-09-07T07:47:12.1359792Z DEBIAN_FRONTEND=noninteractive 2025-09-07T07:47:12.1360159Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_512ea04c-d125-47f2-800f-82b3f106c311 2025-09-07T07:47:12.1360526Z NO_TD=False 2025-09-07T07:47:12.1360678Z SKIP_SCCACHE_INITIALIZATION=1 2025-09-07T07:47:12.1360865Z NCCL_INCLUDE_DIR=/usr/local/cuda/include/ 2025-09-07T07:47:12.1361049Z _=/usr/bin/env 2025-09-07T07:47:12.1361198Z + echo 'Testing pytorch' 2025-09-07T07:47:12.1361358Z Testing pytorch 2025-09-07T07:47:12.1361509Z + export LANG=C.UTF-8 2025-09-07T07:47:12.1361662Z + LANG=C.UTF-8 2025-09-07T07:47:12.1361814Z + PR_NUMBER= 2025-09-07T07:47:12.1362013Z + [[ inductor_huggingface_perf_cpu_x86_zen == \d\e\f\a\u\l\t ]] 2025-09-07T07:47:12.1362310Z + [[ inductor_huggingface_perf_cpu_x86_zen == \d\i\s\t\r\i\b\u\t\e\d ]] 2025-09-07T07:47:12.1362585Z + [[ inductor_huggingface_perf_cpu_x86_zen == \s\l\o\w ]] 2025-09-07T07:47:12.1362849Z + [[ linux-jammy-py3.9-gcc11-build == *slow-gradcheck* ]] 2025-09-07T07:47:12.1363089Z + [[ linux-jammy-py3.9-gcc11-build == *cuda* ]] 2025-09-07T07:47:12.1363303Z + [[ linux-jammy-py3.9-gcc11-build == *rocm* ]] 2025-09-07T07:47:12.1363620Z + [[ linux-jammy-py3.9-gcc11-build == *xpu* ]] 2025-09-07T07:47:12.1363861Z + [[ inductor_huggingface_perf_cpu_x86_zen == *crossref* ]] 2025-09-07T07:47:12.1364098Z + [[ linux-jammy-py3.9-gcc11-build == *rocm* ]] 2025-09-07T07:47:12.1364308Z + [[ linux-jammy-py3.9-gcc11-build == *xpu* ]] 2025-09-07T07:47:12.1364523Z + [[ linux-jammy-py3.9-gcc11-build != *-bazel-* ]] 2025-09-07T07:47:12.1364740Z + pip_install ninja==1.10.2 2025-09-07T07:47:12.1364963Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2025-09-07T07:47:12.1365237Z + python3 -m pip install --progress-bar off ninja==1.10.2 2025-09-07T07:47:12.5363170Z Collecting ninja==1.10.2 2025-09-07T07:47:12.5451134Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2025-09-07T07:47:12.5546485Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2025-09-07T07:47:13.2285970Z Installing collected packages: ninja 2025-09-07T07:47:13.2286266Z Attempting uninstall: ninja 2025-09-07T07:47:13.2293881Z Found existing installation: ninja 1.11.1.3 2025-09-07T07:47:13.2316306Z Uninstalling ninja-1.11.1.3: 2025-09-07T07:47:13.2389547Z Successfully uninstalled ninja-1.11.1.3 2025-09-07T07:47:13.2949312Z Successfully installed ninja-1.10.2 2025-09-07T07:47:13.3680746Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-09-07T07:47:13.3681639Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-09-07T07:47:13.3682236Z + [[ linux-jammy-py3.9-gcc11-build == *aarch64* ]] 2025-09-07T07:47:13.3682511Z + [[ linux-jammy-py3.9-gcc11-build == *asan* ]] 2025-09-07T07:47:13.3682748Z + [[ linux-jammy-py3.9-gcc11-build == *-debug* ]] 2025-09-07T07:47:13.3682984Z + [[ linux-jammy-py3.9-gcc11-build != *-bazel-* ]] 2025-09-07T07:47:13.3683318Z + echo 'We are not in debug mode: linux-jammy-py3.9-gcc11-build. Expect the assertion to pass' 2025-09-07T07:47:13.3683718Z We are not in debug mode: linux-jammy-py3.9-gcc11-build. Expect the assertion to pass 2025-09-07T07:47:13.3685144Z + cd test 2025-09-07T07:47:13.3685737Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2025-09-07T07:47:13.6446081Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T07:47:13.6446894Z import pynvml # type: ignore[import] 2025-09-07T07:47:14.4731642Z + [[ inductor_huggingface_perf_cpu_x86_zen == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2025-09-07T07:47:14.4732032Z + [[ inductor_huggingface_perf_cpu_x86_zen == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2025-09-07T07:47:14.4732410Z + [[ inductor_huggingface_perf_cpu_x86_zen == \l\e\g\a\c\y\_\n\v\i\d\i\a\_\d\r\i\v\e\r ]] 2025-09-07T07:47:14.4733643Z + DYNAMO_BENCHMARK_FLAGS=() 2025-09-07T07:47:14.4734240Z + [[ inductor_huggingface_perf_cpu_x86_zen == *pr_time_benchmarks* ]] 2025-09-07T07:47:14.4734578Z + [[ inductor_huggingface_perf_cpu_x86_zen == *dynamo_eager* ]] 2025-09-07T07:47:14.4734861Z + [[ inductor_huggingface_perf_cpu_x86_zen == *aot_eager* ]] 2025-09-07T07:47:14.4735133Z + [[ inductor_huggingface_perf_cpu_x86_zen == *aot_inductor* ]] 2025-09-07T07:47:14.4735455Z + [[ inductor_huggingface_perf_cpu_x86_zen == *max_autotune_inductor* ]] 2025-09-07T07:47:14.4735743Z + [[ inductor_huggingface_perf_cpu_x86_zen == *inductor* ]] 2025-09-07T07:47:14.4736010Z + [[ inductor_huggingface_perf_cpu_x86_zen != *perf* ]] 2025-09-07T07:47:14.4736264Z + [[ inductor_huggingface_perf_cpu_x86_zen == *dynamic* ]] 2025-09-07T07:47:14.4736518Z + [[ inductor_huggingface_perf_cpu_x86_zen == *cpu* ]] 2025-09-07T07:47:14.4737196Z + DYNAMO_BENCHMARK_FLAGS+=(--device cpu) 2025-09-07T07:47:14.4984628Z + [[ linux-jammy-py3.9-gcc11-build == *libtorch* ]] 2025-09-07T07:47:14.4984895Z + [[ linux-jammy-py3.9-gcc11-build == *-bazel-* ]] 2025-09-07T07:47:14.4987587Z + cd test 2025-09-07T07:47:14.4988565Z + python -c 'import torch; print(torch.__config__.show())' 2025-09-07T07:47:14.7732124Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T07:47:14.7733040Z import pynvml # type: ignore[import] 2025-09-07T07:47:15.4144769Z PyTorch built with: 2025-09-07T07:47:15.4144997Z - GCC 11.4 2025-09-07T07:47:15.4145762Z - C++ Version: 201703 2025-09-07T07:47:15.4146136Z - Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications 2025-09-07T07:47:15.4146603Z - Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-09-07T07:47:15.4146876Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2025-09-07T07:47:15.4147102Z - LAPACK is enabled (usually provided by MKL) 2025-09-07T07:47:15.4147309Z - NNPACK is enabled 2025-09-07T07:47:15.4147485Z - CPU capability usage: AVX512 2025-09-07T07:47:15.4150233Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=93fb23d6fae7c4e82c4239a1033e522088742634, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -DC10_NODEPRECATED -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -faligned-new -Werror -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.9.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, USE_XCCL=OFF, USE_XPU=OFF, 2025-09-07T07:47:15.4153063Z 2025-09-07T07:47:15.5966291Z + cd test 2025-09-07T07:47:15.5966582Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2025-09-07T07:47:15.8681240Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T07:47:15.8682059Z import pynvml # type: ignore[import] 2025-09-07T07:47:16.4954572Z ATen/Parallel: 2025-09-07T07:47:16.4954848Z at::get_num_threads() : 96 2025-09-07T07:47:16.4955060Z at::get_num_interop_threads() : 96 2025-09-07T07:47:16.4955270Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2025-09-07T07:47:16.4955464Z omp_get_max_threads() : 96 2025-09-07T07:47:16.4955812Z Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications 2025-09-07T07:47:16.4956158Z mkl_get_max_threads() : 96 2025-09-07T07:47:16.4956413Z Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-09-07T07:47:16.4956692Z std::thread::hardware_concurrency() : 96 2025-09-07T07:47:16.4956892Z Environment variables: 2025-09-07T07:47:16.4957052Z OMP_NUM_THREADS : [not set] 2025-09-07T07:47:16.4957259Z MKL_NUM_THREADS : [not set] 2025-09-07T07:47:16.4957443Z ATen parallel backend: OpenMP 2025-09-07T07:47:16.4957556Z 2025-09-07T07:47:16.6705850Z + [[ inductor_huggingface_perf_cpu_x86_zen == *numpy_2* ]] 2025-09-07T07:47:16.6706438Z + [[ linux-jammy-py3.9-gcc11-build == *aarch64* ]] 2025-09-07T07:47:16.6706703Z + [[ inductor_huggingface_perf_cpu_x86_zen == *backward* ]] 2025-09-07T07:47:16.6706969Z + [[ inductor_huggingface_perf_cpu_x86_zen == *xla* ]] 2025-09-07T07:47:16.6707221Z + [[ inductor_huggingface_perf_cpu_x86_zen == *vllm* ]] 2025-09-07T07:47:16.6707489Z + [[ inductor_huggingface_perf_cpu_x86_zen == *executorch* ]] 2025-09-07T07:47:16.6707782Z + [[ inductor_huggingface_perf_cpu_x86_zen == \j\i\t\_\l\e\g\a\c\y ]] 2025-09-07T07:47:16.6708060Z + [[ linux-jammy-py3.9-gcc11-build == *libtorch* ]] 2025-09-07T07:47:16.6708309Z + [[ inductor_huggingface_perf_cpu_x86_zen == distributed ]] 2025-09-07T07:47:16.6708765Z + [[ inductor_huggingface_perf_cpu_x86_zen == *operator_benchmark* ]] 2025-09-07T07:47:16.6709087Z + [[ inductor_huggingface_perf_cpu_x86_zen == *inductor_distributed* ]] 2025-09-07T07:47:16.6709392Z + [[ inductor_huggingface_perf_cpu_x86_zen == *inductor-halide* ]] 2025-09-07T07:47:16.6709830Z + [[ inductor_huggingface_perf_cpu_x86_zen == *inductor-triton-cpu* ]] 2025-09-07T07:47:16.6710172Z + [[ inductor_huggingface_perf_cpu_x86_zen == *inductor-micro-benchmark* ]] 2025-09-07T07:47:16.6710480Z + [[ inductor_huggingface_perf_cpu_x86_zen == *huggingface* ]] 2025-09-07T07:47:16.6710713Z + install_torchvision 2025-09-07T07:47:16.6711325Z + local orig_preload 2025-09-07T07:47:16.6711486Z + local commit 2025-09-07T07:47:16.6711645Z ++ get_pinned_commit vision 2025-09-07T07:47:16.6712053Z ++ cat .github/ci_commit_pins/vision.txt 2025-09-07T07:47:16.7390337Z + commit=966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T07:47:16.7390608Z + orig_preload= 2025-09-07T07:47:16.7390771Z + '[' -n '' ']' 2025-09-07T07:47:16.7390974Z + [[ linux-jammy-py3.9-gcc11-build == *cuda* ]] 2025-09-07T07:47:16.7391452Z + pip_build_and_install git+https://github.com/pytorch/vision.git@966da7e46f65d6d49df3e31214470a4fe5cc8e66 dist/vision 2025-09-07T07:47:16.7391994Z + local build_target=git+https://github.com/pytorch/vision.git@966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T07:47:16.7392344Z + local wheel_dir=dist/vision 2025-09-07T07:47:16.7392515Z + local found_whl=0 2025-09-07T07:47:16.7392680Z + for file in "${wheel_dir}"/*.whl 2025-09-07T07:47:16.7392873Z + [[ -f dist/vision/*.whl ]] 2025-09-07T07:47:16.7393039Z + '[' 0 == 0 ']' 2025-09-07T07:47:16.7393469Z + python3 -m pip wheel --no-build-isolation --no-deps --no-use-pep517 -w dist/vision git+https://github.com/pytorch/vision.git@966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T07:47:17.0302086Z Collecting git+https://github.com/pytorch/vision.git@966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T07:47:17.0305845Z Cloning https://github.com/pytorch/vision.git (to revision 966da7e46f65d6d49df3e31214470a4fe5cc8e66) to /tmp/pip-req-build-3rgs96_s 2025-09-07T07:47:17.2218325Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-3rgs96_s 2025-09-07T07:47:18.7611729Z Running command git rev-parse -q --verify 'sha^966da7e46f65d6d49df3e31214470a4fe5cc8e66' 2025-09-07T07:47:18.7658106Z Running command git fetch -q https://github.com/pytorch/vision.git 966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T07:47:18.8860817Z Running command git checkout -q 966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T07:47:19.1819954Z Resolved https://github.com/pytorch/vision.git to commit 966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T07:47:20.6693042Z Preparing metadata (setup.py) ... [?25l- \ | / done 2025-09-07T07:47:20.6735902Z [?25hBuilding wheels for collected packages: torchvision 2025-09-07T07:47:20.6844830Z  DEPRECATION: Building 'torchvision' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'torchvision'. Discussion can be found at https://github.com/pypa/pip/issues/6334 2025-09-07T07:47:49.1926248Z  Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ done 2025-09-07T07:47:49.1950277Z [?25h Created wheel for torchvision: filename=torchvision-0.22.0a0+966da7e-cp39-cp39-linux_x86_64.whl size=1301743 sha256=34782f1034344602fbc8f313d6a3307bcec82449fb22c75cd1e94741ce1096a3 2025-09-07T07:47:49.1951289Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/33/6d/2f/9f3e65c401a351a98a00d9d72c4434fdbd3e10256b2d832157 2025-09-07T07:47:49.1989750Z Successfully built torchvision 2025-09-07T07:47:49.2867907Z + for file in "${wheel_dir}"/*.whl 2025-09-07T07:47:49.2868922Z + pip_install_whl dist/vision/torchvision-0.22.0a0+966da7e-cp39-cp39-linux_x86_64.whl 2025-09-07T07:47:49.2869361Z + args=('dist/vision/torchvision-0.22.0a0+966da7e-cp39-cp39-linux_x86_64.whl') 2025-09-07T07:47:49.2869654Z + local args 2025-09-07T07:47:49.2869907Z + [[ dist/vision/torchvision-0.22.0a0+966da7e-cp39-cp39-linux_x86_64.whl == *\ * ]] 2025-09-07T07:47:49.2870205Z + for path in "${args[@]}" 2025-09-07T07:47:49.2870502Z + echo 'Installing dist/vision/torchvision-0.22.0a0+966da7e-cp39-cp39-linux_x86_64.whl' 2025-09-07T07:47:49.2870909Z Installing dist/vision/torchvision-0.22.0a0+966da7e-cp39-cp39-linux_x86_64.whl 2025-09-07T07:47:49.2871374Z + python3 -mpip install --no-index --no-deps dist/vision/torchvision-0.22.0a0+966da7e-cp39-cp39-linux_x86_64.whl 2025-09-07T07:47:49.5873300Z Processing ./dist/vision/torchvision-0.22.0a0+966da7e-cp39-cp39-linux_x86_64.whl 2025-09-07T07:47:49.5945874Z Installing collected packages: torchvision 2025-09-07T07:47:49.9730276Z Successfully installed torchvision-0.22.0a0+966da7e 2025-09-07T07:47:50.0071579Z + '[' -n '' ']' 2025-09-07T07:47:50.0071752Z + id=0 2025-09-07T07:47:50.0071914Z + test_dynamo_benchmark huggingface 0 2025-09-07T07:47:50.0075894Z ++ pwd 2025-09-07T07:47:50.0079164Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2025-09-07T07:47:50.0079449Z + local suite=huggingface 2025-09-07T07:47:50.0079609Z + shift 2025-09-07T07:47:50.0079759Z + local shard_id=0 2025-09-07T07:47:50.0079908Z + shift 2025-09-07T07:47:50.0080107Z + [[ inductor_huggingface_perf_cpu_x86_zen == *perf_compare* ]] 2025-09-07T07:47:50.0080373Z + [[ inductor_huggingface_perf_cpu_x86_zen == *perf* ]] 2025-09-07T07:47:50.0080610Z + [[ inductor_huggingface_perf_cpu_x86_zen == *b200* ]] 2025-09-07T07:47:50.0080862Z + test_single_dynamo_benchmark dashboard huggingface 0 2025-09-07T07:47:50.0084689Z ++ pwd 2025-09-07T07:47:50.0087133Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2025-09-07T07:47:50.0087443Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2025-09-07T07:47:50.0109575Z + local name=dashboard 2025-09-07T07:47:50.0109861Z + shift 2025-09-07T07:47:50.0110009Z + local suite=huggingface 2025-09-07T07:47:50.0110162Z + shift 2025-09-07T07:47:50.0110301Z + local shard_id=0 2025-09-07T07:47:50.0110443Z + shift 2025-09-07T07:47:50.0110576Z + partition_flags=() 2025-09-07T07:47:50.0110730Z + local partition_flags 2025-09-07T07:47:50.0110887Z + [[ -n 3 ]] 2025-09-07T07:47:50.0111021Z + [[ -n 0 ]] 2025-09-07T07:47:50.0111269Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id") 2025-09-07T07:47:50.0111611Z + [[ inductor_huggingface_perf_cpu_x86_zen == *perf_compare* ]] 2025-09-07T07:47:50.0111875Z + [[ inductor_huggingface_perf_cpu_x86_zen == *perf* ]] 2025-09-07T07:47:50.0112203Z + test_perf_for_dashboard huggingface --device cpu --total-partitions 3 --partition-id 0 2025-09-07T07:47:50.0114343Z ++ pwd 2025-09-07T07:47:50.0116776Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2025-09-07T07:47:50.0117144Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2025-09-07T07:47:50.0135664Z + local suite=huggingface 2025-09-07T07:47:50.0135837Z + shift 2025-09-07T07:47:50.0135980Z + local backend=inductor 2025-09-07T07:47:50.0136646Z + modes=() 2025-09-07T07:47:50.0136787Z + local modes 2025-09-07T07:47:50.0137189Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *training-true* ]] 2025-09-07T07:47:50.0137869Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *inference-true* ]] 2025-09-07T07:47:50.0138298Z + modes+=(inference) 2025-09-07T07:47:50.0138466Z + targets=('accuracy' 'performance') 2025-09-07T07:47:50.0138649Z + local targets 2025-09-07T07:47:50.0138794Z + local device=cuda 2025-09-07T07:47:50.0138981Z + [[ inductor_huggingface_perf_cpu_x86_zen == *cpu* ]] 2025-09-07T07:47:50.0139243Z + [[ inductor_huggingface_perf_cpu_x86_zen == *cpu_x86_zen* ]] 2025-09-07T07:47:50.0139478Z + device=cpu_x86_zen 2025-09-07T07:47:50.0140770Z + test_inductor_set_cpu_affinity 2025-09-07T07:47:50.0141103Z ++ find /usr/lib -name libjemalloc.so.2 2025-09-07T07:47:50.0507124Z + JEMALLOC_LIB=/usr/lib/x86_64-linux-gnu/libjemalloc.so.2 2025-09-07T07:47:50.0507442Z + export LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so.2: 2025-09-07T07:47:50.0507719Z + LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so.2: 2025-09-07T07:47:50.0508119Z + export MALLOC_CONF=oversize_threshold:1,background_thread:true,metadata_thp:auto,dirty_decay_ms:-1,muzzy_decay_ms:-1 2025-09-07T07:47:50.0508636Z + MALLOC_CONF=oversize_threshold:1,background_thread:true,metadata_thp:auto,dirty_decay_ms:-1,muzzy_decay_ms:-1 2025-09-07T07:47:50.0509010Z + [[ inductor_huggingface_perf_cpu_x86_zen != *aarch64* ]] 2025-09-07T07:47:50.0516894Z +++ which python 2025-09-07T07:47:50.0542987Z ++ dirname /opt/conda/envs/py_3.9/bin/python 2025-09-07T07:47:50.0577287Z + IOMP_LIB=/opt/conda/envs/py_3.9/bin/../lib/libiomp5.so 2025-09-07T07:47:50.0577683Z + export LD_PRELOAD=/opt/conda/envs/py_3.9/bin/../lib/libiomp5.so:/usr/lib/x86_64-linux-gnu/libjemalloc.so.2: 2025-09-07T07:47:50.0578128Z + LD_PRELOAD=/opt/conda/envs/py_3.9/bin/../lib/libiomp5.so:/usr/lib/x86_64-linux-gnu/libjemalloc.so.2: 2025-09-07T07:47:50.0578475Z + export KMP_AFFINITY=granularity=fine,compact,1,0 2025-09-07T07:47:50.0578709Z + KMP_AFFINITY=granularity=fine,compact,1,0 2025-09-07T07:47:50.0578917Z + export KMP_BLOCKTIME=1 2025-09-07T07:47:50.0579078Z + KMP_BLOCKTIME=1 2025-09-07T07:47:50.0582815Z ++ nproc 2025-09-07T07:47:50.0617321Z + cpus=96 2025-09-07T07:47:50.0623969Z ++ lscpu 2025-09-07T07:47:50.0625672Z ++ grep 'Thread(s) per core:' 2025-09-07T07:47:50.0626252Z ++ awk '{print $4}' 2025-09-07T07:47:50.1234021Z + thread_per_core=1 2025-09-07T07:47:50.1234197Z + cores=96 2025-09-07T07:47:50.1234382Z + [[ inductor_huggingface_perf_cpu_x86_zen == *aarch64* ]] 2025-09-07T07:47:50.1234622Z + export OMP_NUM_THREADS=96 2025-09-07T07:47:50.1234793Z + OMP_NUM_THREADS=96 2025-09-07T07:47:50.1239572Z ++ python -c 'import os; print(min(os.sched_getaffinity(0)))' 2025-09-07T07:47:50.1492868Z + start_cpu=0 2025-09-07T07:47:50.1497025Z ++ python -c 'import os; print(max(os.sched_getaffinity(0)))' 2025-09-07T07:47:50.1757696Z + end_cpu=94 2025-09-07T07:47:50.1757890Z + export 'TASKSET=taskset -c 0-94' 2025-09-07T07:47:50.1758113Z + TASKSET='taskset -c 0-94' 2025-09-07T07:47:50.1758299Z + for mode in "${modes[@]}" 2025-09-07T07:47:50.1758477Z + [[ inference == \i\n\f\e\r\e\n\c\e ]] 2025-09-07T07:47:50.1758669Z + [[ cpu_x86_zen == \c\p\u\_\x\8\6 ]] 2025-09-07T07:47:50.1758849Z + dtype=bfloat16 2025-09-07T07:47:50.1759008Z + for target in "${targets[@]}" 2025-09-07T07:47:50.1759191Z + target_flag=('--accuracy') 2025-09-07T07:47:50.1768925Z + local target_flag 2025-09-07T07:47:50.1769150Z + [[ accuracy == \p\e\r\f\o\r\m\a\n\c\e ]] 2025-09-07T07:47:50.1769366Z + [[ accuracy == \a\c\c\u\r\a\c\y ]] 2025-09-07T07:47:50.1769582Z + target_flag+=(--no-translation-validation) 2025-09-07T07:47:50.1770071Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *freezing-true* ]] 2025-09-07T07:47:50.1770755Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *default-true* ]] 2025-09-07T07:47:50.1772242Z + taskset -c 0-94 python benchmarks/dynamo/huggingface.py --accuracy --no-translation-validation --inference --bfloat16 --backend inductor --disable-cudagraphs --device cpu --total-partitions 3 --partition-id 0 --output /var/lib/jenkins/workspace/test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv 2025-09-07T07:47:50.9879277Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T07:47:50.9880119Z import pynvml # type: ignore[import] 2025-09-07T07:47:53.7411182Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:47:53.7412129Z from pkg_resources import resource_filename 2025-09-07T07:47:54.2313253Z 2025-09-07T07:47:54.2351251Z config.json: 0% 0.00/694 [00:00bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7226554Z 2025-09-07T07:58:00.7226650Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7227172Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7227652Z layer_outputs = layer_module( 2025-09-07T07:58:00.7227993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7228342Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7228748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7229158Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7229564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7229966Z self_outputs = self.self( 2025-09-07T07:58:00.7230351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7230784Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7231278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7231861Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7232100Z 2025-09-07T07:58:00.7232205Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7232719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7233196Z layer_outputs = layer_module( 2025-09-07T07:58:00.7233537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7233890Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7234305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7234710Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7235121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7235551Z self_outputs = self.self( 2025-09-07T07:58:00.7235945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7236482Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7236968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7237548Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7237789Z 2025-09-07T07:58:00.7237885Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7238390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7238941Z layer_outputs = layer_module( 2025-09-07T07:58:00.7239272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7239629Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7240042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7240451Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7240852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7241249Z self_outputs = self.self( 2025-09-07T07:58:00.7241636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7242069Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7242563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7243140Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7243375Z 2025-09-07T07:58:00.7243451Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7243653Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7243849Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7244039Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7244249Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7244757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7245235Z layer_outputs = layer_module( 2025-09-07T07:58:00.7245576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7245927Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7246325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7246741Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7247141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7247542Z self_outputs = self.self( 2025-09-07T07:58:00.7247926Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7248357Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7248858Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7249397Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7249918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7250529Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7250731Z 2025-09-07T07:58:00.7250803Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7251027Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7251528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7252005Z layer_outputs = layer_module( 2025-09-07T07:58:00.7252335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7252757Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7253164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7253580Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7253982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7254380Z self_outputs = self.self( 2025-09-07T07:58:00.7254776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7255184Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7255297Z 2025-09-07T07:58:00.7255397Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7255894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7256365Z layer_outputs = layer_module( 2025-09-07T07:58:00.7256692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7257040Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7257443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7257855Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7258253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7258655Z self_outputs = self.self( 2025-09-07T07:58:00.7259037Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7259447Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7259569Z 2025-09-07T07:58:00.7259672Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7260164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7260639Z layer_outputs = layer_module( 2025-09-07T07:58:00.7260965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7261314Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7261715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7262116Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7262512Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7262911Z self_outputs = self.self( 2025-09-07T07:58:00.7263295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7263737Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7264342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7264926Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7265352Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7265742Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7265887Z 2025-09-07T07:58:00.7265984Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7266575Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7267059Z layer_outputs = layer_module( 2025-09-07T07:58:00.7267393Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7267748Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7268151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7268562Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7268963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7269367Z self_outputs = self.self( 2025-09-07T07:58:00.7269752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7270195Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7270718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7271258Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7271760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7272219Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7272535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7272870Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7273020Z 2025-09-07T07:58:00.7273111Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7273615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7274090Z layer_outputs = layer_module( 2025-09-07T07:58:00.7274414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7274763Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7275166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7275577Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7275976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7276373Z self_outputs = self.self( 2025-09-07T07:58:00.7276757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7277201Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7277719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7278361Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7278565Z 2025-09-07T07:58:00.7278658Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7279155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7279629Z layer_outputs = layer_module( 2025-09-07T07:58:00.7279956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7280305Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7280772Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7281185Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7281589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7281991Z self_outputs = self.self( 2025-09-07T07:58:00.7282364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7282803Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7283315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7283865Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7284061Z 2025-09-07T07:58:00.7284167Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7284661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7285139Z layer_outputs = layer_module( 2025-09-07T07:58:00.7285467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7285811Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7286210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7286609Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7287007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7287405Z self_outputs = self.self( 2025-09-07T07:58:00.7287789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7288306Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7288544Z 2025-09-07T07:58:00.7288638Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7289137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7289612Z layer_outputs = layer_module( 2025-09-07T07:58:00.7289938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7290282Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7290677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7291085Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7291479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7292034Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7292473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7292883Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7293022Z 2025-09-07T07:58:00.7293111Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7293609Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7294101Z layer_outputs = layer_module( 2025-09-07T07:58:00.7294506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7294857Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7295263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7295686Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7296086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7296473Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7296888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7297337Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7297773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7298189Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7298319Z 2025-09-07T07:58:00.7298418Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7298923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7299399Z layer_outputs = layer_module( 2025-09-07T07:58:00.7299735Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7300089Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7300486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7300895Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7301288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7301674Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7302076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7302514Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7302945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7303389Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7303764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7304098Z return self.act(input) 2025-09-07T07:58:00.7304204Z 2025-09-07T07:58:00.7304303Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7304809Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7305288Z layer_outputs = layer_module( 2025-09-07T07:58:00.7305675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7306108Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7306508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7306919Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7307306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7307692Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7308087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7310472Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7310956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7311388Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7311522Z 2025-09-07T07:58:00.7311627Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7312133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7312616Z layer_outputs = layer_module( 2025-09-07T07:58:00.7312953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7313311Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7313724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7314132Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7314539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7314944Z self_outputs = self.self( 2025-09-07T07:58:00.7315333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7315747Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7315879Z 2025-09-07T07:58:00.7315975Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7316476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7316954Z layer_outputs = layer_module( 2025-09-07T07:58:00.7317292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7317642Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7318043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7318454Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7318860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7319262Z self_outputs = self.self( 2025-09-07T07:58:00.7319642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7320078Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7320570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7321161Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7321399Z 2025-09-07T07:58:00.7321617Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7322126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7322610Z layer_outputs = layer_module( 2025-09-07T07:58:00.7322948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7323301Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7323718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7324121Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7324616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7325021Z self_outputs = self.self( 2025-09-07T07:58:00.7325416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7325826Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7325954Z 2025-09-07T07:58:00.7326049Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7326554Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7327029Z layer_outputs = layer_module( 2025-09-07T07:58:00.7327367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7327717Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7328122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7328526Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7328930Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7329333Z self_outputs = self.self( 2025-09-07T07:58:00.7329711Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7330152Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7330652Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7331235Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7331478Z 2025-09-07T07:58:00.7331578Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7332078Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7332548Z layer_outputs = layer_module( 2025-09-07T07:58:00.7332882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7333225Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7333631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7334031Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7334430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7334834Z self_outputs = self.self( 2025-09-07T07:58:00.7335220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7335735Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7336218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7336790Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7337033Z 2025-09-07T07:58:00.7337126Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7337627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7338105Z layer_outputs = layer_module( 2025-09-07T07:58:00.7338562Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7338918Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7339322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7339733Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7340133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7340528Z self_outputs = self.self( 2025-09-07T07:58:00.7340914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7341338Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7341828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7342401Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7342637Z 2025-09-07T07:58:00.7342718Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7342916Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7343108Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7343301Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7343511Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7344011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7344482Z layer_outputs = layer_module( 2025-09-07T07:58:00.7344806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7345148Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7345544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7346023Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7346441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7346841Z self_outputs = self.self( 2025-09-07T07:58:00.7347226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7347654Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7348145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7348681Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7349199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7349758Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7350072Z 2025-09-07T07:58:00.7350147Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7350382Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7350894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7351375Z layer_outputs = layer_module( 2025-09-07T07:58:00.7351701Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7352040Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7352515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7352927Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7353351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7353766Z self_outputs = self.self( 2025-09-07T07:58:00.7354162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7354581Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7354708Z 2025-09-07T07:58:00.7354808Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7355314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7355784Z layer_outputs = layer_module( 2025-09-07T07:58:00.7356119Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7356478Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7356889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7357312Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7357712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7358110Z self_outputs = self.self( 2025-09-07T07:58:00.7358509Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7358956Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7359079Z 2025-09-07T07:58:00.7359176Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7359669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7360143Z layer_outputs = layer_module( 2025-09-07T07:58:00.7360477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7360825Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7361246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7361666Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7362059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7362450Z self_outputs = self.self( 2025-09-07T07:58:00.7362830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7363238Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7363374Z 2025-09-07T07:58:00.7363485Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7364096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7364571Z layer_outputs = layer_module( 2025-09-07T07:58:00.7364921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7365261Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7365661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7366061Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7366546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7366966Z self_outputs = self.self( 2025-09-07T07:58:00.7367342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7367792Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7368310Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7368904Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7369314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7369646Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7369795Z 2025-09-07T07:58:00.7369888Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7370409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7370910Z layer_outputs = layer_module( 2025-09-07T07:58:00.7371259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7371614Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7372021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7372429Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7372837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7373239Z self_outputs = self.self( 2025-09-07T07:58:00.7373622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7374064Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7374590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7375137Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7375642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7376097Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7376422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7376753Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7376897Z 2025-09-07T07:58:00.7377002Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7377501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7378061Z layer_outputs = layer_module( 2025-09-07T07:58:00.7378391Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7378740Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7379149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7379551Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7379949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7380356Z self_outputs = self.self( 2025-09-07T07:58:00.7380814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7381264Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7381776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7382331Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7382539Z 2025-09-07T07:58:00.7382636Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7383140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7383616Z layer_outputs = layer_module( 2025-09-07T07:58:00.7383944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7384293Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7384698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7385110Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7385515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7385967Z self_outputs = self.self( 2025-09-07T07:58:00.7386385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7386832Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7387353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7387903Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7388098Z 2025-09-07T07:58:00.7388193Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7388698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7389169Z layer_outputs = layer_module( 2025-09-07T07:58:00.7389496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7389844Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7390238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7390646Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7391048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7391455Z self_outputs = self.self( 2025-09-07T07:58:00.7391845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7392458Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7392701Z 2025-09-07T07:58:00.7392800Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7393309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7393788Z layer_outputs = layer_module( 2025-09-07T07:58:00.7394124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7394468Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7394977Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7395401Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7395814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7396254Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7396706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7397128Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7397262Z 2025-09-07T07:58:00.7397364Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7397873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7398346Z layer_outputs = layer_module( 2025-09-07T07:58:00.7398681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7399036Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7399441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7399857Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7400246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7400636Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7401044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7401490Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7401929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7402337Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7402474Z 2025-09-07T07:58:00.7402570Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7403069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7403548Z layer_outputs = layer_module( 2025-09-07T07:58:00.7403878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7404224Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7404628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7405043Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7405442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7405908Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7406301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7406747Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7407185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7407633Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7408002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7408339Z return self.act(input) 2025-09-07T07:58:00.7408448Z 2025-09-07T07:58:00.7408612Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7409121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7409749Z layer_outputs = layer_module( 2025-09-07T07:58:00.7410073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7410425Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7410833Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7411245Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7411628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7412004Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7412406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7412863Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7413317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7413724Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7413854Z 2025-09-07T07:58:00.7413949Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7414449Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7414926Z layer_outputs = layer_module( 2025-09-07T07:58:00.7415251Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7415608Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7416016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7416439Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7416843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7417248Z self_outputs = self.self( 2025-09-07T07:58:00.7417630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7418044Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7418178Z 2025-09-07T07:58:00.7418269Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7418777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7419256Z layer_outputs = layer_module( 2025-09-07T07:58:00.7419573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7420064Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7420478Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7420894Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7421305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7421701Z self_outputs = self.self( 2025-09-07T07:58:00.7422089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7422528Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7423128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7423721Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7423967Z 2025-09-07T07:58:00.7424060Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7424567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7425049Z layer_outputs = layer_module( 2025-09-07T07:58:00.7425380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7425786Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7426190Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7426606Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7427004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7427410Z self_outputs = self.self( 2025-09-07T07:58:00.7427792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7428194Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7428328Z 2025-09-07T07:58:00.7428419Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7428919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7429393Z layer_outputs = layer_module( 2025-09-07T07:58:00.7429717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7430069Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7430477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7430893Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7431292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7431686Z self_outputs = self.self( 2025-09-07T07:58:00.7432070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7432498Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7432988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7433564Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7433800Z 2025-09-07T07:58:00.7433891Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7434472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7434951Z layer_outputs = layer_module( 2025-09-07T07:58:00.7435287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7435640Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7436037Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7436447Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7436912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7437319Z self_outputs = self.self( 2025-09-07T07:58:00.7437700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7438125Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7438617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7439185Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7439417Z 2025-09-07T07:58:00.7439513Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7440011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7440484Z layer_outputs = layer_module( 2025-09-07T07:58:00.7440809Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7441160Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7441565Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7441969Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7442363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7442761Z self_outputs = self.self( 2025-09-07T07:58:00.7443146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7443573Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7444057Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7444631Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7444872Z 2025-09-07T07:58:00.7444948Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7445152Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7445348Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7445532Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7445754Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7446264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7446747Z layer_outputs = layer_module( 2025-09-07T07:58:00.7447083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7447433Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7447843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7448353Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7448757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7449162Z self_outputs = self.self( 2025-09-07T07:58:00.7449538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7449978Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7450476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7451089Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7451610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7452144Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7452354Z 2025-09-07T07:58:00.7452429Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7452656Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7453169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7463456Z layer_outputs = layer_module( 2025-09-07T07:58:00.7463912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7464303Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7464743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7465193Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7465694Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7466159Z self_outputs = self.self( 2025-09-07T07:58:00.7466570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7466977Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7467094Z 2025-09-07T07:58:00.7467205Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7467727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7468209Z layer_outputs = layer_module( 2025-09-07T07:58:00.7468561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7468935Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7469358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7469780Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7470189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7470597Z self_outputs = self.self( 2025-09-07T07:58:00.7471009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7471410Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7471533Z 2025-09-07T07:58:00.7471632Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7472159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7472761Z layer_outputs = layer_module( 2025-09-07T07:58:00.7473093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7473436Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7473835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7474245Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7474639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7475041Z self_outputs = self.self( 2025-09-07T07:58:00.7475495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7475919Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7476059Z 2025-09-07T07:58:00.7476159Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7476665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7477137Z layer_outputs = layer_module( 2025-09-07T07:58:00.7477467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7477816Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7478217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7478624Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7479016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7479423Z self_outputs = self.self( 2025-09-07T07:58:00.7479816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7480267Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7480790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7481370Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7481786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7482131Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7482282Z 2025-09-07T07:58:00.7482385Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7482900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7483383Z layer_outputs = layer_module( 2025-09-07T07:58:00.7483738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7484109Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7484523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7484952Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7485347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7485758Z self_outputs = self.self( 2025-09-07T07:58:00.7486152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7486688Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7487207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7487741Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7488242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7488708Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7489038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7489440Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7489591Z 2025-09-07T07:58:00.7489689Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7490193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7490704Z layer_outputs = layer_module( 2025-09-07T07:58:00.7491031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7491412Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7491807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7492228Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7492634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7493037Z self_outputs = self.self( 2025-09-07T07:58:00.7493411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7493856Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7494371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7494934Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7495140Z 2025-09-07T07:58:00.7495240Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7495739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7496215Z layer_outputs = layer_module( 2025-09-07T07:58:00.7496546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7496901Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7497305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7497705Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7498115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7498516Z self_outputs = self.self( 2025-09-07T07:58:00.7498890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7499322Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7499852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7500389Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7500840Z 2025-09-07T07:58:00.7500941Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7501449Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7501925Z layer_outputs = layer_module( 2025-09-07T07:58:00.7502253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7502608Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7503019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7503499Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7503912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7504311Z self_outputs = self.self( 2025-09-07T07:58:00.7504700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7505213Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7505446Z 2025-09-07T07:58:00.7505544Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7506108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7506582Z layer_outputs = layer_module( 2025-09-07T07:58:00.7506912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7507257Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7507657Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7508063Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7508454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7508885Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7509321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7509901Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7510032Z 2025-09-07T07:58:00.7510129Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7510631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7511104Z layer_outputs = layer_module( 2025-09-07T07:58:00.7511433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7511779Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7512181Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7512590Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7512983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7513371Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7513785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7514227Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7514662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7515252Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7515387Z 2025-09-07T07:58:00.7515486Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7515987Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7516461Z layer_outputs = layer_module( 2025-09-07T07:58:00.7516799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7517150Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7517660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7518081Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7518468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7518860Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7519262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7519703Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7520139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7520579Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7520954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7521293Z return self.act(input) 2025-09-07T07:58:00.7521402Z 2025-09-07T07:58:00.7521509Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7522020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7522505Z layer_outputs = layer_module( 2025-09-07T07:58:00.7522849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7523200Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7523608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7524023Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7524423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7524808Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7525212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7525668Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7526116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7526523Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7526654Z 2025-09-07T07:58:00.7526748Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7527243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7527720Z layer_outputs = layer_module( 2025-09-07T07:58:00.7528054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7528394Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7528793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7529284Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7529684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7530083Z self_outputs = self.self( 2025-09-07T07:58:00.7530470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7530881Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7531015Z 2025-09-07T07:58:00.7531112Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7531692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7532194Z layer_outputs = layer_module( 2025-09-07T07:58:00.7532521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7532873Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7533279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7533688Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7534087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7534492Z self_outputs = self.self( 2025-09-07T07:58:00.7534882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7535322Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7535817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7536406Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7536671Z 2025-09-07T07:58:00.7536772Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7537309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7537795Z layer_outputs = layer_module( 2025-09-07T07:58:00.7538139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7538492Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7538908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7539326Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7539743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7540148Z self_outputs = self.self( 2025-09-07T07:58:00.7540533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7540945Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7541080Z 2025-09-07T07:58:00.7541178Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7541683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7542162Z layer_outputs = layer_module( 2025-09-07T07:58:00.7542493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7542929Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7543338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7543746Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7544141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7544547Z self_outputs = self.self( 2025-09-07T07:58:00.7544949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7545389Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7546029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7546622Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7546877Z 2025-09-07T07:58:00.7547212Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7547726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7548214Z layer_outputs = layer_module( 2025-09-07T07:58:00.7548559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7548919Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7549333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7549754Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7550169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7550581Z self_outputs = self.self( 2025-09-07T07:58:00.7550972Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7551419Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7551922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7552504Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7552742Z 2025-09-07T07:58:00.7552846Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7553360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7553854Z layer_outputs = layer_module( 2025-09-07T07:58:00.7554197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7554555Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7554969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7555376Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7555785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7556188Z self_outputs = self.self( 2025-09-07T07:58:00.7556587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7557020Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7557506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7558180Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7558423Z 2025-09-07T07:58:00.7558500Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7558704Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7558899Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7559085Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7559311Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7559816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7560383Z layer_outputs = layer_module( 2025-09-07T07:58:00.7560715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7561072Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7561494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7561909Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7562314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7562714Z self_outputs = self.self( 2025-09-07T07:58:00.7563095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7563535Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7564042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7564584Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7565103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7565633Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7565841Z 2025-09-07T07:58:00.7565916Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7566142Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7566650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7567125Z layer_outputs = layer_module( 2025-09-07T07:58:00.7567470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7567829Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7568243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7568658Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7568940Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7569009Z self_outputs = self.self( 2025-09-07T07:58:00.7569296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7569363Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7569366Z 2025-09-07T07:58:00.7569470Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7569826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7569892Z layer_outputs = layer_module( 2025-09-07T07:58:00.7570206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7570278Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7570557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7570625Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7570907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7570971Z self_outputs = self.self( 2025-09-07T07:58:00.7571319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7571401Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7571404Z 2025-09-07T07:58:00.7571495Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7571855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7571918Z layer_outputs = layer_module( 2025-09-07T07:58:00.7572130Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7572210Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7572494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7572568Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7572845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7572915Z self_outputs = self.self( 2025-09-07T07:58:00.7573192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7573274Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7573279Z 2025-09-07T07:58:00.7573378Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7573728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7573799Z layer_outputs = layer_module( 2025-09-07T07:58:00.7574011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7574079Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7574368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7574436Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7574719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7574784Z self_outputs = self.self( 2025-09-07T07:58:00.7575065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7575180Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7575533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7575710Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7575900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7576001Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7576005Z 2025-09-07T07:58:00.7576169Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7576522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7576585Z layer_outputs = layer_module( 2025-09-07T07:58:00.7576799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7576876Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7577152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7577226Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7577577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7577641Z self_outputs = self.self( 2025-09-07T07:58:00.7577925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7578029Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7578388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7578515Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7578839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7578924Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7579110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7579202Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7579208Z 2025-09-07T07:58:00.7579298Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7579655Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7579718Z layer_outputs = layer_module( 2025-09-07T07:58:00.7579937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7580010Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7580290Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7580366Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7580647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7580715Z self_outputs = self.self( 2025-09-07T07:58:00.7580990Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7581091Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7581448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7581596Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7581599Z 2025-09-07T07:58:00.7581698Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7582044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7582116Z layer_outputs = layer_module( 2025-09-07T07:58:00.7582326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7582469Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7582754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7582822Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7583107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7583169Z self_outputs = self.self( 2025-09-07T07:58:00.7583445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7583627Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7583980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7584125Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7584128Z 2025-09-07T07:58:00.7584218Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7584571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7584633Z layer_outputs = layer_module( 2025-09-07T07:58:00.7584847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7584922Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7585202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7585276Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7585551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7585681Z self_outputs = self.self( 2025-09-07T07:58:00.7585962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7586144Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7586148Z 2025-09-07T07:58:00.7586246Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7586594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7586669Z layer_outputs = layer_module( 2025-09-07T07:58:00.7586879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7586955Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7587234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7587300Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7587586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7587692Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7587979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7588056Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7588060Z 2025-09-07T07:58:00.7588155Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7588511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7588654Z layer_outputs = layer_module( 2025-09-07T07:58:00.7588875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7588945Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7589227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7589306Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7589567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7589648Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7590015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7590128Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7590408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7590481Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7590493Z 2025-09-07T07:58:00.7590587Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7590936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7591010Z layer_outputs = layer_module( 2025-09-07T07:58:00.7591220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7591296Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7591569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7591646Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7591907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7591974Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7592261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7592356Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7592636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7592745Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7592960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7593033Z return self.act(input) 2025-09-07T07:58:00.7593039Z 2025-09-07T07:58:00.7593129Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7593482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7593546Z layer_outputs = layer_module( 2025-09-07T07:58:00.7593760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7593836Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7594111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7594192Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7594448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7594522Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7594877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7594995Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7595277Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7595349Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7595352Z 2025-09-07T07:58:00.7595450Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7595870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7595940Z layer_outputs = layer_module( 2025-09-07T07:58:00.7596156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7596226Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7596504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7596572Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7596849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7596913Z self_outputs = self.self( 2025-09-07T07:58:00.7597187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7597265Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7597268Z 2025-09-07T07:58:00.7597360Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7597709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7597774Z layer_outputs = layer_module( 2025-09-07T07:58:00.7597985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7598052Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7598328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7598403Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7598678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7598741Z self_outputs = self.self( 2025-09-07T07:58:00.7599014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7599107Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7599452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7599632Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7599636Z 2025-09-07T07:58:00.7599730Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7600074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7600141Z layer_outputs = layer_module( 2025-09-07T07:58:00.7600355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7600420Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7600698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7600845Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7601126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7601185Z self_outputs = self.self( 2025-09-07T07:58:00.7601458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7601533Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7601537Z 2025-09-07T07:58:00.7601625Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7602049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7602110Z layer_outputs = layer_module( 2025-09-07T07:58:00.7602327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7602394Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7602665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7602736Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7603007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7603072Z self_outputs = self.self( 2025-09-07T07:58:00.7603343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7603439Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7603783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7603951Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7603955Z 2025-09-07T07:58:00.7604047Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7604391Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7604460Z layer_outputs = layer_module( 2025-09-07T07:58:00.7604670Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7604737Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7605016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7605080Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7605361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7605420Z self_outputs = self.self( 2025-09-07T07:58:00.7605699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7605784Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7606117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7606285Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7606288Z 2025-09-07T07:58:00.7606377Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7606723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7606860Z layer_outputs = layer_module( 2025-09-07T07:58:00.7607077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7607143Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7607414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7607483Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7607757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7607824Z self_outputs = self.self( 2025-09-07T07:58:00.7608165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7608256Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7608598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7608765Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7608769Z 2025-09-07T07:58:00.7608847Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7608916Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7608990Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7609056Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7609145Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7609496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7609559Z layer_outputs = layer_module( 2025-09-07T07:58:00.7609921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7609994Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7610271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7610344Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7610617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7610682Z self_outputs = self.self( 2025-09-07T07:58:00.7610954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7611065Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7611404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7611543Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7611870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7612009Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7612013Z 2025-09-07T07:58:00.7612090Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7612181Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7612534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7612600Z layer_outputs = layer_module( 2025-09-07T07:58:00.7612815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7613031Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7613306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7613375Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7613650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7613711Z self_outputs = self.self( 2025-09-07T07:58:00.7614002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7614070Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7614074Z 2025-09-07T07:58:00.7614268Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7614629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7614702Z layer_outputs = layer_module( 2025-09-07T07:58:00.7614922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7614994Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7615277Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7615347Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7615625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7615690Z self_outputs = self.self( 2025-09-07T07:58:00.7615968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7616047Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7616050Z 2025-09-07T07:58:00.7616139Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7616490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7616551Z layer_outputs = layer_module( 2025-09-07T07:58:00.7616766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7616833Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7617109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7617183Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7617456Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7617520Z self_outputs = self.self( 2025-09-07T07:58:00.7617790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7617864Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7617867Z 2025-09-07T07:58:00.7617961Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7618308Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7618372Z layer_outputs = layer_module( 2025-09-07T07:58:00.7618582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7618654Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7618936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7619077Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7619355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7619415Z self_outputs = self.self( 2025-09-07T07:58:00.7619691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7619799Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7620149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7620388Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7620579Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7620673Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7620677Z 2025-09-07T07:58:00.7620766Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7621115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7621178Z layer_outputs = layer_module( 2025-09-07T07:58:00.7621387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7621457Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7621734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7621802Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7622074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7622141Z self_outputs = self.self( 2025-09-07T07:58:00.7622419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7622520Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7622876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7623001Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7623320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7623400Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7623579Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7623670Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7623673Z 2025-09-07T07:58:00.7623762Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7624112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7624174Z layer_outputs = layer_module( 2025-09-07T07:58:00.7624386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7624452Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7624726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7624797Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7625072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7625232Z self_outputs = self.self( 2025-09-07T07:58:00.7625504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7625648Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7626004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7626148Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7626152Z 2025-09-07T07:58:00.7626245Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7626661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7626731Z layer_outputs = layer_module( 2025-09-07T07:58:00.7626942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7627011Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7627290Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7627357Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7627636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7627700Z self_outputs = self.self( 2025-09-07T07:58:00.7627983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7628082Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7628432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7628569Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7628572Z 2025-09-07T07:58:00.7628662Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7629013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7629074Z layer_outputs = layer_module( 2025-09-07T07:58:00.7629289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7629358Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7629633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7629705Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7629982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7630047Z self_outputs = self.self( 2025-09-07T07:58:00.7630319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7630494Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7630501Z 2025-09-07T07:58:00.7630592Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7630938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7631001Z layer_outputs = layer_module( 2025-09-07T07:58:00.7631210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7631350Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7631627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7631695Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7631973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7632073Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7632423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7632504Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7632508Z 2025-09-07T07:58:00.7632601Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7632953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7633017Z layer_outputs = layer_module( 2025-09-07T07:58:00.7633237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7633302Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7633577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7633651Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7633911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7633987Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7634271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7634377Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7634651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7634728Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7634731Z 2025-09-07T07:58:00.7634819Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7635162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7635227Z layer_outputs = layer_module( 2025-09-07T07:58:00.7635441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7635511Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7635786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7635858Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7636114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7636182Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7636466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7636559Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7636840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7636941Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7637147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7637302Z return self.act(input) 2025-09-07T07:58:00.7637306Z 2025-09-07T07:58:00.7637394Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7637744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7637804Z layer_outputs = layer_module( 2025-09-07T07:58:00.7638018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7638083Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7638426Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7638506Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7638756Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7638830Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7639106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7639219Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7639497Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7639568Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7639572Z 2025-09-07T07:58:00.7639666Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7640018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7640081Z layer_outputs = layer_module( 2025-09-07T07:58:00.7640293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7640362Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7640640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7640705Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7640982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7641041Z self_outputs = self.self( 2025-09-07T07:58:00.7641318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7641394Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7641397Z 2025-09-07T07:58:00.7641483Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7641833Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7641894Z layer_outputs = layer_module( 2025-09-07T07:58:00.7642108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7642172Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7642446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7642518Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7642792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7642855Z self_outputs = self.self( 2025-09-07T07:58:00.7643127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7643297Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7643645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7643823Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7643826Z 2025-09-07T07:58:00.7643918Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7644263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7644411Z layer_outputs = layer_module( 2025-09-07T07:58:00.7644629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7644697Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7644981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7645049Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7645327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7645388Z self_outputs = self.self( 2025-09-07T07:58:00.7645668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7645739Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7645742Z 2025-09-07T07:58:00.7645833Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7646183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7646248Z layer_outputs = layer_module( 2025-09-07T07:58:00.7646463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7646530Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7646804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7646875Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7647151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7647216Z self_outputs = self.self( 2025-09-07T07:58:00.7647495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7647589Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7647928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7648098Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7648102Z 2025-09-07T07:58:00.7648195Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7648541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7648608Z layer_outputs = layer_module( 2025-09-07T07:58:00.7648820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7648889Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7649162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7649305Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7649586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7649646Z self_outputs = self.self( 2025-09-07T07:58:00.7649922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7650008Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7650359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7650597Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7650601Z 2025-09-07T07:58:00.7650689Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7651042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7651105Z layer_outputs = layer_module( 2025-09-07T07:58:00.7651316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7651383Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7651654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7651725Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7652000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7652064Z self_outputs = self.self( 2025-09-07T07:58:00.7652334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7652428Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7652764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7652935Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7652938Z 2025-09-07T07:58:00.7653016Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7653084Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7653157Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7653225Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7653321Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7653677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7653743Z layer_outputs = layer_module( 2025-09-07T07:58:00.7653964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7654036Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7654315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7654387Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7654665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7654732Z self_outputs = self.self( 2025-09-07T07:58:00.7655017Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7655122Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7655546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7655684Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7656009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7656147Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7656150Z 2025-09-07T07:58:00.7656224Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7656318Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7656756Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7656824Z layer_outputs = layer_module( 2025-09-07T07:58:00.7657038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7657112Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7657393Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7657466Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7657741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7657802Z self_outputs = self.self( 2025-09-07T07:58:00.7658082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7658150Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7658156Z 2025-09-07T07:58:00.7658249Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7658598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7658663Z layer_outputs = layer_module( 2025-09-07T07:58:00.7658873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7658952Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7659246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7659324Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7659604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7659669Z self_outputs = self.self( 2025-09-07T07:58:00.7659942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7660018Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7660021Z 2025-09-07T07:58:00.7660110Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7660464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7660525Z layer_outputs = layer_module( 2025-09-07T07:58:00.7660738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7660805Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7661083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7661154Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7661557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7661624Z self_outputs = self.self( 2025-09-07T07:58:00.7661903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7661978Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7661985Z 2025-09-07T07:58:00.7662076Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7662423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7662494Z layer_outputs = layer_module( 2025-09-07T07:58:00.7662773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7662848Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7663127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7663194Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7663472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7663534Z self_outputs = self.self( 2025-09-07T07:58:00.7663812Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7663920Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7664277Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7664443Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7664631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7664724Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7664727Z 2025-09-07T07:58:00.7664818Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7665169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7665231Z layer_outputs = layer_module( 2025-09-07T07:58:00.7665440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7665512Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7665844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7665922Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7666200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7666271Z self_outputs = self.self( 2025-09-07T07:58:00.7666545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7666652Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7667004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7667132Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7667454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7667604Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7667794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7667879Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7667883Z 2025-09-07T07:58:00.7667976Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7668335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7668398Z layer_outputs = layer_module( 2025-09-07T07:58:00.7668616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7668757Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7669040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7669116Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7669392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7669461Z self_outputs = self.self( 2025-09-07T07:58:00.7669733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7669837Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7670185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7670330Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7670335Z 2025-09-07T07:58:00.7670433Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7670778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7670849Z layer_outputs = layer_module( 2025-09-07T07:58:00.7671060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7671131Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7671409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7671477Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7671754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7671816Z self_outputs = self.self( 2025-09-07T07:58:00.7672093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7672197Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7672540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7672682Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7672685Z 2025-09-07T07:58:00.7672773Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7673125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7673186Z layer_outputs = layer_module( 2025-09-07T07:58:00.7673403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7673468Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7673820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7673893Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7674169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7674232Z self_outputs = self.self( 2025-09-07T07:58:00.7674509Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7674688Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7674691Z 2025-09-07T07:58:00.7674849Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7675200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7675270Z layer_outputs = layer_module( 2025-09-07T07:58:00.7675482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7675555Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7675828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7675892Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7676170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7676270Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7676555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7676630Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7676636Z 2025-09-07T07:58:00.7676729Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7677073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7677136Z layer_outputs = layer_module( 2025-09-07T07:58:00.7677351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7677418Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7677699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7677775Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7678034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7678110Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7678393Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7678498Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7678772Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7678849Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7678852Z 2025-09-07T07:58:00.7678939Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7679286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7679352Z layer_outputs = layer_module( 2025-09-07T07:58:00.7679564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7679714Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7679990Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7680067Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7680319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7680386Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7680667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7680857Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7681142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7681250Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7681459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7681526Z return self.act(input) 2025-09-07T07:58:00.7681529Z 2025-09-07T07:58:00.7681621Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7681970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7682032Z layer_outputs = layer_module( 2025-09-07T07:58:00.7682249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7682317Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7682592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7682670Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7682919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7682989Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7683265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7683379Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7683660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7683732Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7683735Z 2025-09-07T07:58:00.7683828Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7684175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7684243Z layer_outputs = layer_module( 2025-09-07T07:58:00.7684454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7684522Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7684801Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7684867Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7685146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7685207Z self_outputs = self.self( 2025-09-07T07:58:00.7685482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7685642Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7685645Z 2025-09-07T07:58:00.7685734Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7686085Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7686146Z layer_outputs = layer_module( 2025-09-07T07:58:00.7686360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7686427Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7686698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7686833Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7687113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7687181Z self_outputs = self.self( 2025-09-07T07:58:00.7687453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7687547Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7687888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7688067Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7688070Z 2025-09-07T07:58:00.7688164Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7688511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7688578Z layer_outputs = layer_module( 2025-09-07T07:58:00.7688789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7688860Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7689135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7689201Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7689479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7689542Z self_outputs = self.self( 2025-09-07T07:58:00.7689820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7689893Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7689896Z 2025-09-07T07:58:00.7689986Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7690340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7690403Z layer_outputs = layer_module( 2025-09-07T07:58:00.7690617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7690683Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7690960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7691025Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7691301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7691367Z self_outputs = self.self( 2025-09-07T07:58:00.7691642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7691803Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7692142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7692311Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7692318Z 2025-09-07T07:58:00.7692409Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7692760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7692903Z layer_outputs = layer_module( 2025-09-07T07:58:00.7693120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7693191Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7693468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7693536Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7693817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7693876Z self_outputs = self.self( 2025-09-07T07:58:00.7694152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7694238Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7694580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7694747Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7694754Z 2025-09-07T07:58:00.7694843Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7695195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7695258Z layer_outputs = layer_module( 2025-09-07T07:58:00.7695471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7695537Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7695810Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7695883Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7696156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7696223Z self_outputs = self.self( 2025-09-07T07:58:00.7696495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7696585Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7696921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7697087Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7697090Z 2025-09-07T07:58:00.7697168Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7697237Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7697313Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7697381Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7697469Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7697889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7697954Z layer_outputs = layer_module( 2025-09-07T07:58:00.7698169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7698236Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7698515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7698583Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7698927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7698993Z self_outputs = self.self( 2025-09-07T07:58:00.7699268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7699374Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7699709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7699843Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7700170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7700308Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7700312Z 2025-09-07T07:58:00.7700386Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7700476Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7700823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7700889Z layer_outputs = layer_module( 2025-09-07T07:58:00.7701099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7701171Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7701444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7701514Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7701789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7701854Z self_outputs = self.self( 2025-09-07T07:58:00.7702131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7702197Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7702200Z 2025-09-07T07:58:00.7702292Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7702636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7702700Z layer_outputs = layer_module( 2025-09-07T07:58:00.7702911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7702980Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7703258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7703326Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7703604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7703749Z self_outputs = self.self( 2025-09-07T07:58:00.7704029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7704100Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7704103Z 2025-09-07T07:58:00.7704192Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7704540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7704601Z layer_outputs = layer_module( 2025-09-07T07:58:00.7704815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7704946Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7705225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7705297Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7705572Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7705701Z self_outputs = self.self( 2025-09-07T07:58:00.7705979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7706058Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7706062Z 2025-09-07T07:58:00.7706151Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7706503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7706570Z layer_outputs = layer_module( 2025-09-07T07:58:00.7706784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7706858Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7707130Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7707196Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7707472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7707531Z self_outputs = self.self( 2025-09-07T07:58:00.7707808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7707919Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7708276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7708443Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7708628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7708723Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7708727Z 2025-09-07T07:58:00.7708816Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7709166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7709230Z layer_outputs = layer_module( 2025-09-07T07:58:00.7709446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7709515Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7709960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7710170Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7710464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7710532Z self_outputs = self.self( 2025-09-07T07:58:00.7710808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7710917Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7711368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7711499Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7711826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7711909Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7712101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7712189Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7712193Z 2025-09-07T07:58:00.7712287Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7712643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7712709Z layer_outputs = layer_module( 2025-09-07T07:58:00.7712937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7713007Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7713291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7713367Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7713645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7713711Z self_outputs = self.self( 2025-09-07T07:58:00.7713984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7714091Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7714442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7714586Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7714596Z 2025-09-07T07:58:00.7714688Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7715036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7715103Z layer_outputs = layer_module( 2025-09-07T07:58:00.7715314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7715385Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7715658Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7715724Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7716004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7716065Z self_outputs = self.self( 2025-09-07T07:58:00.7716421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7716523Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7716877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7717016Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7717019Z 2025-09-07T07:58:00.7717109Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7717529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7717595Z layer_outputs = layer_module( 2025-09-07T07:58:00.7717822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7717894Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7718173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7718248Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7718526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7718591Z self_outputs = self.self( 2025-09-07T07:58:00.7718864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7719049Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7719052Z 2025-09-07T07:58:00.7719145Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7719500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7719568Z layer_outputs = layer_module( 2025-09-07T07:58:00.7719777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7719853Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7720124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7720201Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7720480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7720583Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7720861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7720939Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7720943Z 2025-09-07T07:58:00.7721037Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7721384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7721446Z layer_outputs = layer_module( 2025-09-07T07:58:00.7721659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7721725Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7722006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7722077Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7722420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7722488Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7722771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7722876Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7723149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7723226Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7723230Z 2025-09-07T07:58:00.7723320Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7723737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7723814Z layer_outputs = layer_module( 2025-09-07T07:58:00.7724029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7724104Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7724375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7724454Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7724710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7724776Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7725063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7725157Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7725437Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7725542Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7725757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7725822Z return self.act(input) 2025-09-07T07:58:00.7725825Z 2025-09-07T07:58:00.7725916Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7726271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7726335Z layer_outputs = layer_module( 2025-09-07T07:58:00.7726552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7726621Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7726897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7726976Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7727229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7727302Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7727581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7727700Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7727981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7728056Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7728059Z 2025-09-07T07:58:00.7728155Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7728596Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7728665Z layer_outputs = layer_module( 2025-09-07T07:58:00.7728877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7728947Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7729227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7729297Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7729646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7729711Z self_outputs = self.self( 2025-09-07T07:58:00.7729995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7730071Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7730074Z 2025-09-07T07:58:00.7730163Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7730518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7730581Z layer_outputs = layer_module( 2025-09-07T07:58:00.7730799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7730865Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7731144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7731217Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7731497Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7731565Z self_outputs = self.self( 2025-09-07T07:58:00.7731841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7731939Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7732279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7732465Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7732468Z 2025-09-07T07:58:00.7732564Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7732914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7732986Z layer_outputs = layer_module( 2025-09-07T07:58:00.7733195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7733270Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7733547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7733614Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7733893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7733954Z self_outputs = self.self( 2025-09-07T07:58:00.7734237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7734309Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7734381Z 2025-09-07T07:58:00.7734471Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7734825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7734892Z layer_outputs = layer_module( 2025-09-07T07:58:00.7735119Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7735193Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7735480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7735620Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7735904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7743585Z self_outputs = self.self( 2025-09-07T07:58:00.7743933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7744038Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7744409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7744594Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7744599Z 2025-09-07T07:58:00.7744708Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7745101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7745174Z layer_outputs = layer_module( 2025-09-07T07:58:00.7745402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7745486Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7745852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7745929Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7746218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7746284Z self_outputs = self.self( 2025-09-07T07:58:00.7746565Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7746668Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7747014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7747204Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7747208Z 2025-09-07T07:58:00.7747305Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7747662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7747730Z layer_outputs = layer_module( 2025-09-07T07:58:00.7747951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7748027Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7748309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7748383Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7748779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7748848Z self_outputs = self.self( 2025-09-07T07:58:00.7749124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7749215Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7749559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7749732Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7749735Z 2025-09-07T07:58:00.7749938Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7750012Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7750083Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7750156Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7750248Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7750601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7750666Z layer_outputs = layer_module( 2025-09-07T07:58:00.7750881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7750952Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7751230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7751307Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7751579Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7751645Z self_outputs = self.self( 2025-09-07T07:58:00.7751936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7752037Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7752384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7752521Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7752848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7752994Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7752998Z 2025-09-07T07:58:00.7753074Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7753168Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7753523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7753588Z layer_outputs = layer_module( 2025-09-07T07:58:00.7753803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7753878Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7754151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7754221Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7754500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7754561Z self_outputs = self.self( 2025-09-07T07:58:00.7754838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7754967Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7754970Z 2025-09-07T07:58:00.7755064Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7755408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7755472Z layer_outputs = layer_module( 2025-09-07T07:58:00.7755687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7755757Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7756111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7756180Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7756459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7756522Z self_outputs = self.self( 2025-09-07T07:58:00.7756795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7756870Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7756874Z 2025-09-07T07:58:00.7756962Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7757313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7757373Z layer_outputs = layer_module( 2025-09-07T07:58:00.7757587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7757659Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7757935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7758004Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7758278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7758340Z self_outputs = self.self( 2025-09-07T07:58:00.7758615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7758693Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7758697Z 2025-09-07T07:58:00.7758792Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7759140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7759209Z layer_outputs = layer_module( 2025-09-07T07:58:00.7759420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7759490Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7759766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7759832Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7760108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7760169Z self_outputs = self.self( 2025-09-07T07:58:00.7760450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7760561Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7760977Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7761153Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7761342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7761439Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7761444Z 2025-09-07T07:58:00.7761536Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7761884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7762009Z layer_outputs = layer_module( 2025-09-07T07:58:00.7762226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7762304Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7762580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7762651Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7762924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7762985Z self_outputs = self.self( 2025-09-07T07:58:00.7763260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7763368Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7763724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7763857Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7764180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7764262Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7764442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7764532Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7764536Z 2025-09-07T07:58:00.7764625Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7764980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7765041Z layer_outputs = layer_module( 2025-09-07T07:58:00.7765252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7765325Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7765599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7765671Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7765945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7766011Z self_outputs = self.self( 2025-09-07T07:58:00.7766284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7766385Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7766736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7766943Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7766946Z 2025-09-07T07:58:00.7767042Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7767386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7767452Z layer_outputs = layer_module( 2025-09-07T07:58:00.7767662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7767732Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7768073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7768139Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7768421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7768485Z self_outputs = self.self( 2025-09-07T07:58:00.7768756Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7768858Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7769202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7769340Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7769344Z 2025-09-07T07:58:00.7769430Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7769778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7769843Z layer_outputs = layer_module( 2025-09-07T07:58:00.7770056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7770130Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7770417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7770489Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7770763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7770826Z self_outputs = self.self( 2025-09-07T07:58:00.7771098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7771277Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7771282Z 2025-09-07T07:58:00.7771372Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7771717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7771784Z layer_outputs = layer_module( 2025-09-07T07:58:00.7771992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7772057Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7772330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7772396Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7772677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7772778Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7773121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7773197Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7773200Z 2025-09-07T07:58:00.7773291Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7773640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7773703Z layer_outputs = layer_module( 2025-09-07T07:58:00.7773918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7774051Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7774336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7774413Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7774672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7774745Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7775027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7775133Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7775406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7775478Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7775484Z 2025-09-07T07:58:00.7775579Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7775923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7775992Z layer_outputs = layer_module( 2025-09-07T07:58:00.7776201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7776275Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7776548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7776621Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7776880Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7776950Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7777230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7777326Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7777599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7777710Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7777917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7777985Z return self.act(input) 2025-09-07T07:58:00.7777989Z 2025-09-07T07:58:00.7778077Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7778429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7778490Z layer_outputs = layer_module( 2025-09-07T07:58:00.7778700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7778832Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7779105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7779181Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7779433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7779498Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7779778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7779891Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7780527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7780604Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7780608Z 2025-09-07T07:58:00.7780702Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7781049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7781113Z layer_outputs = layer_module( 2025-09-07T07:58:00.7781333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7781402Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7781679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7781749Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7782025Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7782091Z self_outputs = self.self( 2025-09-07T07:58:00.7782365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7782442Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7782446Z 2025-09-07T07:58:00.7782533Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7782882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7782943Z layer_outputs = layer_module( 2025-09-07T07:58:00.7783154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7783231Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7783504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7783578Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7783850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7783916Z self_outputs = self.self( 2025-09-07T07:58:00.7784189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7784278Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7784625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7784809Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7784812Z 2025-09-07T07:58:00.7784911Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7785330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7785401Z layer_outputs = layer_module( 2025-09-07T07:58:00.7785672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7785742Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7786020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7786088Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7786425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7786486Z self_outputs = self.self( 2025-09-07T07:58:00.7786761Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7786842Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7786846Z 2025-09-07T07:58:00.7786935Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7787286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7787347Z layer_outputs = layer_module( 2025-09-07T07:58:00.7787560Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7787627Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7787903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7787972Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7788245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7788316Z self_outputs = self.self( 2025-09-07T07:58:00.7788589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7788677Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7789018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7789189Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7789192Z 2025-09-07T07:58:00.7789288Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7789634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7789701Z layer_outputs = layer_module( 2025-09-07T07:58:00.7789909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7789975Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7790256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7790324Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7790604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7790666Z self_outputs = self.self( 2025-09-07T07:58:00.7790947Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7791033Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7791437Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7791609Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7791613Z 2025-09-07T07:58:00.7791702Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7792055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7792117Z layer_outputs = layer_module( 2025-09-07T07:58:00.7792328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7792464Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7792741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7792816Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7793086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7793152Z self_outputs = self.self( 2025-09-07T07:58:00.7793425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7793511Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7793850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7794020Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7794023Z 2025-09-07T07:58:00.7794103Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7794176Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7794250Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7794328Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7794418Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7794767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7794830Z layer_outputs = layer_module( 2025-09-07T07:58:00.7795046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7795127Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7795411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7795478Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7795749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7795813Z self_outputs = self.self( 2025-09-07T07:58:00.7796083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7796181Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7796514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7796651Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7796973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7797111Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7797178Z 2025-09-07T07:58:00.7797249Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7797339Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7797683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7797746Z layer_outputs = layer_module( 2025-09-07T07:58:00.7797957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7798026Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7798298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7798422Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7798699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7798761Z self_outputs = self.self( 2025-09-07T07:58:00.7799034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7799098Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7799101Z 2025-09-07T07:58:00.7799190Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7799531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7799592Z layer_outputs = layer_module( 2025-09-07T07:58:00.7799805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7799871Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7800144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7800212Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7800484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7800545Z self_outputs = self.self( 2025-09-07T07:58:00.7800818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7800889Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7800892Z 2025-09-07T07:58:00.7800979Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7801325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7801385Z layer_outputs = layer_module( 2025-09-07T07:58:00.7801594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7801664Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7801938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7802005Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7802276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7802336Z self_outputs = self.self( 2025-09-07T07:58:00.7802606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7802680Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7802684Z 2025-09-07T07:58:00.7802772Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7803114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7803253Z layer_outputs = layer_module( 2025-09-07T07:58:00.7803461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7803528Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7803803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7803868Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7804142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7804261Z self_outputs = self.self( 2025-09-07T07:58:00.7804538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7804649Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7804995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7805163Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7805348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7805436Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7805440Z 2025-09-07T07:58:00.7805529Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7805878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7805938Z layer_outputs = layer_module( 2025-09-07T07:58:00.7806150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7806219Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7806493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7806562Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7806837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7806895Z self_outputs = self.self( 2025-09-07T07:58:00.7807177Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7807284Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7807637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7807767Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7808090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7808172Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7808352Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7808442Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7808446Z 2025-09-07T07:58:00.7808534Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7808889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7808949Z layer_outputs = layer_module( 2025-09-07T07:58:00.7809226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7809300Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7809574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7809828Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7810103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7810169Z self_outputs = self.self( 2025-09-07T07:58:00.7810563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7810667Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7811021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7811168Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7811172Z 2025-09-07T07:58:00.7811268Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7811614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7811683Z layer_outputs = layer_module( 2025-09-07T07:58:00.7811894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7811966Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7812247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7812316Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7812595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7812656Z self_outputs = self.self( 2025-09-07T07:58:00.7812930Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7813036Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7813383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7813526Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7813530Z 2025-09-07T07:58:00.7813620Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7813974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7814041Z layer_outputs = layer_module( 2025-09-07T07:58:00.7814252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7814325Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7814605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7814679Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7814954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7815026Z self_outputs = self.self( 2025-09-07T07:58:00.7815301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7815579Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7815583Z 2025-09-07T07:58:00.7815690Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7816043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7816113Z layer_outputs = layer_module( 2025-09-07T07:58:00.7816328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7816402Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7816748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7816821Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7817104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7817213Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7817494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7817571Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7817574Z 2025-09-07T07:58:00.7817665Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7818018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7818079Z layer_outputs = layer_module( 2025-09-07T07:58:00.7818298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7818366Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7818649Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7818725Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7818984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7819059Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7819342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7819449Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7819729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7819803Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7819806Z 2025-09-07T07:58:00.7819907Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7820252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7820319Z layer_outputs = layer_module( 2025-09-07T07:58:00.7820529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7820604Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7820876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7820949Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7821212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7821278Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7821632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7821727Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7822003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7822111Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7822321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7822394Z return self.act(input) 2025-09-07T07:58:00.7822397Z 2025-09-07T07:58:00.7822486Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7822899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7822964Z layer_outputs = layer_module( 2025-09-07T07:58:00.7823181Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7823254Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7823529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7823608Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7823863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7823931Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7824224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7824338Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7824619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7824693Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7824697Z 2025-09-07T07:58:00.7824793Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7825141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7825204Z layer_outputs = layer_module( 2025-09-07T07:58:00.7825423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7825489Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7825827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7825902Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7826186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7826248Z self_outputs = self.self( 2025-09-07T07:58:00.7826523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7826602Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7826605Z 2025-09-07T07:58:00.7826696Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7827047Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7827109Z layer_outputs = layer_module( 2025-09-07T07:58:00.7827326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7827401Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7827761Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7827834Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7828107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7828176Z self_outputs = self.self( 2025-09-07T07:58:00.7828448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7828540Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7828946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7829132Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7829139Z 2025-09-07T07:58:00.7829238Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7829584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7829650Z layer_outputs = layer_module( 2025-09-07T07:58:00.7829862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7829929Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7830207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7830276Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7830557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7830622Z self_outputs = self.self( 2025-09-07T07:58:00.7830895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7830974Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7830977Z 2025-09-07T07:58:00.7831067Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7831419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7831480Z layer_outputs = layer_module( 2025-09-07T07:58:00.7831697Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7831769Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7832046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7832120Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7832395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7832462Z self_outputs = self.self( 2025-09-07T07:58:00.7832735Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7832825Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7833167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7833341Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7833344Z 2025-09-07T07:58:00.7833440Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7833851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7833919Z layer_outputs = layer_module( 2025-09-07T07:58:00.7834132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7834199Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7834480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7834547Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7834892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7834955Z self_outputs = self.self( 2025-09-07T07:58:00.7835232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7835322Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7835656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7835832Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7835836Z 2025-09-07T07:58:00.7835924Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7836275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7836338Z layer_outputs = layer_module( 2025-09-07T07:58:00.7836557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7836626Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7836905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7836977Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7837251Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7837317Z self_outputs = self.self( 2025-09-07T07:58:00.7837590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7837675Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7838016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7838184Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7838189Z 2025-09-07T07:58:00.7838270Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7838340Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7838416Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7838485Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7838573Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7838921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7838982Z layer_outputs = layer_module( 2025-09-07T07:58:00.7839200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7839271Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7839547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7839692Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7839967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7840034Z self_outputs = self.self( 2025-09-07T07:58:00.7840307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7840410Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7840749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7840958Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7841288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7841429Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7841432Z 2025-09-07T07:58:00.7841506Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7841594Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7841941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7842008Z layer_outputs = layer_module( 2025-09-07T07:58:00.7842218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7842293Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7842569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7842640Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7842919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7842981Z self_outputs = self.self( 2025-09-07T07:58:00.7843261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7843326Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7843329Z 2025-09-07T07:58:00.7843425Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7843773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7843838Z layer_outputs = layer_module( 2025-09-07T07:58:00.7844056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7844124Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7844407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7844476Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7844754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7844817Z self_outputs = self.self( 2025-09-07T07:58:00.7845092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7845168Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7845171Z 2025-09-07T07:58:00.7845262Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7845613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7845746Z layer_outputs = layer_module( 2025-09-07T07:58:00.7845958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7846031Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7846305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7846378Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7846652Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7846719Z self_outputs = self.self( 2025-09-07T07:58:00.7847109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7847185Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7847191Z 2025-09-07T07:58:00.7847288Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7847632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7847700Z layer_outputs = layer_module( 2025-09-07T07:58:00.7847910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7847979Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7848260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7848328Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7848611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7848673Z self_outputs = self.self( 2025-09-07T07:58:00.7848952Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7849058Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7849407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7849577Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7849759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7849852Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7849855Z 2025-09-07T07:58:00.7849948Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7850301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7850367Z layer_outputs = layer_module( 2025-09-07T07:58:00.7850578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7850650Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7850924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7850996Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7851272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7851332Z self_outputs = self.self( 2025-09-07T07:58:00.7851612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7851716Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7852141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7852268Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7852590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7852673Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7852851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7852942Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7853006Z 2025-09-07T07:58:00.7853098Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7853452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7853518Z layer_outputs = layer_module( 2025-09-07T07:58:00.7853733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7853801Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7854075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7854146Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7854419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7854490Z self_outputs = self.self( 2025-09-07T07:58:00.7854765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7854870Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7855224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7855366Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7855369Z 2025-09-07T07:58:00.7855467Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7855810Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7855881Z layer_outputs = layer_module( 2025-09-07T07:58:00.7856093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7856162Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7856439Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7856506Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7856787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7856850Z self_outputs = self.self( 2025-09-07T07:58:00.7857126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7857234Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7857581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7857722Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7857726Z 2025-09-07T07:58:00.7857885Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7858238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7858301Z layer_outputs = layer_module( 2025-09-07T07:58:00.7858513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7858586Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7858861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7858933Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7859270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7859343Z self_outputs = self.self( 2025-09-07T07:58:00.7859619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7859792Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7859796Z 2025-09-07T07:58:00.7859890Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7860235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7860301Z layer_outputs = layer_module( 2025-09-07T07:58:00.7860511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7860584Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7860861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7860930Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7861207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7861308Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7861587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7861661Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7861664Z 2025-09-07T07:58:00.7861753Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7862103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7862166Z layer_outputs = layer_module( 2025-09-07T07:58:00.7862379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7862451Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7862728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7862800Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7863056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7863126Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7863407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7863512Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7863783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7863921Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7863927Z 2025-09-07T07:58:00.7864016Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7864363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7864427Z layer_outputs = layer_module( 2025-09-07T07:58:00.7864638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7864706Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7864977Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7865119Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7865378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7865449Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7865794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7865889Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7866166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7866267Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7866476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7866541Z return self.act(input) 2025-09-07T07:58:00.7866548Z 2025-09-07T07:58:00.7866639Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7866990Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7867054Z layer_outputs = layer_module( 2025-09-07T07:58:00.7867264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7867336Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7867611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7867686Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7867935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7868007Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7868285Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7868399Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7868677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7868747Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7868750Z 2025-09-07T07:58:00.7868842Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7869186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7869248Z layer_outputs = layer_module( 2025-09-07T07:58:00.7869465Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7869531Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7869808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7869956Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7870234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7870294Z self_outputs = self.self( 2025-09-07T07:58:00.7870568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7870645Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7870649Z 2025-09-07T07:58:00.7870739Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7871193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7871255Z layer_outputs = layer_module( 2025-09-07T07:58:00.7871471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7871542Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7871821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7871891Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7872163Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7872228Z self_outputs = self.self( 2025-09-07T07:58:00.7872501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7872595Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7872938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7873115Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7873118Z 2025-09-07T07:58:00.7873210Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7873557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7873622Z layer_outputs = layer_module( 2025-09-07T07:58:00.7873830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7873896Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7874180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7874246Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7874526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7874587Z self_outputs = self.self( 2025-09-07T07:58:00.7874861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7874934Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7874937Z 2025-09-07T07:58:00.7875024Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7875375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7875437Z layer_outputs = layer_module( 2025-09-07T07:58:00.7875655Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7875720Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7876061Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7876133Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7876405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7876471Z self_outputs = self.self( 2025-09-07T07:58:00.7876744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7876834Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7877239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7877410Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7877416Z 2025-09-07T07:58:00.7877509Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7877855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7877921Z layer_outputs = layer_module( 2025-09-07T07:58:00.7878130Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7878195Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7878473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7878540Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7878819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7878881Z self_outputs = self.self( 2025-09-07T07:58:00.7879160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7879246Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7879581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7879754Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7879758Z 2025-09-07T07:58:00.7879846Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7880195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7880257Z layer_outputs = layer_module( 2025-09-07T07:58:00.7880473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7880543Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7880825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7880895Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7881171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7881234Z self_outputs = self.self( 2025-09-07T07:58:00.7881506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7881594Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7881935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7882175Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7882178Z 2025-09-07T07:58:00.7882256Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7882323Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7882395Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7882462Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7882551Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7882900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7882963Z layer_outputs = layer_module( 2025-09-07T07:58:00.7883234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7883303Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7883580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7883648Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7883920Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7883987Z self_outputs = self.self( 2025-09-07T07:58:00.7884259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7884362Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7884698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7884832Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7885160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7885297Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7885301Z 2025-09-07T07:58:00.7885372Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7885462Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7885806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7885872Z layer_outputs = layer_module( 2025-09-07T07:58:00.7886084Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7886154Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7886429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7886502Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7886774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7886834Z self_outputs = self.self( 2025-09-07T07:58:00.7887109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7887175Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7887178Z 2025-09-07T07:58:00.7887273Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7887617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7887684Z layer_outputs = layer_module( 2025-09-07T07:58:00.7887895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7888025Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7888303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7888372Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7888648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7888709Z self_outputs = self.self( 2025-09-07T07:58:00.7888984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7889118Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7889121Z 2025-09-07T07:58:00.7889212Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7889557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7889625Z layer_outputs = layer_module( 2025-09-07T07:58:00.7889840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7889907Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7890179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7890250Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7890520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7890589Z self_outputs = self.self( 2025-09-07T07:58:00.7890862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7890940Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7890943Z 2025-09-07T07:58:00.7891036Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7891378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7891446Z layer_outputs = layer_module( 2025-09-07T07:58:00.7891656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7891726Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7892002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7892068Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7892347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7892412Z self_outputs = self.self( 2025-09-07T07:58:00.7892690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7892797Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7893145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7893311Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7893495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7893588Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7893591Z 2025-09-07T07:58:00.7893679Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7894108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7894169Z layer_outputs = layer_module( 2025-09-07T07:58:00.7894379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7894452Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7894723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7894794Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7895131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7895199Z self_outputs = self.self( 2025-09-07T07:58:00.7895472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7895577Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7895929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7896053Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7896372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7896451Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7896629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7896716Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7896720Z 2025-09-07T07:58:00.7896809Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7897168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7897230Z layer_outputs = layer_module( 2025-09-07T07:58:00.7897443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7897510Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7897785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7897854Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7898128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7898193Z self_outputs = self.self( 2025-09-07T07:58:00.7898468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7898571Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7898924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7899066Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7899070Z 2025-09-07T07:58:00.7899161Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7899508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7899576Z layer_outputs = layer_module( 2025-09-07T07:58:00.7899786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7899914Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7900192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7900257Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7900534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7900594Z self_outputs = self.self( 2025-09-07T07:58:00.7900870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7900969Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7901376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7901517Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7901520Z 2025-09-07T07:58:00.7901609Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7901959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7902021Z layer_outputs = layer_module( 2025-09-07T07:58:00.7902235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7902303Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7902582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7902651Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7902925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7902991Z self_outputs = self.self( 2025-09-07T07:58:00.7903262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7903435Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7903442Z 2025-09-07T07:58:00.7903532Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7903878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7903943Z layer_outputs = layer_module( 2025-09-07T07:58:00.7904155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7904226Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7904503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7904570Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7904851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7904952Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7905232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7905305Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7905308Z 2025-09-07T07:58:00.7905399Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7905795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7905918Z layer_outputs = layer_module( 2025-09-07T07:58:00.7906133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7906201Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7906480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7906554Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7906812Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7906884Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7907226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7907327Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7907602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7907677Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7907681Z 2025-09-07T07:58:00.7907770Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7908114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7908180Z layer_outputs = layer_module( 2025-09-07T07:58:00.7908392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7908463Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7908740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7908811Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7909073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7909139Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7909422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7909515Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7909960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7910074Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7910302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7910371Z return self.act(input) 2025-09-07T07:58:00.7910374Z 2025-09-07T07:58:00.7910476Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7910842Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7910905Z layer_outputs = layer_module( 2025-09-07T07:58:00.7911117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7911190Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7911467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7911542Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7911800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7911869Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7912144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7912386Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7912665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7912736Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7912740Z 2025-09-07T07:58:00.7912833Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7913190Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7913344Z layer_outputs = layer_module( 2025-09-07T07:58:00.7913560Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7913628Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7913907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7913976Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7914253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7914319Z self_outputs = self.self( 2025-09-07T07:58:00.7914594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T07:58:00.7914669Z query_vectors = self.query(hidden_states) 2025-09-07T07:58:00.7914672Z 2025-09-07T07:58:00.7914765Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7915116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7915180Z layer_outputs = layer_module( 2025-09-07T07:58:00.7915392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7915461Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7915732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7915803Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7916077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7916143Z self_outputs = self.self( 2025-09-07T07:58:00.7916421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7916512Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7916860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7917042Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7917046Z 2025-09-07T07:58:00.7917139Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7917483Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7917549Z layer_outputs = layer_module( 2025-09-07T07:58:00.7917759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7917829Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7918105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7918249Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7918531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7918590Z self_outputs = self.self( 2025-09-07T07:58:00.7918866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T07:58:00.7918939Z key_vectors = self.key(hidden_states) 2025-09-07T07:58:00.7918942Z 2025-09-07T07:58:00.7919030Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7919444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7919506Z layer_outputs = layer_module( 2025-09-07T07:58:00.7919716Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7919786Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7920061Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7920131Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7920403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7920469Z self_outputs = self.self( 2025-09-07T07:58:00.7920740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7920831Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7921167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7921337Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7921340Z 2025-09-07T07:58:00.7921436Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7921780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7921844Z layer_outputs = layer_module( 2025-09-07T07:58:00.7922051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7922124Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7922401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7922465Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7922744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7922807Z self_outputs = self.self( 2025-09-07T07:58:00.7923100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7923186Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7923518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7923692Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7923695Z 2025-09-07T07:58:00.7923785Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7924132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7924261Z layer_outputs = layer_module( 2025-09-07T07:58:00.7924484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7924555Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7924831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7924905Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7925182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7925246Z self_outputs = self.self( 2025-09-07T07:58:00.7925582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T07:58:00.7925677Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7926013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7926180Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T07:58:00.7926184Z 2025-09-07T07:58:00.7926266Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7926335Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7926409Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7926477Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7926568Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7926919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7926980Z layer_outputs = layer_module( 2025-09-07T07:58:00.7927196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7927270Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7927546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7927615Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7927889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7927955Z self_outputs = self.self( 2025-09-07T07:58:00.7928226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 536, in forward 2025-09-07T07:58:00.7928330Z diagonal_mask = self._sliding_chunks_query_key_matmul( 2025-09-07T07:58:00.7928669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 834, in _sliding_chunks_query_key_matmul 2025-09-07T07:58:00.7928808Z self._mask_invalid_locations(diagonal_attention_scores, window_overlap) 2025-09-07T07:58:00.7929135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 762, in _mask_invalid_locations 2025-09-07T07:58:00.7929289Z input_tensor[:, :affected_seq_len, :, : affected_seq_len + 1] = torch.full_like( 2025-09-07T07:58:00.7929293Z 2025-09-07T07:58:00.7929368Z cudagraph partition due to non gpu ops 2025-09-07T07:58:00.7929458Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7929808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7929875Z layer_outputs = layer_module( 2025-09-07T07:58:00.7930088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7930228Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7930503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7930573Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7930850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7930910Z self_outputs = self.self( 2025-09-07T07:58:00.7931188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T07:58:00.7931254Z attn_scores += diagonal_mask 2025-09-07T07:58:00.7931257Z 2025-09-07T07:58:00.7931414Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7931760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7931834Z layer_outputs = layer_module( 2025-09-07T07:58:00.7932043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7932113Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7932392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7932459Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7932740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7932799Z self_outputs = self.self( 2025-09-07T07:58:00.7933076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T07:58:00.7933154Z attn_probs = nn.functional.softmax( 2025-09-07T07:58:00.7933160Z 2025-09-07T07:58:00.7933250Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7933601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7933663Z layer_outputs = layer_module( 2025-09-07T07:58:00.7933879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7933946Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7934218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7934289Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7934567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7934631Z self_outputs = self.self( 2025-09-07T07:58:00.7934906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T07:58:00.7934983Z value_vectors = self.value(hidden_states) 2025-09-07T07:58:00.7934991Z 2025-09-07T07:58:00.7935083Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7935427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7935495Z layer_outputs = layer_module( 2025-09-07T07:58:00.7935705Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7935778Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7936054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7936185Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7936462Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7936522Z self_outputs = self.self( 2025-09-07T07:58:00.7936799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7936907Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7937263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7937505Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T07:58:00.7937693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7937793Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7937800Z 2025-09-07T07:58:00.7937888Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7938241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7938302Z layer_outputs = layer_module( 2025-09-07T07:58:00.7938510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7938582Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7938856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7938932Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7939207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7939275Z self_outputs = self.self( 2025-09-07T07:58:00.7939545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7939646Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7940001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7940127Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T07:58:00.7940449Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T07:58:00.7940532Z chunked_hidden_states = nn.functional.pad( 2025-09-07T07:58:00.7940715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T07:58:00.7940800Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T07:58:00.7940804Z 2025-09-07T07:58:00.7940893Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7941259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7941321Z layer_outputs = layer_module( 2025-09-07T07:58:00.7941537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7941606Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7941879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7941954Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7942225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7942381Z self_outputs = self.self( 2025-09-07T07:58:00.7942654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7942761Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7943108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7943249Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7943253Z 2025-09-07T07:58:00.7943346Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7943751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7943819Z layer_outputs = layer_module( 2025-09-07T07:58:00.7944031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7944100Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7944377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7944444Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7944724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7944788Z self_outputs = self.self( 2025-09-07T07:58:00.7945070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T07:58:00.7945168Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T07:58:00.7945511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T07:58:00.7945713Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T07:58:00.7945717Z 2025-09-07T07:58:00.7945808Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7946159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7946222Z layer_outputs = layer_module( 2025-09-07T07:58:00.7946442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7946510Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7946787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7946858Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7947136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T07:58:00.7947202Z self_outputs = self.self( 2025-09-07T07:58:00.7947475Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 618, in forward 2025-09-07T07:58:00.7947649Z attn_output = attn_output.transpose(0, 1).reshape(seq_len, batch_size, embed_dim).contiguous() 2025-09-07T07:58:00.7947657Z 2025-09-07T07:58:00.7947749Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7948097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7948164Z layer_outputs = layer_module( 2025-09-07T07:58:00.7948375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7948514Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7948789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T07:58:00.7948856Z self_attn_outputs = self.attention( 2025-09-07T07:58:00.7949136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T07:58:00.7949239Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T07:58:00.7949522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T07:58:00.7949655Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7949658Z 2025-09-07T07:58:00.7949756Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7950101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7950168Z layer_outputs = layer_module( 2025-09-07T07:58:00.7950387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7950454Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7950734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7950808Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7951067Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7951145Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7951430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7951538Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7951814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T07:58:00.7951893Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7951896Z 2025-09-07T07:58:00.7951986Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7952331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7952398Z layer_outputs = layer_module( 2025-09-07T07:58:00.7952614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7952684Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7952960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7953039Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7953292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7953358Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7953646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T07:58:00.7953738Z intermediate_output = self.intermediate(attn_output) 2025-09-07T07:58:00.7954019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T07:58:00.7954124Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T07:58:00.7954332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:58:00.7954463Z return self.act(input) 2025-09-07T07:58:00.7954467Z 2025-09-07T07:58:00.7954557Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:58:00.7954907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T07:58:00.7954971Z layer_outputs = layer_module( 2025-09-07T07:58:00.7955188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:58:00.7955257Z return super().__call__(*args, **kwargs) 2025-09-07T07:58:00.7955529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T07:58:00.7955665Z layer_output = apply_chunking_to_forward( 2025-09-07T07:58:00.7955923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T07:58:00.7955998Z return forward_fn(*input_tensors) 2025-09-07T07:58:00.7956279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T07:58:00.7956393Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T07:58:00.7956672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T07:58:00.7956746Z hidden_states = self.dense(hidden_states) 2025-09-07T07:58:00.7956749Z 2025-09-07T07:59:07.1056694Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:07.1057359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1716, in torch_dynamo_resume_in_forward_at_1703 2025-09-07T07:59:07.1057890Z prediction_scores = self.lm_head(sequence_output) 2025-09-07T07:59:07.1058364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1333, in forward 2025-09-07T07:59:07.1058814Z x = self.dense(features) 2025-09-07T07:59:07.1058935Z 2025-09-07T07:59:07.1059043Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:07.1059584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1716, in torch_dynamo_resume_in_forward_at_1703 2025-09-07T07:59:07.1060105Z prediction_scores = self.lm_head(sequence_output) 2025-09-07T07:59:07.1060570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1338, in forward 2025-09-07T07:59:07.1061006Z x = self.decoder(x) 2025-09-07T07:59:07.1061120Z 2025-09-07T07:59:07.1061220Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:07.1061744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1723, in torch_dynamo_resume_in_forward_at_1703 2025-09-07T07:59:07.1062354Z masked_lm_loss = loss_fct(prediction_scores.view(-1, self.config.vocab_size), labels.view(-1)) 2025-09-07T07:59:07.1062594Z 2025-09-07T07:59:07.6523882Z pass 2025-09-07T07:59:07.6524272Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T07:59:11.1262655Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T07:59:11.1263576Z import pynvml # type: ignore[import] 2025-09-07T07:59:13.7911163Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:59:13.7912452Z from pkg_resources import resource_filename 2025-09-07T07:59:14.4542052Z 2025-09-07T07:59:17.7641139Z loading model: 0it [00:00, ?it/s] 2025-09-07T07:59:17.7641457Z loading model: 0it [00:03, ?it/s] 2025-09-07T07:59:17.7982377Z cpu eval BartForCausalLM 2025-09-07T07:59:18.8999354Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T07:59:19.2388390Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T07:59:19.5409479Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T07:59:27.4140192Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4140484Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4140694Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4140913Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4141116Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4141308Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4141506Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4141698Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4141888Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4142074Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4142279Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4142469Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4142698Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4143076Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4143422Z return mod(**inputs) 2025-09-07T07:59:27.4143818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4144236Z outputs = self.model.decoder( 2025-09-07T07:59:27.4144615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4144987Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4145344Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4145766Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4146153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4146560Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4146980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4147445Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4147658Z 2025-09-07T07:59:27.4147775Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4148140Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4156194Z return mod(**inputs) 2025-09-07T07:59:27.4156683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4157115Z outputs = self.model.decoder( 2025-09-07T07:59:27.4157536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4157924Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4158292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4158773Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4159174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4159835Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4160264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4160665Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4160807Z 2025-09-07T07:59:27.4160914Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4161287Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4161609Z return mod(**inputs) 2025-09-07T07:59:27.4161971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4162466Z outputs = self.model.decoder( 2025-09-07T07:59:27.4162847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4163227Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4163568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4163935Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4164310Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4164720Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4165132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4165522Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4165665Z 2025-09-07T07:59:27.4165745Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4165951Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4166151Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4166335Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4166564Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4166924Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4167247Z return mod(**inputs) 2025-09-07T07:59:27.4167612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4168021Z outputs = self.model.decoder( 2025-09-07T07:59:27.4168404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4168780Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4169127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4169485Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4169863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4170276Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4170670Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4171073Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4171521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4172011Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4172199Z 2025-09-07T07:59:27.4172296Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4172655Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4172975Z return mod(**inputs) 2025-09-07T07:59:27.4173326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4173801Z outputs = self.model.decoder( 2025-09-07T07:59:27.4174165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4174540Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4174896Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4175271Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4175652Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4176049Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4176524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4176928Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4177385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4177843Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4178001Z 2025-09-07T07:59:27.4178110Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4178464Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4178780Z return mod(**inputs) 2025-09-07T07:59:27.4179135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4179521Z outputs = self.model.decoder( 2025-09-07T07:59:27.4179898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4180268Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4180616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4180975Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4181354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4181755Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4182145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4182524Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4182660Z 2025-09-07T07:59:27.4182757Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4183110Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4183429Z return mod(**inputs) 2025-09-07T07:59:27.4183770Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4184147Z outputs = self.model.decoder( 2025-09-07T07:59:27.4184513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4184887Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4185226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4185581Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4186024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4186453Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4186629Z 2025-09-07T07:59:27.4186731Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4187076Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4187505Z return mod(**inputs) 2025-09-07T07:59:27.4187849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4188229Z outputs = self.model.decoder( 2025-09-07T07:59:27.4188581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4188958Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4189298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4189647Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4190076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4190497Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4190877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4191212Z return self.act(input) 2025-09-07T07:59:27.4191318Z 2025-09-07T07:59:27.4191420Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4191765Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4192076Z return mod(**inputs) 2025-09-07T07:59:27.4192426Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4192802Z outputs = self.model.decoder( 2025-09-07T07:59:27.4193170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4193540Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4193878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4194232Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4194611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4194996Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4195133Z 2025-09-07T07:59:27.4195236Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4195592Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4195914Z return mod(**inputs) 2025-09-07T07:59:27.4196269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4196656Z outputs = self.model.decoder( 2025-09-07T07:59:27.4197025Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4197405Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4197763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4198127Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4198506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4198910Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4199305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4199756Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4199958Z 2025-09-07T07:59:27.4200066Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4200417Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4200735Z return mod(**inputs) 2025-09-07T07:59:27.4201166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4201553Z outputs = self.model.decoder( 2025-09-07T07:59:27.4201919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4202284Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4202623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4202976Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4203358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4203838Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4204243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4204632Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4204763Z 2025-09-07T07:59:27.4204868Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4205216Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4205531Z return mod(**inputs) 2025-09-07T07:59:27.4205881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4206259Z outputs = self.model.decoder( 2025-09-07T07:59:27.4206632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4207005Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4207343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4207696Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4208078Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4208476Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4208859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4209253Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4209400Z 2025-09-07T07:59:27.4209477Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4209916Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4210113Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4210299Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4210525Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4210878Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4211203Z return mod(**inputs) 2025-09-07T07:59:27.4211546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4211926Z outputs = self.model.decoder( 2025-09-07T07:59:27.4212320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4212702Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4213026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4213378Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4213817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4214231Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4214622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4215194Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4215641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4216125Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4216318Z 2025-09-07T07:59:27.4216416Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4216776Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4217102Z return mod(**inputs) 2025-09-07T07:59:27.4217537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4217917Z outputs = self.model.decoder( 2025-09-07T07:59:27.4218275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4218651Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4218979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4219324Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4219693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4220083Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4220479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4220868Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4221307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4221765Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4221925Z 2025-09-07T07:59:27.4222018Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4222352Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4222655Z return mod(**inputs) 2025-09-07T07:59:27.4222991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4223355Z outputs = self.model.decoder( 2025-09-07T07:59:27.4223702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4224064Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4224386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4224726Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4225089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4225476Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4225901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4226274Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4226400Z 2025-09-07T07:59:27.4226489Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4226818Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4227120Z return mod(**inputs) 2025-09-07T07:59:27.4227452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4227838Z outputs = self.model.decoder( 2025-09-07T07:59:27.4228198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4228714Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4229058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4229417Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4229802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4230225Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4230393Z 2025-09-07T07:59:27.4230492Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4230825Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4231202Z return mod(**inputs) 2025-09-07T07:59:27.4231545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4231924Z outputs = self.model.decoder( 2025-09-07T07:59:27.4232283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4232653Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4232981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4233330Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4233702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4234114Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4234485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4234823Z return self.act(input) 2025-09-07T07:59:27.4234926Z 2025-09-07T07:59:27.4235025Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4235366Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4235676Z return mod(**inputs) 2025-09-07T07:59:27.4236020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4236392Z outputs = self.model.decoder( 2025-09-07T07:59:27.4236747Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4237117Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4237441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4237787Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4238154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4238541Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4238673Z 2025-09-07T07:59:27.4238765Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4239106Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4239416Z return mod(**inputs) 2025-09-07T07:59:27.4239755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4240130Z outputs = self.model.decoder( 2025-09-07T07:59:27.4240477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4240845Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4241179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4241527Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4243108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4243504Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4243895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4244345Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4244546Z 2025-09-07T07:59:27.4244646Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4244982Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4245297Z return mod(**inputs) 2025-09-07T07:59:27.4245716Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4246111Z outputs = self.model.decoder( 2025-09-07T07:59:27.4246483Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4246853Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4247194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4247544Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4247922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4248322Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4248710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4249099Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4249235Z 2025-09-07T07:59:27.4249333Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4249681Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4249995Z return mod(**inputs) 2025-09-07T07:59:27.4250341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4250715Z outputs = self.model.decoder( 2025-09-07T07:59:27.4251087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4251472Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4251819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4252178Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4252569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4252977Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4253380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4253767Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4253913Z 2025-09-07T07:59:27.4253990Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4254194Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4254388Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4254574Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4254795Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4255146Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4255468Z return mod(**inputs) 2025-09-07T07:59:27.4255824Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4256208Z outputs = self.model.decoder( 2025-09-07T07:59:27.4256675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4257057Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4257395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4257741Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4258118Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4258513Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4258901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4259360Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4259806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4260310Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4260498Z 2025-09-07T07:59:27.4260596Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4260944Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4261258Z return mod(**inputs) 2025-09-07T07:59:27.4261610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4261989Z outputs = self.model.decoder( 2025-09-07T07:59:27.4262353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4262726Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4263052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4263401Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4263774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4264171Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4264559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4264944Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4265379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4265891Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4266051Z 2025-09-07T07:59:27.4266155Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4266496Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4266808Z return mod(**inputs) 2025-09-07T07:59:27.4267152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4267530Z outputs = self.model.decoder( 2025-09-07T07:59:27.4267892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4268256Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4268589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4268939Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4269315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4269708Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4270091Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4270556Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4270692Z 2025-09-07T07:59:27.4270786Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4271134Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4271444Z return mod(**inputs) 2025-09-07T07:59:27.4271789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4272162Z outputs = self.model.decoder( 2025-09-07T07:59:27.4272522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4272957Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4273283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4273633Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4274001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4274420Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4274589Z 2025-09-07T07:59:27.4274689Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4275038Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4275363Z return mod(**inputs) 2025-09-07T07:59:27.4275711Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4276083Z outputs = self.model.decoder( 2025-09-07T07:59:27.4276439Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4276813Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4277148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4277500Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4277868Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4278280Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4278661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4278993Z return self.act(input) 2025-09-07T07:59:27.4279098Z 2025-09-07T07:59:27.4279199Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4279543Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4279852Z return mod(**inputs) 2025-09-07T07:59:27.4280200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4280577Z outputs = self.model.decoder( 2025-09-07T07:59:27.4280933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4281295Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4281632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4281978Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4282351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4282735Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4282871Z 2025-09-07T07:59:27.4282963Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4283304Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4283693Z return mod(**inputs) 2025-09-07T07:59:27.4284038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4284405Z outputs = self.model.decoder( 2025-09-07T07:59:27.4284762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4285132Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4285463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4285817Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4286243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4286644Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4287032Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4287488Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4287684Z 2025-09-07T07:59:27.4287784Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4288120Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4288427Z return mod(**inputs) 2025-09-07T07:59:27.4288764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4289143Z outputs = self.model.decoder( 2025-09-07T07:59:27.4289500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4289875Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4290204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4290557Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4290925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4291311Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4291700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4292074Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4292202Z 2025-09-07T07:59:27.4292300Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4292638Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4292943Z return mod(**inputs) 2025-09-07T07:59:27.4293282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4293664Z outputs = self.model.decoder( 2025-09-07T07:59:27.4294024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4294396Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4294728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4295081Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4295454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4295856Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4296242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4296622Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4296833Z 2025-09-07T07:59:27.4296909Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4297111Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4297295Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4297491Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4297705Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4298049Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4298363Z return mod(**inputs) 2025-09-07T07:59:27.4298703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4299077Z outputs = self.model.decoder( 2025-09-07T07:59:27.4299502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4299881Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4300202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4300552Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4300918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4301318Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4301726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4302128Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4302577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4303074Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4303254Z 2025-09-07T07:59:27.4303361Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4303718Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4304034Z return mod(**inputs) 2025-09-07T07:59:27.4304390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4304772Z outputs = self.model.decoder( 2025-09-07T07:59:27.4305139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4305507Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4305934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4306293Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4306677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4307083Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4307472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4307865Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4308304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4308762Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4308916Z 2025-09-07T07:59:27.4309022Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4309367Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4309869Z return mod(**inputs) 2025-09-07T07:59:27.4310225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4310610Z outputs = self.model.decoder( 2025-09-07T07:59:27.4311117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4311497Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4311844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4312203Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4312584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4312974Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4313453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4313845Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4313972Z 2025-09-07T07:59:27.4314072Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4314420Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4314734Z return mod(**inputs) 2025-09-07T07:59:27.4315081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4315456Z outputs = self.model.decoder( 2025-09-07T07:59:27.4315823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4316189Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4316524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4316867Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4317240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4317657Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4317827Z 2025-09-07T07:59:27.4317919Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4318261Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4318577Z return mod(**inputs) 2025-09-07T07:59:27.4318920Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4319294Z outputs = self.model.decoder( 2025-09-07T07:59:27.4319647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4320016Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4320351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4320695Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4321059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4321468Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4321847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4322182Z return self.act(input) 2025-09-07T07:59:27.4322285Z 2025-09-07T07:59:27.4322386Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4322717Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4323029Z return mod(**inputs) 2025-09-07T07:59:27.4323373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4323748Z outputs = self.model.decoder( 2025-09-07T07:59:27.4324102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4324557Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4324892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4325244Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4325622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4326000Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4326141Z 2025-09-07T07:59:27.4326238Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4326588Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4326970Z return mod(**inputs) 2025-09-07T07:59:27.4327327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4327709Z outputs = self.model.decoder( 2025-09-07T07:59:27.4328082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4328464Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4328805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4329151Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4329529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4329929Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4330329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4330779Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4330978Z 2025-09-07T07:59:27.4331079Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4331429Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4331747Z return mod(**inputs) 2025-09-07T07:59:27.4332092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4332469Z outputs = self.model.decoder( 2025-09-07T07:59:27.4332823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4333203Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4333533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4333886Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4334256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4334656Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4335045Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4335420Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4335547Z 2025-09-07T07:59:27.4335647Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4335977Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4336290Z return mod(**inputs) 2025-09-07T07:59:27.4336635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4337013Z outputs = self.model.decoder( 2025-09-07T07:59:27.4337372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4337823Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4338152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4338501Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4338871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4339262Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4339658Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4340043Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4340177Z 2025-09-07T07:59:27.4340257Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4340529Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4340721Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4340913Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4341135Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4341482Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4341794Z return mod(**inputs) 2025-09-07T07:59:27.4342141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4342515Z outputs = self.model.decoder( 2025-09-07T07:59:27.4342876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4343263Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4343610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4343966Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4344352Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4344762Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4345152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4345551Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4346055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4346542Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4346735Z 2025-09-07T07:59:27.4346846Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4347199Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4347528Z return mod(**inputs) 2025-09-07T07:59:27.4347887Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4348277Z outputs = self.model.decoder( 2025-09-07T07:59:27.4348646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4349017Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4349356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4349715Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4350093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4350491Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4350890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4351285Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4351800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4352252Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4352411Z 2025-09-07T07:59:27.4352505Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4352858Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4353177Z return mod(**inputs) 2025-09-07T07:59:27.4353523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4353897Z outputs = self.model.decoder( 2025-09-07T07:59:27.4354339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4354719Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4355058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4355414Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4355778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4356177Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4356568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4356949Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4357074Z 2025-09-07T07:59:27.4357191Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4357532Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4357847Z return mod(**inputs) 2025-09-07T07:59:27.4358191Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4358572Z outputs = self.model.decoder( 2025-09-07T07:59:27.4358935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4359301Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4359638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4359983Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4360350Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4360760Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4360939Z 2025-09-07T07:59:27.4361033Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4361376Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4361693Z return mod(**inputs) 2025-09-07T07:59:27.4362030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4362397Z outputs = self.model.decoder( 2025-09-07T07:59:27.4362759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4363126Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4363457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4363804Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4364167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4364579Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4364954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4365391Z return self.act(input) 2025-09-07T07:59:27.4365493Z 2025-09-07T07:59:27.4365584Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4365925Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4366239Z return mod(**inputs) 2025-09-07T07:59:27.4366581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4366953Z outputs = self.model.decoder( 2025-09-07T07:59:27.4367306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4367742Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4368074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4368423Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4368791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4369186Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4369325Z 2025-09-07T07:59:27.4369422Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4369773Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4370092Z return mod(**inputs) 2025-09-07T07:59:27.4370434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4370814Z outputs = self.model.decoder( 2025-09-07T07:59:27.4371194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4371566Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4371910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4372257Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4372636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4373037Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4373430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4373871Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4374079Z 2025-09-07T07:59:27.4374176Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4374524Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4374839Z return mod(**inputs) 2025-09-07T07:59:27.4375189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4375558Z outputs = self.model.decoder( 2025-09-07T07:59:27.4375919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4376292Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4376624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4376971Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4377334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4377727Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4378112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4378575Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4378706Z 2025-09-07T07:59:27.4378807Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4379151Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4379466Z return mod(**inputs) 2025-09-07T07:59:27.4379826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4380202Z outputs = self.model.decoder( 2025-09-07T07:59:27.4380560Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4380937Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4381337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4381694Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4382066Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4382458Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4382855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4383238Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4383373Z 2025-09-07T07:59:27.4383453Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4383646Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4383837Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4384027Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4384246Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4384595Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4384904Z return mod(**inputs) 2025-09-07T07:59:27.4385257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4385701Z outputs = self.model.decoder( 2025-09-07T07:59:27.4386065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4386430Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4386773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4387125Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4387498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4387893Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4388275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4388673Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4389113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4389591Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4389770Z 2025-09-07T07:59:27.4389873Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4390217Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4390536Z return mod(**inputs) 2025-09-07T07:59:27.4390887Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4391270Z outputs = self.model.decoder( 2025-09-07T07:59:27.4391626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4392081Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4392414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4392761Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4393132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4393526Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4393917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4394311Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4394811Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4395269Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4395428Z 2025-09-07T07:59:27.4395520Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4395863Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4396178Z return mod(**inputs) 2025-09-07T07:59:27.4396524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4396904Z outputs = self.model.decoder( 2025-09-07T07:59:27.4397264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4397633Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4397970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4398320Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4398680Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4399077Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4399464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4399838Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4399965Z 2025-09-07T07:59:27.4400060Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4400396Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4400735Z return mod(**inputs) 2025-09-07T07:59:27.4401079Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4401452Z outputs = self.model.decoder( 2025-09-07T07:59:27.4401809Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4402183Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4402519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4402867Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4403232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4403645Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4403820Z 2025-09-07T07:59:27.4403914Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4404252Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4404569Z return mod(**inputs) 2025-09-07T07:59:27.4404900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4405380Z outputs = self.model.decoder( 2025-09-07T07:59:27.4405749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4406126Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4406460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4406804Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4407179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4407595Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4408064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4408407Z return self.act(input) 2025-09-07T07:59:27.4408510Z 2025-09-07T07:59:27.4408603Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4408954Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4409269Z return mod(**inputs) 2025-09-07T07:59:27.4409776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4410160Z outputs = self.model.decoder( 2025-09-07T07:59:27.4410527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4410899Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4411231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4411584Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4411953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4412344Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4412482Z 2025-09-07T07:59:27.4412576Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4412918Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4413238Z return mod(**inputs) 2025-09-07T07:59:27.4413575Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4413949Z outputs = self.model.decoder( 2025-09-07T07:59:27.4414311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4414684Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4422750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4423154Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4423552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4423976Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4424381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4424828Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4425036Z 2025-09-07T07:59:27.4425148Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4425507Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4425918Z return mod(**inputs) 2025-09-07T07:59:27.4426293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4426703Z outputs = self.model.decoder( 2025-09-07T07:59:27.4427073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4427656Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4428010Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4428361Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4428740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4429140Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4429533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4430019Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4430155Z 2025-09-07T07:59:27.4430264Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4430626Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4430941Z return mod(**inputs) 2025-09-07T07:59:27.4431299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4431677Z outputs = self.model.decoder( 2025-09-07T07:59:27.4432040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4432427Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4432764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4433117Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4433495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4433895Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4434278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4434670Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4434809Z 2025-09-07T07:59:27.4434966Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4435164Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4435350Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4435535Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4435755Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4436111Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4436434Z return mod(**inputs) 2025-09-07T07:59:27.4436780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4437160Z outputs = self.model.decoder( 2025-09-07T07:59:27.4437519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4437898Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4438232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4438575Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4438945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4439331Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4439717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4440116Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4440545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4441107Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4441289Z 2025-09-07T07:59:27.4441386Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4441732Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4442046Z return mod(**inputs) 2025-09-07T07:59:27.4442401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4442770Z outputs = self.model.decoder( 2025-09-07T07:59:27.4443133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4443623Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4443946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4444300Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4444668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4445058Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4445437Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4445813Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4446237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4446683Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4446839Z 2025-09-07T07:59:27.4446941Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4447277Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4447587Z return mod(**inputs) 2025-09-07T07:59:27.4447925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4448296Z outputs = self.model.decoder( 2025-09-07T07:59:27.4448663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4449033Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4449367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4449723Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4450099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4450505Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4450889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4451266Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4451393Z 2025-09-07T07:59:27.4451489Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4451832Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4452142Z return mod(**inputs) 2025-09-07T07:59:27.4452489Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4452862Z outputs = self.model.decoder( 2025-09-07T07:59:27.4453224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4453609Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4453957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4454394Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4454765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4455183Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4455352Z 2025-09-07T07:59:27.4455454Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4455802Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4456112Z return mod(**inputs) 2025-09-07T07:59:27.4456458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4456833Z outputs = self.model.decoder( 2025-09-07T07:59:27.4457250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4457625Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4457961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4458310Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4458677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4459084Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4459460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4459789Z return self.act(input) 2025-09-07T07:59:27.4459896Z 2025-09-07T07:59:27.4459996Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4460345Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4460657Z return mod(**inputs) 2025-09-07T07:59:27.4461001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4461374Z outputs = self.model.decoder( 2025-09-07T07:59:27.4461729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4462092Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4462418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4462762Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4463126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4463503Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4463634Z 2025-09-07T07:59:27.4463724Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4464061Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4464373Z return mod(**inputs) 2025-09-07T07:59:27.4464708Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4465071Z outputs = self.model.decoder( 2025-09-07T07:59:27.4465421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4465875Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4466199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4466540Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4466905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4467299Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4467684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4468231Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4468427Z 2025-09-07T07:59:27.4468520Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4468854Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4469162Z return mod(**inputs) 2025-09-07T07:59:27.4469498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4469863Z outputs = self.model.decoder( 2025-09-07T07:59:27.4470273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4470643Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4470965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4471312Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4471674Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4472057Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4472435Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4472801Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4472927Z 2025-09-07T07:59:27.4473022Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4473356Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4473660Z return mod(**inputs) 2025-09-07T07:59:27.4473997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4474364Z outputs = self.model.decoder( 2025-09-07T07:59:27.4474715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4475077Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4475400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4475740Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4476104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4476489Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4476871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4477421Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4477561Z 2025-09-07T07:59:27.4477636Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4477831Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4478012Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4478200Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4478408Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4478754Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4479068Z return mod(**inputs) 2025-09-07T07:59:27.4479411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4479786Z outputs = self.model.decoder( 2025-09-07T07:59:27.4480147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4480515Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4480847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4481269Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4481632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4482021Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4482402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4482787Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4483218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4483757Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4483948Z 2025-09-07T07:59:27.4484048Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4484397Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4484717Z return mod(**inputs) 2025-09-07T07:59:27.4485057Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4485438Z outputs = self.model.decoder( 2025-09-07T07:59:27.4485802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4486180Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4486508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4486868Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4487322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4487720Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4488115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4488504Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4488939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4489389Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4489546Z 2025-09-07T07:59:27.4489652Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4490003Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4490315Z return mod(**inputs) 2025-09-07T07:59:27.4490665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4491044Z outputs = self.model.decoder( 2025-09-07T07:59:27.4491406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4491779Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4492105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4492459Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4492831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4493226Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4493603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4493982Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4494113Z 2025-09-07T07:59:27.4494206Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4494622Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4494934Z return mod(**inputs) 2025-09-07T07:59:27.4495270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4495642Z outputs = self.model.decoder( 2025-09-07T07:59:27.4496002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4496372Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4496693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4497038Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4497466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4497886Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4498055Z 2025-09-07T07:59:27.4498152Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4498480Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4498791Z return mod(**inputs) 2025-09-07T07:59:27.4499129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4499503Z outputs = self.model.decoder( 2025-09-07T07:59:27.4499858Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4500220Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4500544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4500893Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4501258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4501662Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4502030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4502361Z return self.act(input) 2025-09-07T07:59:27.4502466Z 2025-09-07T07:59:27.4502565Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4502905Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4503215Z return mod(**inputs) 2025-09-07T07:59:27.4503558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4503927Z outputs = self.model.decoder( 2025-09-07T07:59:27.4504286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4504664Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4504986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4505330Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4505752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4506136Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4506267Z 2025-09-07T07:59:27.4506358Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4506694Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4507006Z return mod(**inputs) 2025-09-07T07:59:27.4507345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4507798Z outputs = self.model.decoder( 2025-09-07T07:59:27.4508149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4508518Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4508845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4509193Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4509554Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4510108Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4510605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4511081Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4511279Z 2025-09-07T07:59:27.4511388Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4511726Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4512035Z return mod(**inputs) 2025-09-07T07:59:27.4512375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4512748Z outputs = self.model.decoder( 2025-09-07T07:59:27.4513106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4513467Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4513792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4514136Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4514504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4514901Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4515279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4515651Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4515784Z 2025-09-07T07:59:27.4515875Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4516214Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4516521Z return mod(**inputs) 2025-09-07T07:59:27.4516859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4517237Z outputs = self.model.decoder( 2025-09-07T07:59:27.4517592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4517964Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4518280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4518619Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4518978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4519366Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4519744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4520127Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4520267Z 2025-09-07T07:59:27.4520342Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4520547Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4520741Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4520933Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4521272Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4521613Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4521672Z return mod(**inputs) 2025-09-07T07:59:27.4521923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4521990Z outputs = self.model.decoder( 2025-09-07T07:59:27.4522238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4522302Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4522576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4522654Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4522895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4522992Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4523229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4523317Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4523619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4523743Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4523747Z 2025-09-07T07:59:27.4523846Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4524039Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4524104Z return mod(**inputs) 2025-09-07T07:59:27.4524348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4524416Z outputs = self.model.decoder( 2025-09-07T07:59:27.4524667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4524739Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4524961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4525027Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4525267Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4525356Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4525597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4525687Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4525974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4526074Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4526083Z 2025-09-07T07:59:27.4526174Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4526360Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4526425Z return mod(**inputs) 2025-09-07T07:59:27.4526667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4526737Z outputs = self.model.decoder( 2025-09-07T07:59:27.4526978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4527041Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4527258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4527390Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4527638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4527722Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4527964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4528042Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4528046Z 2025-09-07T07:59:27.4528135Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4528388Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4528448Z return mod(**inputs) 2025-09-07T07:59:27.4528712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4528788Z outputs = self.model.decoder( 2025-09-07T07:59:27.4529044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4529115Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4529324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4529399Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4529638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4529744Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4529748Z 2025-09-07T07:59:27.4529849Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4530037Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4530103Z return mod(**inputs) 2025-09-07T07:59:27.4530345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4530411Z outputs = self.model.decoder( 2025-09-07T07:59:27.4530660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4530721Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4530938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4531004Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4531253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4531354Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4531562Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4531633Z return self.act(input) 2025-09-07T07:59:27.4531636Z 2025-09-07T07:59:27.4531724Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4531915Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4531971Z return mod(**inputs) 2025-09-07T07:59:27.4532211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4532280Z outputs = self.model.decoder( 2025-09-07T07:59:27.4532523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4532594Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4532805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4532941Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4533185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4533259Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4533263Z 2025-09-07T07:59:27.4533360Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4533544Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4533610Z return mod(**inputs) 2025-09-07T07:59:27.4533851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4533915Z outputs = self.model.decoder( 2025-09-07T07:59:27.4534225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4534290Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4534510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4534575Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4534814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4534907Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4535147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4535295Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4535299Z 2025-09-07T07:59:27.4535389Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4535582Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4535637Z return mod(**inputs) 2025-09-07T07:59:27.4535882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4535951Z outputs = self.model.decoder( 2025-09-07T07:59:27.4536194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4536264Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4536474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4536541Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4536785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4536871Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4537120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4537195Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4537198Z 2025-09-07T07:59:27.4537295Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4537477Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4537535Z return mod(**inputs) 2025-09-07T07:59:27.4537785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4537850Z outputs = self.model.decoder( 2025-09-07T07:59:27.4538098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4538160Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4538375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4538448Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4538756Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4538851Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4539090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4539168Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4539179Z 2025-09-07T07:59:27.4539250Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4539317Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4539390Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4539455Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4539626Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4539823Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4539878Z return mod(**inputs) 2025-09-07T07:59:27.4540132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4540195Z outputs = self.model.decoder( 2025-09-07T07:59:27.4540446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4540511Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4540723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4540796Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4541035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4541126Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4541365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4541452Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4541750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4541868Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4541871Z 2025-09-07T07:59:27.4541962Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4542143Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4542200Z return mod(**inputs) 2025-09-07T07:59:27.4542440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4542502Z outputs = self.model.decoder( 2025-09-07T07:59:27.4542747Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4542808Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4543016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4543081Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4543316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4543398Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4543633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4543714Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4543999Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4544090Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4544158Z 2025-09-07T07:59:27.4544248Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4544429Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4544485Z return mod(**inputs) 2025-09-07T07:59:27.4544725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4544788Z outputs = self.model.decoder( 2025-09-07T07:59:27.4545027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4545085Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4545361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4545426Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4545736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4545821Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4546060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4546136Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4546140Z 2025-09-07T07:59:27.4546227Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4546417Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4546473Z return mod(**inputs) 2025-09-07T07:59:27.4546717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4546781Z outputs = self.model.decoder( 2025-09-07T07:59:27.4547023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4547091Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4547301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4547367Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4547602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4547702Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4547705Z 2025-09-07T07:59:27.4547791Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4547973Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4548032Z return mod(**inputs) 2025-09-07T07:59:27.4548274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4548335Z outputs = self.model.decoder( 2025-09-07T07:59:27.4548576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4548635Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4548847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4548911Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4549151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4549247Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4549451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4549514Z return self.act(input) 2025-09-07T07:59:27.4549518Z 2025-09-07T07:59:27.4549605Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4549865Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4549919Z return mod(**inputs) 2025-09-07T07:59:27.4550158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4550222Z outputs = self.model.decoder( 2025-09-07T07:59:27.4550460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4550523Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4550730Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4550795Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4551361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4551434Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4551440Z 2025-09-07T07:59:27.4551530Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4551713Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4551771Z return mod(**inputs) 2025-09-07T07:59:27.4552009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4552071Z outputs = self.model.decoder( 2025-09-07T07:59:27.4552318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4552377Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4552590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4552654Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4552891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4552981Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4553217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4553355Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4553359Z 2025-09-07T07:59:27.4553445Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4553634Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4553687Z return mod(**inputs) 2025-09-07T07:59:27.4553929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4554002Z outputs = self.model.decoder( 2025-09-07T07:59:27.4554254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4554324Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4554531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4554593Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4554833Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4554914Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4555154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4555225Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4555228Z 2025-09-07T07:59:27.4555319Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4555501Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4555624Z return mod(**inputs) 2025-09-07T07:59:27.4555867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4555929Z outputs = self.model.decoder( 2025-09-07T07:59:27.4556171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4556232Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4556439Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4556508Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4556804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4556890Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4557129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4557203Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4557210Z 2025-09-07T07:59:27.4557282Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4557348Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4557419Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4557484Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4557574Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4557760Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4557814Z return mod(**inputs) 2025-09-07T07:59:27.4558063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4558122Z outputs = self.model.decoder( 2025-09-07T07:59:27.4558364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4558426Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4558635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4558704Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4558942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4559026Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4559261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4559347Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4559636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4559757Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4559760Z 2025-09-07T07:59:27.4559849Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4560033Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4560091Z return mod(**inputs) 2025-09-07T07:59:27.4560332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4560395Z outputs = self.model.decoder( 2025-09-07T07:59:27.4560641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4560701Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4560914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4560978Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4561283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4561368Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4561602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4561684Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4561968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4562059Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4562067Z 2025-09-07T07:59:27.4562247Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4562434Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4562495Z return mod(**inputs) 2025-09-07T07:59:27.4562735Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4562798Z outputs = self.model.decoder( 2025-09-07T07:59:27.4563034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4563095Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4563306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4563370Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4563615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4563699Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4563935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4564008Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4564011Z 2025-09-07T07:59:27.4564096Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4564285Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4564337Z return mod(**inputs) 2025-09-07T07:59:27.4564577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4564639Z outputs = self.model.decoder( 2025-09-07T07:59:27.4564880Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4564948Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4565155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4565223Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4565463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4565564Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4565568Z 2025-09-07T07:59:27.4565656Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4565839Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4565898Z return mod(**inputs) 2025-09-07T07:59:27.4566138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4566203Z outputs = self.model.decoder( 2025-09-07T07:59:27.4566447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4566506Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4566791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4566854Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4567094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4567193Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4567397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4567458Z return self.act(input) 2025-09-07T07:59:27.4567462Z 2025-09-07T07:59:27.4567549Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4567796Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4567853Z return mod(**inputs) 2025-09-07T07:59:27.4568095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4568163Z outputs = self.model.decoder( 2025-09-07T07:59:27.4568402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4568467Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4568676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4568743Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4568980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4569050Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4569054Z 2025-09-07T07:59:27.4569146Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4569326Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4569388Z return mod(**inputs) 2025-09-07T07:59:27.4569629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4569692Z outputs = self.model.decoder( 2025-09-07T07:59:27.4569935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4569994Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4570206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4570270Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4570510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4570597Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4570837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T07:59:27.4570976Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T07:59:27.4570979Z 2025-09-07T07:59:27.4571065Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4571250Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4571305Z return mod(**inputs) 2025-09-07T07:59:27.4571544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4571610Z outputs = self.model.decoder( 2025-09-07T07:59:27.4571855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4571920Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4572128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4572261Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4572502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4572583Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4572831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T07:59:27.4572912Z key_states = self.k_proj(current_states) 2025-09-07T07:59:27.4572915Z 2025-09-07T07:59:27.4573011Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4573194Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4573308Z return mod(**inputs) 2025-09-07T07:59:27.4573553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4573618Z outputs = self.model.decoder( 2025-09-07T07:59:27.4573863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4573922Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4574132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4574199Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4574438Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4574522Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4574763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T07:59:27.4574837Z value_states = self.v_proj(current_states) 2025-09-07T07:59:27.4574844Z 2025-09-07T07:59:27.4574916Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4574983Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4575053Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4575118Z cudagraph partition due to non gpu ops 2025-09-07T07:59:27.4575210Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4575395Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4575451Z return mod(**inputs) 2025-09-07T07:59:27.4575695Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4575755Z outputs = self.model.decoder( 2025-09-07T07:59:27.4575997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4576058Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4576265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4576338Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4576574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4576658Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4576894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4576974Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4577262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T07:59:27.4577380Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T07:59:27.4577384Z 2025-09-07T07:59:27.4577473Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4577657Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4577784Z return mod(**inputs) 2025-09-07T07:59:27.4578023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4578084Z outputs = self.model.decoder( 2025-09-07T07:59:27.4578326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4578387Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4578599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4578662Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4579062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4579150Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4579388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T07:59:27.4579475Z attn_output, attn_weights = attention_interface( 2025-09-07T07:59:27.4579755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T07:59:27.4579850Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T07:59:27.4579854Z 2025-09-07T07:59:27.4579943Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4580126Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4580185Z return mod(**inputs) 2025-09-07T07:59:27.4580429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4580492Z outputs = self.model.decoder( 2025-09-07T07:59:27.4580735Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4580796Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4581005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4581067Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4581307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T07:59:27.4581389Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T07:59:27.4581625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T07:59:27.4581704Z attn_output = self.out_proj(attn_output) 2025-09-07T07:59:27.4581708Z 2025-09-07T07:59:27.4581792Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4581981Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4582034Z return mod(**inputs) 2025-09-07T07:59:27.4582278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4582337Z outputs = self.model.decoder( 2025-09-07T07:59:27.4582574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4582639Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4582848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4582914Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4583155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4583260Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4583340Z 2025-09-07T07:59:27.4583437Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4583619Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4583676Z return mod(**inputs) 2025-09-07T07:59:27.4583916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4583982Z outputs = self.model.decoder( 2025-09-07T07:59:27.4584222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4584281Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4584559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4584627Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4584866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T07:59:27.4584965Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T07:59:27.4585166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T07:59:27.4585228Z return self.act(input) 2025-09-07T07:59:27.4585231Z 2025-09-07T07:59:27.4585317Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4585502Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4585558Z return mod(**inputs) 2025-09-07T07:59:27.4585862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1901, in forward 2025-09-07T07:59:27.4585936Z outputs = self.model.decoder( 2025-09-07T07:59:27.4586182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T07:59:27.4586253Z layer_outputs = decoder_layer( 2025-09-07T07:59:27.4586470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T07:59:27.4586545Z return super().__call__(*args, **kwargs) 2025-09-07T07:59:27.4586793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T07:59:27.4586864Z hidden_states = self.fc2(hidden_states) 2025-09-07T07:59:27.4586868Z 2025-09-07T07:59:27.4586968Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4587158Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4587220Z return mod(**inputs) 2025-09-07T07:59:27.4587472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1917, in forward 2025-09-07T07:59:27.4587539Z logits = self.lm_head(outputs[0]) 2025-09-07T07:59:27.4587545Z 2025-09-07T07:59:27.4587634Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T07:59:27.4587819Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T07:59:27.4587875Z return mod(**inputs) 2025-09-07T07:59:27.4588114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1923, in forward 2025-09-07T07:59:27.4588249Z loss = loss_fct(logits.view(-1, self.config.vocab_size), labels.view(-1)) 2025-09-07T07:59:27.4588252Z 2025-09-07T07:59:35.1898675Z pass 2025-09-07T07:59:35.1899071Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T07:59:38.2100831Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T07:59:38.2102054Z import pynvml # type: ignore[import] 2025-09-07T07:59:40.8828184Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:59:40.8829105Z from pkg_resources import resource_filename 2025-09-07T07:59:41.5245416Z 2025-09-07T07:59:47.4537484Z loading model: 0it [00:00, ?it/s] 2025-09-07T07:59:47.4537813Z loading model: 0it [00:05, ?it/s] 2025-09-07T07:59:47.5030404Z cpu eval BartForConditionalGeneration 2025-09-07T07:59:49.9777720Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T07:59:50.7343226Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T07:59:51.4739732Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:04.8063801Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8068481Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8068743Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8068945Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8069135Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8069326Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8069521Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8069736Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8069931Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8070125Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8070346Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8070539Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8070774Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8071177Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8071517Z return mod(**inputs) 2025-09-07T08:00:04.8071917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8072335Z outputs = self.model( 2025-09-07T08:00:04.8072718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8073132Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8073533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8073934Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8074293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8074653Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8075033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8075437Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8075849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8076350Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8076555Z 2025-09-07T08:00:04.8076666Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8077023Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8077352Z return mod(**inputs) 2025-09-07T08:00:04.8077728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8078115Z outputs = self.model( 2025-09-07T08:00:04.8078935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8079346Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8079724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8080102Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8080446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8080801Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8081285Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8081857Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8082285Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8082682Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8082814Z 2025-09-07T08:00:04.8083073Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8083431Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8083751Z return mod(**inputs) 2025-09-07T08:00:04.8084102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8084481Z outputs = self.model( 2025-09-07T08:00:04.8084828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8085210Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8085585Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8085967Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8086301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8086660Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8087039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8087441Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8087826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8088205Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8088348Z 2025-09-07T08:00:04.8088424Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8088625Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8088820Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8089007Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8089229Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8089582Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8089911Z return mod(**inputs) 2025-09-07T08:00:04.8090262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8090629Z outputs = self.model( 2025-09-07T08:00:04.8090983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8091393Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8091760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8092147Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8092491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8092941Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8093336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8093735Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8094117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8094522Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8094973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8095454Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8096979Z 2025-09-07T08:00:04.8097099Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8097453Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8097776Z return mod(**inputs) 2025-09-07T08:00:04.8098135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8098531Z outputs = self.model( 2025-09-07T08:00:04.8098873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8099258Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8099626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8100005Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8100350Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8100700Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8101095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8101490Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8101879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8102272Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8102704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8103165Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8103325Z 2025-09-07T08:00:04.8103425Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8103776Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8104098Z return mod(**inputs) 2025-09-07T08:00:04.8104452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8104836Z outputs = self.model( 2025-09-07T08:00:04.8105194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8105575Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8105994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8106380Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8106721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8107080Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8107475Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8107881Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8108368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8108747Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8108875Z 2025-09-07T08:00:04.8108979Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8109333Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8109774Z return mod(**inputs) 2025-09-07T08:00:04.8110129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8110503Z outputs = self.model( 2025-09-07T08:00:04.8110970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8111357Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8111728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8112126Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8112466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8112823Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8113190Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8113605Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8113782Z 2025-09-07T08:00:04.8113878Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8114228Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8114549Z return mod(**inputs) 2025-09-07T08:00:04.8114901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8115271Z outputs = self.model( 2025-09-07T08:00:04.8115621Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8116002Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8116365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8116733Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8117070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8117415Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8117797Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8131243Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8131692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8132080Z return self.act(input) 2025-09-07T08:00:04.8132204Z 2025-09-07T08:00:04.8132314Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8132697Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8133034Z return mod(**inputs) 2025-09-07T08:00:04.8133409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8133814Z outputs = self.model( 2025-09-07T08:00:04.8134196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8134586Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8134966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8135544Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8135901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8136267Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8136650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8137037Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8137179Z 2025-09-07T08:00:04.8137283Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8137647Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8137973Z return mod(**inputs) 2025-09-07T08:00:04.8138411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8138792Z outputs = self.model( 2025-09-07T08:00:04.8139146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8139538Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8139917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8140312Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8140654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8141017Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8141400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8141803Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8142186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8142638Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8142847Z 2025-09-07T08:00:04.8142946Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8143305Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8143625Z return mod(**inputs) 2025-09-07T08:00:04.8143974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8144344Z outputs = self.model( 2025-09-07T08:00:04.8144698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8145078Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8145447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8145870Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8146215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8146569Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8146938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8147321Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8147709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8148105Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8148232Z 2025-09-07T08:00:04.8148331Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8148682Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8148988Z return mod(**inputs) 2025-09-07T08:00:04.8149330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8149803Z outputs = self.model( 2025-09-07T08:00:04.8150165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8150541Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8150897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8151274Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8151608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8151963Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8152385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8152777Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8153168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8153546Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8153678Z 2025-09-07T08:00:04.8153764Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8153959Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8154152Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8154345Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8154559Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8154892Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8155209Z return mod(**inputs) 2025-09-07T08:00:04.8155553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8155923Z outputs = self.model( 2025-09-07T08:00:04.8156273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8156636Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8156997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8157377Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8157722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8158074Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8158449Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8158846Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8159234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8159634Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8160078Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8160566Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8160751Z 2025-09-07T08:00:04.8160847Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8161203Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8161527Z return mod(**inputs) 2025-09-07T08:00:04.8161875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8162256Z outputs = self.model( 2025-09-07T08:00:04.8162603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8163073Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8163435Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8163810Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8164149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8164519Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8164889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8165270Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8165723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8166116Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8166559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8167021Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8167180Z 2025-09-07T08:00:04.8167274Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8167619Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8167937Z return mod(**inputs) 2025-09-07T08:00:04.8168289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8168660Z outputs = self.model( 2025-09-07T08:00:04.8169001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8169377Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8169743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8170118Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8170448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8170795Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8171165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8171549Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8171933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8172303Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8172435Z 2025-09-07T08:00:04.8172530Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8172870Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8173186Z return mod(**inputs) 2025-09-07T08:00:04.8173531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8173896Z outputs = self.model( 2025-09-07T08:00:04.8174242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8174619Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8174978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8175343Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8175675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8176025Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8176393Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8176896Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8177065Z 2025-09-07T08:00:04.8177160Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8177500Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8177813Z return mod(**inputs) 2025-09-07T08:00:04.8178155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8178519Z outputs = self.model( 2025-09-07T08:00:04.8178859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8179330Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8179684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8180045Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8180382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8180715Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8181092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8181490Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8181852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8182173Z return self.act(input) 2025-09-07T08:00:04.8182271Z 2025-09-07T08:00:04.8182359Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8182717Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8183045Z return mod(**inputs) 2025-09-07T08:00:04.8183376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8183735Z outputs = self.model( 2025-09-07T08:00:04.8184066Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8184444Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8184791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8185159Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8185504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8185933Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8186320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8186724Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8186859Z 2025-09-07T08:00:04.8186966Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8187319Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8187639Z return mod(**inputs) 2025-09-07T08:00:04.8187995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8188370Z outputs = self.model( 2025-09-07T08:00:04.8188712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8189087Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8189458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8189854Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8190199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8190627Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8191006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8191407Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8191795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8192249Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8192451Z 2025-09-07T08:00:04.8192545Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8192973Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8193297Z return mod(**inputs) 2025-09-07T08:00:04.8193645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8194013Z outputs = self.model( 2025-09-07T08:00:04.8194358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8194732Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8195096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8195465Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8195790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8196140Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8196519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8196908Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8197284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8197660Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8197791Z 2025-09-07T08:00:04.8197881Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8198224Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8198537Z return mod(**inputs) 2025-09-07T08:00:04.8198869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8199237Z outputs = self.model( 2025-09-07T08:00:04.8199583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8199952Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8200311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8200675Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8201002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8201344Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8201710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8202089Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8202470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8202851Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8202987Z 2025-09-07T08:00:04.8203067Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8203268Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8203455Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8203732Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8203947Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8204291Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8204598Z return mod(**inputs) 2025-09-07T08:00:04.8204936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8205302Z outputs = self.model( 2025-09-07T08:00:04.8205643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8206016Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8206868Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8207254Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8207598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8207950Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8208314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8208703Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8209087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8209484Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8210100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8210572Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8210761Z 2025-09-07T08:00:04.8210856Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8211205Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8211523Z return mod(**inputs) 2025-09-07T08:00:04.8211873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8212237Z outputs = self.model( 2025-09-07T08:00:04.8212584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8212953Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8213314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8213685Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8214031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8214388Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8214764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8215153Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8215524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8215915Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8216352Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8216808Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8216964Z 2025-09-07T08:00:04.8217067Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8217411Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8217849Z return mod(**inputs) 2025-09-07T08:00:04.8218215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8218593Z outputs = self.model( 2025-09-07T08:00:04.8218936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8219311Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8219679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8220048Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8220386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8220876Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8221245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8221640Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8222019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8222398Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8222523Z 2025-09-07T08:00:04.8222619Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8222969Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8223286Z return mod(**inputs) 2025-09-07T08:00:04.8223632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8223996Z outputs = self.model( 2025-09-07T08:00:04.8224341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8224711Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8225071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8225438Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8225819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8226167Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8226539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8226958Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8227127Z 2025-09-07T08:00:04.8227228Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8227564Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8227878Z return mod(**inputs) 2025-09-07T08:00:04.8228225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8228589Z outputs = self.model( 2025-09-07T08:00:04.8228924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8229292Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8229649Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8230018Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8230345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8230685Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8231052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8231571Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8231943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8232268Z return self.act(input) 2025-09-07T08:00:04.8232381Z 2025-09-07T08:00:04.8232473Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8232814Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8233125Z return mod(**inputs) 2025-09-07T08:00:04.8233461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8233823Z outputs = self.model( 2025-09-07T08:00:04.8234235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8234608Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8234964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8235334Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8235657Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8236005Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8236385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8236766Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8236898Z 2025-09-07T08:00:04.8236994Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8237346Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8237666Z return mod(**inputs) 2025-09-07T08:00:04.8238014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8238389Z outputs = self.model( 2025-09-07T08:00:04.8238729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8239102Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8239466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8239838Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8240165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8240513Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8240881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8241276Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8241661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8242101Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8242308Z 2025-09-07T08:00:04.8242401Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8242744Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8243059Z return mod(**inputs) 2025-09-07T08:00:04.8243404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8243771Z outputs = self.model( 2025-09-07T08:00:04.8244136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8244519Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8244881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8245328Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8245663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8246012Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8246381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8246762Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8247139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8247522Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8247727Z 2025-09-07T08:00:04.8247827Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8248175Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8248493Z return mod(**inputs) 2025-09-07T08:00:04.8248830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8249236Z outputs = self.model( 2025-09-07T08:00:04.8249582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8249952Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8250305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8250672Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8251008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8251355Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8251722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8252103Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8252485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8252867Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8253002Z 2025-09-07T08:00:04.8253087Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8253278Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8253474Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8253663Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8253880Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8254226Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8254535Z return mod(**inputs) 2025-09-07T08:00:04.8254874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8255256Z outputs = self.model( 2025-09-07T08:00:04.8255600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8255967Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8256324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8256694Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8257028Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8257378Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8257738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8258113Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8258572Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8258959Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8259395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8259859Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8260040Z 2025-09-07T08:00:04.8260131Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8260467Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8260775Z return mod(**inputs) 2025-09-07T08:00:04.8261173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8261547Z outputs = self.model( 2025-09-07T08:00:04.8261893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8262265Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8262629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8262996Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8263331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8263682Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8264050Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8264438Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8264815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8265206Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8265683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8266136Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8266291Z 2025-09-07T08:00:04.8266389Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8266734Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8267042Z return mod(**inputs) 2025-09-07T08:00:04.8267381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8267748Z outputs = self.model( 2025-09-07T08:00:04.8268088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8268461Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8268848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8269225Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8269564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8269906Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8270271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8270650Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8271026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8271394Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8271522Z 2025-09-07T08:00:04.8271631Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8272088Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8272411Z return mod(**inputs) 2025-09-07T08:00:04.8272768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8273144Z outputs = self.model( 2025-09-07T08:00:04.8273483Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8273849Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8274204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8274564Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8274950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8275306Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8275708Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8276148Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8276313Z 2025-09-07T08:00:04.8276416Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8276761Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8277068Z return mod(**inputs) 2025-09-07T08:00:04.8277409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8277768Z outputs = self.model( 2025-09-07T08:00:04.8278112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8278506Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8278857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8279240Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8279558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8279903Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8280258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8280663Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8281036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8281364Z return self.act(input) 2025-09-07T08:00:04.8281480Z 2025-09-07T08:00:04.8281576Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8281910Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8282229Z return mod(**inputs) 2025-09-07T08:00:04.8282567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8282925Z outputs = self.model( 2025-09-07T08:00:04.8283262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8283630Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8283984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8284337Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8284675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8285017Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8285373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8285854Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8285989Z 2025-09-07T08:00:04.8286079Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8286407Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8286708Z return mod(**inputs) 2025-09-07T08:00:04.8287051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8287413Z outputs = self.model( 2025-09-07T08:00:04.8287760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8288189Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8288551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8288927Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8289253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8289602Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8289972Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8290345Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8290716Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8291160Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8291362Z 2025-09-07T08:00:04.8291455Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8291803Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8292110Z return mod(**inputs) 2025-09-07T08:00:04.8292467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8292830Z outputs = self.model( 2025-09-07T08:00:04.8293162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8293523Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8293897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8294258Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8294584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8294931Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8295291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8295672Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8296038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8296404Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8296525Z 2025-09-07T08:00:04.8296629Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8296962Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8297261Z return mod(**inputs) 2025-09-07T08:00:04.8297603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8297966Z outputs = self.model( 2025-09-07T08:00:04.8298322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8298784Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8299148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8299506Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8299826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8300161Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8300512Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8300918Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8301366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8301742Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8301872Z 2025-09-07T08:00:04.8301965Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8302155Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8302346Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8302526Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8302734Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8303060Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8303372Z return mod(**inputs) 2025-09-07T08:00:04.8303702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8304079Z outputs = self.model( 2025-09-07T08:00:04.8304416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8304775Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8305148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8305507Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8305899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8306244Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8306605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8306975Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8307363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8307758Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8308213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8308685Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8308874Z 2025-09-07T08:00:04.8308974Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8309323Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8309823Z return mod(**inputs) 2025-09-07T08:00:04.8310158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8310527Z outputs = self.model( 2025-09-07T08:00:04.8310870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8311242Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8311593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8311958Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8312285Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8312771Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8313135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8313509Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8313885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8314270Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8314700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8315259Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8315421Z 2025-09-07T08:00:04.8315514Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8315861Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8316172Z return mod(**inputs) 2025-09-07T08:00:04.8316513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8316877Z outputs = self.model( 2025-09-07T08:00:04.8317217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8317585Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8317945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8318314Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8318642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8318991Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8319361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8319743Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8320122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8320490Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8320624Z 2025-09-07T08:00:04.8320715Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8321055Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8321364Z return mod(**inputs) 2025-09-07T08:00:04.8321695Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8322068Z outputs = self.model( 2025-09-07T08:00:04.8322406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8322780Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8323137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8323498Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8323826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8324170Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8324535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8324953Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8325122Z 2025-09-07T08:00:04.8325216Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8325556Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8325961Z return mod(**inputs) 2025-09-07T08:00:04.8326324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8326705Z outputs = self.model( 2025-09-07T08:00:04.8327046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8327415Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8327771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8328135Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8328537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8328885Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8329250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8329663Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8330029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8330361Z return self.act(input) 2025-09-07T08:00:04.8330470Z 2025-09-07T08:00:04.8330562Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8330900Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8331212Z return mod(**inputs) 2025-09-07T08:00:04.8331545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8331915Z outputs = self.model( 2025-09-07T08:00:04.8332256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8332628Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8332983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8333341Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8333667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8334009Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8334375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8334744Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8334878Z 2025-09-07T08:00:04.8334974Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8335309Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8335621Z return mod(**inputs) 2025-09-07T08:00:04.8335964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8336322Z outputs = self.model( 2025-09-07T08:00:04.8336662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8337027Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8337384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8337742Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8338065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8338406Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8338770Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8339262Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8339633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8340074Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8340281Z 2025-09-07T08:00:04.8340373Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8340715Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8341031Z return mod(**inputs) 2025-09-07T08:00:04.8341369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8341799Z outputs = self.model( 2025-09-07T08:00:04.8342150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8342528Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8342885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8343257Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8343585Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8343932Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8344300Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8344680Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8345063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8345435Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8345558Z 2025-09-07T08:00:04.8345716Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8346065Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8346368Z return mod(**inputs) 2025-09-07T08:00:04.8346704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8347073Z outputs = self.model( 2025-09-07T08:00:04.8347414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8347780Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8348138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8348505Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8348835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8349184Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8349540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8349924Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8350301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8350681Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8350815Z 2025-09-07T08:00:04.8350894Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8351088Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8351280Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8351470Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8351686Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8352018Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8352423Z return mod(**inputs) 2025-09-07T08:00:04.8352766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8353135Z outputs = self.model( 2025-09-07T08:00:04.8353472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8353849Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8354211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8354577Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8354904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8355316Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8355684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8356071Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8356450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8356839Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8357275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8357750Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8357933Z 2025-09-07T08:00:04.8358028Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8358371Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8358676Z return mod(**inputs) 2025-09-07T08:00:04.8359021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8359395Z outputs = self.model( 2025-09-07T08:00:04.8359737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8360109Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8360457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8360829Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8361156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8361501Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8361860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8362246Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8362620Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8363009Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8363447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8363890Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8364053Z 2025-09-07T08:00:04.8364147Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8364485Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8364806Z return mod(**inputs) 2025-09-07T08:00:04.8365149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8365509Z outputs = self.model( 2025-09-07T08:00:04.8365849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8366318Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8366679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8367048Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8367370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8367713Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8368081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8368459Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8368898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8369280Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8369423Z 2025-09-07T08:00:04.8369513Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8369861Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8370176Z return mod(**inputs) 2025-09-07T08:00:04.8370510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8370879Z outputs = self.model( 2025-09-07T08:00:04.8371219Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8371588Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8371954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8372328Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8372651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8372999Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8373368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8373776Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8373950Z 2025-09-07T08:00:04.8374042Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8374379Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8374689Z return mod(**inputs) 2025-09-07T08:00:04.8375028Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8375389Z outputs = self.model( 2025-09-07T08:00:04.8375729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8376102Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8376457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8376819Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8377142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8377488Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8377851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8378255Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8378621Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8378951Z return self.act(input) 2025-09-07T08:00:04.8379059Z 2025-09-07T08:00:04.8379151Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8379575Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8379890Z return mod(**inputs) 2025-09-07T08:00:04.8380229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8380596Z outputs = self.model( 2025-09-07T08:00:04.8391828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8392297Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8392713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8393437Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8393810Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8394173Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8394556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8394940Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8395069Z 2025-09-07T08:00:04.8395526Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8395901Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8396220Z return mod(**inputs) 2025-09-07T08:00:04.8396576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8396946Z outputs = self.model( 2025-09-07T08:00:04.8397289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8397655Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8398017Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8398382Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8398711Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8399054Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8399453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8399870Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8400266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8400739Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8400943Z 2025-09-07T08:00:04.8401050Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8401417Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8401750Z return mod(**inputs) 2025-09-07T08:00:04.8402115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8402489Z outputs = self.model( 2025-09-07T08:00:04.8402845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8403233Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8403604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8403993Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8404341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8404689Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8405156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8405539Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8405911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8406294Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8406437Z 2025-09-07T08:00:04.8406534Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8406878Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8407205Z return mod(**inputs) 2025-09-07T08:00:04.8407609Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8407981Z outputs = self.model( 2025-09-07T08:00:04.8408339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8408712Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8409071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8409454Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8409981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8410350Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8410724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8411109Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8411484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8411876Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8412010Z 2025-09-07T08:00:04.8412084Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8412299Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8412480Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8412680Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8412886Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8413234Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8413543Z return mod(**inputs) 2025-09-07T08:00:04.8413875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8414233Z outputs = self.model( 2025-09-07T08:00:04.8414595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8414964Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8415340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8415707Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8416036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8416390Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8416753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8417124Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8417499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8417898Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8418330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8418970Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8419152Z 2025-09-07T08:00:04.8419243Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8419597Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8419906Z return mod(**inputs) 2025-09-07T08:00:04.8420247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8420609Z outputs = self.model( 2025-09-07T08:00:04.8420963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8421451Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8421804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8422170Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8422517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8422862Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8423222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8423619Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8423991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8424379Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8424804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8425247Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8425406Z 2025-09-07T08:00:04.8425509Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8425908Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8426237Z return mod(**inputs) 2025-09-07T08:00:04.8426570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8426951Z outputs = self.model( 2025-09-07T08:00:04.8427289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8427651Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8428017Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8428375Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8428699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8429042Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8429399Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8429789Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8430160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8430526Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8430674Z 2025-09-07T08:00:04.8430768Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8431095Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8431416Z return mod(**inputs) 2025-09-07T08:00:04.8431750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8432204Z outputs = self.model( 2025-09-07T08:00:04.8432531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8432902Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8433251Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8433648Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8433972Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8434312Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8434759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8435174Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8435342Z 2025-09-07T08:00:04.8435446Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8435775Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8436083Z return mod(**inputs) 2025-09-07T08:00:04.8436445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8436806Z outputs = self.model( 2025-09-07T08:00:04.8437141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8437517Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8437868Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8438231Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8438595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8438949Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8439306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8439718Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8440082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8440405Z return self.act(input) 2025-09-07T08:00:04.8440502Z 2025-09-07T08:00:04.8440591Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8440937Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8441263Z return mod(**inputs) 2025-09-07T08:00:04.8441599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8441971Z outputs = self.model( 2025-09-07T08:00:04.8442307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8442672Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8443033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8443394Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8443726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8444067Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8444442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8444819Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8444947Z 2025-09-07T08:00:04.8445043Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8445367Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8445748Z return mod(**inputs) 2025-09-07T08:00:04.8446102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8446462Z outputs = self.model( 2025-09-07T08:00:04.8446803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8447165Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8447529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8447898Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8448306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8448655Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8449030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8449448Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8449820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8450258Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8450455Z 2025-09-07T08:00:04.8450549Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8450891Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8451248Z return mod(**inputs) 2025-09-07T08:00:04.8451594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8451963Z outputs = self.model( 2025-09-07T08:00:04.8452320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8452692Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8453048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8453414Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8453739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8454116Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8454505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8454885Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8455262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8455623Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8455755Z 2025-09-07T08:00:04.8455850Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8456194Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8456500Z return mod(**inputs) 2025-09-07T08:00:04.8456839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8457203Z outputs = self.model( 2025-09-07T08:00:04.8457539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8457903Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8458264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8458624Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8458945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8459095Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8459338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8459418Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8459654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8459729Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8459737Z 2025-09-07T08:00:04.8459809Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8459876Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8460007Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8460075Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8460166Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8460361Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8460417Z return mod(**inputs) 2025-09-07T08:00:04.8460665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8460731Z outputs = self.model( 2025-09-07T08:00:04.8460973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8461034Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8461272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8461336Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8461550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8461617Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8461860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8461935Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8462175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8462260Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8462554Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8462672Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8462676Z 2025-09-07T08:00:04.8462771Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8462954Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8463008Z return mod(**inputs) 2025-09-07T08:00:04.8463254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8463310Z outputs = self.model( 2025-09-07T08:00:04.8463559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8463622Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8463861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8463928Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8464138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8464214Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8464453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8464601Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8464850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8464934Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8465231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8465331Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8465335Z 2025-09-07T08:00:04.8465429Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8465675Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8465811Z return mod(**inputs) 2025-09-07T08:00:04.8466070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8466130Z outputs = self.model( 2025-09-07T08:00:04.8466380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8466446Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8466690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8466764Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8466982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8467058Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8467302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8467392Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8467635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8467712Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8467715Z 2025-09-07T08:00:04.8467819Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8468012Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8468076Z return mod(**inputs) 2025-09-07T08:00:04.8468320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8468379Z outputs = self.model( 2025-09-07T08:00:04.8468626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8468691Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8468940Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8469005Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8469215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8469287Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8469528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8469646Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8469650Z 2025-09-07T08:00:04.8469742Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8469937Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8469994Z return mod(**inputs) 2025-09-07T08:00:04.8470237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8470304Z outputs = self.model( 2025-09-07T08:00:04.8470616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8470688Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8470926Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8470988Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8471211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8471278Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8471521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8471686Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8471899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8471973Z return self.act(input) 2025-09-07T08:00:04.8471976Z 2025-09-07T08:00:04.8472065Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8472259Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8472316Z return mod(**inputs) 2025-09-07T08:00:04.8472564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8472622Z outputs = self.model( 2025-09-07T08:00:04.8472864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8472933Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8473173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8473246Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8473459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8473525Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8473771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8473845Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8473850Z 2025-09-07T08:00:04.8473945Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8474130Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8474197Z return mod(**inputs) 2025-09-07T08:00:04.8474444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8474503Z outputs = self.model( 2025-09-07T08:00:04.8474756Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8474822Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8475065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8475128Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8475339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8475410Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8475648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8475734Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8475973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8476116Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8476194Z 2025-09-07T08:00:04.8476287Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8476473Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8476537Z return mod(**inputs) 2025-09-07T08:00:04.8476782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8476846Z outputs = self.model( 2025-09-07T08:00:04.8477089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8477154Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8477465Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8477529Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8477755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8477826Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8478063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8478146Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8478382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8478459Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8478462Z 2025-09-07T08:00:04.8478550Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8478743Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8478801Z return mod(**inputs) 2025-09-07T08:00:04.8479043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8479114Z outputs = self.model( 2025-09-07T08:00:04.8479357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8479427Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8479664Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8479730Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8479947Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8480013Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8480260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8480338Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8480577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8480664Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8480668Z 2025-09-07T08:00:04.8480742Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8480818Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8480884Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8480951Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8481047Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8481231Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8481297Z return mod(**inputs) 2025-09-07T08:00:04.8481544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8481603Z outputs = self.model( 2025-09-07T08:00:04.8481852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8481989Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8482237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8482299Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8482516Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8482579Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8482818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8482902Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8483201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8483299Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8483595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8483826Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8483836Z 2025-09-07T08:00:04.8483927Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8484112Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8484176Z return mod(**inputs) 2025-09-07T08:00:04.8484424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8484491Z outputs = self.model( 2025-09-07T08:00:04.8484734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8484798Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8485046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8485109Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8485325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8485392Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8485634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8485717Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8485955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8486048Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8486332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8486441Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8486445Z 2025-09-07T08:00:04.8486538Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8486724Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8486787Z return mod(**inputs) 2025-09-07T08:00:04.8487029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8487096Z outputs = self.model( 2025-09-07T08:00:04.8487340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8487405Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8487651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8487804Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8488021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8488088Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8488327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8488411Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8488650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8488729Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8488732Z 2025-09-07T08:00:04.8488822Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8489081Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8489138Z return mod(**inputs) 2025-09-07T08:00:04.8489386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8489450Z outputs = self.model( 2025-09-07T08:00:04.8489690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8489760Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8489998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8490060Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8490278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8490348Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8490591Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8490698Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8490701Z 2025-09-07T08:00:04.8490794Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8490979Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8491035Z return mod(**inputs) 2025-09-07T08:00:04.8491284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8491342Z outputs = self.model( 2025-09-07T08:00:04.8491590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8491651Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8491891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8491961Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8492174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8492246Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8492486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8492584Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8492796Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8492858Z return self.act(input) 2025-09-07T08:00:04.8492861Z 2025-09-07T08:00:04.8492958Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8493145Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8493208Z return mod(**inputs) 2025-09-07T08:00:04.8493453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8493580Z outputs = self.model( 2025-09-07T08:00:04.8493831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8493894Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8494137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8494200Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8494411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8494487Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8494787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8494866Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8494872Z 2025-09-07T08:00:04.8494964Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8495149Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8495214Z return mod(**inputs) 2025-09-07T08:00:04.8495457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8495523Z outputs = self.model( 2025-09-07T08:00:04.8495767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8495837Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8496083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8496145Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8496366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8496435Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8496679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8496754Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8496993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8497139Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8497143Z 2025-09-07T08:00:04.8497233Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8497429Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8497488Z return mod(**inputs) 2025-09-07T08:00:04.8497729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8497795Z outputs = self.model( 2025-09-07T08:00:04.8498038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8498109Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8498347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8498416Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8498624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8498689Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8498935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8499012Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8499258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8499391Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8499394Z 2025-09-07T08:00:04.8499486Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8499680Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8499739Z return mod(**inputs) 2025-09-07T08:00:04.8499991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8500047Z outputs = self.model( 2025-09-07T08:00:04.8500295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8500422Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8500673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8500750Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8500964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8501045Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8501287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8501372Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8501618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8501697Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8501700Z 2025-09-07T08:00:04.8501780Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8501850Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8501917Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8501992Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8502084Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8502284Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8502343Z return mod(**inputs) 2025-09-07T08:00:04.8502590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8502658Z outputs = self.model( 2025-09-07T08:00:04.8502902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8502974Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8503219Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8503289Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8503505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8503576Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8503826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8503904Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8504147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8504233Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8504525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8504657Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8504661Z 2025-09-07T08:00:04.8504751Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8504942Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8505076Z return mod(**inputs) 2025-09-07T08:00:04.8505329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8505389Z outputs = self.model( 2025-09-07T08:00:04.8505685Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8505758Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8506001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8506067Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8506347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8506415Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8506682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8506760Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8507003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8507083Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8507370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8507475Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8507479Z 2025-09-07T08:00:04.8507569Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8507766Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8507824Z return mod(**inputs) 2025-09-07T08:00:04.8508093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8508153Z outputs = self.model( 2025-09-07T08:00:04.8508395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8508466Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8508706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8508775Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8508986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8509052Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8509300Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8509376Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8509727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8509801Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8509804Z 2025-09-07T08:00:04.8509899Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8510087Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8510145Z return mod(**inputs) 2025-09-07T08:00:04.8510397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8510454Z outputs = self.model( 2025-09-07T08:00:04.8510707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8510771Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8511009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8511194Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8511405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8511478Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8511721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8511831Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8511842Z 2025-09-07T08:00:04.8511935Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8512217Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8512283Z return mod(**inputs) 2025-09-07T08:00:04.8512530Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8512596Z outputs = self.model( 2025-09-07T08:00:04.8512838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8512908Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8513185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8513253Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8513477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8513546Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8513788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8513896Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8514102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8514166Z return self.act(input) 2025-09-07T08:00:04.8514169Z 2025-09-07T08:00:04.8514259Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8514446Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8514508Z return mod(**inputs) 2025-09-07T08:00:04.8514750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8514815Z outputs = self.model( 2025-09-07T08:00:04.8515054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8515120Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8515361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8515425Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8515637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8515702Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8515941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8516012Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8516016Z 2025-09-07T08:00:04.8516102Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8516291Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8516348Z return mod(**inputs) 2025-09-07T08:00:04.8516593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8516718Z outputs = self.model( 2025-09-07T08:00:04.8516974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8517037Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8517281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8517344Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8517559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8517628Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8517864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8518009Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8518257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8518402Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8518407Z 2025-09-07T08:00:04.8518500Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8518686Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8518741Z return mod(**inputs) 2025-09-07T08:00:04.8518985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8519040Z outputs = self.model( 2025-09-07T08:00:04.8519283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8519347Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8519589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8519652Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8519865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8519932Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8520171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8520252Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8520488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8520556Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8520559Z 2025-09-07T08:00:04.8520653Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8520836Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8520895Z return mod(**inputs) 2025-09-07T08:00:04.8521135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8521194Z outputs = self.model( 2025-09-07T08:00:04.8521434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8521493Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8521733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8521793Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8522007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8522073Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8522309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8522455Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8522690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8522769Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8522773Z 2025-09-07T08:00:04.8522844Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8522908Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8522977Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8523041Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8523134Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8523316Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8523433Z return mod(**inputs) 2025-09-07T08:00:04.8523682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8523741Z outputs = self.model( 2025-09-07T08:00:04.8523986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8524046Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8524286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8524348Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8524557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8524623Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8524861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8524937Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8525171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8525259Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8525550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8525670Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8525674Z 2025-09-07T08:00:04.8525763Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8525947Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8526004Z return mod(**inputs) 2025-09-07T08:00:04.8526254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8526310Z outputs = self.model( 2025-09-07T08:00:04.8526553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8526616Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8526857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8526917Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8527125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8527193Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8527430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8527507Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8527745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8527826Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8528183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8528281Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8528285Z 2025-09-07T08:00:04.8528377Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8528561Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8528621Z return mod(**inputs) 2025-09-07T08:00:04.8528863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8528920Z outputs = self.model( 2025-09-07T08:00:04.8529238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8529301Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8529550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8529612Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8529822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8529888Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8530125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8530204Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8530444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8530518Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8530527Z 2025-09-07T08:00:04.8530617Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8530799Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8530862Z return mod(**inputs) 2025-09-07T08:00:04.8531100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8531160Z outputs = self.model( 2025-09-07T08:00:04.8531399Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8531459Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8531701Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8531760Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8531978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8532041Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8532279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8532390Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8532394Z 2025-09-07T08:00:04.8532479Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8532664Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8532720Z return mod(**inputs) 2025-09-07T08:00:04.8532959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8533023Z outputs = self.model( 2025-09-07T08:00:04.8533265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8533330Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8533564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8533738Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8533949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8534014Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8534255Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8534354Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8534560Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8534618Z return self.act(input) 2025-09-07T08:00:04.8534621Z 2025-09-07T08:00:04.8534772Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8534965Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8535023Z return mod(**inputs) 2025-09-07T08:00:04.8535269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8535325Z outputs = self.model( 2025-09-07T08:00:04.8535567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8535633Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8535874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8535944Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8536156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8536231Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8536470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8536543Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8536547Z 2025-09-07T08:00:04.8536639Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8536820Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8536884Z return mod(**inputs) 2025-09-07T08:00:04.8537123Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8537182Z outputs = self.model( 2025-09-07T08:00:04.8537424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8537485Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8537729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8537789Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8538004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8538069Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8538305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8538387Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8538624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8538766Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8538770Z 2025-09-07T08:00:04.8538859Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8539040Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8539102Z return mod(**inputs) 2025-09-07T08:00:04.8539466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8539530Z outputs = self.model( 2025-09-07T08:00:04.8539771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8539835Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8540082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8540145Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8540363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8540493Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8540745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8540829Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8541068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8541145Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8541149Z 2025-09-07T08:00:04.8541240Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8541431Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8541487Z return mod(**inputs) 2025-09-07T08:00:04.8541731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8541796Z outputs = self.model( 2025-09-07T08:00:04.8542038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8542107Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8542345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8542408Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8542626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8542693Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8542937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8543012Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8543253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8543328Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8543332Z 2025-09-07T08:00:04.8543401Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8543473Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8543541Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8543612Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8543701Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8543885Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8543944Z return mod(**inputs) 2025-09-07T08:00:04.8544186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8544248Z outputs = self.model( 2025-09-07T08:00:04.8544485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8544550Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8544792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8544923Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8545144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8545209Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8545446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8545525Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8545821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8545911Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8546274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8546400Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8546406Z 2025-09-07T08:00:04.8546495Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8546679Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8546739Z return mod(**inputs) 2025-09-07T08:00:04.8546979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8547041Z outputs = self.model( 2025-09-07T08:00:04.8547281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8547342Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8547589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8547652Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8547864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8547932Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8548175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8548253Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8548492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8548581Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8548869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8548973Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8548980Z 2025-09-07T08:00:04.8549070Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8549256Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8549320Z return mod(**inputs) 2025-09-07T08:00:04.8549566Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8549628Z outputs = self.model( 2025-09-07T08:00:04.8549869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8549935Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8550176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8550237Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8550456Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8550523Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8550763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 312, in forward 2025-09-07T08:00:04.8550904Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:00:04.8551143Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8551218Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8551222Z 2025-09-07T08:00:04.8551309Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8551496Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8551550Z return mod(**inputs) 2025-09-07T08:00:04.8551876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8551937Z outputs = self.model( 2025-09-07T08:00:04.8552178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8552248Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8552491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8552561Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8552778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8552850Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8553101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8553215Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8553219Z 2025-09-07T08:00:04.8553322Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8553519Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8553584Z return mod(**inputs) 2025-09-07T08:00:04.8553837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8553899Z outputs = self.model( 2025-09-07T08:00:04.8554147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8554211Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8554455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8554518Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8554731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8554809Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8555046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 323, in forward 2025-09-07T08:00:04.8555159Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8555364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8555425Z return self.act(input) 2025-09-07T08:00:04.8555429Z 2025-09-07T08:00:04.8555527Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8555713Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8555770Z return mod(**inputs) 2025-09-07T08:00:04.8556012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8556070Z outputs = self.model( 2025-09-07T08:00:04.8556316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1270, in forward 2025-09-07T08:00:04.8556381Z encoder_outputs = self.encoder( 2025-09-07T08:00:04.8556698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 869, in forward 2025-09-07T08:00:04.8556762Z layer_outputs = encoder_layer( 2025-09-07T08:00:04.8556974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8557041Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8557282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 325, in forward 2025-09-07T08:00:04.8557359Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8557362Z 2025-09-07T08:00:04.8557451Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8557703Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8557760Z return mod(**inputs) 2025-09-07T08:00:04.8558001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8558063Z outputs = self.model( 2025-09-07T08:00:04.8558302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8558369Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8558604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8558664Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8558879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8558943Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8559187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8559277Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8559525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8559667Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8559671Z 2025-09-07T08:00:04.8559766Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8559957Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8560016Z return mod(**inputs) 2025-09-07T08:00:04.8560264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8560319Z outputs = self.model( 2025-09-07T08:00:04.8560563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8560631Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8560873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8560940Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8561154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8565111Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8565389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8565489Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8565747Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8565831Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8565835Z 2025-09-07T08:00:04.8565938Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8566203Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8566267Z return mod(**inputs) 2025-09-07T08:00:04.8566526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8566587Z outputs = self.model( 2025-09-07T08:00:04.8566857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8566929Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8567173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8567237Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8567523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8567600Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8567851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8567946Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8568192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8568271Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8568275Z 2025-09-07T08:00:04.8568347Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8568419Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8568486Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8568556Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8568656Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8568850Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8568913Z return mod(**inputs) 2025-09-07T08:00:04.8569163Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8569240Z outputs = self.model( 2025-09-07T08:00:04.8569483Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8569558Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8569799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8569867Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8570085Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8570160Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8570405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8570496Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8570734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8570832Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8571127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8571341Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8571345Z 2025-09-07T08:00:04.8571437Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8571632Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8571693Z return mod(**inputs) 2025-09-07T08:00:04.8571939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8572038Z outputs = self.model( 2025-09-07T08:00:04.8572279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8572349Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8572588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8572654Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8572872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8572940Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8573248Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8573332Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8573573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8573660Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8573945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8574049Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8574055Z 2025-09-07T08:00:04.8574146Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8574338Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8574395Z return mod(**inputs) 2025-09-07T08:00:04.8574641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8574707Z outputs = self.model( 2025-09-07T08:00:04.8574949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8575022Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8575263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8575326Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8575541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8575609Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8575853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8575938Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8576181Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8576250Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8576255Z 2025-09-07T08:00:04.8576344Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8576531Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8576584Z return mod(**inputs) 2025-09-07T08:00:04.8576832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8576958Z outputs = self.model( 2025-09-07T08:00:04.8577202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8577270Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8577513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8577580Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8577789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8577914Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8578161Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8578257Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8578504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8578647Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8578651Z 2025-09-07T08:00:04.8578746Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8578991Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8579049Z return mod(**inputs) 2025-09-07T08:00:04.8579296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8579355Z outputs = self.model( 2025-09-07T08:00:04.8579600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8579662Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8579900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8579964Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8580175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8580247Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8580486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8580587Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8580827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8580899Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8580903Z 2025-09-07T08:00:04.8580998Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8581184Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8581249Z return mod(**inputs) 2025-09-07T08:00:04.8581488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8581545Z outputs = self.model( 2025-09-07T08:00:04.8581792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8581851Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8582095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8582155Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8582365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8582435Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8582675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8583134Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8583374Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8583455Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8583458Z 2025-09-07T08:00:04.8583531Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8583599Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8583672Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8583773Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8583867Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8584050Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8584107Z return mod(**inputs) 2025-09-07T08:00:04.8584356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8584416Z outputs = self.model( 2025-09-07T08:00:04.8584660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8584722Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8585021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8585090Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8585304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8585378Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8585674Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8585765Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8586013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8586097Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8586390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8586514Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8586518Z 2025-09-07T08:00:04.8586610Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8586794Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8586850Z return mod(**inputs) 2025-09-07T08:00:04.8587099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8587156Z outputs = self.model( 2025-09-07T08:00:04.8587402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8587467Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8587709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8587777Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8587985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8588056Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8588295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8588389Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8588627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8588757Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8589048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8589140Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8589145Z 2025-09-07T08:00:04.8589240Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8589424Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8589515Z return mod(**inputs) 2025-09-07T08:00:04.8589760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8589817Z outputs = self.model( 2025-09-07T08:00:04.8590059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8590122Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8590363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8590425Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8590635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8590762Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8591006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8591102Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8591339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8591408Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8591412Z 2025-09-07T08:00:04.8591505Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8591687Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8591747Z return mod(**inputs) 2025-09-07T08:00:04.8591988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8592049Z outputs = self.model( 2025-09-07T08:00:04.8592294Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8592357Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8592600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8592661Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8592872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8592937Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8593174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8593293Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8593296Z 2025-09-07T08:00:04.8593383Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8593572Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8593629Z return mod(**inputs) 2025-09-07T08:00:04.8593872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8593935Z outputs = self.model( 2025-09-07T08:00:04.8594175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8594282Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8594537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8594599Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8594815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8594883Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8595126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8595262Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8595477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8595538Z return self.act(input) 2025-09-07T08:00:04.8595541Z 2025-09-07T08:00:04.8595629Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8595820Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8595876Z return mod(**inputs) 2025-09-07T08:00:04.8596123Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8596178Z outputs = self.model( 2025-09-07T08:00:04.8596481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8596548Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8596788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8596856Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8597065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8597131Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8597385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8597456Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8597459Z 2025-09-07T08:00:04.8597557Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8597752Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8597814Z return mod(**inputs) 2025-09-07T08:00:04.8598060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8598121Z outputs = self.model( 2025-09-07T08:00:04.8598367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8598430Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8598676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8598741Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8598956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8599032Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8599276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8599370Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8599614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8599758Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8599762Z 2025-09-07T08:00:04.8599853Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8600097Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8600160Z return mod(**inputs) 2025-09-07T08:00:04.8600407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8600469Z outputs = self.model( 2025-09-07T08:00:04.8600713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8600776Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8601023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8601124Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8601344Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8601411Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8601653Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8601740Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8601979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8602056Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8602118Z 2025-09-07T08:00:04.8602208Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8602396Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8602455Z return mod(**inputs) 2025-09-07T08:00:04.8602696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8602759Z outputs = self.model( 2025-09-07T08:00:04.8602998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8603065Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8603303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8603364Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8603580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8603646Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8603888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8603969Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8604212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8604286Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8604291Z 2025-09-07T08:00:04.8604362Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8604435Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8604501Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8604571Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8604662Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8604848Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8604907Z return mod(**inputs) 2025-09-07T08:00:04.8605148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8605210Z outputs = self.model( 2025-09-07T08:00:04.8605452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8605513Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8605802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8605861Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8606075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8606140Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8606384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8606469Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8606745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8606835Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8607125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8607249Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8607253Z 2025-09-07T08:00:04.8607343Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8607530Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8607591Z return mod(**inputs) 2025-09-07T08:00:04.8607891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8607955Z outputs = self.model( 2025-09-07T08:00:04.8608199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8608262Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8608508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8608570Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8608788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8608854Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8609092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8609192Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8609431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8609520Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8610008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8610113Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8610117Z 2025-09-07T08:00:04.8610204Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8610399Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8610462Z return mod(**inputs) 2025-09-07T08:00:04.8610715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8610779Z outputs = self.model( 2025-09-07T08:00:04.8611025Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8611088Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8611338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8611401Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8611622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8611767Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8612021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8612105Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8612353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8612431Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8612435Z 2025-09-07T08:00:04.8612527Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8612770Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8612827Z return mod(**inputs) 2025-09-07T08:00:04.8613076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8613138Z outputs = self.model( 2025-09-07T08:00:04.8613379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8613447Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8613687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8613847Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8614068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8614138Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8614385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8614483Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8614726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8614869Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8614873Z 2025-09-07T08:00:04.8614964Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8615158Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8615216Z return mod(**inputs) 2025-09-07T08:00:04.8615463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8615522Z outputs = self.model( 2025-09-07T08:00:04.8615764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8615834Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8616074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8616142Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8616355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8616425Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8616663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8616757Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8616998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8617067Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8617071Z 2025-09-07T08:00:04.8617165Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8617351Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8617449Z return mod(**inputs) 2025-09-07T08:00:04.8617698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8617755Z outputs = self.model( 2025-09-07T08:00:04.8618001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8618064Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8618309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8618402Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8618615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8618683Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8618922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8619019Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8619253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8619329Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8619333Z 2025-09-07T08:00:04.8619481Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8619549Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8619620Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8619683Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8619773Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8619964Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8620019Z return mod(**inputs) 2025-09-07T08:00:04.8620265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8620323Z outputs = self.model( 2025-09-07T08:00:04.8620559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8620627Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8620871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8620932Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8621142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8621214Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8621453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8621540Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8621787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8621871Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8622167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8622288Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8622292Z 2025-09-07T08:00:04.8622381Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8622566Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8622621Z return mod(**inputs) 2025-09-07T08:00:04.8622872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8622929Z outputs = self.model( 2025-09-07T08:00:04.8623217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8623280Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8623521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8623586Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8623800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8623869Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8624148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8624238Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8629696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8629828Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8630164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8630272Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8630277Z 2025-09-07T08:00:04.8630378Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8630722Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8630788Z return mod(**inputs) 2025-09-07T08:00:04.8631060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8631123Z outputs = self.model( 2025-09-07T08:00:04.8631368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8631440Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8631684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8631751Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8631971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8632048Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8632297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8632398Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8632643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8632714Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8632718Z 2025-09-07T08:00:04.8632818Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8633013Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8633070Z return mod(**inputs) 2025-09-07T08:00:04.8633327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8633385Z outputs = self.model( 2025-09-07T08:00:04.8633633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8633700Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8633956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8634030Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8634263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8634339Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8634637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8634754Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8634758Z 2025-09-07T08:00:04.8634860Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8635066Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8635131Z return mod(**inputs) 2025-09-07T08:00:04.8635380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8635481Z outputs = self.model( 2025-09-07T08:00:04.8635724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8635793Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8636039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8636102Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8636326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8636398Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8636709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8636816Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8637025Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8637091Z return self.act(input) 2025-09-07T08:00:04.8637094Z 2025-09-07T08:00:04.8637197Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8637390Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8637450Z return mod(**inputs) 2025-09-07T08:00:04.8637699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8637757Z outputs = self.model( 2025-09-07T08:00:04.8638006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8638071Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8638314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8638384Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8638597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8638669Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8638908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8638982Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8638991Z 2025-09-07T08:00:04.8639078Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8639264Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8639329Z return mod(**inputs) 2025-09-07T08:00:04.8639569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8639634Z outputs = self.model( 2025-09-07T08:00:04.8639873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8639936Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8640178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8640285Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8640501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8640569Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8640813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8640914Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8641154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8641336Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8641339Z 2025-09-07T08:00:04.8641432Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8641628Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8641691Z return mod(**inputs) 2025-09-07T08:00:04.8641934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8641998Z outputs = self.model( 2025-09-07T08:00:04.8642296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8642366Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8642608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8642675Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8642890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8642959Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8643202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8643291Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8643527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8643599Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8643603Z 2025-09-07T08:00:04.8643695Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8643887Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8643946Z return mod(**inputs) 2025-09-07T08:00:04.8644188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8644244Z outputs = self.model( 2025-09-07T08:00:04.8644481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8644546Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8644784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8644850Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8645059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8645128Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8645370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8645452Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8645692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8645767Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8645807Z 2025-09-07T08:00:04.8645886Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8645953Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8646021Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8646095Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8646182Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8646374Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8646435Z return mod(**inputs) 2025-09-07T08:00:04.8646683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8646784Z outputs = self.model( 2025-09-07T08:00:04.8647027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8647097Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8647335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8647400Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8647612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8647678Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8647999Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8648083Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8648322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8648420Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8648718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8648847Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8648851Z 2025-09-07T08:00:04.8648936Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8649124Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8649178Z return mod(**inputs) 2025-09-07T08:00:04.8649421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8649481Z outputs = self.model( 2025-09-07T08:00:04.8649721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8649788Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8650027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8650086Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8650303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8650367Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8650610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8650709Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8650951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8651035Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8651319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8651422Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8651426Z 2025-09-07T08:00:04.8651515Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8651746Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8651803Z return mod(**inputs) 2025-09-07T08:00:04.8652043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8652105Z outputs = self.model( 2025-09-07T08:00:04.8652347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8652413Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8652691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8652757Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8652971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8653038Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8653277Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8653357Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8653594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8653721Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8653725Z 2025-09-07T08:00:04.8653813Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8654002Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8654058Z return mod(**inputs) 2025-09-07T08:00:04.8654302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8654358Z outputs = self.model( 2025-09-07T08:00:04.8654599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8654663Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8654904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8654971Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8655182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8655247Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8655492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8655587Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8655834Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8655977Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8655980Z 2025-09-07T08:00:04.8656079Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8656267Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8656323Z return mod(**inputs) 2025-09-07T08:00:04.8656578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8656637Z outputs = self.model( 2025-09-07T08:00:04.8656881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8656944Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8657182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8657286Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8657502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8657573Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8657816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8657920Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8658157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8658261Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8658264Z 2025-09-07T08:00:04.8658360Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8658543Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8658604Z return mod(**inputs) 2025-09-07T08:00:04.8658847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8658907Z outputs = self.model( 2025-09-07T08:00:04.8659149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8659210Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8659666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8659731Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8659945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8660012Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8660249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8660348Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8660586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8660666Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8660669Z 2025-09-07T08:00:04.8660740Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8660809Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8660877Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8660942Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8661043Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8661233Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8661288Z return mod(**inputs) 2025-09-07T08:00:04.8661545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8661602Z outputs = self.model( 2025-09-07T08:00:04.8661847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8661907Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8662146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8662211Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8662421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8662491Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8662736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8662831Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8663070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8663198Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8663495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8663617Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8663624Z 2025-09-07T08:00:04.8663717Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8663904Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8663992Z return mod(**inputs) 2025-09-07T08:00:04.8664242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8664300Z outputs = self.model( 2025-09-07T08:00:04.8664545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8664609Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8664850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8664919Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8665189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8665263Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8665501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8665650Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8665893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8665979Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8666273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8666366Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8666369Z 2025-09-07T08:00:04.8666460Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8666645Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8666701Z return mod(**inputs) 2025-09-07T08:00:04.8666948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8667004Z outputs = self.model( 2025-09-07T08:00:04.8667249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8667309Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8667556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8667617Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8667828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8667899Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8668140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8668234Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8668474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8668542Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8668546Z 2025-09-07T08:00:04.8668637Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8668819Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8668936Z return mod(**inputs) 2025-09-07T08:00:04.8669178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8669243Z outputs = self.model( 2025-09-07T08:00:04.8669487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8669550Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8669794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8669905Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8670122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8670187Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8670429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8670545Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8670549Z 2025-09-07T08:00:04.8670638Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8670886Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8670943Z return mod(**inputs) 2025-09-07T08:00:04.8671182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8671244Z outputs = self.model( 2025-09-07T08:00:04.8671484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8671549Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8671788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8671854Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8672073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8672136Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8672384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8672483Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8672692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8672754Z return self.act(input) 2025-09-07T08:00:04.8672758Z 2025-09-07T08:00:04.8672842Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8673030Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8673086Z return mod(**inputs) 2025-09-07T08:00:04.8673329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8673384Z outputs = self.model( 2025-09-07T08:00:04.8673624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8673691Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8673932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8673998Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8674207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8674274Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8674514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8674622Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8674625Z 2025-09-07T08:00:04.8674717Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8674897Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8674956Z return mod(**inputs) 2025-09-07T08:00:04.8675199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8675254Z outputs = self.model( 2025-09-07T08:00:04.8675539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8675602Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8675848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8675911Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8676123Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8676189Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8676428Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8676578Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8676827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8676985Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8676989Z 2025-09-07T08:00:04.8677082Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8677268Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8677329Z return mod(**inputs) 2025-09-07T08:00:04.8677568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8677630Z outputs = self.model( 2025-09-07T08:00:04.8677870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8677934Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8678179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8678243Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8678458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8678524Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8678767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8678852Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8679093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8679168Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8679172Z 2025-09-07T08:00:04.8679263Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8679455Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8679510Z return mod(**inputs) 2025-09-07T08:00:04.8679749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8679811Z outputs = self.model( 2025-09-07T08:00:04.8680051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8680152Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8680394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8680452Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8680666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8680732Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8680991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8681124Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8681367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8681441Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8681444Z 2025-09-07T08:00:04.8681514Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8681584Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8681648Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8681716Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8681804Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8681988Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8682110Z return mod(**inputs) 2025-09-07T08:00:04.8682356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8682420Z outputs = self.model( 2025-09-07T08:00:04.8682661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8682723Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8682967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8683029Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8683242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8683310Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8683559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8683642Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8683883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8683968Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8684261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8684388Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8684394Z 2025-09-07T08:00:04.8684482Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8684673Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8684728Z return mod(**inputs) 2025-09-07T08:00:04.8684970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8685030Z outputs = self.model( 2025-09-07T08:00:04.8685271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8685340Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8685578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8685645Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8685855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8685960Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8686208Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8686292Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8686540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8686623Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8686948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8687051Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8687054Z 2025-09-07T08:00:04.8687143Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8687334Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8687393Z return mod(**inputs) 2025-09-07T08:00:04.8687643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8687701Z outputs = self.model( 2025-09-07T08:00:04.8688000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8688070Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8688312Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8688384Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8688595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8688662Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8688906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8688998Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8689262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8689347Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8689350Z 2025-09-07T08:00:04.8689449Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8689652Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8689715Z return mod(**inputs) 2025-09-07T08:00:04.8689970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8690031Z outputs = self.model( 2025-09-07T08:00:04.8690277Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8690345Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8690587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8690658Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8690879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8690952Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8691194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8691298Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8691542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8691733Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8691737Z 2025-09-07T08:00:04.8691835Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8692026Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8692091Z return mod(**inputs) 2025-09-07T08:00:04.8692341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8692402Z outputs = self.model( 2025-09-07T08:00:04.8692647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8692746Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8692995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8693058Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8693274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8693352Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8693589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8693693Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8693994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8694069Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8694079Z 2025-09-07T08:00:04.8694172Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8694358Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8694422Z return mod(**inputs) 2025-09-07T08:00:04.8694665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8694735Z outputs = self.model( 2025-09-07T08:00:04.8694977Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8695043Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8695295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8695361Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8695582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8695650Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8695889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8695984Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8696220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8696302Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8696305Z 2025-09-07T08:00:04.8696377Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8696446Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8696521Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8696586Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8696684Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8696876Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8696932Z return mod(**inputs) 2025-09-07T08:00:04.8697178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8697235Z outputs = self.model( 2025-09-07T08:00:04.8697520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8697585Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8697831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8697894Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8698107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8698187Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8698464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8698569Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8698805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8698891Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8699186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8699306Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8699310Z 2025-09-07T08:00:04.8699468Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8699660Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8699726Z return mod(**inputs) 2025-09-07T08:00:04.8699969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8700028Z outputs = self.model( 2025-09-07T08:00:04.8700278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8700344Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8700588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8700649Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8700860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8700935Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8701174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8701275Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8701514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8701596Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8701889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8701987Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8701990Z 2025-09-07T08:00:04.8702087Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8702275Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8702337Z return mod(**inputs) 2025-09-07T08:00:04.8702578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8702638Z outputs = self.model( 2025-09-07T08:00:04.8702885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8702948Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8703194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8703297Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8703508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8703582Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8703824Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8703927Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8704166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8704276Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8704279Z 2025-09-07T08:00:04.8704372Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8704576Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8704649Z return mod(**inputs) 2025-09-07T08:00:04.8704891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8704959Z outputs = self.model( 2025-09-07T08:00:04.8705198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8705319Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8705574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8705685Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8705904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8705968Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8706210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8706331Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8706336Z 2025-09-07T08:00:04.8706432Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8706632Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8706696Z return mod(**inputs) 2025-09-07T08:00:04.8706944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8707002Z outputs = self.model( 2025-09-07T08:00:04.8707243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8707317Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8707559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8707630Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8707844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8707915Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8708167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8708276Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8708487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8708549Z return self.act(input) 2025-09-07T08:00:04.8708552Z 2025-09-07T08:00:04.8708650Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8708841Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8708896Z return mod(**inputs) 2025-09-07T08:00:04.8709189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8709247Z outputs = self.model( 2025-09-07T08:00:04.8709493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8709553Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8710005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8710084Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8710386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8710468Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8710723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8710800Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8710808Z 2025-09-07T08:00:04.8710913Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8711116Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8711182Z return mod(**inputs) 2025-09-07T08:00:04.8711549Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8711618Z outputs = self.model( 2025-09-07T08:00:04.8711865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8711935Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8712184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8712247Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8712469Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8712537Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8712778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8712873Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8713114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8713260Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8713265Z 2025-09-07T08:00:04.8713358Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8713557Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8713618Z return mod(**inputs) 2025-09-07T08:00:04.8713862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8713929Z outputs = self.model( 2025-09-07T08:00:04.8714170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8714240Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8714487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8714548Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8714767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8714832Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8715075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8715216Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8715461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8715535Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8715538Z 2025-09-07T08:00:04.8715630Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8715833Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8715890Z return mod(**inputs) 2025-09-07T08:00:04.8716138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8716234Z outputs = self.model( 2025-09-07T08:00:04.8716476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8716542Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8716784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8716848Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8717058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8717122Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8717429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8717514Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8717765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8717843Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8717846Z 2025-09-07T08:00:04.8717920Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8717994Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8718062Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8718132Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8718227Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8718417Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8718480Z return mod(**inputs) 2025-09-07T08:00:04.8718818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8718884Z outputs = self.model( 2025-09-07T08:00:04.8719132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8719205Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8719448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8719513Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8719740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8719810Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8720054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8720145Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8720382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8720476Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8720771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8720899Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8720940Z 2025-09-07T08:00:04.8721031Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8721225Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8721283Z return mod(**inputs) 2025-09-07T08:00:04.8721526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8721593Z outputs = self.model( 2025-09-07T08:00:04.8721834Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8721938Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8722181Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8722244Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8722467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8722537Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8722780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8722862Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8723189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8723282Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8723568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8723678Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8723682Z 2025-09-07T08:00:04.8723770Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8723961Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8724021Z return mod(**inputs) 2025-09-07T08:00:04.8724279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8724345Z outputs = self.model( 2025-09-07T08:00:04.8724586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8724657Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8724894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8724959Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8725176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8725241Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8725489Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8725578Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8725815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8725891Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8725894Z 2025-09-07T08:00:04.8725982Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8726180Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8726238Z return mod(**inputs) 2025-09-07T08:00:04.8726485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8726541Z outputs = self.model( 2025-09-07T08:00:04.8726783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8726892Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8727132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8727199Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8727411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8727475Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8727718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8727850Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8728095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8728233Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8728239Z 2025-09-07T08:00:04.8728333Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8728521Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8728574Z return mod(**inputs) 2025-09-07T08:00:04.8728882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8728941Z outputs = self.model( 2025-09-07T08:00:04.8729191Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8729253Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8729491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8729557Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8729766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8729837Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8730073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8730165Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8730414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8730480Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8730485Z 2025-09-07T08:00:04.8730577Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8730761Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8730822Z return mod(**inputs) 2025-09-07T08:00:04.8731062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8731121Z outputs = self.model( 2025-09-07T08:00:04.8731367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8731429Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8731676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8731736Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8731948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8732020Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8732263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8732360Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8732636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8732718Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8732721Z 2025-09-07T08:00:04.8732794Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8732861Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8732933Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8733004Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8733095Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8733279Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8733366Z return mod(**inputs) 2025-09-07T08:00:04.8733610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8733665Z outputs = self.model( 2025-09-07T08:00:04.8733910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8733972Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8734215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8734283Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8734570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8734644Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8734883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8734974Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8735216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8735301Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8735594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8735710Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8735714Z 2025-09-07T08:00:04.8735803Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8735994Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8736050Z return mod(**inputs) 2025-09-07T08:00:04.8736305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8736364Z outputs = self.model( 2025-09-07T08:00:04.8736609Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8736672Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8736915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8736983Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8737196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8737274Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8737514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8737619Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8737860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8737949Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8738242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8738373Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8738376Z 2025-09-07T08:00:04.8738475Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8738663Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8738726Z return mod(**inputs) 2025-09-07T08:00:04.8738973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8739068Z outputs = self.model( 2025-09-07T08:00:04.8739311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8739372Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8739608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8739675Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8739888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8739961Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8740197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8740370Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8740614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8740683Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8740687Z 2025-09-07T08:00:04.8740780Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8740964Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8741024Z return mod(**inputs) 2025-09-07T08:00:04.8741263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8741321Z outputs = self.model( 2025-09-07T08:00:04.8741566Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8741627Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8741870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8741932Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8742153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8742218Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8742455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8742571Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8742574Z 2025-09-07T08:00:04.8742663Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8742847Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8742901Z return mod(**inputs) 2025-09-07T08:00:04.8743145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8743203Z outputs = self.model( 2025-09-07T08:00:04.8743442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8743504Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8743742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8743837Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8744051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8744112Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8744352Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8744456Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8744665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8744757Z return self.act(input) 2025-09-07T08:00:04.8744760Z 2025-09-07T08:00:04.8744845Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8745032Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8745087Z return mod(**inputs) 2025-09-07T08:00:04.8745333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8745391Z outputs = self.model( 2025-09-07T08:00:04.8745689Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8745756Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8746057Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8746124Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8746334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8746400Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8746642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8746713Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8746718Z 2025-09-07T08:00:04.8746809Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8746990Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8747047Z return mod(**inputs) 2025-09-07T08:00:04.8747289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8747344Z outputs = self.model( 2025-09-07T08:00:04.8747588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8747649Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8747893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8747952Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8748158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8748224Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8748460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8748551Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8748790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8748934Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8748939Z 2025-09-07T08:00:04.8749027Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8749209Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8749267Z return mod(**inputs) 2025-09-07T08:00:04.8749503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8749598Z outputs = self.model( 2025-09-07T08:00:04.8749841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8749901Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8750148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8750207Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8750422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8750519Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8750759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8750849Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8751088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8751158Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8751162Z 2025-09-07T08:00:04.8751247Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8751490Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8751544Z return mod(**inputs) 2025-09-07T08:00:04.8751787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8751847Z outputs = self.model( 2025-09-07T08:00:04.8752083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8752152Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8752387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8752447Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8752661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8752725Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8752966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8753044Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8753284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8753359Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8753362Z 2025-09-07T08:00:04.8753427Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8753498Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8753563Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8753631Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8753719Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8753905Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8753965Z return mod(**inputs) 2025-09-07T08:00:04.8754207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8754270Z outputs = self.model( 2025-09-07T08:00:04.8754511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8754574Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8754820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8754882Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8755137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8755201Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8755441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8755527Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8755767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8755855Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8756200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8756319Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8756323Z 2025-09-07T08:00:04.8756410Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8756597Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8756654Z return mod(**inputs) 2025-09-07T08:00:04.8756892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8756950Z outputs = self.model( 2025-09-07T08:00:04.8757250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8757310Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8757561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8757621Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8757834Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8757898Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8758135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8758216Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8758452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8758539Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8758827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8758924Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8758928Z 2025-09-07T08:00:04.8759013Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8759198Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8759259Z return mod(**inputs) 2025-09-07T08:00:04.8759499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8759558Z outputs = self.model( 2025-09-07T08:00:04.8759795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8759857Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8760101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8760162Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8760378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8760441Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8760682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8760803Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8761041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8761112Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8761115Z 2025-09-07T08:00:04.8761205Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8761399Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8761457Z return mod(**inputs) 2025-09-07T08:00:04.8761731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8761793Z outputs = self.model( 2025-09-07T08:00:04.8762034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8762100Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8762339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8762400Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8762611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8762730Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8762976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8763070Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8763313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8763444Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8763450Z 2025-09-07T08:00:04.8763535Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8763720Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8763776Z return mod(**inputs) 2025-09-07T08:00:04.8764018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8764074Z outputs = self.model( 2025-09-07T08:00:04.8764318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8764383Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8764622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8764687Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8764897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8764970Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8765207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8765295Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8765544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8765612Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8765615Z 2025-09-07T08:00:04.8765707Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8765890Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8765943Z return mod(**inputs) 2025-09-07T08:00:04.8766188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8766280Z outputs = self.model( 2025-09-07T08:00:04.8766531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8766590Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8766827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8766896Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8767107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8767211Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8767453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8767548Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8767786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8767861Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8767865Z 2025-09-07T08:00:04.8767940Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8768006Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8768072Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8768137Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8768283Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8768474Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8768530Z return mod(**inputs) 2025-09-07T08:00:04.8768776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8768833Z outputs = self.model( 2025-09-07T08:00:04.8769071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8769136Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8769376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8769441Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8769651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8769715Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8769959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8770048Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8770289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8770368Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8770659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8770773Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8770779Z 2025-09-07T08:00:04.8770862Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8771050Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8771103Z return mod(**inputs) 2025-09-07T08:00:04.8771345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8771405Z outputs = self.model( 2025-09-07T08:00:04.8771643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8771706Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8771984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8772049Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8772256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8772324Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8772564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8772653Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8772932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8773010Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8773296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8773389Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8773392Z 2025-09-07T08:00:04.8773478Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8773665Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8773719Z return mod(**inputs) 2025-09-07T08:00:04.8774020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8774076Z outputs = self.model( 2025-09-07T08:00:04.8774323Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8774386Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8774624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8774684Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8774896Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8774962Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8775201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8775291Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8775535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8775605Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8775608Z 2025-09-07T08:00:04.8775701Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8775882Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8775937Z return mod(**inputs) 2025-09-07T08:00:04.8776182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8776236Z outputs = self.model( 2025-09-07T08:00:04.8776478Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8776543Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8776791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8776851Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8777060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8777127Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8777365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8777523Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8777526Z 2025-09-07T08:00:04.8777612Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8777792Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8777849Z return mod(**inputs) 2025-09-07T08:00:04.8778090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8778149Z outputs = self.model( 2025-09-07T08:00:04.8778389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8778486Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8778728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8778786Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8779003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8779066Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8779307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8779403Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8779667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8779732Z return self.act(input) 2025-09-07T08:00:04.8779737Z 2025-09-07T08:00:04.8779824Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8780009Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8780063Z return mod(**inputs) 2025-09-07T08:00:04.8780301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8780363Z outputs = self.model( 2025-09-07T08:00:04.8780603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8780667Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8780908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8780974Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8781184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8781248Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8781488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8781558Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8781563Z 2025-09-07T08:00:04.8781654Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8781836Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8781891Z return mod(**inputs) 2025-09-07T08:00:04.8782136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8782194Z outputs = self.model( 2025-09-07T08:00:04.8782436Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8782496Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8782733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8782795Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8783006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8783113Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8783359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8783447Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8783690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8783827Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8783830Z 2025-09-07T08:00:04.8783957Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8784144Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8784201Z return mod(**inputs) 2025-09-07T08:00:04.8784445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8784507Z outputs = self.model( 2025-09-07T08:00:04.8784748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8784809Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8785117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8785181Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8785398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8785464Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8785749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8785836Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8786076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8786149Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8786153Z 2025-09-07T08:00:04.8786240Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8786423Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8786483Z return mod(**inputs) 2025-09-07T08:00:04.8786746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8786806Z outputs = self.model( 2025-09-07T08:00:04.8787045Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8787107Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8787353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8787417Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8787634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8787699Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8787938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8788019Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8788259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8788340Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8788344Z 2025-09-07T08:00:04.8788414Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8788483Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8788549Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8788654Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8788746Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8788933Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8788991Z return mod(**inputs) 2025-09-07T08:00:04.8789235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8789290Z outputs = self.model( 2025-09-07T08:00:04.8789536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8789631Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8789875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8789937Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8790146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8790220Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8790458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8790541Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8790846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8790943Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8791233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8791355Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8791359Z 2025-09-07T08:00:04.8791452Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8791636Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8791692Z return mod(**inputs) 2025-09-07T08:00:04.8791933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8791998Z outputs = self.model( 2025-09-07T08:00:04.8792246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8792308Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8792551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8792614Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8792826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8792890Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8793131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8793221Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8793457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8793544Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8793825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8793925Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8793928Z 2025-09-07T08:00:04.8794020Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8794205Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8794265Z return mod(**inputs) 2025-09-07T08:00:04.8794545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8794606Z outputs = self.model( 2025-09-07T08:00:04.8794849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8794911Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8795156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8795218Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8795469Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8795534Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8795771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8795857Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8796092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8796166Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8796170Z 2025-09-07T08:00:04.8796267Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8796526Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8796588Z return mod(**inputs) 2025-09-07T08:00:04.8796830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8796893Z outputs = self.model( 2025-09-07T08:00:04.8797131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8797199Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8797438Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8797497Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8797709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8797773Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8798013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8798110Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8798349Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8798490Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8798494Z 2025-09-07T08:00:04.8798580Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8798770Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8798827Z return mod(**inputs) 2025-09-07T08:00:04.8799069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8799126Z outputs = self.model( 2025-09-07T08:00:04.8799369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8799436Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8799680Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8799743Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8799951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8800052Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8800295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8800386Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8800630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8800701Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8800705Z 2025-09-07T08:00:04.8800793Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8801015Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8801071Z return mod(**inputs) 2025-09-07T08:00:04.8801316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8801373Z outputs = self.model( 2025-09-07T08:00:04.8801619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8801680Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8801919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8801985Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8802253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8802324Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8802577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8802668Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8802911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8802985Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8802989Z 2025-09-07T08:00:04.8803062Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8803129Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8803196Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8803265Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8803356Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8803551Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8803606Z return mod(**inputs) 2025-09-07T08:00:04.8803852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8803913Z outputs = self.model( 2025-09-07T08:00:04.8804158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8804226Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8804465Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8804531Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8804748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8804817Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8805057Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8805147Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8805390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8805472Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8805761Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8805918Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8805921Z 2025-09-07T08:00:04.8806008Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8806204Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8806258Z return mod(**inputs) 2025-09-07T08:00:04.8806530Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8806624Z outputs = self.model( 2025-09-07T08:00:04.8806866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8806933Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8807172Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8807239Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8807447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8807513Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8807813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8807908Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8808152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8808234Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8808518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8808616Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8808620Z 2025-09-07T08:00:04.8808705Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8808897Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8808952Z return mod(**inputs) 2025-09-07T08:00:04.8809198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8809254Z outputs = self.model( 2025-09-07T08:00:04.8809493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8809561Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8809927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8810002Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8810223Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8810293Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8810542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8810638Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8810885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8810953Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8810958Z 2025-09-07T08:00:04.8811055Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8811245Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8811300Z return mod(**inputs) 2025-09-07T08:00:04.8811547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8811680Z outputs = self.model( 2025-09-07T08:00:04.8811925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8811990Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8812234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8812302Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8812513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8812654Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8812895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8813005Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8813016Z 2025-09-07T08:00:04.8813104Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8813290Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8813351Z return mod(**inputs) 2025-09-07T08:00:04.8813692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8813757Z outputs = self.model( 2025-09-07T08:00:04.8813996Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8814060Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8814306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8814369Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8814585Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8814652Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8814891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8814993Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8815200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8815266Z return self.act(input) 2025-09-07T08:00:04.8815270Z 2025-09-07T08:00:04.8815359Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8815549Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8815603Z return mod(**inputs) 2025-09-07T08:00:04.8815842Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8815908Z outputs = self.model( 2025-09-07T08:00:04.8816146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8816212Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8816451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8816513Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8816729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8816796Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8817034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8817106Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8817110Z 2025-09-07T08:00:04.8817195Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8817425Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8817478Z return mod(**inputs) 2025-09-07T08:00:04.8817721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8817775Z outputs = self.model( 2025-09-07T08:00:04.8818020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8818081Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8818356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8818421Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8818629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8818699Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8818936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8819024Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8819264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8819479Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8819483Z 2025-09-07T08:00:04.8819576Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8819758Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8819819Z return mod(**inputs) 2025-09-07T08:00:04.8820059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8820118Z outputs = self.model( 2025-09-07T08:00:04.8820358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8820421Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8820665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8820725Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8820935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8821004Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8821240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8821327Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8821564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8821634Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8821643Z 2025-09-07T08:00:04.8821730Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8821913Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8821972Z return mod(**inputs) 2025-09-07T08:00:04.8822213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8822273Z outputs = self.model( 2025-09-07T08:00:04.8822515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8822575Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8822817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8822913Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8823126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8823190Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8823425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8823515Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8823753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8823867Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8823870Z 2025-09-07T08:00:04.8823939Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8824008Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8824078Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8824141Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8824236Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8824420Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8824475Z return mod(**inputs) 2025-09-07T08:00:04.8824722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8824836Z outputs = self.model( 2025-09-07T08:00:04.8825090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8825155Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8825404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8825466Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8825723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8825800Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8826041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8826132Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8826371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8826457Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8826751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8826873Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8826877Z 2025-09-07T08:00:04.8826972Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8827159Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8827221Z return mod(**inputs) 2025-09-07T08:00:04.8827463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8827520Z outputs = self.model( 2025-09-07T08:00:04.8827763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8827824Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8828065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8828127Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8828338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8828408Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8828645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8828773Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8829009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8829090Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8829381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8829478Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8829514Z 2025-09-07T08:00:04.8829607Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8829789Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8829846Z return mod(**inputs) 2025-09-07T08:00:04.8830088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8830147Z outputs = self.model( 2025-09-07T08:00:04.8830392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8830453Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8830753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8830814Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8831025Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8831095Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8831332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8831417Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8831660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8831738Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8831741Z 2025-09-07T08:00:04.8831829Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8832018Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8832079Z return mod(**inputs) 2025-09-07T08:00:04.8832320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8832383Z outputs = self.model( 2025-09-07T08:00:04.8832626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8832688Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8832932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8832995Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8833212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8833278Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8833521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8833622Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8833861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8834001Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8834004Z 2025-09-07T08:00:04.8834091Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8834322Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8834377Z return mod(**inputs) 2025-09-07T08:00:04.8834618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8834681Z outputs = self.model( 2025-09-07T08:00:04.8834922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8834989Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8835228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8835330Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8835544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8835607Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8835852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8835942Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8836185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8836313Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8836317Z 2025-09-07T08:00:04.8836404Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8836595Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8836652Z return mod(**inputs) 2025-09-07T08:00:04.8836895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8836953Z outputs = self.model( 2025-09-07T08:00:04.8837193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8837261Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8837500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8837567Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8837780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8837845Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8838087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8838181Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8838424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8838500Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8838503Z 2025-09-07T08:00:04.8838576Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8838641Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8838706Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8838776Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8838864Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8839054Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8839111Z return mod(**inputs) 2025-09-07T08:00:04.8839351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8839416Z outputs = self.model( 2025-09-07T08:00:04.8839659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8839724Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8840001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8840064Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8840282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8840349Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8840598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8840692Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8840988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8841081Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8841372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8841498Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8841501Z 2025-09-07T08:00:04.8841595Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8841789Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8841909Z return mod(**inputs) 2025-09-07T08:00:04.8842151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8842215Z outputs = self.model( 2025-09-07T08:00:04.8842455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8842523Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8842760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8842822Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8843035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8843101Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8843344Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8843433Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8843683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8843774Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8844062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8844158Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8844163Z 2025-09-07T08:00:04.8844249Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8844439Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8844492Z return mod(**inputs) 2025-09-07T08:00:04.8844732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8844796Z outputs = self.model( 2025-09-07T08:00:04.8845037Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8845104Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8845343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8845402Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8845616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8845729Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8845968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8846055Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8846301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8846370Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8846373Z 2025-09-07T08:00:04.8846492Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8846678Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8846735Z return mod(**inputs) 2025-09-07T08:00:04.8850984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8851074Z outputs = self.model( 2025-09-07T08:00:04.8851364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8851435Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8851800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8851869Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8852112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8852195Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8852458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8852578Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8852583Z 2025-09-07T08:00:04.8852688Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8852893Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8852952Z return mod(**inputs) 2025-09-07T08:00:04.8853213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8853280Z outputs = self.model( 2025-09-07T08:00:04.8853524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8853592Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8853831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8853894Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8854115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8854189Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8854438Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8854546Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8854760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8854824Z return self.act(input) 2025-09-07T08:00:04.8854829Z 2025-09-07T08:00:04.8854922Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8855122Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8855180Z return mod(**inputs) 2025-09-07T08:00:04.8855428Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8855487Z outputs = self.model( 2025-09-07T08:00:04.8855782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8855853Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8856094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8856163Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8856377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8856442Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8856726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8856800Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8856804Z 2025-09-07T08:00:04.8856901Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8857089Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8857150Z return mod(**inputs) 2025-09-07T08:00:04.8857397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8857453Z outputs = self.model( 2025-09-07T08:00:04.8857757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8857824Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8858069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8858131Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8858348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8858418Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8858662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8858753Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8858991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8859142Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8859146Z 2025-09-07T08:00:04.8859235Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8859427Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8859483Z return mod(**inputs) 2025-09-07T08:00:04.8859726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8859784Z outputs = self.model( 2025-09-07T08:00:04.8860024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8860090Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8860328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8860395Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8860609Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8860673Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8860915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8861000Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8861239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8861341Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8861345Z 2025-09-07T08:00:04.8861432Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8861616Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8861669Z return mod(**inputs) 2025-09-07T08:00:04.8861916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8861972Z outputs = self.model( 2025-09-07T08:00:04.8862214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8862313Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8862551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8862613Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8862825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8862893Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8863129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8863211Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8863514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8863593Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8863597Z 2025-09-07T08:00:04.8863675Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8863744Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8863812Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8863882Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8863971Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8864161Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8864214Z return mod(**inputs) 2025-09-07T08:00:04.8864453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8864511Z outputs = self.model( 2025-09-07T08:00:04.8864751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8864814Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8865051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8865112Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8865322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8865387Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8865691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8865772Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8866013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8866105Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8866402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8866532Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8866536Z 2025-09-07T08:00:04.8866629Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8866822Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8866935Z return mod(**inputs) 2025-09-07T08:00:04.8867187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8867245Z outputs = self.model( 2025-09-07T08:00:04.8867485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8867552Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8867790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8867888Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8868101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8868166Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8868409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8868494Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8868739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8868818Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8869165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8869271Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8869275Z 2025-09-07T08:00:04.8869365Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8869557Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8869612Z return mod(**inputs) 2025-09-07T08:00:04.8869860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8869919Z outputs = self.model( 2025-09-07T08:00:04.8870158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8870229Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8870477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8870542Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8870752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8870819Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8871064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8871149Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8871389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8871456Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8871460Z 2025-09-07T08:00:04.8871556Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8871744Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8871804Z return mod(**inputs) 2025-09-07T08:00:04.8872050Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8872109Z outputs = self.model( 2025-09-07T08:00:04.8872356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8872417Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8872655Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8872760Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8872974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8873044Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8873283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8873381Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8873620Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8873792Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8873796Z 2025-09-07T08:00:04.8873894Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8874078Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8874138Z return mod(**inputs) 2025-09-07T08:00:04.8874378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8874435Z outputs = self.model( 2025-09-07T08:00:04.8874740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8874804Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8875051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8875118Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8875327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8875401Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8875640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8875740Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8875977Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8876047Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8876050Z 2025-09-07T08:00:04.8876141Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8876323Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8876384Z return mod(**inputs) 2025-09-07T08:00:04.8876623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8876681Z outputs = self.model( 2025-09-07T08:00:04.8876918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8876979Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8877220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8877279Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8877492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8877558Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8877793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8877886Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8878122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8878200Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8878238Z 2025-09-07T08:00:04.8878312Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8878383Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8878450Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8878515Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8878605Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8878787Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8878846Z return mod(**inputs) 2025-09-07T08:00:04.8879083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8879182Z outputs = self.model( 2025-09-07T08:00:04.8879425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8879487Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8879730Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8879792Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8880004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8880074Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8880369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8880461Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8880701Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8880787Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8881080Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8881198Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8881201Z 2025-09-07T08:00:04.8881292Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8881473Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8881530Z return mod(**inputs) 2025-09-07T08:00:04.8881771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8881829Z outputs = self.model( 2025-09-07T08:00:04.8882070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8882130Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8882372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8882431Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8882641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8882707Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8882949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8883045Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8883280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8883362Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8883644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8883741Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8883744Z 2025-09-07T08:00:04.8884162Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8884347Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8884409Z return mod(**inputs) 2025-09-07T08:00:04.8884651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8884713Z outputs = self.model( 2025-09-07T08:00:04.8884962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8885024Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8885313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8885376Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8885600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8885672Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8885922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8886025Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8886341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8886419Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8886422Z 2025-09-07T08:00:04.8886516Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8886705Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8886765Z return mod(**inputs) 2025-09-07T08:00:04.8887009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8887075Z outputs = self.model( 2025-09-07T08:00:04.8887317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8887382Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8887626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8887693Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8887910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8887976Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8888220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8888329Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8888333Z 2025-09-07T08:00:04.8888421Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8888612Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8888667Z return mod(**inputs) 2025-09-07T08:00:04.8888912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8888968Z outputs = self.model( 2025-09-07T08:00:04.8889208Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8889275Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8889515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8889583Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8889792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8889858Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8890140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8890236Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8890446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8890511Z return self.act(input) 2025-09-07T08:00:04.8890514Z 2025-09-07T08:00:04.8890606Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8890790Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8890879Z return mod(**inputs) 2025-09-07T08:00:04.8891122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8891181Z outputs = self.model( 2025-09-07T08:00:04.8891426Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8891490Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8891725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8891786Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8892052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8892125Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8892366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8892447Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8892451Z 2025-09-07T08:00:04.8892535Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8892719Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8892778Z return mod(**inputs) 2025-09-07T08:00:04.8893019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8893079Z outputs = self.model( 2025-09-07T08:00:04.8893321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8893381Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8893622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8893683Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8893897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8893961Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8894196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8894289Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8894525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8894668Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8894674Z 2025-09-07T08:00:04.8894759Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8894951Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8895005Z return mod(**inputs) 2025-09-07T08:00:04.8895244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8895304Z outputs = self.model( 2025-09-07T08:00:04.8895544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8895661Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8895902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8895963Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8896175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8896239Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8896480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8896597Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8896838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8896908Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8896913Z 2025-09-07T08:00:04.8896999Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8897184Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8897239Z return mod(**inputs) 2025-09-07T08:00:04.8897541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8897598Z outputs = self.model( 2025-09-07T08:00:04.8897836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8897900Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8898140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8898201Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8898410Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8898473Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8898712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8898793Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8899038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8899112Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8899118Z 2025-09-07T08:00:04.8899190Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8899256Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8899320Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8899388Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8899475Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8899662Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8899715Z return mod(**inputs) 2025-09-07T08:00:04.8899955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8900015Z outputs = self.model( 2025-09-07T08:00:04.8900264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8900329Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8900569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8900632Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8900848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8900912Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8901193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8901286Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8901524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8901618Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8901906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8902066Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8902069Z 2025-09-07T08:00:04.8902163Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8902351Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8902405Z return mod(**inputs) 2025-09-07T08:00:04.8902648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8902710Z outputs = self.model( 2025-09-07T08:00:04.8902950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8903013Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8903314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8903377Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8903594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8903660Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8903903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8903989Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8904229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8904309Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8904610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8904704Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8904707Z 2025-09-07T08:00:04.8904795Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8904983Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8905037Z return mod(**inputs) 2025-09-07T08:00:04.8905283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8905340Z outputs = self.model( 2025-09-07T08:00:04.8905581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8905715Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8905955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8906029Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8906240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8906314Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8906554Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8906636Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8906877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8907037Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8907040Z 2025-09-07T08:00:04.8907133Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8907318Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8907375Z return mod(**inputs) 2025-09-07T08:00:04.8907625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8907683Z outputs = self.model( 2025-09-07T08:00:04.8907965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8908028Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8908272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8908335Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8908546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8908617Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8908856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8909038Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8909278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8909420Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8909423Z 2025-09-07T08:00:04.8909512Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8909869Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8909937Z return mod(**inputs) 2025-09-07T08:00:04.8910189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8910245Z outputs = self.model( 2025-09-07T08:00:04.8910493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8910559Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8910805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8910866Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8911083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8911148Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8911388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8911490Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8911726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8911801Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8911805Z 2025-09-07T08:00:04.8911895Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8912083Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8912143Z return mod(**inputs) 2025-09-07T08:00:04.8912385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8912447Z outputs = self.model( 2025-09-07T08:00:04.8912686Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8912836Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8913074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8913136Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8913353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8913424Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8913665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8913804Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8914043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8914126Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8914130Z 2025-09-07T08:00:04.8914205Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8914282Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8914358Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8914423Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8914530Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8914725Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8914886Z return mod(**inputs) 2025-09-07T08:00:04.8915142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8915206Z outputs = self.model( 2025-09-07T08:00:04.8915454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8915518Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8915766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8915833Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8916056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8916130Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8916377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8916484Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8916722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8916815Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8917112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8917233Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8917239Z 2025-09-07T08:00:04.8917340Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8917536Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8917600Z return mod(**inputs) 2025-09-07T08:00:04.8917846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8917910Z outputs = self.model( 2025-09-07T08:00:04.8918151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8918216Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8918462Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8918523Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8918781Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8918848Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8919090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8919193Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8919436Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8919522Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8919858Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8919958Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8919967Z 2025-09-07T08:00:04.8920062Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8920254Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8920318Z return mod(**inputs) 2025-09-07T08:00:04.8920564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8920628Z outputs = self.model( 2025-09-07T08:00:04.8920955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8921024Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8921271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8921334Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8921553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8921622Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8921868Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8921973Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8922210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8922291Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8922294Z 2025-09-07T08:00:04.8922385Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8922576Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8922633Z return mod(**inputs) 2025-09-07T08:00:04.8922876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8922940Z outputs = self.model( 2025-09-07T08:00:04.8923183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8923250Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8923487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8923551Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8923771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8923836Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8924079Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8924191Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8924195Z 2025-09-07T08:00:04.8924285Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8924480Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8924573Z return mod(**inputs) 2025-09-07T08:00:04.8924824Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8924880Z outputs = self.model( 2025-09-07T08:00:04.8925127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8925190Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8925429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8925528Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8925739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8925811Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8926054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8926156Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8926367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8926427Z return self.act(input) 2025-09-07T08:00:04.8926431Z 2025-09-07T08:00:04.8926584Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8926769Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8926826Z return mod(**inputs) 2025-09-07T08:00:04.8927073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8927130Z outputs = self.model( 2025-09-07T08:00:04.8927374Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8927440Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8927681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8927740Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8927951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8928019Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8928256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8928337Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8928340Z 2025-09-07T08:00:04.8928426Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8928613Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8928673Z return mod(**inputs) 2025-09-07T08:00:04.8928915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8928976Z outputs = self.model( 2025-09-07T08:00:04.8929215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8929280Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8929527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8929590Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8929806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8929874Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8930118Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8930240Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8930480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8930624Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8930627Z 2025-09-07T08:00:04.8930717Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8930909Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8931008Z return mod(**inputs) 2025-09-07T08:00:04.8931249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8931310Z outputs = self.model( 2025-09-07T08:00:04.8931551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8931619Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8931857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8931922Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8932135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8932258Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8932503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8932587Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8932831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8932899Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8932902Z 2025-09-07T08:00:04.8932991Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8933180Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8933235Z return mod(**inputs) 2025-09-07T08:00:04.8933476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8933534Z outputs = self.model( 2025-09-07T08:00:04.8933773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8933840Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8934077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8934143Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8934353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8934424Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8934660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8934743Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8934991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8935065Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8935068Z 2025-09-07T08:00:04.8935144Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8935212Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8935279Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8935351Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8935438Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8935621Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8935710Z return mod(**inputs) 2025-09-07T08:00:04.8935950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8936015Z outputs = self.model( 2025-09-07T08:00:04.8936257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8936324Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8936562Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8936657Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8936873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8936937Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8937181Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8937264Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8937503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8937589Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8937940Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8938068Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8938073Z 2025-09-07T08:00:04.8938163Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8938350Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8938407Z return mod(**inputs) 2025-09-07T08:00:04.8938650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8938714Z outputs = self.model( 2025-09-07T08:00:04.8938956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8939026Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8939268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8939335Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8939548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8939616Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8939865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8939945Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8940189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8940269Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8940553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8940658Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8940661Z 2025-09-07T08:00:04.8940749Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8940939Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8940996Z return mod(**inputs) 2025-09-07T08:00:04.8941241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8941297Z outputs = self.model( 2025-09-07T08:00:04.8941574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8941642Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8941880Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8941949Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8942159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8942226Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8942508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8942590Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8942834Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8942905Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8942909Z 2025-09-07T08:00:04.8943004Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8943188Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8943243Z return mod(**inputs) 2025-09-07T08:00:04.8943548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8943605Z outputs = self.model( 2025-09-07T08:00:04.8943861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8943930Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8944168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8944234Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8944444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8944515Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8944751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8944848Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8945092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8945231Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8945235Z 2025-09-07T08:00:04.8945328Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8945512Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8945573Z return mod(**inputs) 2025-09-07T08:00:04.8945894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8945951Z outputs = self.model( 2025-09-07T08:00:04.8946203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8946267Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8946535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8946603Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8946816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8946889Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8947127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8947287Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8947526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8947594Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8947603Z 2025-09-07T08:00:04.8947690Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8947877Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8947939Z return mod(**inputs) 2025-09-07T08:00:04.8948180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8948279Z outputs = self.model( 2025-09-07T08:00:04.8948518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8948581Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8948828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8948889Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8949105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8949168Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8949467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8949562Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8949804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8949884Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8949887Z 2025-09-07T08:00:04.8949958Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8950030Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8950096Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8950162Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8950253Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8950438Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8950498Z return mod(**inputs) 2025-09-07T08:00:04.8950742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8950798Z outputs = self.model( 2025-09-07T08:00:04.8951041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8951103Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8951347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8951409Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8951618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8951691Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8951925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8952021Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8952258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8952340Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8952631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8952749Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8952803Z 2025-09-07T08:00:04.8952893Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8953076Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8953138Z return mod(**inputs) 2025-09-07T08:00:04.8953378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8953437Z outputs = self.model( 2025-09-07T08:00:04.8953683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8953778Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8954023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8954083Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8954297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8954370Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8954608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8954705Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8955107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8955189Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8955477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8955570Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8955573Z 2025-09-07T08:00:04.8955666Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8955847Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8955909Z return mod(**inputs) 2025-09-07T08:00:04.8956149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8956206Z outputs = self.model( 2025-09-07T08:00:04.8956452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8956513Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8956757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8956819Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8957029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8957100Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8957338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8957434Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8957668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8957740Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8957746Z 2025-09-07T08:00:04.8957832Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8958013Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8958075Z return mod(**inputs) 2025-09-07T08:00:04.8958313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8958376Z outputs = self.model( 2025-09-07T08:00:04.8958614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8958715Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8958960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8959019Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8959239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8959302Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8959544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8959690Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8959693Z 2025-09-07T08:00:04.8959779Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8959964Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8960021Z return mod(**inputs) 2025-09-07T08:00:04.8960264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8960317Z outputs = self.model( 2025-09-07T08:00:04.8960557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8960680Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8960924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8960991Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8961202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8961267Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8961509Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8961612Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8961818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8961879Z return self.act(input) 2025-09-07T08:00:04.8961882Z 2025-09-07T08:00:04.8961977Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8962163Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8962217Z return mod(**inputs) 2025-09-07T08:00:04.8962461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8962515Z outputs = self.model( 2025-09-07T08:00:04.8962759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8962822Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8963061Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8963122Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8963331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8963398Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8963634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8963706Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8963712Z 2025-09-07T08:00:04.8963800Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8963985Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8964040Z return mod(**inputs) 2025-09-07T08:00:04.8964314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8964375Z outputs = self.model( 2025-09-07T08:00:04.8964625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8964687Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8964933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8964996Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8965250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8965321Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8965567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8965661Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8965901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8966044Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8966049Z 2025-09-07T08:00:04.8966142Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8966399Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8966458Z return mod(**inputs) 2025-09-07T08:00:04.8966706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8966766Z outputs = self.model( 2025-09-07T08:00:04.8967007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8967073Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8967320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8967383Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8967603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8967671Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8967914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8968000Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8968237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8968311Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8968315Z 2025-09-07T08:00:04.8968404Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8968596Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8968652Z return mod(**inputs) 2025-09-07T08:00:04.8968898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8968954Z outputs = self.model( 2025-09-07T08:00:04.8969196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8969262Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8969503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8969563Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8969773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8969872Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8970113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8970193Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8970431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8970508Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8970512Z 2025-09-07T08:00:04.8970586Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8970652Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8970750Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8970818Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8970905Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8971088Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8971147Z return mod(**inputs) 2025-09-07T08:00:04.8971387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8971445Z outputs = self.model( 2025-09-07T08:00:04.8971683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8971818Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8972063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8972125Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8972342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8972405Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8972645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8972730Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8972970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8973061Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8973352Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8973478Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8973483Z 2025-09-07T08:00:04.8973572Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8973761Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8973816Z return mod(**inputs) 2025-09-07T08:00:04.8974056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8974120Z outputs = self.model( 2025-09-07T08:00:04.8974361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8974422Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8974663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8974722Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8974932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8974999Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8975238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8975320Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8975594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8975679Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8975963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8976068Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8976072Z 2025-09-07T08:00:04.8976157Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8976345Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8976434Z return mod(**inputs) 2025-09-07T08:00:04.8976675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8976733Z outputs = self.model( 2025-09-07T08:00:04.8976975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8977041Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8977279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8977337Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8977609Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8977674Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8977929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 413, in forward 2025-09-07T08:00:04.8978013Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:00:04.8978252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8978322Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8978327Z 2025-09-07T08:00:04.8978414Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8978605Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8978660Z return mod(**inputs) 2025-09-07T08:00:04.8978910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8978965Z outputs = self.model( 2025-09-07T08:00:04.8979204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8979268Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8979505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8979568Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8979778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8979846Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8980086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8980182Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8980421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 216, in forward 2025-09-07T08:00:04.8980563Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:00:04.8980568Z 2025-09-07T08:00:04.8980656Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8980841Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8980895Z return mod(**inputs) 2025-09-07T08:00:04.8981142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8981237Z outputs = self.model( 2025-09-07T08:00:04.8981476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8981536Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8981779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8981842Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8982049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8982150Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8982387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8982483Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8982729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 235, in forward 2025-09-07T08:00:04.8982795Z key_states = self.k_proj(current_states) 2025-09-07T08:00:04.8982798Z 2025-09-07T08:00:04.8982888Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8983132Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8983192Z return mod(**inputs) 2025-09-07T08:00:04.8983433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8983490Z outputs = self.model( 2025-09-07T08:00:04.8983733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8983795Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8984038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8984099Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8984308Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8984376Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8984615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8984706Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8984944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 236, in forward 2025-09-07T08:00:04.8985023Z value_states = self.v_proj(current_states) 2025-09-07T08:00:04.8985027Z 2025-09-07T08:00:04.8985093Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8985157Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8985226Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8985292Z cudagraph partition due to non gpu ops 2025-09-07T08:00:04.8985383Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8985566Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8985666Z return mod(**inputs) 2025-09-07T08:00:04.8985914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8985973Z outputs = self.model( 2025-09-07T08:00:04.8986215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8986282Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8986527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8986594Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8986868Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8986941Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8987182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8987280Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8987523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8987647Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8987936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:00:04.8988056Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:04.8988060Z 2025-09-07T08:00:04.8988156Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8988341Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8988395Z return mod(**inputs) 2025-09-07T08:00:04.8988643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8988701Z outputs = self.model( 2025-09-07T08:00:04.8989005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8989069Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8989313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8989381Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8989592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8989663Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8989901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8989996Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8990241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 254, in forward 2025-09-07T08:00:04.8990325Z attn_output, attn_weights = attention_interface( 2025-09-07T08:00:04.8990618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:00:04.8990713Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:00:04.8990716Z 2025-09-07T08:00:04.8990806Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8990994Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8991053Z return mod(**inputs) 2025-09-07T08:00:04.8991298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8991353Z outputs = self.model( 2025-09-07T08:00:04.8991593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8991659Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8991899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8991964Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8992174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8992243Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8992482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 430, in forward 2025-09-07T08:00:04.8992609Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:00:04.8992847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 268, in forward 2025-09-07T08:00:04.8992919Z attn_output = self.out_proj(attn_output) 2025-09-07T08:00:04.8992923Z 2025-09-07T08:00:04.8993022Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8993204Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8993296Z return mod(**inputs) 2025-09-07T08:00:04.8993539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8993597Z outputs = self.model( 2025-09-07T08:00:04.8993838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8993903Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8994147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8994208Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8994422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8994592Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8994834Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8994949Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8994953Z 2025-09-07T08:00:04.8995039Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8995225Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8995287Z return mod(**inputs) 2025-09-07T08:00:04.8995526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8995584Z outputs = self.model( 2025-09-07T08:00:04.8995821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8995889Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8996132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8996192Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8996405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8996468Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8996710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 445, in forward 2025-09-07T08:00:04.8996811Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:00:04.8997015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:04.8997076Z return self.act(input) 2025-09-07T08:00:04.8997079Z 2025-09-07T08:00:04.8997164Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8997352Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8997408Z return mod(**inputs) 2025-09-07T08:00:04.8997658Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1471, in forward 2025-09-07T08:00:04.8997713Z outputs = self.model( 2025-09-07T08:00:04.8997953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1288, in forward 2025-09-07T08:00:04.8998019Z decoder_outputs = self.decoder( 2025-09-07T08:00:04.8998294Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1115, in forward 2025-09-07T08:00:04.8998359Z layer_outputs = decoder_layer( 2025-09-07T08:00:04.8998566Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:04.8998632Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:04.8998873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 447, in forward 2025-09-07T08:00:04.8998944Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:00:04.8998978Z 2025-09-07T08:00:04.8999068Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8999249Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.8999306Z return mod(**inputs) 2025-09-07T08:00:04.8999545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1490, in forward 2025-09-07T08:00:04.8999616Z lm_logits = self.lm_head(outputs[0]) 2025-09-07T08:00:04.8999620Z 2025-09-07T08:00:04.8999708Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:04.8999888Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:04.9000004Z return mod(**inputs) 2025-09-07T08:00:04.9000247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bart/modeling_bart.py", line 1497, in forward 2025-09-07T08:00:04.9000406Z masked_lm_loss = loss_fct(lm_logits.view(-1, self.config.vocab_size), labels.view(-1)) 2025-09-07T08:00:04.9000413Z 2025-09-07T08:00:15.8144273Z pass 2025-09-07T08:00:15.8144694Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:19.1658915Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:00:19.1659798Z import pynvml # type: ignore[import] 2025-09-07T08:00:21.8384136Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:00:21.8385071Z from pkg_resources import resource_filename 2025-09-07T08:00:22.4602889Z 2025-09-07T08:00:23.9659649Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:00:23.9659988Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:00:23.9868899Z cpu eval BertForMaskedLM 2025-09-07T08:00:24.4731257Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:24.6415051Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:24.7856947Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:32.7203972Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7204305Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7204555Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7204766Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7204966Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7205162Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7205354Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7205545Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7205728Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7205923Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7206111Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7206772Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7207004Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7207397Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7207744Z return mod(**inputs) 2025-09-07T08:00:32.7208144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7208555Z outputs = self.bert( 2025-09-07T08:00:32.7208935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7209450Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7209967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7210356Z layer_outputs = layer_module( 2025-09-07T08:00:32.7210718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7211079Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7211471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7211854Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7212431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7212813Z return func(*args, **kwargs) 2025-09-07T08:00:32.7213178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7213577Z self_outputs = self.self( 2025-09-07T08:00:32.7213965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7214340Z return func(*args, **kwargs) 2025-09-07T08:00:32.7214715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7215254Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7215516Z 2025-09-07T08:00:32.7215627Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7215986Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7216311Z return mod(**inputs) 2025-09-07T08:00:32.7216692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7217111Z outputs = self.bert( 2025-09-07T08:00:32.7217461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7217844Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7218220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7218593Z layer_outputs = layer_module( 2025-09-07T08:00:32.7218932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7219284Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7219749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7220136Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7220510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7220877Z return func(*args, **kwargs) 2025-09-07T08:00:32.7221276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7221725Z self_outputs = self.self( 2025-09-07T08:00:32.7222082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7222441Z return func(*args, **kwargs) 2025-09-07T08:00:32.7222802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7223184Z self.key(current_states) 2025-09-07T08:00:32.7223303Z 2025-09-07T08:00:32.7223404Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7223826Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7224158Z return mod(**inputs) 2025-09-07T08:00:32.7224520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7224900Z outputs = self.bert( 2025-09-07T08:00:32.7225253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7225695Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7226072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7226447Z layer_outputs = layer_module( 2025-09-07T08:00:32.7226866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7227237Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7227624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7228000Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7228372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7228753Z return func(*args, **kwargs) 2025-09-07T08:00:32.7229110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7229485Z self_outputs = self.self( 2025-09-07T08:00:32.7229838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7230206Z return func(*args, **kwargs) 2025-09-07T08:00:32.7230563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7230938Z self.value(current_states) 2025-09-07T08:00:32.7231047Z 2025-09-07T08:00:32.7231126Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7231387Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7231743Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7244554Z return mod(**inputs) 2025-09-07T08:00:32.7244984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7245412Z outputs = self.bert( 2025-09-07T08:00:32.7245799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7246209Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7246597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7246983Z layer_outputs = layer_module( 2025-09-07T08:00:32.7247329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7247683Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7248086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7248577Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7248969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7249347Z return func(*args, **kwargs) 2025-09-07T08:00:32.7249715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7250098Z self_outputs = self.self( 2025-09-07T08:00:32.7250468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7250888Z return func(*args, **kwargs) 2025-09-07T08:00:32.7251252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7251682Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7251875Z 2025-09-07T08:00:32.7251984Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7252347Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7252670Z return mod(**inputs) 2025-09-07T08:00:32.7253029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7253406Z outputs = self.bert( 2025-09-07T08:00:32.7253815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7254201Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7254569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7254933Z layer_outputs = layer_module( 2025-09-07T08:00:32.7255274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7255633Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7256008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7256383Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7256768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7257136Z return func(*args, **kwargs) 2025-09-07T08:00:32.7257502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7257928Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7258354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7258742Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7258886Z 2025-09-07T08:00:32.7258989Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7259351Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7259670Z return mod(**inputs) 2025-09-07T08:00:32.7260021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7260400Z outputs = self.bert( 2025-09-07T08:00:32.7260743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7261121Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7261484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7261859Z layer_outputs = layer_module( 2025-09-07T08:00:32.7262196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7262597Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7262969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7263344Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7263746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7264137Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7264547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7265044Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7265455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7265915Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7266056Z 2025-09-07T08:00:32.7266155Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7266511Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7266828Z return mod(**inputs) 2025-09-07T08:00:32.7267244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7267626Z outputs = self.bert( 2025-09-07T08:00:32.7267969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7268347Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7268702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7269070Z layer_outputs = layer_module( 2025-09-07T08:00:32.7269414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7269777Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7270148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7270520Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7270924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7271501Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7271898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7272347Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7272750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7273162Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7273532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7273868Z return self.act(input) 2025-09-07T08:00:32.7273971Z 2025-09-07T08:00:32.7274068Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7274421Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7274741Z return mod(**inputs) 2025-09-07T08:00:32.7275090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7275462Z outputs = self.bert( 2025-09-07T08:00:32.7275790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7276164Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7276523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7276943Z layer_outputs = layer_module( 2025-09-07T08:00:32.7277276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7277633Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7278009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7278390Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7278820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7279199Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7279593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7280051Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7280478Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7280861Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7280988Z 2025-09-07T08:00:32.7281083Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7281498Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7281820Z return mod(**inputs) 2025-09-07T08:00:32.7282162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7282525Z outputs = self.bert( 2025-09-07T08:00:32.7282863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7283235Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7283598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7283967Z layer_outputs = layer_module( 2025-09-07T08:00:32.7284292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7284639Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7285012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7285396Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7285766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7286131Z return func(*args, **kwargs) 2025-09-07T08:00:32.7286488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7286855Z self_outputs = self.self( 2025-09-07T08:00:32.7287204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7287558Z return func(*args, **kwargs) 2025-09-07T08:00:32.7287913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7288430Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7288693Z 2025-09-07T08:00:32.7288796Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7289153Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7289462Z return mod(**inputs) 2025-09-07T08:00:32.7289825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7290243Z outputs = self.bert( 2025-09-07T08:00:32.7290583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7290958Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7291312Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7291683Z layer_outputs = layer_module( 2025-09-07T08:00:32.7292014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7292410Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7292777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7293162Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7293534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7293900Z return func(*args, **kwargs) 2025-09-07T08:00:32.7294252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7294612Z self_outputs = self.self( 2025-09-07T08:00:32.7295035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7295401Z return func(*args, **kwargs) 2025-09-07T08:00:32.7295757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7296121Z self.key(current_states) 2025-09-07T08:00:32.7296236Z 2025-09-07T08:00:32.7296331Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7296700Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7297023Z return mod(**inputs) 2025-09-07T08:00:32.7297369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7297727Z outputs = self.bert( 2025-09-07T08:00:32.7298068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7298439Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7298801Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7299171Z layer_outputs = layer_module( 2025-09-07T08:00:32.7299496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7299841Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7300217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7300598Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7300965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7301324Z return func(*args, **kwargs) 2025-09-07T08:00:32.7301671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7302039Z self_outputs = self.self( 2025-09-07T08:00:32.7302381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7302736Z return func(*args, **kwargs) 2025-09-07T08:00:32.7303083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7303453Z self.value(current_states) 2025-09-07T08:00:32.7303563Z 2025-09-07T08:00:32.7303648Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7303937Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7304283Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7304602Z return mod(**inputs) 2025-09-07T08:00:32.7304946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7305315Z outputs = self.bert( 2025-09-07T08:00:32.7305719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7306132Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7306492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7306865Z layer_outputs = layer_module( 2025-09-07T08:00:32.7307188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7307546Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7307928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7308316Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7308754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7309121Z return func(*args, **kwargs) 2025-09-07T08:00:32.7309483Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7310066Z self_outputs = self.self( 2025-09-07T08:00:32.7310408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7310769Z return func(*args, **kwargs) 2025-09-07T08:00:32.7311110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7311541Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7311728Z 2025-09-07T08:00:32.7311827Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7312188Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7312504Z return mod(**inputs) 2025-09-07T08:00:32.7312860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7313243Z outputs = self.bert( 2025-09-07T08:00:32.7313586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7313962Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7314322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7314701Z layer_outputs = layer_module( 2025-09-07T08:00:32.7315036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7315394Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7315768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7316167Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7316539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7316901Z return func(*args, **kwargs) 2025-09-07T08:00:32.7317252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7317673Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7318196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7318590Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7318726Z 2025-09-07T08:00:32.7318832Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7319191Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7319506Z return mod(**inputs) 2025-09-07T08:00:32.7319860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7321504Z outputs = self.bert( 2025-09-07T08:00:32.7321934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7322324Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7322695Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7323083Z layer_outputs = layer_module( 2025-09-07T08:00:32.7323425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7323783Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7324267Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7324672Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7325073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7325469Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7325872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7326321Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7326750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7327134Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7327267Z 2025-09-07T08:00:32.7327379Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7327737Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7328050Z return mod(**inputs) 2025-09-07T08:00:32.7328407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7328783Z outputs = self.bert( 2025-09-07T08:00:32.7329136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7329515Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7329883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7330256Z layer_outputs = layer_module( 2025-09-07T08:00:32.7330599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7330952Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7331319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7331698Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7332095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7332483Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7332875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7333369Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7333784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7334195Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7334571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7334898Z return self.act(input) 2025-09-07T08:00:32.7335011Z 2025-09-07T08:00:32.7335112Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7335508Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7335829Z return mod(**inputs) 2025-09-07T08:00:32.7336175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7336536Z outputs = self.bert( 2025-09-07T08:00:32.7336880Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7337250Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7337610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7337976Z layer_outputs = layer_module( 2025-09-07T08:00:32.7338376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7338730Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7339102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7339486Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7339871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7340264Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7340657Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7341110Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7341538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7341908Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7342042Z 2025-09-07T08:00:32.7342137Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7342483Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7342799Z return mod(**inputs) 2025-09-07T08:00:32.7343131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7343506Z outputs = self.bert( 2025-09-07T08:00:32.7343845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7344216Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7344572Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7344936Z layer_outputs = layer_module( 2025-09-07T08:00:32.7345265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7345673Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7346044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7346424Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7346788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7347221Z return func(*args, **kwargs) 2025-09-07T08:00:32.7347579Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7347948Z self_outputs = self.self( 2025-09-07T08:00:32.7348296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7348654Z return func(*args, **kwargs) 2025-09-07T08:00:32.7349010Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7349577Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7349836Z 2025-09-07T08:00:32.7349943Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7350288Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7350603Z return mod(**inputs) 2025-09-07T08:00:32.7350949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7351316Z outputs = self.bert( 2025-09-07T08:00:32.7351726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7352094Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7352455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7352821Z layer_outputs = layer_module( 2025-09-07T08:00:32.7353150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7353508Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7353876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7354258Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7354623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7354984Z return func(*args, **kwargs) 2025-09-07T08:00:32.7355327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7355694Z self_outputs = self.self( 2025-09-07T08:00:32.7356041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7356400Z return func(*args, **kwargs) 2025-09-07T08:00:32.7356744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7357111Z self.key(current_states) 2025-09-07T08:00:32.7357227Z 2025-09-07T08:00:32.7357320Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7357668Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7357979Z return mod(**inputs) 2025-09-07T08:00:32.7358316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7358684Z outputs = self.bert( 2025-09-07T08:00:32.7359021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7359394Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7359752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7360126Z layer_outputs = layer_module( 2025-09-07T08:00:32.7360457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7360861Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7361229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7361601Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7361966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7362328Z return func(*args, **kwargs) 2025-09-07T08:00:32.7362678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7363087Z self_outputs = self.self( 2025-09-07T08:00:32.7363424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7363779Z return func(*args, **kwargs) 2025-09-07T08:00:32.7364131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7364497Z self.value(current_states) 2025-09-07T08:00:32.7364609Z 2025-09-07T08:00:32.7364684Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7364908Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7365313Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7365633Z return mod(**inputs) 2025-09-07T08:00:32.7365976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7366341Z outputs = self.bert( 2025-09-07T08:00:32.7366677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7367051Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7367418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7367785Z layer_outputs = layer_module( 2025-09-07T08:00:32.7368141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7368497Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7368879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7369258Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7369620Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7369979Z return func(*args, **kwargs) 2025-09-07T08:00:32.7370323Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7370691Z self_outputs = self.self( 2025-09-07T08:00:32.7371037Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7371384Z return func(*args, **kwargs) 2025-09-07T08:00:32.7371723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7372137Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7372316Z 2025-09-07T08:00:32.7372413Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7372758Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7373078Z return mod(**inputs) 2025-09-07T08:00:32.7373422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7373790Z outputs = self.bert( 2025-09-07T08:00:32.7374130Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7374538Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7374900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7375258Z layer_outputs = layer_module( 2025-09-07T08:00:32.7375594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7375937Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7376306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7376722Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7377077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7377433Z return func(*args, **kwargs) 2025-09-07T08:00:32.7377775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7378197Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7378613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7379052Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7379185Z 2025-09-07T08:00:32.7379288Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7379632Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7379951Z return mod(**inputs) 2025-09-07T08:00:32.7380292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7380663Z outputs = self.bert( 2025-09-07T08:00:32.7380995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7381378Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7381741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7382109Z layer_outputs = layer_module( 2025-09-07T08:00:32.7382447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7382789Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7383162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7383546Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7383943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7384334Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7384738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7385186Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7385654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7386046Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7386179Z 2025-09-07T08:00:32.7386271Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7386617Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7386932Z return mod(**inputs) 2025-09-07T08:00:32.7387278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7387646Z outputs = self.bert( 2025-09-07T08:00:32.7388030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7388404Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7388767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7389136Z layer_outputs = layer_module( 2025-09-07T08:00:32.7389473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7389822Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7390229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7390609Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7391007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7391389Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7391792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7392232Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7392703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7393119Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7393485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7393820Z return self.act(input) 2025-09-07T08:00:32.7393930Z 2025-09-07T08:00:32.7394022Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7394369Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7394692Z return mod(**inputs) 2025-09-07T08:00:32.7395030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7395401Z outputs = self.bert( 2025-09-07T08:00:32.7395742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7396115Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7396466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7396833Z layer_outputs = layer_module( 2025-09-07T08:00:32.7397164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7397512Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7397875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7398255Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7398640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7399026Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7399427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7399880Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7400298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7400682Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7400837Z 2025-09-07T08:00:32.7400932Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7401275Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7401634Z return mod(**inputs) 2025-09-07T08:00:32.7401974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7402344Z outputs = self.bert( 2025-09-07T08:00:32.7402676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7403046Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7403396Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7403804Z layer_outputs = layer_module( 2025-09-07T08:00:32.7404148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7404518Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7404880Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7405249Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7405612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7405968Z return func(*args, **kwargs) 2025-09-07T08:00:32.7406394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7406759Z self_outputs = self.self( 2025-09-07T08:00:32.7407102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7407465Z return func(*args, **kwargs) 2025-09-07T08:00:32.7407812Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7408313Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7408572Z 2025-09-07T08:00:32.7408668Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7409015Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7409321Z return mod(**inputs) 2025-09-07T08:00:32.7409809Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7410173Z outputs = self.bert( 2025-09-07T08:00:32.7410508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7410894Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7411284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7411670Z layer_outputs = layer_module( 2025-09-07T08:00:32.7412021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7412387Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7412746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7413115Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7413479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7413828Z return func(*args, **kwargs) 2025-09-07T08:00:32.7414173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7414539Z self_outputs = self.self( 2025-09-07T08:00:32.7414883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7415240Z return func(*args, **kwargs) 2025-09-07T08:00:32.7415688Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7416094Z self.key(current_states) 2025-09-07T08:00:32.7416202Z 2025-09-07T08:00:32.7416303Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7416671Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7416974Z return mod(**inputs) 2025-09-07T08:00:32.7417309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7417726Z outputs = self.bert( 2025-09-07T08:00:32.7418063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7418421Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7418788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7419190Z layer_outputs = layer_module( 2025-09-07T08:00:32.7419547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7419929Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7420405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7420823Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7421185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7421552Z return func(*args, **kwargs) 2025-09-07T08:00:32.7421924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7422288Z self_outputs = self.self( 2025-09-07T08:00:32.7422641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7423009Z return func(*args, **kwargs) 2025-09-07T08:00:32.7423361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7423733Z self.value(current_states) 2025-09-07T08:00:32.7423848Z 2025-09-07T08:00:32.7423933Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7424178Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7424534Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7424845Z return mod(**inputs) 2025-09-07T08:00:32.7425207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7425572Z outputs = self.bert( 2025-09-07T08:00:32.7425981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7426368Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7426732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7427101Z layer_outputs = layer_module( 2025-09-07T08:00:32.7427436Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7427788Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7428169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7428537Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7428895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7429264Z return func(*args, **kwargs) 2025-09-07T08:00:32.7429659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7430032Z self_outputs = self.self( 2025-09-07T08:00:32.7430380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7430748Z return func(*args, **kwargs) 2025-09-07T08:00:32.7431117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7431553Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7431771Z 2025-09-07T08:00:32.7431865Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7432224Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7432538Z return mod(**inputs) 2025-09-07T08:00:32.7432911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7433275Z outputs = self.bert( 2025-09-07T08:00:32.7433604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7433984Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7434401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7434782Z layer_outputs = layer_module( 2025-09-07T08:00:32.7435115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7435471Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7435845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7436227Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7436597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7436952Z return func(*args, **kwargs) 2025-09-07T08:00:32.7437302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7437736Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7438160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7438550Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7438685Z 2025-09-07T08:00:32.7438781Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7439132Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7439449Z return mod(**inputs) 2025-09-07T08:00:32.7439797Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7440161Z outputs = self.bert( 2025-09-07T08:00:32.7440502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7440874Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7441240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7441610Z layer_outputs = layer_module( 2025-09-07T08:00:32.7441938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7442290Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7442658Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7443086Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7443475Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7443864Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7444266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7444721Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7445137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7445553Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7445692Z 2025-09-07T08:00:32.7445785Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7446138Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7446455Z return mod(**inputs) 2025-09-07T08:00:32.7446800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7447164Z outputs = self.bert( 2025-09-07T08:00:32.7447505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7447873Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7448362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7448728Z layer_outputs = layer_module( 2025-09-07T08:00:32.7449066Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7449423Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7449794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7450175Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7450555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7450944Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7451343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7451791Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7452203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7452611Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7452980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7453314Z return self.act(input) 2025-09-07T08:00:32.7453419Z 2025-09-07T08:00:32.7453519Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7453867Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7454174Z return mod(**inputs) 2025-09-07T08:00:32.7454517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7454889Z outputs = self.bert( 2025-09-07T08:00:32.7455227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7455597Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7455956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7456337Z layer_outputs = layer_module( 2025-09-07T08:00:32.7456698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7457097Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7457460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7457840Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7458234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7458617Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7459008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7459498Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7459924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7460299Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7460429Z 2025-09-07T08:00:32.7460531Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7460868Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7461182Z return mod(**inputs) 2025-09-07T08:00:32.7461587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7461964Z outputs = self.bert( 2025-09-07T08:00:32.7462303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7462674Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7463033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7463401Z layer_outputs = layer_module( 2025-09-07T08:00:32.7463733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7464081Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7464447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7464826Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7465203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7465569Z return func(*args, **kwargs) 2025-09-07T08:00:32.7465981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7466353Z self_outputs = self.self( 2025-09-07T08:00:32.7466708Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7467071Z return func(*args, **kwargs) 2025-09-07T08:00:32.7467417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7467928Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7468191Z 2025-09-07T08:00:32.7468287Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7468639Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7468955Z return mod(**inputs) 2025-09-07T08:00:32.7469293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7469659Z outputs = self.bert( 2025-09-07T08:00:32.7469998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7470369Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7470785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7471146Z layer_outputs = layer_module( 2025-09-07T08:00:32.7471476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7471823Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7472193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7472569Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7472968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7473331Z return func(*args, **kwargs) 2025-09-07T08:00:32.7473681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7474052Z self_outputs = self.self( 2025-09-07T08:00:32.7474389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7474746Z return func(*args, **kwargs) 2025-09-07T08:00:32.7475093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7475569Z self.key(current_states) 2025-09-07T08:00:32.7475678Z 2025-09-07T08:00:32.7475775Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7476111Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7476434Z return mod(**inputs) 2025-09-07T08:00:32.7476777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7477144Z outputs = self.bert( 2025-09-07T08:00:32.7477476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7477848Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7478206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7478575Z layer_outputs = layer_module( 2025-09-07T08:00:32.7478905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7479247Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7479616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7479992Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7480357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7480711Z return func(*args, **kwargs) 2025-09-07T08:00:32.7481059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7481422Z self_outputs = self.self( 2025-09-07T08:00:32.7481765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7482125Z return func(*args, **kwargs) 2025-09-07T08:00:32.7482466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7482841Z self.value(current_states) 2025-09-07T08:00:32.7482960Z 2025-09-07T08:00:32.7483035Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7483256Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7483595Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7483900Z return mod(**inputs) 2025-09-07T08:00:32.7484286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7484655Z outputs = self.bert( 2025-09-07T08:00:32.7484993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7485359Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7485721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7486089Z layer_outputs = layer_module( 2025-09-07T08:00:32.7486454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7486802Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7487162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7487537Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7487912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7488273Z return func(*args, **kwargs) 2025-09-07T08:00:32.7488611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7489034Z self_outputs = self.self( 2025-09-07T08:00:32.7489375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7489737Z return func(*args, **kwargs) 2025-09-07T08:00:32.7490089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7490508Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7490693Z 2025-09-07T08:00:32.7490783Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7491128Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7491442Z return mod(**inputs) 2025-09-07T08:00:32.7491774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7492142Z outputs = self.bert( 2025-09-07T08:00:32.7492482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7492852Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7493210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7493571Z layer_outputs = layer_module( 2025-09-07T08:00:32.7493899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7494245Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7494612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7494991Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7495346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7495707Z return func(*args, **kwargs) 2025-09-07T08:00:32.7496064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7496487Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7496897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7497275Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7497413Z 2025-09-07T08:00:32.7497703Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7498047Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7498360Z return mod(**inputs) 2025-09-07T08:00:32.7498692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7499064Z outputs = self.bert( 2025-09-07T08:00:32.7499402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7499777Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7500173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7500535Z layer_outputs = layer_module( 2025-09-07T08:00:32.7500869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7501218Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7501581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7501954Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7502346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7502813Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7503225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7503686Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7504100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7504490Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7504631Z 2025-09-07T08:00:32.7504727Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7505078Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7505394Z return mod(**inputs) 2025-09-07T08:00:32.7505789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7506164Z outputs = self.bert( 2025-09-07T08:00:32.7506506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7506881Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7507239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7507610Z layer_outputs = layer_module( 2025-09-07T08:00:32.7507944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7508302Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7508673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7509044Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7509440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7509990Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7510392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7510846Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7511256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7511668Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7521283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7521785Z return self.act(input) 2025-09-07T08:00:32.7521919Z 2025-09-07T08:00:32.7522038Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7522413Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7522741Z return mod(**inputs) 2025-09-07T08:00:32.7523105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7523611Z outputs = self.bert( 2025-09-07T08:00:32.7523969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7524346Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7524719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7525106Z layer_outputs = layer_module( 2025-09-07T08:00:32.7525451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7525808Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7526287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7526691Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7527088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7527476Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7527882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7528343Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7528775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7529157Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7529290Z 2025-09-07T08:00:32.7529391Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7529750Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7530068Z return mod(**inputs) 2025-09-07T08:00:32.7530419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7530790Z outputs = self.bert( 2025-09-07T08:00:32.7531123Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7531494Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7531857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7532223Z layer_outputs = layer_module( 2025-09-07T08:00:32.7532556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7532914Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7533286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7533668Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7534040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7534402Z return func(*args, **kwargs) 2025-09-07T08:00:32.7534754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7535178Z self_outputs = self.self( 2025-09-07T08:00:32.7535524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7535876Z return func(*args, **kwargs) 2025-09-07T08:00:32.7536225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7536743Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7537015Z 2025-09-07T08:00:32.7537112Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7537512Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7537829Z return mod(**inputs) 2025-09-07T08:00:32.7538196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7538569Z outputs = self.bert( 2025-09-07T08:00:32.7538935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7539311Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7539667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7540034Z layer_outputs = layer_module( 2025-09-07T08:00:32.7540430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7540786Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7541153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7541531Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7541902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7542263Z return func(*args, **kwargs) 2025-09-07T08:00:32.7542610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7542971Z self_outputs = self.self( 2025-09-07T08:00:32.7543314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7543673Z return func(*args, **kwargs) 2025-09-07T08:00:32.7544015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7544380Z self.key(current_states) 2025-09-07T08:00:32.7544486Z 2025-09-07T08:00:32.7544579Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7544921Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7545233Z return mod(**inputs) 2025-09-07T08:00:32.7545577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7546009Z outputs = self.bert( 2025-09-07T08:00:32.7546362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7546733Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7547101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7547466Z layer_outputs = layer_module( 2025-09-07T08:00:32.7547795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7548166Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7548558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7548994Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7549360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7549725Z return func(*args, **kwargs) 2025-09-07T08:00:32.7550082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7550455Z self_outputs = self.self( 2025-09-07T08:00:32.7550801Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7551200Z return func(*args, **kwargs) 2025-09-07T08:00:32.7551551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7551915Z self.value(current_states) 2025-09-07T08:00:32.7552027Z 2025-09-07T08:00:32.7552106Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7552337Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7552693Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7553002Z return mod(**inputs) 2025-09-07T08:00:32.7553354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7553714Z outputs = self.bert( 2025-09-07T08:00:32.7554110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7554484Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7554842Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7555204Z layer_outputs = layer_module( 2025-09-07T08:00:32.7555534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7555882Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7556244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7556617Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7556979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7557338Z return func(*args, **kwargs) 2025-09-07T08:00:32.7557684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7558051Z self_outputs = self.self( 2025-09-07T08:00:32.7558398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7558755Z return func(*args, **kwargs) 2025-09-07T08:00:32.7559104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7559530Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7559714Z 2025-09-07T08:00:32.7559809Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7560152Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7560470Z return mod(**inputs) 2025-09-07T08:00:32.7560810Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7561172Z outputs = self.bert( 2025-09-07T08:00:32.7561510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7561881Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7562235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7562643Z layer_outputs = layer_module( 2025-09-07T08:00:32.7562975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7563321Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7563702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7564075Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7564438Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7564848Z return func(*args, **kwargs) 2025-09-07T08:00:32.7565195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7565610Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7566027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7566407Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7566539Z 2025-09-07T08:00:32.7566636Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7566972Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7567349Z return mod(**inputs) 2025-09-07T08:00:32.7567693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7568062Z outputs = self.bert( 2025-09-07T08:00:32.7568394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7568763Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7569113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7569476Z layer_outputs = layer_module( 2025-09-07T08:00:32.7569804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7570148Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7570508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7570885Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7571275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7571668Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7572064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7572507Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7572918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7573292Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7573421Z 2025-09-07T08:00:32.7573524Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7573873Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7574178Z return mod(**inputs) 2025-09-07T08:00:32.7574515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7574883Z outputs = self.bert( 2025-09-07T08:00:32.7575215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7575584Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7575933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7576348Z layer_outputs = layer_module( 2025-09-07T08:00:32.7576671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7577013Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7577371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7577742Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7578122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7578540Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7578930Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7579372Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7579774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7580169Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7580531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7580915Z return self.act(input) 2025-09-07T08:00:32.7581018Z 2025-09-07T08:00:32.7581111Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7581450Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7581761Z return mod(**inputs) 2025-09-07T08:00:32.7582103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7582462Z outputs = self.bert( 2025-09-07T08:00:32.7582793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7583159Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7583512Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7583871Z layer_outputs = layer_module( 2025-09-07T08:00:32.7584195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7584542Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7584901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7585272Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7585714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7586098Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7586499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7586953Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7587383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7587760Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7587898Z 2025-09-07T08:00:32.7587996Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7588347Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7588666Z return mod(**inputs) 2025-09-07T08:00:32.7589011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7589370Z outputs = self.bert( 2025-09-07T08:00:32.7589753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7590126Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7590487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7590857Z layer_outputs = layer_module( 2025-09-07T08:00:32.7591183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7591533Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7591939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7592327Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7592707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7593080Z return func(*args, **kwargs) 2025-09-07T08:00:32.7593433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7593807Z self_outputs = self.self( 2025-09-07T08:00:32.7594155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7594575Z return func(*args, **kwargs) 2025-09-07T08:00:32.7594932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7595450Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7595712Z 2025-09-07T08:00:32.7595813Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7596164Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7596477Z return mod(**inputs) 2025-09-07T08:00:32.7596821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7597189Z outputs = self.bert( 2025-09-07T08:00:32.7597525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7597896Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7598257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7598628Z layer_outputs = layer_module( 2025-09-07T08:00:32.7598961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7599312Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7599671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7600049Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7600414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7600477Z return func(*args, **kwargs) 2025-09-07T08:00:32.7600723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7600786Z self_outputs = self.self( 2025-09-07T08:00:32.7601026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7601089Z return func(*args, **kwargs) 2025-09-07T08:00:32.7601329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7601403Z self.key(current_states) 2025-09-07T08:00:32.7601407Z 2025-09-07T08:00:32.7601541Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7601738Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7601798Z return mod(**inputs) 2025-09-07T08:00:32.7602042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7602110Z outputs = self.bert( 2025-09-07T08:00:32.7602356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7602429Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7602704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7602775Z layer_outputs = layer_module( 2025-09-07T08:00:32.7602988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7603059Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7603303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7603375Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7603615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7603738Z return func(*args, **kwargs) 2025-09-07T08:00:32.7603980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7604052Z self_outputs = self.self( 2025-09-07T08:00:32.7604286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7604356Z return func(*args, **kwargs) 2025-09-07T08:00:32.7604594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7604662Z self.value(current_states) 2025-09-07T08:00:32.7604665Z 2025-09-07T08:00:32.7604749Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7604841Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7605035Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7605096Z return mod(**inputs) 2025-09-07T08:00:32.7605340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7605407Z outputs = self.bert( 2025-09-07T08:00:32.7605648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7605721Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7605963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7606035Z layer_outputs = layer_module( 2025-09-07T08:00:32.7606246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7606315Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7606563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7606635Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7606879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7606940Z return func(*args, **kwargs) 2025-09-07T08:00:32.7607180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7607251Z self_outputs = self.self( 2025-09-07T08:00:32.7607486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7607604Z return func(*args, **kwargs) 2025-09-07T08:00:32.7607846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7607967Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7607977Z 2025-09-07T08:00:32.7608074Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7608264Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7608368Z return mod(**inputs) 2025-09-07T08:00:32.7608616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7608682Z outputs = self.bert( 2025-09-07T08:00:32.7608924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7608993Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7609241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7609303Z layer_outputs = layer_module( 2025-09-07T08:00:32.7609587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7609810Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7610055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7610141Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7610380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7610451Z return func(*args, **kwargs) 2025-09-07T08:00:32.7610691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7610825Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7611064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7611140Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7611147Z 2025-09-07T08:00:32.7611248Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7611438Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7611506Z return mod(**inputs) 2025-09-07T08:00:32.7611749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7611808Z outputs = self.bert( 2025-09-07T08:00:32.7612057Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7612123Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7612368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7612431Z layer_outputs = layer_module( 2025-09-07T08:00:32.7612646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7612723Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7612960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7613045Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7613305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7613379Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7613727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7613844Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7614097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7614177Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7614180Z 2025-09-07T08:00:32.7614283Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7614475Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7614584Z return mod(**inputs) 2025-09-07T08:00:32.7614837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7614895Z outputs = self.bert( 2025-09-07T08:00:32.7615147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7615217Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7615467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7615533Z layer_outputs = layer_module( 2025-09-07T08:00:32.7615839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7615920Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7616160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7616243Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7616504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7616574Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7616859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7616965Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7617214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7617320Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7617526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7617598Z return self.act(input) 2025-09-07T08:00:32.7617602Z 2025-09-07T08:00:32.7617694Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7617893Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7617951Z return mod(**inputs) 2025-09-07T08:00:32.7618206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7618264Z outputs = self.bert( 2025-09-07T08:00:32.7618508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7618581Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7618825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7618896Z layer_outputs = layer_module( 2025-09-07T08:00:32.7619112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7619183Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7619428Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7619534Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7619798Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7619865Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7620137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7620272Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7620511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7620623Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7620626Z 2025-09-07T08:00:32.7620714Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7620910Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7620971Z return mod(**inputs) 2025-09-07T08:00:32.7621216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7621281Z outputs = self.bert( 2025-09-07T08:00:32.7621524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7621654Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7621898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7621970Z layer_outputs = layer_module( 2025-09-07T08:00:32.7622192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7622263Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7622513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7622589Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7622840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7622905Z return func(*args, **kwargs) 2025-09-07T08:00:32.7623149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7623219Z self_outputs = self.self( 2025-09-07T08:00:32.7623454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7623522Z return func(*args, **kwargs) 2025-09-07T08:00:32.7623762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7623966Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7623971Z 2025-09-07T08:00:32.7624071Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7624264Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7624328Z return mod(**inputs) 2025-09-07T08:00:32.7624580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7624645Z outputs = self.bert( 2025-09-07T08:00:32.7624891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7624958Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7625208Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7625272Z layer_outputs = layer_module( 2025-09-07T08:00:32.7625496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7625641Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7625884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7625968Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7626211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7626283Z return func(*args, **kwargs) 2025-09-07T08:00:32.7626522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7626624Z self_outputs = self.self( 2025-09-07T08:00:32.7626865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7626926Z return func(*args, **kwargs) 2025-09-07T08:00:32.7627177Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7627240Z self.key(current_states) 2025-09-07T08:00:32.7627244Z 2025-09-07T08:00:32.7627341Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7627530Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7627669Z return mod(**inputs) 2025-09-07T08:00:32.7627925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7627986Z outputs = self.bert( 2025-09-07T08:00:32.7628235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7628300Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7628538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7628611Z layer_outputs = layer_module( 2025-09-07T08:00:32.7628825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7628900Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7629141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7629213Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7629457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7629524Z return func(*args, **kwargs) 2025-09-07T08:00:32.7629767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7629830Z self_outputs = self.self( 2025-09-07T08:00:32.7630064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7630135Z return func(*args, **kwargs) 2025-09-07T08:00:32.7630376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7630449Z self.value(current_states) 2025-09-07T08:00:32.7630452Z 2025-09-07T08:00:32.7630530Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7630627Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7630813Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7630873Z return mod(**inputs) 2025-09-07T08:00:32.7631124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7631183Z outputs = self.bert( 2025-09-07T08:00:32.7631429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7631529Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7631768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7631839Z layer_outputs = layer_module( 2025-09-07T08:00:32.7632052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7632127Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7632369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7632530Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7632771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7632831Z return func(*args, **kwargs) 2025-09-07T08:00:32.7633080Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7633142Z self_outputs = self.self( 2025-09-07T08:00:32.7633380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7633440Z return func(*args, **kwargs) 2025-09-07T08:00:32.7633922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7634056Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7634061Z 2025-09-07T08:00:32.7634151Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7634345Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7634403Z return mod(**inputs) 2025-09-07T08:00:32.7634643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7634710Z outputs = self.bert( 2025-09-07T08:00:32.7634951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7635022Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7635261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7635324Z layer_outputs = layer_module( 2025-09-07T08:00:32.7635545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7635612Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7635862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7635933Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7636178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7636236Z return func(*args, **kwargs) 2025-09-07T08:00:32.7636473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7636596Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7636837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7636916Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7636922Z 2025-09-07T08:00:32.7637010Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7637196Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7637256Z return mod(**inputs) 2025-09-07T08:00:32.7637497Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7637598Z outputs = self.bert( 2025-09-07T08:00:32.7637839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7637907Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7638149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7638213Z layer_outputs = layer_module( 2025-09-07T08:00:32.7638428Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7638527Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7638773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7638846Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7639109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7639184Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7639460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7639637Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7639878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7639953Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7639962Z 2025-09-07T08:00:32.7640052Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7640237Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7640297Z return mod(**inputs) 2025-09-07T08:00:32.7640542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7640602Z outputs = self.bert( 2025-09-07T08:00:32.7640842Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7640905Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7641149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7641209Z layer_outputs = layer_module( 2025-09-07T08:00:32.7641424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7641491Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7641730Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7641807Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7642060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7642131Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7642401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7642512Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7642751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7642855Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7643068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7643128Z return self.act(input) 2025-09-07T08:00:32.7643131Z 2025-09-07T08:00:32.7643262Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7643450Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7643507Z return mod(**inputs) 2025-09-07T08:00:32.7643756Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7643813Z outputs = self.bert( 2025-09-07T08:00:32.7644062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7644124Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7644397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7644462Z layer_outputs = layer_module( 2025-09-07T08:00:32.7644674Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7644748Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7644986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7645060Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7645374Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7645441Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7645724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7645846Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7646088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7646159Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7646165Z 2025-09-07T08:00:32.7646254Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7646441Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7646496Z return mod(**inputs) 2025-09-07T08:00:32.7646740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7646797Z outputs = self.bert( 2025-09-07T08:00:32.7647043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7647108Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7647344Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7647409Z layer_outputs = layer_module( 2025-09-07T08:00:32.7647616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7647687Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7647923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7647991Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7648232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7648290Z return func(*args, **kwargs) 2025-09-07T08:00:32.7648533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7648595Z self_outputs = self.self( 2025-09-07T08:00:32.7648826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7648891Z return func(*args, **kwargs) 2025-09-07T08:00:32.7649128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7649364Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7649367Z 2025-09-07T08:00:32.7649455Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7649645Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7649700Z return mod(**inputs) 2025-09-07T08:00:32.7649944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7650039Z outputs = self.bert( 2025-09-07T08:00:32.7650278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7650343Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7650580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7650642Z layer_outputs = layer_module( 2025-09-07T08:00:32.7650857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7650922Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7651237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7651308Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7651543Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7651606Z return func(*args, **kwargs) 2025-09-07T08:00:32.7651844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7651911Z self_outputs = self.self( 2025-09-07T08:00:32.7652145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7652207Z return func(*args, **kwargs) 2025-09-07T08:00:32.7652445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7652506Z self.key(current_states) 2025-09-07T08:00:32.7652511Z 2025-09-07T08:00:32.7652603Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7652786Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7652846Z return mod(**inputs) 2025-09-07T08:00:32.7653087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7653143Z outputs = self.bert( 2025-09-07T08:00:32.7653389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7653453Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7653694Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7653755Z layer_outputs = layer_module( 2025-09-07T08:00:32.7653967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7654037Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7654274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7654347Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7654578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7654640Z return func(*args, **kwargs) 2025-09-07T08:00:32.7654910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7654968Z self_outputs = self.self( 2025-09-07T08:00:32.7655203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7655262Z return func(*args, **kwargs) 2025-09-07T08:00:32.7655505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7655567Z self.value(current_states) 2025-09-07T08:00:32.7655603Z 2025-09-07T08:00:32.7655677Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7655770Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7655952Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7656011Z return mod(**inputs) 2025-09-07T08:00:32.7656249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7656308Z outputs = self.bert( 2025-09-07T08:00:32.7656563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7656626Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7656928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7656989Z layer_outputs = layer_module( 2025-09-07T08:00:32.7657201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7657269Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7657506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7657578Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7657808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7657869Z return func(*args, **kwargs) 2025-09-07T08:00:32.7658104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7658164Z self_outputs = self.self( 2025-09-07T08:00:32.7658402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7658460Z return func(*args, **kwargs) 2025-09-07T08:00:32.7658699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7658819Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7658823Z 2025-09-07T08:00:32.7658911Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7659102Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7659159Z return mod(**inputs) 2025-09-07T08:00:32.7659401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7659456Z outputs = self.bert( 2025-09-07T08:00:32.7659703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7659765Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7660001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7660066Z layer_outputs = layer_module( 2025-09-07T08:00:32.7660274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7660341Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7660622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7660694Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7660930Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7660987Z return func(*args, **kwargs) 2025-09-07T08:00:32.7661229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7661346Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7661623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7661701Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7661705Z 2025-09-07T08:00:32.7661791Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7661980Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7662036Z return mod(**inputs) 2025-09-07T08:00:32.7662278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7662334Z outputs = self.bert( 2025-09-07T08:00:32.7662634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7662700Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7662939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7663003Z layer_outputs = layer_module( 2025-09-07T08:00:32.7663213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7663278Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7663519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7663591Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7663970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7664039Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7664314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7664428Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7664669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7664743Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7664746Z 2025-09-07T08:00:32.7664835Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7665025Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7665080Z return mod(**inputs) 2025-09-07T08:00:32.7665320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7665381Z outputs = self.bert( 2025-09-07T08:00:32.7665668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7665736Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7665978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7666038Z layer_outputs = layer_module( 2025-09-07T08:00:32.7666253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7666365Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7666605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7666674Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7666933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7666997Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7667266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7667410Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7667647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7667748Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7667959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7668023Z return self.act(input) 2025-09-07T08:00:32.7668031Z 2025-09-07T08:00:32.7668124Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7668314Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7668435Z return mod(**inputs) 2025-09-07T08:00:32.7668687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7668752Z outputs = self.bert( 2025-09-07T08:00:32.7668993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7669058Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7669298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7669361Z layer_outputs = layer_module( 2025-09-07T08:00:32.7669575Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7669644Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7669882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7669957Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7670209Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7670281Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7670546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7670668Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7670928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7670997Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7671001Z 2025-09-07T08:00:32.7671094Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7671288Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7671347Z return mod(**inputs) 2025-09-07T08:00:32.7671590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7671649Z outputs = self.bert( 2025-09-07T08:00:32.7671895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7671963Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7672206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7672311Z layer_outputs = layer_module( 2025-09-07T08:00:32.7672523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7672593Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7672833Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7672907Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7673144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7673260Z return func(*args, **kwargs) 2025-09-07T08:00:32.7673499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7673560Z self_outputs = self.self( 2025-09-07T08:00:32.7673800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7673860Z return func(*args, **kwargs) 2025-09-07T08:00:32.7674103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7674363Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7674367Z 2025-09-07T08:00:32.7674455Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7674649Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7674719Z return mod(**inputs) 2025-09-07T08:00:32.7674978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7675034Z outputs = self.bert( 2025-09-07T08:00:32.7675278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7675343Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7675580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7675642Z layer_outputs = layer_module( 2025-09-07T08:00:32.7675854Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7675924Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7676162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7676233Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7676468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7676527Z return func(*args, **kwargs) 2025-09-07T08:00:32.7676766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7676825Z self_outputs = self.self( 2025-09-07T08:00:32.7677056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7677121Z return func(*args, **kwargs) 2025-09-07T08:00:32.7677354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7677418Z self.key(current_states) 2025-09-07T08:00:32.7677422Z 2025-09-07T08:00:32.7677511Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7677694Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7677754Z return mod(**inputs) 2025-09-07T08:00:32.7677993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7678089Z outputs = self.bert( 2025-09-07T08:00:32.7678328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7678391Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7678629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7678689Z layer_outputs = layer_module( 2025-09-07T08:00:32.7678904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7679027Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7679271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7679342Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7679573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7679635Z return func(*args, **kwargs) 2025-09-07T08:00:32.7679869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7679929Z self_outputs = self.self( 2025-09-07T08:00:32.7680221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7680281Z return func(*args, **kwargs) 2025-09-07T08:00:32.7680522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7680583Z self.value(current_states) 2025-09-07T08:00:32.7680587Z 2025-09-07T08:00:32.7680657Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7680745Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7680936Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7680993Z return mod(**inputs) 2025-09-07T08:00:32.7681234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7681294Z outputs = self.bert( 2025-09-07T08:00:32.7681539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7681604Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7681843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7681902Z layer_outputs = layer_module( 2025-09-07T08:00:32.7682112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7682177Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7682420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7682491Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7682721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7682785Z return func(*args, **kwargs) 2025-09-07T08:00:32.7683020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7683084Z self_outputs = self.self( 2025-09-07T08:00:32.7683314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7683377Z return func(*args, **kwargs) 2025-09-07T08:00:32.7683611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7683776Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7683779Z 2025-09-07T08:00:32.7683870Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7684053Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7684113Z return mod(**inputs) 2025-09-07T08:00:32.7684356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7684413Z outputs = self.bert( 2025-09-07T08:00:32.7684709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7684773Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7685016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7685078Z layer_outputs = layer_module( 2025-09-07T08:00:32.7685285Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7685356Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7685593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7685730Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7685965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7686031Z return func(*args, **kwargs) 2025-09-07T08:00:32.7686268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7686382Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7686622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7686695Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7686699Z 2025-09-07T08:00:32.7686790Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7686974Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7687031Z return mod(**inputs) 2025-09-07T08:00:32.7687281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7687339Z outputs = self.bert( 2025-09-07T08:00:32.7687584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7687646Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7687884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7687952Z layer_outputs = layer_module( 2025-09-07T08:00:32.7688161Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7688230Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7688467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7688545Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7688800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7688868Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7689147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7689255Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7689501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7689607Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7689610Z 2025-09-07T08:00:32.7689697Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7689884Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7689941Z return mod(**inputs) 2025-09-07T08:00:32.7690187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7690276Z outputs = self.bert( 2025-09-07T08:00:32.7690522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7690586Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7690825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7690890Z layer_outputs = layer_module( 2025-09-07T08:00:32.7691098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7691170Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7691465Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7691539Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7691801Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7691868Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7692144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7692247Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7692496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7692598Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7692809Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7692876Z return self.act(input) 2025-09-07T08:00:32.7692881Z 2025-09-07T08:00:32.7692975Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7693164Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7693225Z return mod(**inputs) 2025-09-07T08:00:32.7693464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7693525Z outputs = self.bert( 2025-09-07T08:00:32.7693765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7693837Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7694076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7694137Z layer_outputs = layer_module( 2025-09-07T08:00:32.7694353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7694418Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7694661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7694733Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7694992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7695055Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7695381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7695509Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7695747Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7695825Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7695829Z 2025-09-07T08:00:32.7695916Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7696102Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7696205Z return mod(**inputs) 2025-09-07T08:00:32.7696449Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7696510Z outputs = self.bert( 2025-09-07T08:00:32.7696752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7696817Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7697058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7697118Z layer_outputs = layer_module( 2025-09-07T08:00:32.7697394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7697460Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7697708Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7697777Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7698014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7698082Z return func(*args, **kwargs) 2025-09-07T08:00:32.7698318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7698384Z self_outputs = self.self( 2025-09-07T08:00:32.7698615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7698677Z return func(*args, **kwargs) 2025-09-07T08:00:32.7698921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7699120Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7699124Z 2025-09-07T08:00:32.7699221Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7699405Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7699465Z return mod(**inputs) 2025-09-07T08:00:32.7699707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7699765Z outputs = self.bert( 2025-09-07T08:00:32.7700011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7700073Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7700320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7700380Z layer_outputs = layer_module( 2025-09-07T08:00:32.7700589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7700655Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7700897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7701014Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7701248Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7701307Z return func(*args, **kwargs) 2025-09-07T08:00:32.7701549Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7701612Z self_outputs = self.self( 2025-09-07T08:00:32.7701850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7701945Z return func(*args, **kwargs) 2025-09-07T08:00:32.7702186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7702249Z self.key(current_states) 2025-09-07T08:00:32.7702253Z 2025-09-07T08:00:32.7702339Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7702528Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7702584Z return mod(**inputs) 2025-09-07T08:00:32.7702828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7702886Z outputs = self.bert( 2025-09-07T08:00:32.7703194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7703263Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7703503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7703566Z layer_outputs = layer_module( 2025-09-07T08:00:32.7703776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7703842Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7704085Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7704155Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7704394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7704456Z return func(*args, **kwargs) 2025-09-07T08:00:32.7704698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7704759Z self_outputs = self.self( 2025-09-07T08:00:32.7704992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7705055Z return func(*args, **kwargs) 2025-09-07T08:00:32.7705290Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7705359Z self.value(current_states) 2025-09-07T08:00:32.7705362Z 2025-09-07T08:00:32.7705433Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7705522Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7705763Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7705821Z return mod(**inputs) 2025-09-07T08:00:32.7706069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7706126Z outputs = self.bert( 2025-09-07T08:00:32.7706370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7706438Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7706676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7706794Z layer_outputs = layer_module( 2025-09-07T08:00:32.7707002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7707068Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7707310Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7707380Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7707617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7707717Z return func(*args, **kwargs) 2025-09-07T08:00:32.7707961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7708021Z self_outputs = self.self( 2025-09-07T08:00:32.7708252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7708319Z return func(*args, **kwargs) 2025-09-07T08:00:32.7708557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7708680Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7708683Z 2025-09-07T08:00:32.7708933Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7709126Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7709190Z return mod(**inputs) 2025-09-07T08:00:32.7709440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7709500Z outputs = self.bert( 2025-09-07T08:00:32.7709893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7709966Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7710208Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7710273Z layer_outputs = layer_module( 2025-09-07T08:00:32.7710491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7710561Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7710803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7710875Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7711113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7711176Z return func(*args, **kwargs) 2025-09-07T08:00:32.7711413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7711540Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7711775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7711845Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7711854Z 2025-09-07T08:00:32.7711951Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7712150Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7712214Z return mod(**inputs) 2025-09-07T08:00:32.7712464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7712525Z outputs = self.bert( 2025-09-07T08:00:32.7712768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7712917Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7713161Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7713225Z layer_outputs = layer_module( 2025-09-07T08:00:32.7713445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7713515Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7713752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7713886Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7714147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7714218Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7714491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7714608Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7714851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7714921Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7715037Z 2025-09-07T08:00:32.7715134Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7715320Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7715386Z return mod(**inputs) 2025-09-07T08:00:32.7715627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7715684Z outputs = self.bert( 2025-09-07T08:00:32.7715927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7715992Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7716235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7716297Z layer_outputs = layer_module( 2025-09-07T08:00:32.7716512Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7716583Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7716820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7716899Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7717153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7717224Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7717498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7717600Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7717844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7717946Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7718157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7718221Z return self.act(input) 2025-09-07T08:00:32.7718225Z 2025-09-07T08:00:32.7718313Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7718503Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7718560Z return mod(**inputs) 2025-09-07T08:00:32.7718807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7718903Z outputs = self.bert( 2025-09-07T08:00:32.7719152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7719225Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7719468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7719533Z layer_outputs = layer_module( 2025-09-07T08:00:32.7719744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7719846Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7720083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7720152Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7720413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7720477Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7720753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7720942Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7721187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7721264Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7721267Z 2025-09-07T08:00:32.7721359Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7721549Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7721606Z return mod(**inputs) 2025-09-07T08:00:32.7721854Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7721911Z outputs = self.bert( 2025-09-07T08:00:32.7722153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7722219Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7722457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7722524Z layer_outputs = layer_module( 2025-09-07T08:00:32.7722735Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7722801Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7723044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7723114Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7723356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7723417Z return func(*args, **kwargs) 2025-09-07T08:00:32.7723656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7723728Z self_outputs = self.self( 2025-09-07T08:00:32.7723963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7724030Z return func(*args, **kwargs) 2025-09-07T08:00:32.7724268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:32.7724472Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:32.7724563Z 2025-09-07T08:00:32.7724651Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7724839Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7724901Z return mod(**inputs) 2025-09-07T08:00:32.7725146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7725213Z outputs = self.bert( 2025-09-07T08:00:32.7725454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7725552Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7725794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7725857Z layer_outputs = layer_module( 2025-09-07T08:00:32.7726072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7726141Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7726382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7726451Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7726743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7726807Z return func(*args, **kwargs) 2025-09-07T08:00:32.7727044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7727109Z self_outputs = self.self( 2025-09-07T08:00:32.7727345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7727403Z return func(*args, **kwargs) 2025-09-07T08:00:32.7727645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:32.7727707Z self.key(current_states) 2025-09-07T08:00:32.7727710Z 2025-09-07T08:00:32.7727803Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7727988Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7728044Z return mod(**inputs) 2025-09-07T08:00:32.7728293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7728353Z outputs = self.bert( 2025-09-07T08:00:32.7728601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7728664Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7728910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7728970Z layer_outputs = layer_module( 2025-09-07T08:00:32.7729180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7729250Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7729487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7729561Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7729792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7729852Z return func(*args, **kwargs) 2025-09-07T08:00:32.7730092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7730151Z self_outputs = self.self( 2025-09-07T08:00:32.7730385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7730480Z return func(*args, **kwargs) 2025-09-07T08:00:32.7730721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:32.7730790Z self.value(current_states) 2025-09-07T08:00:32.7730793Z 2025-09-07T08:00:32.7730865Z cudagraph partition due to non gpu ops 2025-09-07T08:00:32.7730958Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7731145Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7731269Z return mod(**inputs) 2025-09-07T08:00:32.7731517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7731574Z outputs = self.bert( 2025-09-07T08:00:32.7731821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7731887Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7732127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7732188Z layer_outputs = layer_module( 2025-09-07T08:00:32.7732459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7732529Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7732766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7732840Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7733073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7733133Z return func(*args, **kwargs) 2025-09-07T08:00:32.7733374Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:32.7733434Z self_outputs = self.self( 2025-09-07T08:00:32.7733669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7733726Z return func(*args, **kwargs) 2025-09-07T08:00:32.7733967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:32.7734092Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:32.7734097Z 2025-09-07T08:00:32.7734189Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7734385Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7734443Z return mod(**inputs) 2025-09-07T08:00:32.7734688Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7734748Z outputs = self.bert( 2025-09-07T08:00:32.7734987Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7735055Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7735295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7735362Z layer_outputs = layer_module( 2025-09-07T08:00:32.7735570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7735637Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7735882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:32.7735952Z self_attention_outputs = self.attention( 2025-09-07T08:00:32.7736190Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:32.7736286Z return func(*args, **kwargs) 2025-09-07T08:00:32.7736528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:32.7736644Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:32.7736884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:32.7736962Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7736999Z 2025-09-07T08:00:32.7737089Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7737281Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7737338Z return mod(**inputs) 2025-09-07T08:00:32.7737585Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7737648Z outputs = self.bert( 2025-09-07T08:00:32.7737887Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7737953Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7738266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7738329Z layer_outputs = layer_module( 2025-09-07T08:00:32.7738543Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7738612Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7738852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7738922Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7739187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7739255Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7739527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7739639Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7739877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:32.7739953Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7739960Z 2025-09-07T08:00:32.7740047Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7740230Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7740289Z return mod(**inputs) 2025-09-07T08:00:32.7740529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7740589Z outputs = self.bert( 2025-09-07T08:00:32.7740827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7740894Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7741136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7741196Z layer_outputs = layer_module( 2025-09-07T08:00:32.7741412Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7741478Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7741719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7741789Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7742094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7742164Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7742435Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:32.7742548Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:32.7742788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:32.7742923Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:32.7743134Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:32.7743195Z return self.act(input) 2025-09-07T08:00:32.7743199Z 2025-09-07T08:00:32.7743292Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7743478Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7743541Z return mod(**inputs) 2025-09-07T08:00:32.7743780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1308, in forward 2025-09-07T08:00:32.7743837Z outputs = self.bert( 2025-09-07T08:00:32.7744141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:32.7744207Z encoder_outputs = self.encoder( 2025-09-07T08:00:32.7744451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:32.7744512Z layer_outputs = layer_module( 2025-09-07T08:00:32.7744722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:32.7744790Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:32.7745029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:32.7745104Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:32.7745355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:32.7745421Z return forward_fn(*input_tensors) 2025-09-07T08:00:32.7745728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:32.7745848Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:32.7746090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:32.7746159Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7746163Z 2025-09-07T08:00:32.7746253Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7746441Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7746494Z return mod(**inputs) 2025-09-07T08:00:32.7746738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1323, in forward 2025-09-07T08:00:32.7746825Z prediction_scores = self.cls(sequence_output) 2025-09-07T08:00:32.7747075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 780, in forward 2025-09-07T08:00:32.7747180Z prediction_scores = self.predictions(sequence_output) 2025-09-07T08:00:32.7747423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 769, in forward 2025-09-07T08:00:32.7747504Z hidden_states = self.transform(hidden_states) 2025-09-07T08:00:32.7747742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 745, in forward 2025-09-07T08:00:32.7747855Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:32.7747858Z 2025-09-07T08:00:32.7747949Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7748137Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7748197Z return mod(**inputs) 2025-09-07T08:00:32.7748439Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1323, in forward 2025-09-07T08:00:32.7748522Z prediction_scores = self.cls(sequence_output) 2025-09-07T08:00:32.7748795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 780, in forward 2025-09-07T08:00:32.7748896Z prediction_scores = self.predictions(sequence_output) 2025-09-07T08:00:32.7749135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 770, in forward 2025-09-07T08:00:32.7749217Z hidden_states = self.decoder(hidden_states) 2025-09-07T08:00:32.7749228Z 2025-09-07T08:00:32.7749320Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:32.7749509Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:32.7749571Z return mod(**inputs) 2025-09-07T08:00:32.7749871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1328, in forward 2025-09-07T08:00:32.7750055Z masked_lm_loss = loss_fct(prediction_scores.view(-1, self.config.vocab_size), labels.view(-1)) 2025-09-07T08:00:32.7750060Z 2025-09-07T08:00:39.3231261Z pass 2025-09-07T08:00:39.3232496Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:42.1897566Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:00:42.1898498Z import pynvml # type: ignore[import] 2025-09-07T08:00:44.8707430Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:00:44.8708365Z from pkg_resources import resource_filename 2025-09-07T08:00:45.5205163Z 2025-09-07T08:00:46.8208660Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:00:46.8208956Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:00:46.8414464Z cpu eval BertForQuestionAnswering 2025-09-07T08:00:47.2660899Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:47.4068806Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:47.5474666Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:00:55.5304267Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5304603Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5304842Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5305040Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5305246Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5305452Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5305695Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5305891Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5306091Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5306282Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5306466Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5306966Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5307199Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5307589Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5307932Z return mod(**inputs) 2025-09-07T08:00:55.5308340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5308737Z outputs = self.bert( 2025-09-07T08:00:55.5309100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5309813Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5310209Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5310598Z layer_outputs = layer_module( 2025-09-07T08:00:55.5310944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5311318Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5311694Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5312082Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5312635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5313020Z return func(*args, **kwargs) 2025-09-07T08:00:55.5313391Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5313763Z self_outputs = self.self( 2025-09-07T08:00:55.5314123Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5314490Z return func(*args, **kwargs) 2025-09-07T08:00:55.5314851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5315390Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5315664Z 2025-09-07T08:00:55.5315774Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5316153Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5316489Z return mod(**inputs) 2025-09-07T08:00:55.5316860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5317238Z outputs = self.bert( 2025-09-07T08:00:55.5317590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5317971Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5318351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5318734Z layer_outputs = layer_module( 2025-09-07T08:00:55.5319083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5319444Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5319821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5320210Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5320589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5320953Z return func(*args, **kwargs) 2025-09-07T08:00:55.5321305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5321803Z self_outputs = self.self( 2025-09-07T08:00:55.5322170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5322530Z return func(*args, **kwargs) 2025-09-07T08:00:55.5322885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5323268Z self.key(current_states) 2025-09-07T08:00:55.5323389Z 2025-09-07T08:00:55.5323654Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5324011Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5324390Z return mod(**inputs) 2025-09-07T08:00:55.5324757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5325132Z outputs = self.bert( 2025-09-07T08:00:55.5325474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5325859Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5326222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5326596Z layer_outputs = layer_module( 2025-09-07T08:00:55.5327028Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5327401Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5327793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5328186Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5328556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5328932Z return func(*args, **kwargs) 2025-09-07T08:00:55.5329293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5329654Z self_outputs = self.self( 2025-09-07T08:00:55.5330004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5330363Z return func(*args, **kwargs) 2025-09-07T08:00:55.5330714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5331101Z self.value(current_states) 2025-09-07T08:00:55.5331221Z 2025-09-07T08:00:55.5331300Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5331537Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5331900Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5332217Z return mod(**inputs) 2025-09-07T08:00:55.5332567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5332963Z outputs = self.bert( 2025-09-07T08:00:55.5333304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5333675Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5334038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5334416Z layer_outputs = layer_module( 2025-09-07T08:00:55.5334759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5335119Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5335499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5335922Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5336295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5336682Z return func(*args, **kwargs) 2025-09-07T08:00:55.5337032Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5337410Z self_outputs = self.self( 2025-09-07T08:00:55.5337748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5338152Z return func(*args, **kwargs) 2025-09-07T08:00:55.5338505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5338940Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5339119Z 2025-09-07T08:00:55.5339223Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5339569Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5339896Z return mod(**inputs) 2025-09-07T08:00:55.5340241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5340615Z outputs = self.bert( 2025-09-07T08:00:55.5341013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5341396Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5341779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5342146Z layer_outputs = layer_module( 2025-09-07T08:00:55.5342477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5342818Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5343186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5343564Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5343929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5344294Z return func(*args, **kwargs) 2025-09-07T08:00:55.5344634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5345063Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5345482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5345939Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5346073Z 2025-09-07T08:00:55.5346183Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5346539Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5346867Z return mod(**inputs) 2025-09-07T08:00:55.5347227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5347604Z outputs = self.bert( 2025-09-07T08:00:55.5347943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5348322Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5348700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5349077Z layer_outputs = layer_module( 2025-09-07T08:00:55.5349418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5349818Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5350194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5350576Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5350978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5351365Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5351771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5352299Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5352717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5353097Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5353235Z 2025-09-07T08:00:55.5353335Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5353694Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5354018Z return mod(**inputs) 2025-09-07T08:00:55.5354371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5354814Z outputs = self.bert( 2025-09-07T08:00:55.5355156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5355534Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5355901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5356276Z layer_outputs = layer_module( 2025-09-07T08:00:55.5356608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5356964Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5357334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5357714Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5358105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5358485Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5358908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5359353Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5359763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5360174Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5360543Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5360881Z return self.act(input) 2025-09-07T08:00:55.5360992Z 2025-09-07T08:00:55.5361089Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5361444Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5361754Z return mod(**inputs) 2025-09-07T08:00:55.5362102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5362472Z outputs = self.bert( 2025-09-07T08:00:55.5362819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5363211Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5363567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5363980Z layer_outputs = layer_module( 2025-09-07T08:00:55.5364313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5364666Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5365038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5365414Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5365808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5366242Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5366641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5367092Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5367517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5367912Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5368043Z 2025-09-07T08:00:55.5368147Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5368562Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5368875Z return mod(**inputs) 2025-09-07T08:00:55.5369224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5369597Z outputs = self.bert( 2025-09-07T08:00:55.5369942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5370317Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5370676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5371053Z layer_outputs = layer_module( 2025-09-07T08:00:55.5371404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5371760Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5372131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5372512Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5372892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5373261Z return func(*args, **kwargs) 2025-09-07T08:00:55.5373615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5373977Z self_outputs = self.self( 2025-09-07T08:00:55.5374326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5374689Z return func(*args, **kwargs) 2025-09-07T08:00:55.5375044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5375568Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5375830Z 2025-09-07T08:00:55.5375929Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5376282Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5376608Z return mod(**inputs) 2025-09-07T08:00:55.5376964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5377373Z outputs = self.bert( 2025-09-07T08:00:55.5377715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5378094Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5378458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5378831Z layer_outputs = layer_module( 2025-09-07T08:00:55.5379156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5379514Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5379924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5380306Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5380666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5381031Z return func(*args, **kwargs) 2025-09-07T08:00:55.5381383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5381755Z self_outputs = self.self( 2025-09-07T08:00:55.5382165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5382526Z return func(*args, **kwargs) 2025-09-07T08:00:55.5382880Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5383247Z self.key(current_states) 2025-09-07T08:00:55.5383354Z 2025-09-07T08:00:55.5383457Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5383806Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5384114Z return mod(**inputs) 2025-09-07T08:00:55.5384455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5384822Z outputs = self.bert( 2025-09-07T08:00:55.5385164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5385532Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5385967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5386352Z layer_outputs = layer_module( 2025-09-07T08:00:55.5386702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5387058Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5387421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5387804Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5388173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5388536Z return func(*args, **kwargs) 2025-09-07T08:00:55.5388877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5389252Z self_outputs = self.self( 2025-09-07T08:00:55.5389593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5389955Z return func(*args, **kwargs) 2025-09-07T08:00:55.5390306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5390669Z self.value(current_states) 2025-09-07T08:00:55.5390790Z 2025-09-07T08:00:55.5390866Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5391140Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5391487Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5391796Z return mod(**inputs) 2025-09-07T08:00:55.5392137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5392505Z outputs = self.bert( 2025-09-07T08:00:55.5392844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5393261Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5393618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5393991Z layer_outputs = layer_module( 2025-09-07T08:00:55.5394325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5394677Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5395048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5395419Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5395859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5396226Z return func(*args, **kwargs) 2025-09-07T08:00:55.5396580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5396942Z self_outputs = self.self( 2025-09-07T08:00:55.5397287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5397652Z return func(*args, **kwargs) 2025-09-07T08:00:55.5398001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5398428Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5398608Z 2025-09-07T08:00:55.5398702Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5399048Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5399368Z return mod(**inputs) 2025-09-07T08:00:55.5399717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5400083Z outputs = self.bert( 2025-09-07T08:00:55.5400423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5400798Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5401160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5401537Z layer_outputs = layer_module( 2025-09-07T08:00:55.5401862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5402207Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5402584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5402966Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5403331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5403691Z return func(*args, **kwargs) 2025-09-07T08:00:55.5404043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5404469Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5404954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5405329Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5405469Z 2025-09-07T08:00:55.5405569Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5405940Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5406267Z return mod(**inputs) 2025-09-07T08:00:55.5406615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5407028Z outputs = self.bert( 2025-09-07T08:00:55.5407368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5407740Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5408098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5408481Z layer_outputs = layer_module( 2025-09-07T08:00:55.5408805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5409159Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5409600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5410181Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5410574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5410975Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5411383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5411839Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5412262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5412637Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5412776Z 2025-09-07T08:00:55.5412874Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5413228Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5413544Z return mod(**inputs) 2025-09-07T08:00:55.5413895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5414261Z outputs = self.bert( 2025-09-07T08:00:55.5414603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5414978Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5415346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5415716Z layer_outputs = layer_module( 2025-09-07T08:00:55.5416052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5416411Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5416787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5417171Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5417559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5417953Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5418355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5418800Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5420212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5420621Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5420994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5421333Z return self.act(input) 2025-09-07T08:00:55.5421442Z 2025-09-07T08:00:55.5421548Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5421889Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5422271Z return mod(**inputs) 2025-09-07T08:00:55.5422626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5422994Z outputs = self.bert( 2025-09-07T08:00:55.5423340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5423712Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5424082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5424454Z layer_outputs = layer_module( 2025-09-07T08:00:55.5424891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5425246Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5425693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5426079Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5426475Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5426862Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5427253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5427710Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5428141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5428523Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5428649Z 2025-09-07T08:00:55.5428754Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5429096Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5429414Z return mod(**inputs) 2025-09-07T08:00:55.5429759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5430127Z outputs = self.bert( 2025-09-07T08:00:55.5430461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5430839Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5431221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5431601Z layer_outputs = layer_module( 2025-09-07T08:00:55.5431954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5432307Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5432691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5433074Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5433450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5433866Z return func(*args, **kwargs) 2025-09-07T08:00:55.5434218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5434584Z self_outputs = self.self( 2025-09-07T08:00:55.5434937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5435305Z return func(*args, **kwargs) 2025-09-07T08:00:55.5435650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5436204Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5436477Z 2025-09-07T08:00:55.5436579Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5436936Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5437256Z return mod(**inputs) 2025-09-07T08:00:55.5437604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5437979Z outputs = self.bert( 2025-09-07T08:00:55.5438324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5438763Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5439132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5439498Z layer_outputs = layer_module( 2025-09-07T08:00:55.5439838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5440186Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5440557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5440931Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5441301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5441662Z return func(*args, **kwargs) 2025-09-07T08:00:55.5442019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5442387Z self_outputs = self.self( 2025-09-07T08:00:55.5442736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5443116Z return func(*args, **kwargs) 2025-09-07T08:00:55.5443470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5443850Z self.key(current_states) 2025-09-07T08:00:55.5443957Z 2025-09-07T08:00:55.5444065Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5444411Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5444728Z return mod(**inputs) 2025-09-07T08:00:55.5445073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5445446Z outputs = self.bert( 2025-09-07T08:00:55.5445778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5446155Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5446521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5446887Z layer_outputs = layer_module( 2025-09-07T08:00:55.5447220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5447607Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5447979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5448360Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5448733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5449095Z return func(*args, **kwargs) 2025-09-07T08:00:55.5449452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5449924Z self_outputs = self.self( 2025-09-07T08:00:55.5450280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5450646Z return func(*args, **kwargs) 2025-09-07T08:00:55.5451000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5451373Z self.value(current_states) 2025-09-07T08:00:55.5451489Z 2025-09-07T08:00:55.5451565Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5451796Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5452140Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5452539Z return mod(**inputs) 2025-09-07T08:00:55.5452895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5453275Z outputs = self.bert( 2025-09-07T08:00:55.5453622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5453991Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5454361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5454742Z layer_outputs = layer_module( 2025-09-07T08:00:55.5455081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5455430Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5455807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5456184Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5456555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5456925Z return func(*args, **kwargs) 2025-09-07T08:00:55.5457278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5457651Z self_outputs = self.self( 2025-09-07T08:00:55.5457998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5458366Z return func(*args, **kwargs) 2025-09-07T08:00:55.5458713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5459134Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5459322Z 2025-09-07T08:00:55.5459420Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5459771Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5460091Z return mod(**inputs) 2025-09-07T08:00:55.5460431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5460809Z outputs = self.bert( 2025-09-07T08:00:55.5461148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5461581Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5461951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5462314Z layer_outputs = layer_module( 2025-09-07T08:00:55.5462654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5463006Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5463378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5463797Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5464160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5464523Z return func(*args, **kwargs) 2025-09-07T08:00:55.5464885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5465306Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5465792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5466181Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5466386Z 2025-09-07T08:00:55.5466498Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5466846Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5467165Z return mod(**inputs) 2025-09-07T08:00:55.5467501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5467866Z outputs = self.bert( 2025-09-07T08:00:55.5468207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5468586Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5468962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5469337Z layer_outputs = layer_module( 2025-09-07T08:00:55.5469674Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5470027Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5470397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5470777Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5471171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5471567Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5471972Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5472429Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5472835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5473218Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5473359Z 2025-09-07T08:00:55.5473456Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5473803Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5474121Z return mod(**inputs) 2025-09-07T08:00:55.5474460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5474834Z outputs = self.bert( 2025-09-07T08:00:55.5475176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5475597Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5475956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5476325Z layer_outputs = layer_module( 2025-09-07T08:00:55.5476674Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5477025Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5477433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5477822Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5478211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5478602Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5479000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5479437Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5479848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5480326Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5480704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5481041Z return self.act(input) 2025-09-07T08:00:55.5481145Z 2025-09-07T08:00:55.5481242Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5481585Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5481898Z return mod(**inputs) 2025-09-07T08:00:55.5482245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5482610Z outputs = self.bert( 2025-09-07T08:00:55.5482945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5483316Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5483681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5484049Z layer_outputs = layer_module( 2025-09-07T08:00:55.5484377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5484725Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5485095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5485475Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5485861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5486240Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5486639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5487097Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5487524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5487923Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5488057Z 2025-09-07T08:00:55.5488152Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5488493Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5488849Z return mod(**inputs) 2025-09-07T08:00:55.5489191Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5489554Z outputs = self.bert( 2025-09-07T08:00:55.5489895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5490273Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5490635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5491046Z layer_outputs = layer_module( 2025-09-07T08:00:55.5491373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5491721Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5492086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5492463Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5492828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5493186Z return func(*args, **kwargs) 2025-09-07T08:00:55.5493603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5493979Z self_outputs = self.self( 2025-09-07T08:00:55.5494328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5494686Z return func(*args, **kwargs) 2025-09-07T08:00:55.5495042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5495555Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5495816Z 2025-09-07T08:00:55.5495917Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5496265Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5496574Z return mod(**inputs) 2025-09-07T08:00:55.5496924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5497291Z outputs = self.bert( 2025-09-07T08:00:55.5497630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5498004Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5498359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5498728Z layer_outputs = layer_module( 2025-09-07T08:00:55.5499064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5499414Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5499781Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5500162Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5500537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5500906Z return func(*args, **kwargs) 2025-09-07T08:00:55.5501253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5501613Z self_outputs = self.self( 2025-09-07T08:00:55.5501955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5502311Z return func(*args, **kwargs) 2025-09-07T08:00:55.5502703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5503066Z self.key(current_states) 2025-09-07T08:00:55.5503179Z 2025-09-07T08:00:55.5503273Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5503619Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5503936Z return mod(**inputs) 2025-09-07T08:00:55.5504278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5504698Z outputs = self.bert( 2025-09-07T08:00:55.5505037Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5505409Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5505906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5506282Z layer_outputs = layer_module( 2025-09-07T08:00:55.5506607Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5506957Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5507413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5507797Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5508160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5508523Z return func(*args, **kwargs) 2025-09-07T08:00:55.5508874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5509242Z self_outputs = self.self( 2025-09-07T08:00:55.5509584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5510098Z return func(*args, **kwargs) 2025-09-07T08:00:55.5510461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5510838Z self.value(current_states) 2025-09-07T08:00:55.5510951Z 2025-09-07T08:00:55.5511045Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5511267Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5511624Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5511946Z return mod(**inputs) 2025-09-07T08:00:55.5512299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5512675Z outputs = self.bert( 2025-09-07T08:00:55.5513010Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5513383Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5513750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5514119Z layer_outputs = layer_module( 2025-09-07T08:00:55.5514453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5514806Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5515184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5515564Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5515933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5516291Z return func(*args, **kwargs) 2025-09-07T08:00:55.5516729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5517099Z self_outputs = self.self( 2025-09-07T08:00:55.5517443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5517805Z return func(*args, **kwargs) 2025-09-07T08:00:55.5518152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5518578Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5518828Z 2025-09-07T08:00:55.5518924Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5519275Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5519584Z return mod(**inputs) 2025-09-07T08:00:55.5519928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5520298Z outputs = self.bert( 2025-09-07T08:00:55.5520639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5521012Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5521464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5521850Z layer_outputs = layer_module( 2025-09-07T08:00:55.5522191Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5522551Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5522922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5523301Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5523672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5524037Z return func(*args, **kwargs) 2025-09-07T08:00:55.5524387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5524804Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5525231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5525616Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5525748Z 2025-09-07T08:00:55.5525851Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5526200Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5526511Z return mod(**inputs) 2025-09-07T08:00:55.5526862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5527233Z outputs = self.bert( 2025-09-07T08:00:55.5527576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5527941Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5528306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5528682Z layer_outputs = layer_module( 2025-09-07T08:00:55.5529021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5529380Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5529749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5530130Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5530586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5530977Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5531376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5531824Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5532240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5532662Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5532792Z 2025-09-07T08:00:55.5532893Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5533233Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5533549Z return mod(**inputs) 2025-09-07T08:00:55.5533895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5534263Z outputs = self.bert( 2025-09-07T08:00:55.5534604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5534972Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5535395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5535770Z layer_outputs = layer_module( 2025-09-07T08:00:55.5536104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5536454Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5536819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5537200Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5537588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5537972Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5538364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5538812Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5539229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5539647Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5540017Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5540345Z return self.act(input) 2025-09-07T08:00:55.5540457Z 2025-09-07T08:00:55.5540554Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5540897Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5541212Z return mod(**inputs) 2025-09-07T08:00:55.5541555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5541925Z outputs = self.bert( 2025-09-07T08:00:55.5542265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5542638Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5542999Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5543365Z layer_outputs = layer_module( 2025-09-07T08:00:55.5543695Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5544094Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5544470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5544849Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5545235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5545669Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5546071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5546571Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5546999Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5547370Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5547507Z 2025-09-07T08:00:55.5547597Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5547941Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5548253Z return mod(**inputs) 2025-09-07T08:00:55.5548654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5549026Z outputs = self.bert( 2025-09-07T08:00:55.5549364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5549740Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5550098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5550459Z layer_outputs = layer_module( 2025-09-07T08:00:55.5550790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5551141Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5565452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5565895Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5566308Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5566701Z return func(*args, **kwargs) 2025-09-07T08:00:55.5567078Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5567461Z self_outputs = self.self( 2025-09-07T08:00:55.5567814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5568181Z return func(*args, **kwargs) 2025-09-07T08:00:55.5568545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5569060Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5569318Z 2025-09-07T08:00:55.5569430Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5569787Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5570112Z return mod(**inputs) 2025-09-07T08:00:55.5570469Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5570845Z outputs = self.bert( 2025-09-07T08:00:55.5571183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5571566Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5572021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5572401Z layer_outputs = layer_module( 2025-09-07T08:00:55.5572738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5573087Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5573468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5573848Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5574259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5574621Z return func(*args, **kwargs) 2025-09-07T08:00:55.5574968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5575336Z self_outputs = self.self( 2025-09-07T08:00:55.5575677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5576030Z return func(*args, **kwargs) 2025-09-07T08:00:55.5576378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5576779Z self.key(current_states) 2025-09-07T08:00:55.5576967Z 2025-09-07T08:00:55.5577073Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5577432Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5577751Z return mod(**inputs) 2025-09-07T08:00:55.5578100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5578469Z outputs = self.bert( 2025-09-07T08:00:55.5578803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5579178Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5579534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5579898Z layer_outputs = layer_module( 2025-09-07T08:00:55.5580231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5580580Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5580943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5581315Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5581672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5582026Z return func(*args, **kwargs) 2025-09-07T08:00:55.5582380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5582756Z self_outputs = self.self( 2025-09-07T08:00:55.5583090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5583445Z return func(*args, **kwargs) 2025-09-07T08:00:55.5583796Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5584159Z self.value(current_states) 2025-09-07T08:00:55.5584269Z 2025-09-07T08:00:55.5584343Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5584568Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5584910Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5585229Z return mod(**inputs) 2025-09-07T08:00:55.5585709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5586088Z outputs = self.bert( 2025-09-07T08:00:55.5586431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5586795Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5587159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5587524Z layer_outputs = layer_module( 2025-09-07T08:00:55.5587862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5588265Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5588648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5589030Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5589393Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5589756Z return func(*args, **kwargs) 2025-09-07T08:00:55.5590112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5590543Z self_outputs = self.self( 2025-09-07T08:00:55.5590888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5591252Z return func(*args, **kwargs) 2025-09-07T08:00:55.5591601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5592025Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5592212Z 2025-09-07T08:00:55.5592311Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5592662Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5592998Z return mod(**inputs) 2025-09-07T08:00:55.5593361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5593725Z outputs = self.bert( 2025-09-07T08:00:55.5594069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5594444Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5594797Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5595160Z layer_outputs = layer_module( 2025-09-07T08:00:55.5595493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5595842Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5596213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5596583Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5596944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5597305Z return func(*args, **kwargs) 2025-09-07T08:00:55.5597642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5598057Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5598466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5598844Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5598977Z 2025-09-07T08:00:55.5599082Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5599484Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5599801Z return mod(**inputs) 2025-09-07T08:00:55.5600149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5600517Z outputs = self.bert( 2025-09-07T08:00:55.5600852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5601227Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5601630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5602001Z layer_outputs = layer_module( 2025-09-07T08:00:55.5602377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5602781Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5603159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5603553Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5603953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5604638Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5605042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5605491Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5605914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5606314Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5606447Z 2025-09-07T08:00:55.5606545Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5606899Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5607215Z return mod(**inputs) 2025-09-07T08:00:55.5607573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5607979Z outputs = self.bert( 2025-09-07T08:00:55.5608313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5608688Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5609067Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5609444Z layer_outputs = layer_module( 2025-09-07T08:00:55.5610007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5610375Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5610765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5611158Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5611551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5611932Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5612343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5612787Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5613207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5613628Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5614096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5614436Z return self.act(input) 2025-09-07T08:00:55.5614544Z 2025-09-07T08:00:55.5614645Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5614999Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5615335Z return mod(**inputs) 2025-09-07T08:00:55.5615684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5616115Z outputs = self.bert( 2025-09-07T08:00:55.5616477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5616847Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5617217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5617597Z layer_outputs = layer_module( 2025-09-07T08:00:55.5617938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5618291Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5618769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5619150Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5619549Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5619936Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5620330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5620787Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5621212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5621588Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5621715Z 2025-09-07T08:00:55.5621823Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5622175Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5622485Z return mod(**inputs) 2025-09-07T08:00:55.5622829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5623190Z outputs = self.bert( 2025-09-07T08:00:55.5623518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5623886Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5624240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5624601Z layer_outputs = layer_module( 2025-09-07T08:00:55.5624927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5625271Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5625709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5626091Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5626460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5626818Z return func(*args, **kwargs) 2025-09-07T08:00:55.5627165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5627528Z self_outputs = self.self( 2025-09-07T08:00:55.5627920Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5628280Z return func(*args, **kwargs) 2025-09-07T08:00:55.5628650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5629156Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5629419Z 2025-09-07T08:00:55.5629513Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5629902Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5630216Z return mod(**inputs) 2025-09-07T08:00:55.5630568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5630934Z outputs = self.bert( 2025-09-07T08:00:55.5631278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5631650Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5632006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5632374Z layer_outputs = layer_module( 2025-09-07T08:00:55.5632774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5633135Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5633506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5633885Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5634257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5634622Z return func(*args, **kwargs) 2025-09-07T08:00:55.5634975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5635336Z self_outputs = self.self( 2025-09-07T08:00:55.5635686Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5636049Z return func(*args, **kwargs) 2025-09-07T08:00:55.5636400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5636769Z self.key(current_states) 2025-09-07T08:00:55.5636877Z 2025-09-07T08:00:55.5636971Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5637318Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5637635Z return mod(**inputs) 2025-09-07T08:00:55.5637975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5638341Z outputs = self.bert( 2025-09-07T08:00:55.5638682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5639055Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5639418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5639784Z layer_outputs = layer_module( 2025-09-07T08:00:55.5640108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5640464Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5640834Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5641211Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5641613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5641977Z return func(*args, **kwargs) 2025-09-07T08:00:55.5642332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5642700Z self_outputs = self.self( 2025-09-07T08:00:55.5643046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5643396Z return func(*args, **kwargs) 2025-09-07T08:00:55.5643779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5644146Z self.value(current_states) 2025-09-07T08:00:55.5644254Z 2025-09-07T08:00:55.5644337Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5644558Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5644898Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5645211Z return mod(**inputs) 2025-09-07T08:00:55.5645555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5645921Z outputs = self.bert( 2025-09-07T08:00:55.5646316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5646692Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5647069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5647451Z layer_outputs = layer_module( 2025-09-07T08:00:55.5647792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5648156Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5648535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5648917Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5649287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5649653Z return func(*args, **kwargs) 2025-09-07T08:00:55.5650018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5650390Z self_outputs = self.self( 2025-09-07T08:00:55.5650745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5651108Z return func(*args, **kwargs) 2025-09-07T08:00:55.5651453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5651883Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5652070Z 2025-09-07T08:00:55.5652170Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5652524Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5652841Z return mod(**inputs) 2025-09-07T08:00:55.5653196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5653565Z outputs = self.bert( 2025-09-07T08:00:55.5653908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5654284Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5654650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5655069Z layer_outputs = layer_module( 2025-09-07T08:00:55.5655406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5655759Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5656128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5656505Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5656872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5657339Z return func(*args, **kwargs) 2025-09-07T08:00:55.5657697Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5658114Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5658538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5658927Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5659062Z 2025-09-07T08:00:55.5659168Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5659515Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5659825Z return mod(**inputs) 2025-09-07T08:00:55.5660235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5660611Z outputs = self.bert( 2025-09-07T08:00:55.5660957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5661330Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5661683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5662059Z layer_outputs = layer_module( 2025-09-07T08:00:55.5662393Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5662749Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5663128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5663535Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5663942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5664339Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5664745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5665190Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5665684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5666077Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5666210Z 2025-09-07T08:00:55.5666314Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5666667Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5666987Z return mod(**inputs) 2025-09-07T08:00:55.5667341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5667722Z outputs = self.bert( 2025-09-07T08:00:55.5668066Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5668452Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5668823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5669245Z layer_outputs = layer_module( 2025-09-07T08:00:55.5669592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5669947Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5670317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5670703Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5671095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5671548Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5671953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5672402Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5672819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5673231Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5673608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5673933Z return self.act(input) 2025-09-07T08:00:55.5674116Z 2025-09-07T08:00:55.5674215Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5674566Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5674888Z return mod(**inputs) 2025-09-07T08:00:55.5675236Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5675598Z outputs = self.bert( 2025-09-07T08:00:55.5675941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5676315Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5676678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5677043Z layer_outputs = layer_module( 2025-09-07T08:00:55.5677390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5677744Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5678109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5678490Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5678872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5679258Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5679659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5680118Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5680541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5680921Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5681056Z 2025-09-07T08:00:55.5681150Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5681500Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5681813Z return mod(**inputs) 2025-09-07T08:00:55.5682153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5682517Z outputs = self.bert( 2025-09-07T08:00:55.5682898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5683268Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5683630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5683993Z layer_outputs = layer_module( 2025-09-07T08:00:55.5684336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5684700Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5685110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5685493Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5685857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5686227Z return func(*args, **kwargs) 2025-09-07T08:00:55.5686585Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5686955Z self_outputs = self.self( 2025-09-07T08:00:55.5687294Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5687722Z return func(*args, **kwargs) 2025-09-07T08:00:55.5688076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5688589Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5688845Z 2025-09-07T08:00:55.5688943Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5689282Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5689593Z return mod(**inputs) 2025-09-07T08:00:55.5689928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5690287Z outputs = self.bert( 2025-09-07T08:00:55.5690615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5690979Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5691330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5691692Z layer_outputs = layer_module( 2025-09-07T08:00:55.5692012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5692349Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5692705Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5693074Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5693427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5693487Z return func(*args, **kwargs) 2025-09-07T08:00:55.5693730Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5693792Z self_outputs = self.self( 2025-09-07T08:00:55.5694021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5694084Z return func(*args, **kwargs) 2025-09-07T08:00:55.5694322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5694386Z self.key(current_states) 2025-09-07T08:00:55.5694390Z 2025-09-07T08:00:55.5694480Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5694717Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5694775Z return mod(**inputs) 2025-09-07T08:00:55.5695022Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5695082Z outputs = self.bert( 2025-09-07T08:00:55.5695328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5695394Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5695681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5695744Z layer_outputs = layer_module( 2025-09-07T08:00:55.5695963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5696035Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5696282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5696351Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5696589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5696714Z return func(*args, **kwargs) 2025-09-07T08:00:55.5696955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5697019Z self_outputs = self.self( 2025-09-07T08:00:55.5697250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5697309Z return func(*args, **kwargs) 2025-09-07T08:00:55.5697546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5697611Z self.value(current_states) 2025-09-07T08:00:55.5697615Z 2025-09-07T08:00:55.5697788Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5697883Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5698076Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5698137Z return mod(**inputs) 2025-09-07T08:00:55.5698383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5698442Z outputs = self.bert( 2025-09-07T08:00:55.5698685Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5698753Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5698989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5699053Z layer_outputs = layer_module( 2025-09-07T08:00:55.5699271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5699335Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5699576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5699648Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5699885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5699948Z return func(*args, **kwargs) 2025-09-07T08:00:55.5700184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5700246Z self_outputs = self.self( 2025-09-07T08:00:55.5700477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5700576Z return func(*args, **kwargs) 2025-09-07T08:00:55.5700816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5700940Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5700944Z 2025-09-07T08:00:55.5701038Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5701225Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5701318Z return mod(**inputs) 2025-09-07T08:00:55.5701561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5701618Z outputs = self.bert( 2025-09-07T08:00:55.5701862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5701927Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5702169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5702228Z layer_outputs = layer_module( 2025-09-07T08:00:55.5702445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5702577Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5702828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5702909Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5703148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5703214Z return func(*args, **kwargs) 2025-09-07T08:00:55.5703453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5703573Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5703815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5703889Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5703893Z 2025-09-07T08:00:55.5703994Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5704185Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5704248Z return mod(**inputs) 2025-09-07T08:00:55.5704494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5704550Z outputs = self.bert( 2025-09-07T08:00:55.5704799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5704864Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5705108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5705169Z layer_outputs = layer_module( 2025-09-07T08:00:55.5705389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5705463Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5705739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5705821Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5706081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5706148Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5706486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5706600Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5706840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5706910Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5706918Z 2025-09-07T08:00:55.5707014Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5707203Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5707296Z return mod(**inputs) 2025-09-07T08:00:55.5707544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5707603Z outputs = self.bert( 2025-09-07T08:00:55.5707843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5707909Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5708148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5708212Z layer_outputs = layer_module( 2025-09-07T08:00:55.5708511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5708584Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5708822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5708899Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5709153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5709217Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5709496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5709599Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5709985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5710095Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5710303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5710375Z return self.act(input) 2025-09-07T08:00:55.5710379Z 2025-09-07T08:00:55.5710471Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5710667Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5710723Z return mod(**inputs) 2025-09-07T08:00:55.5710988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5711049Z outputs = self.bert( 2025-09-07T08:00:55.5711289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5711356Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5711598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5711662Z layer_outputs = layer_module( 2025-09-07T08:00:55.5711877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5711945Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5712187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5712257Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5712580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5712642Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5712915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5713043Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5713281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5713405Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5713408Z 2025-09-07T08:00:55.5713494Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5713688Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5713743Z return mod(**inputs) 2025-09-07T08:00:55.5713985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5714048Z outputs = self.bert( 2025-09-07T08:00:55.5714288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5714354Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5714685Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5714748Z layer_outputs = layer_module( 2025-09-07T08:00:55.5714968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5715034Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5715274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5715346Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5715583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5715648Z return func(*args, **kwargs) 2025-09-07T08:00:55.5715888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5715957Z self_outputs = self.self( 2025-09-07T08:00:55.5716194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5716260Z return func(*args, **kwargs) 2025-09-07T08:00:55.5716498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5716698Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5716703Z 2025-09-07T08:00:55.5716798Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5716985Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5717046Z return mod(**inputs) 2025-09-07T08:00:55.5717290Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5717348Z outputs = self.bert( 2025-09-07T08:00:55.5717592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5717654Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5717899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5717959Z layer_outputs = layer_module( 2025-09-07T08:00:55.5718170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5718278Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5718515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5718586Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5718820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5718883Z return func(*args, **kwargs) 2025-09-07T08:00:55.5719120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5719216Z self_outputs = self.self( 2025-09-07T08:00:55.5719457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5719513Z return func(*args, **kwargs) 2025-09-07T08:00:55.5719753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5719817Z self.key(current_states) 2025-09-07T08:00:55.5719821Z 2025-09-07T08:00:55.5719909Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5720096Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5720218Z return mod(**inputs) 2025-09-07T08:00:55.5720467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5720526Z outputs = self.bert( 2025-09-07T08:00:55.5720767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5720833Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5721071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5721138Z layer_outputs = layer_module( 2025-09-07T08:00:55.5721349Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5721420Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5721655Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5721727Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5721962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5722021Z return func(*args, **kwargs) 2025-09-07T08:00:55.5722262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5722318Z self_outputs = self.self( 2025-09-07T08:00:55.5722550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5722612Z return func(*args, **kwargs) 2025-09-07T08:00:55.5722846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5722911Z self.value(current_states) 2025-09-07T08:00:55.5722915Z 2025-09-07T08:00:55.5722986Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5723081Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5723272Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5723330Z return mod(**inputs) 2025-09-07T08:00:55.5723572Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5723627Z outputs = self.bert( 2025-09-07T08:00:55.5723872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5723970Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5724213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5724278Z layer_outputs = layer_module( 2025-09-07T08:00:55.5724491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5724560Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5724797Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5724900Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5725139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5725197Z return func(*args, **kwargs) 2025-09-07T08:00:55.5725440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5725500Z self_outputs = self.self( 2025-09-07T08:00:55.5725731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5725792Z return func(*args, **kwargs) 2025-09-07T08:00:55.5726110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5726235Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5726241Z 2025-09-07T08:00:55.5726327Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5726516Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5726570Z return mod(**inputs) 2025-09-07T08:00:55.5726811Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5726874Z outputs = self.bert( 2025-09-07T08:00:55.5727115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5727178Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5727417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5727477Z layer_outputs = layer_module( 2025-09-07T08:00:55.5727691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5727759Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5727999Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5728069Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5728299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5728363Z return func(*args, **kwargs) 2025-09-07T08:00:55.5728600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5728720Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5728959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5729034Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5729039Z 2025-09-07T08:00:55.5729124Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5729309Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5729368Z return mod(**inputs) 2025-09-07T08:00:55.5729608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5729704Z outputs = self.bert( 2025-09-07T08:00:55.5729945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5730008Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5730255Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5730315Z layer_outputs = layer_module( 2025-09-07T08:00:55.5730528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5730625Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5730867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5730939Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5731197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5731268Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5731543Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5731882Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5732125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5732200Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5732203Z 2025-09-07T08:00:55.5732296Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5732481Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5732540Z return mod(**inputs) 2025-09-07T08:00:55.5732782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5732840Z outputs = self.bert( 2025-09-07T08:00:55.5733085Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5733148Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5733394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5733452Z layer_outputs = layer_module( 2025-09-07T08:00:55.5733669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5733735Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5733973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5734048Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5734302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5734372Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5734640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5734744Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5734984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5735084Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5735293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5735356Z return self.act(input) 2025-09-07T08:00:55.5735359Z 2025-09-07T08:00:55.5735448Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5735672Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5735729Z return mod(**inputs) 2025-09-07T08:00:55.5735976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5736033Z outputs = self.bert( 2025-09-07T08:00:55.5736278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5736339Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5736616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5736679Z layer_outputs = layer_module( 2025-09-07T08:00:55.5736892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5736961Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5737197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5737265Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5737519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5737646Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5737922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5738043Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5738296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5738368Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5738375Z 2025-09-07T08:00:55.5738464Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5738662Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5738720Z return mod(**inputs) 2025-09-07T08:00:55.5738967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5739023Z outputs = self.bert( 2025-09-07T08:00:55.5739261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5739327Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5739567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5739628Z layer_outputs = layer_module( 2025-09-07T08:00:55.5739836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5739905Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5740144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5740211Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5740454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5740512Z return func(*args, **kwargs) 2025-09-07T08:00:55.5740755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5740816Z self_outputs = self.self( 2025-09-07T08:00:55.5741049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5741112Z return func(*args, **kwargs) 2025-09-07T08:00:55.5741350Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5741590Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5741594Z 2025-09-07T08:00:55.5741681Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5741872Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5741929Z return mod(**inputs) 2025-09-07T08:00:55.5742171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5742265Z outputs = self.bert( 2025-09-07T08:00:55.5742509Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5742571Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5742808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5742873Z layer_outputs = layer_module( 2025-09-07T08:00:55.5743087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5743152Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5743456Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5743529Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5743763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5743826Z return func(*args, **kwargs) 2025-09-07T08:00:55.5744062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5744126Z self_outputs = self.self( 2025-09-07T08:00:55.5744356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5744415Z return func(*args, **kwargs) 2025-09-07T08:00:55.5744661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5744722Z self.key(current_states) 2025-09-07T08:00:55.5744726Z 2025-09-07T08:00:55.5744825Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5745009Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5745070Z return mod(**inputs) 2025-09-07T08:00:55.5745313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5745370Z outputs = self.bert( 2025-09-07T08:00:55.5745694Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5745760Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5746006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5746067Z layer_outputs = layer_module( 2025-09-07T08:00:55.5746279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5746350Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5746591Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5746671Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5746912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5746974Z return func(*args, **kwargs) 2025-09-07T08:00:55.5747223Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5747335Z self_outputs = self.self( 2025-09-07T08:00:55.5747577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5747636Z return func(*args, **kwargs) 2025-09-07T08:00:55.5747885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5747948Z self.value(current_states) 2025-09-07T08:00:55.5747952Z 2025-09-07T08:00:55.5748058Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5748161Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5748350Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5748412Z return mod(**inputs) 2025-09-07T08:00:55.5748661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5748721Z outputs = self.bert( 2025-09-07T08:00:55.5748969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5749034Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5749354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5749418Z layer_outputs = layer_module( 2025-09-07T08:00:55.5749638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5749712Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5749951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5750030Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5750261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5750326Z return func(*args, **kwargs) 2025-09-07T08:00:55.5750566Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5750627Z self_outputs = self.self( 2025-09-07T08:00:55.5750867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5750928Z return func(*args, **kwargs) 2025-09-07T08:00:55.5751169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5751294Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5751298Z 2025-09-07T08:00:55.5751389Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5751586Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5751644Z return mod(**inputs) 2025-09-07T08:00:55.5751891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5751948Z outputs = self.bert( 2025-09-07T08:00:55.5752190Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5752260Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5752500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5752565Z layer_outputs = layer_module( 2025-09-07T08:00:55.5752777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5752848Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5753125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5753195Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5753433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5753495Z return func(*args, **kwargs) 2025-09-07T08:00:55.5753739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5753856Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5754133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5754215Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5754218Z 2025-09-07T08:00:55.5754308Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5754499Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5754554Z return mod(**inputs) 2025-09-07T08:00:55.5754801Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5754857Z outputs = self.bert( 2025-09-07T08:00:55.5755165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5755235Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5755473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5755541Z layer_outputs = layer_module( 2025-09-07T08:00:55.5755753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5755818Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5756060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5756131Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5756398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5756469Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5756748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5756867Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5757116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5757197Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5757200Z 2025-09-07T08:00:55.5757291Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5757491Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5757549Z return mod(**inputs) 2025-09-07T08:00:55.5757794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5757856Z outputs = self.bert( 2025-09-07T08:00:55.5758101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5758169Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5758412Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5758474Z layer_outputs = layer_module( 2025-09-07T08:00:55.5758694Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5758799Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5759046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5759118Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5759375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5759453Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5759726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5759871Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5760111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5760222Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5760430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5760493Z return self.act(input) 2025-09-07T08:00:55.5760497Z 2025-09-07T08:00:55.5760592Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5760778Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5760899Z return mod(**inputs) 2025-09-07T08:00:55.5761151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5761211Z outputs = self.bert( 2025-09-07T08:00:55.5761461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5761526Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5761772Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5761839Z layer_outputs = layer_module( 2025-09-07T08:00:55.5762060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5762131Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5762372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5762456Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5762712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5762787Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5763061Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5763184Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5763430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5763503Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5763507Z 2025-09-07T08:00:55.5763605Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5763798Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5763859Z return mod(**inputs) 2025-09-07T08:00:55.5764110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5764175Z outputs = self.bert( 2025-09-07T08:00:55.5764435Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5764496Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5764743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5764841Z layer_outputs = layer_module( 2025-09-07T08:00:55.5765055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5765128Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5765368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5765444Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5765682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5765781Z return func(*args, **kwargs) 2025-09-07T08:00:55.5766030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5766092Z self_outputs = self.self( 2025-09-07T08:00:55.5766334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5766394Z return func(*args, **kwargs) 2025-09-07T08:00:55.5766630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5766895Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5766898Z 2025-09-07T08:00:55.5766992Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5767191Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5767249Z return mod(**inputs) 2025-09-07T08:00:55.5767495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5767551Z outputs = self.bert( 2025-09-07T08:00:55.5767791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5767862Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5768099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5768162Z layer_outputs = layer_module( 2025-09-07T08:00:55.5768375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5768440Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5768682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5768754Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5768991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5769052Z return func(*args, **kwargs) 2025-09-07T08:00:55.5769295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5769356Z self_outputs = self.self( 2025-09-07T08:00:55.5769587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5769654Z return func(*args, **kwargs) 2025-09-07T08:00:55.5769892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5769958Z self.key(current_states) 2025-09-07T08:00:55.5769962Z 2025-09-07T08:00:55.5770050Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5770233Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5770301Z return mod(**inputs) 2025-09-07T08:00:55.5770545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5770700Z outputs = self.bert( 2025-09-07T08:00:55.5770943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5771008Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5771254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5771314Z layer_outputs = layer_module( 2025-09-07T08:00:55.5771532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5771646Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5771888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5771956Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5772189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5772253Z return func(*args, **kwargs) 2025-09-07T08:00:55.5772491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5772558Z self_outputs = self.self( 2025-09-07T08:00:55.5772850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5772912Z return func(*args, **kwargs) 2025-09-07T08:00:55.5773160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5773223Z self.value(current_states) 2025-09-07T08:00:55.5773226Z 2025-09-07T08:00:55.5773302Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5773391Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5773577Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5773637Z return mod(**inputs) 2025-09-07T08:00:55.5773877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5773936Z outputs = self.bert( 2025-09-07T08:00:55.5774176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5774243Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5774480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5774541Z layer_outputs = layer_module( 2025-09-07T08:00:55.5774754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5774820Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5775060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5775128Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5775361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5775424Z return func(*args, **kwargs) 2025-09-07T08:00:55.5775663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5775730Z self_outputs = self.self( 2025-09-07T08:00:55.5775964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5776022Z return func(*args, **kwargs) 2025-09-07T08:00:55.5776263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5776424Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5776427Z 2025-09-07T08:00:55.5776520Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5776702Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5776762Z return mod(**inputs) 2025-09-07T08:00:55.5777006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5777063Z outputs = self.bert( 2025-09-07T08:00:55.5777306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5777402Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5777648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5777708Z layer_outputs = layer_module( 2025-09-07T08:00:55.5777921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5777989Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5778228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5778363Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5778600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5778660Z return func(*args, **kwargs) 2025-09-07T08:00:55.5778909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5779029Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5779273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5779348Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5779351Z 2025-09-07T08:00:55.5779446Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5779631Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5779688Z return mod(**inputs) 2025-09-07T08:00:55.5779934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5779990Z outputs = self.bert( 2025-09-07T08:00:55.5780239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5780299Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5780537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5780603Z layer_outputs = layer_module( 2025-09-07T08:00:55.5780814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5780881Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5781120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5781192Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5781457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5781525Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5781803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5781916Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5782160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5782267Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5782270Z 2025-09-07T08:00:55.5782359Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5782545Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5782604Z return mod(**inputs) 2025-09-07T08:00:55.5782850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5782938Z outputs = self.bert( 2025-09-07T08:00:55.5783181Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5783249Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5783487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5783554Z layer_outputs = layer_module( 2025-09-07T08:00:55.5783765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5783831Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5784072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5784201Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5784483Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5784549Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5784830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5784932Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5785175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5785282Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5785490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5785553Z return self.act(input) 2025-09-07T08:00:55.5785557Z 2025-09-07T08:00:55.5785716Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5785914Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5785971Z return mod(**inputs) 2025-09-07T08:00:55.5786216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5786276Z outputs = self.bert( 2025-09-07T08:00:55.5786516Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5786581Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5786818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5786879Z layer_outputs = layer_module( 2025-09-07T08:00:55.5787098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5787164Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5787406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5787478Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5787732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5787801Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5788113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5788240Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5788481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5788559Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5788562Z 2025-09-07T08:00:55.5788653Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5788840Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5788941Z return mod(**inputs) 2025-09-07T08:00:55.5789185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5789245Z outputs = self.bert( 2025-09-07T08:00:55.5789486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5789551Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5789792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5789854Z layer_outputs = layer_module( 2025-09-07T08:00:55.5790129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5790195Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5790434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5790512Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5790750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5790820Z return func(*args, **kwargs) 2025-09-07T08:00:55.5791059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5791124Z self_outputs = self.self( 2025-09-07T08:00:55.5791357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5791418Z return func(*args, **kwargs) 2025-09-07T08:00:55.5791665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5791864Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5791870Z 2025-09-07T08:00:55.5791966Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5792151Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5792206Z return mod(**inputs) 2025-09-07T08:00:55.5792453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5792509Z outputs = self.bert( 2025-09-07T08:00:55.5792751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5792811Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5793055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5793116Z layer_outputs = layer_module( 2025-09-07T08:00:55.5793329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5793398Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5793637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5793765Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5793998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5794057Z return func(*args, **kwargs) 2025-09-07T08:00:55.5794300Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5794363Z self_outputs = self.self( 2025-09-07T08:00:55.5794598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5794693Z return func(*args, **kwargs) 2025-09-07T08:00:55.5794932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5794997Z self.key(current_states) 2025-09-07T08:00:55.5795001Z 2025-09-07T08:00:55.5795088Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5795277Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5795331Z return mod(**inputs) 2025-09-07T08:00:55.5795577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5795632Z outputs = self.bert( 2025-09-07T08:00:55.5795934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5796002Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5796241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5796309Z layer_outputs = layer_module( 2025-09-07T08:00:55.5796520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5796583Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5796827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5796896Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5797132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5797191Z return func(*args, **kwargs) 2025-09-07T08:00:55.5797431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5797498Z self_outputs = self.self( 2025-09-07T08:00:55.5797732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5797794Z return func(*args, **kwargs) 2025-09-07T08:00:55.5798029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5798098Z self.value(current_states) 2025-09-07T08:00:55.5798102Z 2025-09-07T08:00:55.5798176Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5798263Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5798455Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5798511Z return mod(**inputs) 2025-09-07T08:00:55.5798762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5798817Z outputs = self.bert( 2025-09-07T08:00:55.5799058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5799126Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5799361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5799465Z layer_outputs = layer_module( 2025-09-07T08:00:55.5799678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5799743Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5799993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5800070Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5800315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5800408Z return func(*args, **kwargs) 2025-09-07T08:00:55.5800650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5800720Z self_outputs = self.self( 2025-09-07T08:00:55.5800954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5801023Z return func(*args, **kwargs) 2025-09-07T08:00:55.5801258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5801388Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5801391Z 2025-09-07T08:00:55.5801545Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5801734Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5801803Z return mod(**inputs) 2025-09-07T08:00:55.5802050Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5802112Z outputs = self.bert( 2025-09-07T08:00:55.5802355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5802422Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5802666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5802727Z layer_outputs = layer_module( 2025-09-07T08:00:55.5802939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5803005Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5803248Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5803323Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5803557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5803621Z return func(*args, **kwargs) 2025-09-07T08:00:55.5803859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5803983Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5804219Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5804291Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5804295Z 2025-09-07T08:00:55.5804396Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5804582Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5804648Z return mod(**inputs) 2025-09-07T08:00:55.5804892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5804951Z outputs = self.bert( 2025-09-07T08:00:55.5805195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5805294Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5805540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5805598Z layer_outputs = layer_module( 2025-09-07T08:00:55.5805816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5805887Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5806127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5806351Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5806611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5806686Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5806960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5807070Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5807315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5807387Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5807390Z 2025-09-07T08:00:55.5807545Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5807734Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5807797Z return mod(**inputs) 2025-09-07T08:00:55.5808043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5808101Z outputs = self.bert( 2025-09-07T08:00:55.5808348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5808412Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5808652Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5808712Z layer_outputs = layer_module( 2025-09-07T08:00:55.5808926Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5808996Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5809233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5817792Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5818138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5818215Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5818526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5818651Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5818912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5819026Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5819239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5819305Z return self.act(input) 2025-09-07T08:00:55.5819318Z 2025-09-07T08:00:55.5819426Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5819632Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5819698Z return mod(**inputs) 2025-09-07T08:00:55.5819965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5820147Z outputs = self.bert( 2025-09-07T08:00:55.5820412Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5820485Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5820753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5820819Z layer_outputs = layer_module( 2025-09-07T08:00:55.5821044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5821180Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5821432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5821518Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5821781Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5821858Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5822136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5822373Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5822621Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5822702Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5822706Z 2025-09-07T08:00:55.5822811Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5823014Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5823076Z return mod(**inputs) 2025-09-07T08:00:55.5823341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5823398Z outputs = self.bert( 2025-09-07T08:00:55.5823649Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5823716Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5823965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5824028Z layer_outputs = layer_module( 2025-09-07T08:00:55.5824248Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5824328Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5824567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5824647Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5824891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5824959Z return func(*args, **kwargs) 2025-09-07T08:00:55.5825199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5825264Z self_outputs = self.self( 2025-09-07T08:00:55.5825499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5825557Z return func(*args, **kwargs) 2025-09-07T08:00:55.5825875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 374, in forward 2025-09-07T08:00:55.5826084Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:00:55.5826088Z 2025-09-07T08:00:55.5826229Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5826431Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5826489Z return mod(**inputs) 2025-09-07T08:00:55.5826737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5826792Z outputs = self.bert( 2025-09-07T08:00:55.5827042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5827106Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5827384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5827454Z layer_outputs = layer_module( 2025-09-07T08:00:55.5827669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5827742Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5827980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5828047Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5828342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5828405Z return func(*args, **kwargs) 2025-09-07T08:00:55.5828652Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5828715Z self_outputs = self.self( 2025-09-07T08:00:55.5828966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5829031Z return func(*args, **kwargs) 2025-09-07T08:00:55.5829274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 402, in forward 2025-09-07T08:00:55.5829342Z self.key(current_states) 2025-09-07T08:00:55.5829345Z 2025-09-07T08:00:55.5829441Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5829641Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5829697Z return mod(**inputs) 2025-09-07T08:00:55.5829948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5830008Z outputs = self.bert( 2025-09-07T08:00:55.5830253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5830323Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5830565Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5830630Z layer_outputs = layer_module( 2025-09-07T08:00:55.5830853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5830924Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5831166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5831238Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5831477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5831543Z return func(*args, **kwargs) 2025-09-07T08:00:55.5831782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5831848Z self_outputs = self.self( 2025-09-07T08:00:55.5832080Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5832190Z return func(*args, **kwargs) 2025-09-07T08:00:55.5832431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 407, in forward 2025-09-07T08:00:55.5832498Z self.value(current_states) 2025-09-07T08:00:55.5832502Z 2025-09-07T08:00:55.5832585Z cudagraph partition due to non gpu ops 2025-09-07T08:00:55.5832684Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5832881Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5832977Z return mod(**inputs) 2025-09-07T08:00:55.5833224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5833287Z outputs = self.bert( 2025-09-07T08:00:55.5833528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5833600Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5833839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5833901Z layer_outputs = layer_module( 2025-09-07T08:00:55.5834117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5834248Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5834494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5834568Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5834802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5834866Z return func(*args, **kwargs) 2025-09-07T08:00:55.5835105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 514, in forward 2025-09-07T08:00:55.5835170Z self_outputs = self.self( 2025-09-07T08:00:55.5835404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5835466Z return func(*args, **kwargs) 2025-09-07T08:00:55.5835707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 438, in forward 2025-09-07T08:00:55.5835830Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:00:55.5835834Z 2025-09-07T08:00:55.5835932Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5836116Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5836176Z return mod(**inputs) 2025-09-07T08:00:55.5836419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5836478Z outputs = self.bert( 2025-09-07T08:00:55.5836721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5836785Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5837026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5837088Z layer_outputs = layer_module( 2025-09-07T08:00:55.5837297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5837367Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5837603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 584, in forward 2025-09-07T08:00:55.5837673Z self_attention_outputs = self.attention( 2025-09-07T08:00:55.5837905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:00:55.5838007Z return func(*args, **kwargs) 2025-09-07T08:00:55.5838247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 524, in forward 2025-09-07T08:00:55.5838368Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:00:55.5838613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 461, in forward 2025-09-07T08:00:55.5838693Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5838730Z 2025-09-07T08:00:55.5838827Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5839016Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5839074Z return mod(**inputs) 2025-09-07T08:00:55.5839320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5839381Z outputs = self.bert( 2025-09-07T08:00:55.5839625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5839689Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5839989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5840054Z layer_outputs = layer_module( 2025-09-07T08:00:55.5840268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5840339Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5840572Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5840647Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5840909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5840981Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5841263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5841376Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5841626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 539, in forward 2025-09-07T08:00:55.5841700Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5841705Z 2025-09-07T08:00:55.5841798Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5841987Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5842045Z return mod(**inputs) 2025-09-07T08:00:55.5842287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5842348Z outputs = self.bert( 2025-09-07T08:00:55.5842593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5842658Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5842903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5842972Z layer_outputs = layer_module( 2025-09-07T08:00:55.5843185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5843258Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5843498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5843567Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5843867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5843933Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5844209Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 622, in feed_forward_chunk 2025-09-07T08:00:55.5844317Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:00:55.5844559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 540, in forward 2025-09-07T08:00:55.5844704Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:00:55.5844916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:00:55.5844982Z return self.act(input) 2025-09-07T08:00:55.5844986Z 2025-09-07T08:00:55.5845082Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5845281Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5845340Z return mod(**inputs) 2025-09-07T08:00:55.5845588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1767, in forward 2025-09-07T08:00:55.5845650Z outputs = self.bert( 2025-09-07T08:00:55.5845971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1028, in forward 2025-09-07T08:00:55.5846042Z encoder_outputs = self.encoder( 2025-09-07T08:00:55.5846287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 675, in forward 2025-09-07T08:00:55.5846354Z layer_outputs = layer_module( 2025-09-07T08:00:55.5846578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:00:55.5846653Z return super().__call__(*args, **kwargs) 2025-09-07T08:00:55.5846912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 614, in forward 2025-09-07T08:00:55.5846987Z layer_output = apply_chunking_to_forward( 2025-09-07T08:00:55.5847242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:00:55.5847314Z return forward_fn(*input_tensors) 2025-09-07T08:00:55.5847588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 623, in feed_forward_chunk 2025-09-07T08:00:55.5847718Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:00:55.5847958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 552, in forward 2025-09-07T08:00:55.5848034Z hidden_states = self.dense(hidden_states) 2025-09-07T08:00:55.5848038Z 2025-09-07T08:00:55.5848135Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5848318Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5848377Z return mod(**inputs) 2025-09-07T08:00:55.5848623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1781, in forward 2025-09-07T08:00:55.5848706Z logits = self.qa_outputs(sequence_output) 2025-09-07T08:00:55.5848710Z 2025-09-07T08:00:55.5848802Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5848992Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5849048Z return mod(**inputs) 2025-09-07T08:00:55.5849287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1799, in forward 2025-09-07T08:00:55.5849387Z start_loss = loss_fct(start_logits, start_positions) 2025-09-07T08:00:55.5849427Z 2025-09-07T08:00:55.5849519Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:00:55.5849707Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:00:55.5849763Z return mod(**inputs) 2025-09-07T08:00:55.5850007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/bert/modeling_bert.py", line 1800, in forward 2025-09-07T08:00:55.5850097Z end_loss = loss_fct(end_logits, end_positions) 2025-09-07T08:00:55.5850100Z 2025-09-07T08:01:01.2866910Z pass 2025-09-07T08:01:01.2867310Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:01:04.1618571Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:01:04.1619446Z import pynvml # type: ignore[import] 2025-09-07T08:01:06.8414413Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:01:06.8415791Z from pkg_resources import resource_filename 2025-09-07T08:01:07.5644840Z 2025-09-07T08:01:32.1701642Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:01:32.1702173Z loading model: 0it [00:24, ?it/s] 2025-09-07T08:01:32.3144485Z cpu eval BlenderbotForCausalLM 2025-09-07T08:01:32.8024469Z pass_due_to_skip 2025-09-07T08:01:32.8026732Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:01:35.8981130Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:01:35.8982116Z import pynvml # type: ignore[import] 2025-09-07T08:01:38.5661689Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:01:38.5662615Z from pkg_resources import resource_filename 2025-09-07T08:01:39.1786014Z 2025-09-07T08:01:40.1034887Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:01:40.1036187Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:01:40.1197536Z cpu eval BlenderbotSmallForCausalLM 2025-09-07T08:01:40.3175141Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:01:40.3867966Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:01:40.4549659Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:01:47.2422076Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2422380Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2422619Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2422820Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2423013Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2423244Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2423452Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2423644Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2423879Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2424258Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2424952Z return mod(**inputs) 2025-09-07T08:01:47.2425415Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2425932Z outputs = self.model.decoder( 2025-09-07T08:01:47.2426372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2426835Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2427194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2427657Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2428103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2428597Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2429109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:01:47.2429649Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:01:47.2429861Z 2025-09-07T08:01:47.2429966Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2430472Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2430799Z return mod(**inputs) 2025-09-07T08:01:47.2431239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2431698Z outputs = self.model.decoder( 2025-09-07T08:01:47.2432164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2432598Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2432954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2433314Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2433773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2434244Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2434706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:01:47.2435147Z key_states = self.k_proj(current_states) 2025-09-07T08:01:47.2435287Z 2025-09-07T08:01:47.2435388Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2435743Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2436064Z return mod(**inputs) 2025-09-07T08:01:47.2436485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2436928Z outputs = self.model.decoder( 2025-09-07T08:01:47.2437365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2437804Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2438151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2438509Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2438952Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2439417Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2439873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:01:47.2440369Z value_states = self.v_proj(current_states) 2025-09-07T08:01:47.2440502Z 2025-09-07T08:01:47.2440585Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2440794Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2440988Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2441298Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2441519Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2441871Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2442242Z return mod(**inputs) 2025-09-07T08:01:47.2442657Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2443104Z outputs = self.model.decoder( 2025-09-07T08:01:47.2443536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2443971Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2444311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2444665Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2445180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2445636Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2446094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2446554Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2447006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:01:47.2447490Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:01:47.2447670Z 2025-09-07T08:01:47.2447772Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2448118Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2448443Z return mod(**inputs) 2025-09-07T08:01:47.2448853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2449301Z outputs = self.model.decoder( 2025-09-07T08:01:47.2449716Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2450156Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2450502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2450863Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2451301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2451756Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2452212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2452668Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2453109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:01:47.2453565Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:01:47.2453721Z 2025-09-07T08:01:47.2453818Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2454213Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2454532Z return mod(**inputs) 2025-09-07T08:01:47.2454976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2455416Z outputs = self.model.decoder( 2025-09-07T08:01:47.2455845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2456321Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2456662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2457020Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2457449Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2457906Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2458354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:01:47.2458791Z attn_output = self.out_proj(attn_output) 2025-09-07T08:01:47.2458917Z 2025-09-07T08:01:47.2459090Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2459429Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2459750Z return mod(**inputs) 2025-09-07T08:01:47.2460158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2460595Z outputs = self.model.decoder( 2025-09-07T08:01:47.2461014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2461447Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2461784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2462136Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2462569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2463039Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2463218Z 2025-09-07T08:01:47.2463311Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2463651Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2463965Z return mod(**inputs) 2025-09-07T08:01:47.2464365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2464792Z outputs = self.model.decoder( 2025-09-07T08:01:47.2465207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2465692Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2466024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2466369Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2466790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2467255Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2467633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:01:47.2468016Z return self.act(input) 2025-09-07T08:01:47.2468121Z 2025-09-07T08:01:47.2468220Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2468558Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2468869Z return mod(**inputs) 2025-09-07T08:01:47.2469277Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2469708Z outputs = self.model.decoder( 2025-09-07T08:01:47.2470118Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2471632Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2471966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2472314Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2472748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:01:47.2473187Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:01:47.2473325Z 2025-09-07T08:01:47.2473418Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2473853Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2474174Z return mod(**inputs) 2025-09-07T08:01:47.2474573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2475005Z outputs = self.model.decoder( 2025-09-07T08:01:47.2475429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2475869Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2476207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2476552Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2476988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2477448Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2477903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:01:47.2478420Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:01:47.2478641Z 2025-09-07T08:01:47.2478753Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2479104Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2479428Z return mod(**inputs) 2025-09-07T08:01:47.2479855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2480305Z outputs = self.model.decoder( 2025-09-07T08:01:47.2480731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2481167Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2481513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2481872Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2482311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2482764Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2483263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:01:47.2483705Z key_states = self.k_proj(current_states) 2025-09-07T08:01:47.2483832Z 2025-09-07T08:01:47.2483937Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2484292Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2484606Z return mod(**inputs) 2025-09-07T08:01:47.2485029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2485515Z outputs = self.model.decoder( 2025-09-07T08:01:47.2485950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2486382Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2486736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2487094Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2487543Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2488072Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2488526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:01:47.2488981Z value_states = self.v_proj(current_states) 2025-09-07T08:01:47.2489126Z 2025-09-07T08:01:47.2489205Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2489406Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2489606Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2489791Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2490016Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2490376Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2490699Z return mod(**inputs) 2025-09-07T08:01:47.2491105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2491549Z outputs = self.model.decoder( 2025-09-07T08:01:47.2491982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2492421Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2492762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2493110Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2493548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2494005Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2494458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2494922Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2495365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:01:47.2495849Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:01:47.2496034Z 2025-09-07T08:01:47.2496130Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2496476Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2496791Z return mod(**inputs) 2025-09-07T08:01:47.2497254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2497697Z outputs = self.model.decoder( 2025-09-07T08:01:47.2498122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2498574Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2498906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2499296Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2499734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2500198Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2500654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2501109Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2501549Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:01:47.2502063Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:01:47.2502223Z 2025-09-07T08:01:47.2502331Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2502677Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2502991Z return mod(**inputs) 2025-09-07T08:01:47.2503407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2503845Z outputs = self.model.decoder( 2025-09-07T08:01:47.2504274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2504707Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2505044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2505400Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2505901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2506374Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2506826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:01:47.2507267Z attn_output = self.out_proj(attn_output) 2025-09-07T08:01:47.2507404Z 2025-09-07T08:01:47.2507500Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2507853Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2508172Z return mod(**inputs) 2025-09-07T08:01:47.2508601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2509046Z outputs = self.model.decoder( 2025-09-07T08:01:47.2509473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2510139Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2510492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2510849Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2511291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2511864Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2512038Z 2025-09-07T08:01:47.2512147Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2512497Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2512820Z return mod(**inputs) 2025-09-07T08:01:47.2513232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2513739Z outputs = self.model.decoder( 2025-09-07T08:01:47.2514167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2514597Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2514948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2515308Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2515750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2516229Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2516703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:01:47.2517045Z return self.act(input) 2025-09-07T08:01:47.2517161Z 2025-09-07T08:01:47.2517262Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2517616Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2517935Z return mod(**inputs) 2025-09-07T08:01:47.2518337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2518774Z outputs = self.model.decoder( 2025-09-07T08:01:47.2519193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2519628Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2519961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2520313Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2520749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:01:47.2521194Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:01:47.2521324Z 2025-09-07T08:01:47.2521426Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2521762Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2522079Z return mod(**inputs) 2025-09-07T08:01:47.2522480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2522910Z outputs = self.model.decoder( 2025-09-07T08:01:47.2523335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2523761Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2524088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2524438Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2524870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2525327Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2525816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:01:47.2526341Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:01:47.2526544Z 2025-09-07T08:01:47.2526639Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2526991Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2527307Z return mod(**inputs) 2025-09-07T08:01:47.2527710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2528236Z outputs = self.model.decoder( 2025-09-07T08:01:47.2528661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2529099Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2529424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2529773Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2530273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2530741Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2531196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:01:47.2531633Z key_states = self.k_proj(current_states) 2025-09-07T08:01:47.2531772Z 2025-09-07T08:01:47.2531870Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2532221Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2532544Z return mod(**inputs) 2025-09-07T08:01:47.2532957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2533390Z outputs = self.model.decoder( 2025-09-07T08:01:47.2533825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2534261Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2534602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2534966Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2535403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2535864Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2536327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:01:47.2536789Z value_states = self.v_proj(current_states) 2025-09-07T08:01:47.2536925Z 2025-09-07T08:01:47.2537001Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2537204Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2537401Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2537594Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2537816Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2538170Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2538500Z return mod(**inputs) 2025-09-07T08:01:47.2538924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2539416Z outputs = self.model.decoder( 2025-09-07T08:01:47.2539855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2540295Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2540638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2541001Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2541440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2541936Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2542385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2542845Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2543295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:01:47.2543774Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:01:47.2543955Z 2025-09-07T08:01:47.2544054Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2544471Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2544800Z return mod(**inputs) 2025-09-07T08:01:47.2545217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2545731Z outputs = self.model.decoder( 2025-09-07T08:01:47.2546150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2546581Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2546928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2547280Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2547705Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2548163Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2548613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2549069Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2549501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:01:47.2549945Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:01:47.2550112Z 2025-09-07T08:01:47.2550207Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2550551Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2550878Z return mod(**inputs) 2025-09-07T08:01:47.2551291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2551723Z outputs = self.model.decoder( 2025-09-07T08:01:47.2552147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2552576Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2552909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2553256Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2553677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2554181Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2554639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:01:47.2555085Z attn_output = self.out_proj(attn_output) 2025-09-07T08:01:47.2555216Z 2025-09-07T08:01:47.2555322Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2555671Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2556030Z return mod(**inputs) 2025-09-07T08:01:47.2556443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2556885Z outputs = self.model.decoder( 2025-09-07T08:01:47.2557306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2557745Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2558088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2558445Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2558943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2559422Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2559598Z 2025-09-07T08:01:47.2559693Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2560042Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2560358Z return mod(**inputs) 2025-09-07T08:01:47.2560762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2561191Z outputs = self.model.decoder( 2025-09-07T08:01:47.2561614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2562044Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2562383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2562729Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2563166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2563636Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2564009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:01:47.2564347Z return self.act(input) 2025-09-07T08:01:47.2564452Z 2025-09-07T08:01:47.2564547Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2564891Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2565202Z return mod(**inputs) 2025-09-07T08:01:47.2565613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2566049Z outputs = self.model.decoder( 2025-09-07T08:01:47.2566466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2566896Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2567234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2567628Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2568053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:01:47.2568495Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:01:47.2568632Z 2025-09-07T08:01:47.2568727Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2569074Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2569392Z return mod(**inputs) 2025-09-07T08:01:47.2569826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2570260Z outputs = self.model.decoder( 2025-09-07T08:01:47.2570679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2571112Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2571442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2571784Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2572275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2572732Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2573183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:01:47.2573692Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:01:47.2573895Z 2025-09-07T08:01:47.2573988Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2574338Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2574652Z return mod(**inputs) 2025-09-07T08:01:47.2575053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2575483Z outputs = self.model.decoder( 2025-09-07T08:01:47.2575897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2576324Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2576656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2577003Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2577424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2577874Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2578320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:01:47.2578757Z key_states = self.k_proj(current_states) 2025-09-07T08:01:47.2578881Z 2025-09-07T08:01:47.2578978Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2579314Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2579627Z return mod(**inputs) 2025-09-07T08:01:47.2580028Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2580465Z outputs = self.model.decoder( 2025-09-07T08:01:47.2580883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2581382Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2581711Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2582059Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2582486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2582940Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2583377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:01:47.2583859Z value_states = self.v_proj(current_states) 2025-09-07T08:01:47.2583996Z 2025-09-07T08:01:47.2584074Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2584277Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2584463Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2584664Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2584875Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2585216Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2585532Z return mod(**inputs) 2025-09-07T08:01:47.2586054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2586494Z outputs = self.model.decoder( 2025-09-07T08:01:47.2586927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2587368Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2587703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2588057Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2588500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2588962Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2589411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2589864Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2590306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:01:47.2590799Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:01:47.2590982Z 2025-09-07T08:01:47.2591093Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2591445Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2591761Z return mod(**inputs) 2025-09-07T08:01:47.2592170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2592609Z outputs = self.model.decoder( 2025-09-07T08:01:47.2593035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2593467Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2593795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2594149Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2594582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2595038Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2595541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2595997Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2596433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:01:47.2596891Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:01:47.2597047Z 2025-09-07T08:01:47.2597149Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2597530Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2597845Z return mod(**inputs) 2025-09-07T08:01:47.2598252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2598690Z outputs = self.model.decoder( 2025-09-07T08:01:47.2599116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2599540Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2599878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2600301Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2600738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2601191Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2601633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:01:47.2602069Z attn_output = self.out_proj(attn_output) 2025-09-07T08:01:47.2602202Z 2025-09-07T08:01:47.2602296Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2602639Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2602952Z return mod(**inputs) 2025-09-07T08:01:47.2603347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2603783Z outputs = self.model.decoder( 2025-09-07T08:01:47.2604203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2604637Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2604964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2605309Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2605737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2606220Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2606390Z 2025-09-07T08:01:47.2606488Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2606821Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2607140Z return mod(**inputs) 2025-09-07T08:01:47.2607537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2607971Z outputs = self.model.decoder( 2025-09-07T08:01:47.2608393Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2608815Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2609148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2609549Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2610137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2610605Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2610974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:01:47.2611312Z return self.act(input) 2025-09-07T08:01:47.2611488Z 2025-09-07T08:01:47.2611588Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2611934Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2612241Z return mod(**inputs) 2025-09-07T08:01:47.2612641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2613078Z outputs = self.model.decoder( 2025-09-07T08:01:47.2613492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2613920Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2614411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2614772Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2615204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:01:47.2615648Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:01:47.2615777Z 2025-09-07T08:01:47.2615879Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2616213Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2616530Z return mod(**inputs) 2025-09-07T08:01:47.2616927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2617355Z outputs = self.model.decoder( 2025-09-07T08:01:47.2617774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2618209Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2618535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2618890Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2619315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2619766Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2620218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:01:47.2620727Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:01:47.2620929Z 2025-09-07T08:01:47.2621033Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2621370Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2621679Z return mod(**inputs) 2025-09-07T08:01:47.2622088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2622517Z outputs = self.model.decoder( 2025-09-07T08:01:47.2622934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2623451Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2623778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2624130Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2624565Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2625026Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2625476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:01:47.2626016Z key_states = self.k_proj(current_states) 2025-09-07T08:01:47.2626157Z 2025-09-07T08:01:47.2626254Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2626604Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2626923Z return mod(**inputs) 2025-09-07T08:01:47.2627327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2627767Z outputs = self.model.decoder( 2025-09-07T08:01:47.2628270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2628723Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2629059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2629409Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2629846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2630303Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2630758Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:01:47.2631200Z value_states = self.v_proj(current_states) 2025-09-07T08:01:47.2631334Z 2025-09-07T08:01:47.2631408Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2631614Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2631805Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2631995Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2632202Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2632552Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2632868Z return mod(**inputs) 2025-09-07T08:01:47.2643887Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2644444Z outputs = self.model.decoder( 2025-09-07T08:01:47.2644914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2645370Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2645733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2646101Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2646553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2647024Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2647522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2648014Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2648550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:01:47.2649034Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:01:47.2649215Z 2025-09-07T08:01:47.2649331Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2649703Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2650036Z return mod(**inputs) 2025-09-07T08:01:47.2650471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2650968Z outputs = self.model.decoder( 2025-09-07T08:01:47.2651403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2651835Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2652184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2652544Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2652985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2653521Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2653980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2654439Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2654885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:01:47.2655340Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:01:47.2655499Z 2025-09-07T08:01:47.2655606Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2655956Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2656283Z return mod(**inputs) 2025-09-07T08:01:47.2656702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2657147Z outputs = self.model.decoder( 2025-09-07T08:01:47.2657570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2658008Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2658353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2658712Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2659151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2659603Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2660059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:01:47.2660500Z attn_output = self.out_proj(attn_output) 2025-09-07T08:01:47.2660627Z 2025-09-07T08:01:47.2660735Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2661098Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2661416Z return mod(**inputs) 2025-09-07T08:01:47.2661829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2662268Z outputs = self.model.decoder( 2025-09-07T08:01:47.2662933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2663373Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2663705Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2664065Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2664499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2665015Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2665183Z 2025-09-07T08:01:47.2665280Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2665688Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2666007Z return mod(**inputs) 2025-09-07T08:01:47.2666416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2666850Z outputs = self.model.decoder( 2025-09-07T08:01:47.2667264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2667773Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2668109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2668576Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2669010Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2669473Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2669844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:01:47.2670181Z return self.act(input) 2025-09-07T08:01:47.2670287Z 2025-09-07T08:01:47.2670388Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2670727Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2671037Z return mod(**inputs) 2025-09-07T08:01:47.2671441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2671878Z outputs = self.model.decoder( 2025-09-07T08:01:47.2672298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2672723Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2673059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2673409Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2673837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:01:47.2674278Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:01:47.2674408Z 2025-09-07T08:01:47.2674504Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2674841Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2675153Z return mod(**inputs) 2025-09-07T08:01:47.2675554Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2675985Z outputs = self.model.decoder( 2025-09-07T08:01:47.2676394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2676879Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2677222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2677575Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2678007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2678469Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2678925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:01:47.2679472Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:01:47.2679681Z 2025-09-07T08:01:47.2679785Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2680130Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2680442Z return mod(**inputs) 2025-09-07T08:01:47.2680843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2681277Z outputs = self.model.decoder( 2025-09-07T08:01:47.2681759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2682185Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2682521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2682871Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2683304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2683764Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2684206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:01:47.2684639Z key_states = self.k_proj(current_states) 2025-09-07T08:01:47.2684771Z 2025-09-07T08:01:47.2684863Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2685213Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2685529Z return mod(**inputs) 2025-09-07T08:01:47.2685929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2686359Z outputs = self.model.decoder( 2025-09-07T08:01:47.2686777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2687215Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2687540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2687891Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2688320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2688770Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2689216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:01:47.2689654Z value_states = self.v_proj(current_states) 2025-09-07T08:01:47.2689795Z 2025-09-07T08:01:47.2689872Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2690073Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2690270Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2690499Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2690716Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2691055Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2691372Z return mod(**inputs) 2025-09-07T08:01:47.2691791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2692224Z outputs = self.model.decoder( 2025-09-07T08:01:47.2692652Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2693121Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2693453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2693800Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2694222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2694673Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2695204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2695664Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2696099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:01:47.2696571Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:01:47.2696757Z 2025-09-07T08:01:47.2696852Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2697195Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2697508Z return mod(**inputs) 2025-09-07T08:01:47.2697903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2698336Z outputs = self.model.decoder( 2025-09-07T08:01:47.2698759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2699193Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2699522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2699865Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2700293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2700742Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2701188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2701637Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2702066Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:01:47.2702517Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:01:47.2702679Z 2025-09-07T08:01:47.2702770Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2703112Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2703428Z return mod(**inputs) 2025-09-07T08:01:47.2703822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2704302Z outputs = self.model.decoder( 2025-09-07T08:01:47.2704719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2705154Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2705480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2705889Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2706327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2706829Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2707288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:01:47.2707727Z attn_output = self.out_proj(attn_output) 2025-09-07T08:01:47.2707869Z 2025-09-07T08:01:47.2707968Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2708317Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2708641Z return mod(**inputs) 2025-09-07T08:01:47.2709119Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2709553Z outputs = self.model.decoder( 2025-09-07T08:01:47.2710131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2710565Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2710908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2711256Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2711687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2712155Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2712322Z 2025-09-07T08:01:47.2712415Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2712759Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2713070Z return mod(**inputs) 2025-09-07T08:01:47.2713467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2713899Z outputs = self.model.decoder( 2025-09-07T08:01:47.2714313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2714737Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2715065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2715403Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2715830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2716290Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2716657Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:01:47.2716981Z return self.act(input) 2025-09-07T08:01:47.2717084Z 2025-09-07T08:01:47.2717175Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2717511Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2717815Z return mod(**inputs) 2025-09-07T08:01:47.2718213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2718726Z outputs = self.model.decoder( 2025-09-07T08:01:47.2719135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2719570Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2719983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2720327Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2720800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:01:47.2721234Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:01:47.2721364Z 2025-09-07T08:01:47.2721454Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2721801Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2722114Z return mod(**inputs) 2025-09-07T08:01:47.2722508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2722944Z outputs = self.model.decoder( 2025-09-07T08:01:47.2723460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2723902Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2724236Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2724577Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2725004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2725461Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2725916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:01:47.2726425Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:01:47.2726630Z 2025-09-07T08:01:47.2726787Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2727131Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2727451Z return mod(**inputs) 2025-09-07T08:01:47.2727855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2728290Z outputs = self.model.decoder( 2025-09-07T08:01:47.2728705Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2729136Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2729468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2729815Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2730241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2730697Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2731152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:01:47.2731587Z key_states = self.k_proj(current_states) 2025-09-07T08:01:47.2731713Z 2025-09-07T08:01:47.2731811Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2732152Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2732519Z return mod(**inputs) 2025-09-07T08:01:47.2732922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2733352Z outputs = self.model.decoder( 2025-09-07T08:01:47.2733773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2734197Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2734567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2734912Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2735340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2735794Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2736234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:01:47.2736677Z value_states = self.v_proj(current_states) 2025-09-07T08:01:47.2736816Z 2025-09-07T08:01:47.2736892Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2737158Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2737349Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2737540Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2737757Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2738101Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2738415Z return mod(**inputs) 2025-09-07T08:01:47.2738809Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2739251Z outputs = self.model.decoder( 2025-09-07T08:01:47.2739669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2740098Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2740425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2740779Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2741207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2741663Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2742114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2742569Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2743009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:01:47.2743485Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:01:47.2743664Z 2025-09-07T08:01:47.2743762Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2744106Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2744413Z return mod(**inputs) 2025-09-07T08:01:47.2744826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2745257Z outputs = self.model.decoder( 2025-09-07T08:01:47.2745736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2746207Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2746535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2746890Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2747327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2747778Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2748218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2748733Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2749178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:01:47.2749625Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:01:47.2749784Z 2025-09-07T08:01:47.2749889Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2750233Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2750566Z return mod(**inputs) 2025-09-07T08:01:47.2751042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2751488Z outputs = self.model.decoder( 2025-09-07T08:01:47.2751914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2752345Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2752685Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2753040Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2753480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2753935Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2754387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:01:47.2754825Z attn_output = self.out_proj(attn_output) 2025-09-07T08:01:47.2754961Z 2025-09-07T08:01:47.2755056Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2755402Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2755717Z return mod(**inputs) 2025-09-07T08:01:47.2756116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2756550Z outputs = self.model.decoder( 2025-09-07T08:01:47.2756968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2757400Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2757723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2758075Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2758504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2758998Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2759166Z 2025-09-07T08:01:47.2759270Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2759608Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2759968Z return mod(**inputs) 2025-09-07T08:01:47.2760377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2760818Z outputs = self.model.decoder( 2025-09-07T08:01:47.2761244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2761672Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2762005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2762391Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2762822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2763295Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2763666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:01:47.2764006Z return self.act(input) 2025-09-07T08:01:47.2764116Z 2025-09-07T08:01:47.2764212Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2764554Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2764924Z return mod(**inputs) 2025-09-07T08:01:47.2765332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2765765Z outputs = self.model.decoder( 2025-09-07T08:01:47.2766185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2766622Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2766945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2767302Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2767733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:01:47.2768174Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:01:47.2768303Z 2025-09-07T08:01:47.2768412Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2768744Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2769059Z return mod(**inputs) 2025-09-07T08:01:47.2769459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2769889Z outputs = self.model.decoder( 2025-09-07T08:01:47.2770296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2770727Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2771056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2771407Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2771840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2772288Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2772738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:01:47.2773249Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:01:47.2773450Z 2025-09-07T08:01:47.2773549Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2773948Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2774257Z return mod(**inputs) 2025-09-07T08:01:47.2774659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2775093Z outputs = self.model.decoder( 2025-09-07T08:01:47.2775515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2775946Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2776303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2776650Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2777075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2777532Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2777977Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:01:47.2778407Z key_states = self.k_proj(current_states) 2025-09-07T08:01:47.2778538Z 2025-09-07T08:01:47.2778692Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2779033Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2779354Z return mod(**inputs) 2025-09-07T08:01:47.2779749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2780184Z outputs = self.model.decoder( 2025-09-07T08:01:47.2780598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2781029Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2781354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2781691Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2782120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2782564Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2783006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:01:47.2783444Z value_states = self.v_proj(current_states) 2025-09-07T08:01:47.2783576Z 2025-09-07T08:01:47.2783651Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2783843Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2784032Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2784218Z cudagraph partition due to non gpu ops 2025-09-07T08:01:47.2784424Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2784760Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2785067Z return mod(**inputs) 2025-09-07T08:01:47.2785467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2785977Z outputs = self.model.decoder( 2025-09-07T08:01:47.2786402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2786827Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2787150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2787541Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2787961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2788406Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2788852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2789299Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2789731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:01:47.2790241Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:01:47.2790422Z 2025-09-07T08:01:47.2790512Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2790844Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2791153Z return mod(**inputs) 2025-09-07T08:01:47.2791549Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2791977Z outputs = self.model.decoder( 2025-09-07T08:01:47.2792448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2792874Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2793203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2793547Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2793962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2794410Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2794843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:01:47.2795284Z attn_output, attn_weights = attention_interface( 2025-09-07T08:01:47.2795710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:01:47.2796148Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:01:47.2796302Z 2025-09-07T08:01:47.2796396Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2796728Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2797033Z return mod(**inputs) 2025-09-07T08:01:47.2797423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2797848Z outputs = self.model.decoder( 2025-09-07T08:01:47.2798257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2798680Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2799004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2799343Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2799765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:01:47.2800216Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:01:47.2800661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:01:47.2801157Z attn_output = self.out_proj(attn_output) 2025-09-07T08:01:47.2801281Z 2025-09-07T08:01:47.2801370Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2801703Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2802010Z return mod(**inputs) 2025-09-07T08:01:47.2802410Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2802836Z outputs = self.model.decoder( 2025-09-07T08:01:47.2803247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2803712Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2804034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2804379Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2804800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2805272Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2805441Z 2025-09-07T08:01:47.2805533Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2805929Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2806240Z return mod(**inputs) 2025-09-07T08:01:47.2806630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2807060Z outputs = self.model.decoder( 2025-09-07T08:01:47.2807471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2807897Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2808222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2808556Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2808982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:01:47.2809460Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:01:47.2809968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:01:47.2810298Z return self.act(input) 2025-09-07T08:01:47.2810402Z 2025-09-07T08:01:47.2810499Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2810843Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2811158Z return mod(**inputs) 2025-09-07T08:01:47.2811567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1512, in forward 2025-09-07T08:01:47.2811992Z outputs = self.model.decoder( 2025-09-07T08:01:47.2812408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:01:47.2812838Z layer_outputs = decoder_layer( 2025-09-07T08:01:47.2813178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:01:47.2813531Z return super().__call__(*args, **kwargs) 2025-09-07T08:01:47.2813958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:01:47.2814397Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:01:47.2814528Z 2025-09-07T08:01:47.2814622Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2815042Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2815355Z return mod(**inputs) 2025-09-07T08:01:47.2815759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1528, in forward 2025-09-07T08:01:47.2816196Z logits = self.lm_head(outputs[0]) 2025-09-07T08:01:47.2816331Z 2025-09-07T08:01:47.2816424Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:01:47.2816761Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:01:47.2817135Z return mod(**inputs) 2025-09-07T08:01:47.2817533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1534, in forward 2025-09-07T08:01:47.2818031Z loss = loss_fct(logits.view(-1, self.config.vocab_size), labels.view(-1)) 2025-09-07T08:01:47.2818230Z 2025-09-07T08:01:53.4807275Z pass 2025-09-07T08:01:53.4807663Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:01:56.2686780Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:01:56.2687636Z import pynvml # type: ignore[import] 2025-09-07T08:01:58.9385912Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:01:58.9386885Z from pkg_resources import resource_filename 2025-09-07T08:01:59.6060405Z 2025-09-07T08:02:00.8880800Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:02:00.8881107Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:02:00.9127178Z cpu eval BlenderbotSmallForConditionalGeneration 2025-09-07T08:02:01.2877249Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:02:01.4305496Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:02:01.5749742Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:02:12.0368934Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0369264Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0369467Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0369663Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0369852Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0370046Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0370250Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0370447Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0370681Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0371074Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0371423Z return mod(**inputs) 2025-09-07T08:02:12.0371896Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0372347Z outputs = self.model( 2025-09-07T08:02:12.0372773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0373238Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0373725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0374498Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0374885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0375253Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0375707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0376175Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0376646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0377263Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0377478Z 2025-09-07T08:02:12.0377608Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0378029Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0378376Z return mod(**inputs) 2025-09-07T08:02:12.0378812Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0379249Z outputs = self.model( 2025-09-07T08:02:12.0379804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0380253Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0380783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0381257Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0381612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0381975Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0382426Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0382888Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0383333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0383785Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0383923Z 2025-09-07T08:02:12.0384026Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0384400Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0384733Z return mod(**inputs) 2025-09-07T08:02:12.0385141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0385654Z outputs = self.model( 2025-09-07T08:02:12.0386071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0386521Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0386959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0387389Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0387742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0388107Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0388547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0389000Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0389448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0389945Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0390094Z 2025-09-07T08:02:12.0390335Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0390546Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0390732Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0390932Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0391162Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0391516Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0391884Z return mod(**inputs) 2025-09-07T08:02:12.0392284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0392710Z outputs = self.model( 2025-09-07T08:02:12.0393127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0393573Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0394005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0394501Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0394866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0395226Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0395661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0396116Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0396555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0397044Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0397487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0397969Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0398153Z 2025-09-07T08:02:12.0398258Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0398599Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0398930Z return mod(**inputs) 2025-09-07T08:02:12.0399351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0399784Z outputs = self.model( 2025-09-07T08:02:12.0400194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0400629Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0401056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0401492Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0401829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0402186Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0402622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0403066Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0403514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0404010Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0404442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0404917Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0405087Z 2025-09-07T08:02:12.0405185Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0405535Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0405956Z return mod(**inputs) 2025-09-07T08:02:12.0406362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0406803Z outputs = self.model( 2025-09-07T08:02:12.0407204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0407654Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0408075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0408507Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0408918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0409282Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0409866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0410313Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0410764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0411214Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0411341Z 2025-09-07T08:02:12.0411445Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0411805Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0412113Z return mod(**inputs) 2025-09-07T08:02:12.0412537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0412969Z outputs = self.model( 2025-09-07T08:02:12.0413382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0413819Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0414239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0414673Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0415019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0415402Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0415843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0416316Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0416489Z 2025-09-07T08:02:12.0416606Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0416959Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0417294Z return mod(**inputs) 2025-09-07T08:02:12.0417760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0418260Z outputs = self.model( 2025-09-07T08:02:12.0418666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0419107Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0419540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0419991Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0420330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0420748Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0421183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0421663Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0422033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0422371Z return self.act(input) 2025-09-07T08:02:12.0422482Z 2025-09-07T08:02:12.0422578Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0422929Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0423368Z return mod(**inputs) 2025-09-07T08:02:12.0423773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0424212Z outputs = self.model( 2025-09-07T08:02:12.0424616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0425051Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0425471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0425954Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0426307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0426663Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0427115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 309, in forward 2025-09-07T08:02:12.0427563Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0427709Z 2025-09-07T08:02:12.0427806Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0428168Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0428489Z return mod(**inputs) 2025-09-07T08:02:12.0428919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0429350Z outputs = self.model( 2025-09-07T08:02:12.0429763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0430212Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0430643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0431083Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0431414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0431774Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0432205Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0432713Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0433168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0433671Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0433880Z 2025-09-07T08:02:12.0433979Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0434330Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0434682Z return mod(**inputs) 2025-09-07T08:02:12.0435087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0435527Z outputs = self.model( 2025-09-07T08:02:12.0435930Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0436366Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0436793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0437227Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0439879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0440277Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0440749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0441214Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0441653Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0442099Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0442233Z 2025-09-07T08:02:12.0442331Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0442687Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0443018Z return mod(**inputs) 2025-09-07T08:02:12.0443429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0443864Z outputs = self.model( 2025-09-07T08:02:12.0444278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0444722Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0445153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0445580Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0445926Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0446282Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0459333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0459917Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0460417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0460891Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0461036Z 2025-09-07T08:02:12.0461116Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0461325Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0461533Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0461807Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0462028Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0462393Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0462718Z return mod(**inputs) 2025-09-07T08:02:12.0463163Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0463620Z outputs = self.model( 2025-09-07T08:02:12.0464042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0464529Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0464968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0465405Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0465819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0466182Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0466619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0467144Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0467601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0468053Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0468495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0468970Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0469154Z 2025-09-07T08:02:12.0469265Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0469625Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0469940Z return mod(**inputs) 2025-09-07T08:02:12.0470355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0470791Z outputs = self.model( 2025-09-07T08:02:12.0471201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0471633Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0472052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0472497Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0472839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0473193Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0473618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0474062Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0474514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0474972Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0475418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0475872Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0476040Z 2025-09-07T08:02:12.0476143Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0476542Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0476882Z return mod(**inputs) 2025-09-07T08:02:12.0477303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0477740Z outputs = self.model( 2025-09-07T08:02:12.0478152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0478630Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0479063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0479502Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0479842Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0480205Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0480640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0481092Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0481603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0482045Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0482184Z 2025-09-07T08:02:12.0482284Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0482639Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0482956Z return mod(**inputs) 2025-09-07T08:02:12.0483358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0483795Z outputs = self.model( 2025-09-07T08:02:12.0484201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0484637Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0485063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0485485Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0485826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0486175Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0486606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0487083Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0487251Z 2025-09-07T08:02:12.0487345Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0487687Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0487998Z return mod(**inputs) 2025-09-07T08:02:12.0488402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0488825Z outputs = self.model( 2025-09-07T08:02:12.0489230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0489660Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0490081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0490557Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0490882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0491243Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0491696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0492178Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0492558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0492941Z return self.act(input) 2025-09-07T08:02:12.0493052Z 2025-09-07T08:02:12.0493145Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0493498Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0493821Z return mod(**inputs) 2025-09-07T08:02:12.0494224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0494655Z outputs = self.model( 2025-09-07T08:02:12.0495065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0495562Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0495989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0496416Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0496762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0497117Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0497554Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 309, in forward 2025-09-07T08:02:12.0498000Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0498130Z 2025-09-07T08:02:12.0498226Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0498589Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0498910Z return mod(**inputs) 2025-09-07T08:02:12.0499317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0499745Z outputs = self.model( 2025-09-07T08:02:12.0500144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0500581Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0501019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0501460Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0501800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0502155Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0502597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0503054Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0503511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0504010Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0504221Z 2025-09-07T08:02:12.0504318Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0504713Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0505036Z return mod(**inputs) 2025-09-07T08:02:12.0505448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0505949Z outputs = self.model( 2025-09-07T08:02:12.0506372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0506852Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0507278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0507707Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0508039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0508390Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0508825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0509271Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0510055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0510506Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0510649Z 2025-09-07T08:02:12.0510746Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0511099Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0511416Z return mod(**inputs) 2025-09-07T08:02:12.0511815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0512253Z outputs = self.model( 2025-09-07T08:02:12.0512659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0513098Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0513529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0513956Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0514304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0514660Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0515091Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0515541Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0515977Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0516424Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0516565Z 2025-09-07T08:02:12.0516639Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0516849Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0517034Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0517226Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0517448Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0517797Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0518110Z return mod(**inputs) 2025-09-07T08:02:12.0518512Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0519016Z outputs = self.model( 2025-09-07T08:02:12.0519434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0519860Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0520285Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0520709Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0521036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0521440Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0521872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0522321Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0522763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0523211Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0523644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0524180Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0524360Z 2025-09-07T08:02:12.0524460Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0524830Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0525153Z return mod(**inputs) 2025-09-07T08:02:12.0525568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0526013Z outputs = self.model( 2025-09-07T08:02:12.0526431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0526878Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0527322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0527763Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0528115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0528469Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0528906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0529360Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0529813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0530270Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0530713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0531177Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0531342Z 2025-09-07T08:02:12.0531440Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0531796Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0532124Z return mod(**inputs) 2025-09-07T08:02:12.0532535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0532974Z outputs = self.model( 2025-09-07T08:02:12.0533438Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0533876Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0534298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0534733Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0535074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0535468Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0535905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0536344Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0536785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0537225Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0537352Z 2025-09-07T08:02:12.0537452Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0537800Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0538190Z return mod(**inputs) 2025-09-07T08:02:12.0538604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0539038Z outputs = self.model( 2025-09-07T08:02:12.0539453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0539880Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0540300Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0540735Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0541073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0541427Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0541851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0542330Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0542509Z 2025-09-07T08:02:12.0542605Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0542951Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0543264Z return mod(**inputs) 2025-09-07T08:02:12.0543680Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0544111Z outputs = self.model( 2025-09-07T08:02:12.0544515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0545051Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0545492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0545964Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0546318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0546675Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0547120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0547649Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0548028Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0548365Z return self.act(input) 2025-09-07T08:02:12.0548469Z 2025-09-07T08:02:12.0548574Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0548927Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0549237Z return mod(**inputs) 2025-09-07T08:02:12.0549644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0550117Z outputs = self.model( 2025-09-07T08:02:12.0550527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0550972Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0551397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0551838Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0552182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0552605Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0553039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 309, in forward 2025-09-07T08:02:12.0553488Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0553625Z 2025-09-07T08:02:12.0553722Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0554075Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0554393Z return mod(**inputs) 2025-09-07T08:02:12.0554803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0555236Z outputs = self.model( 2025-09-07T08:02:12.0555651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0556091Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0556521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0556950Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0557288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0557639Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0558074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0558526Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0558968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0559497Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0559703Z 2025-09-07T08:02:12.0559797Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0560157Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0560475Z return mod(**inputs) 2025-09-07T08:02:12.0560881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0561308Z outputs = self.model( 2025-09-07T08:02:12.0561752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0562181Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0562597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0563032Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0563373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0563723Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0564210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0564652Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0565096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0565536Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0565663Z 2025-09-07T08:02:12.0565762Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0566101Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0566406Z return mod(**inputs) 2025-09-07T08:02:12.0566918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0567353Z outputs = self.model( 2025-09-07T08:02:12.0567757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0568189Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0568601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0569032Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0569364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0569707Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0570131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0570576Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0571019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0571459Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0571594Z 2025-09-07T08:02:12.0571674Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0571869Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0572064Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0572257Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0572470Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0572807Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0573120Z return mod(**inputs) 2025-09-07T08:02:12.0573525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0573946Z outputs = self.model( 2025-09-07T08:02:12.0574353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0574778Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0575201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0575690Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0576022Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0576367Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0576793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0577234Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0577673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0578173Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0578617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0579088Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0579281Z 2025-09-07T08:02:12.0579376Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0579720Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0580035Z return mod(**inputs) 2025-09-07T08:02:12.0580500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0580944Z outputs = self.model( 2025-09-07T08:02:12.0581356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0581794Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0582212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0582637Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0582969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0583316Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0583748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0584192Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0584624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0585084Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0585514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0586033Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0586194Z 2025-09-07T08:02:12.0586293Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0586630Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0586944Z return mod(**inputs) 2025-09-07T08:02:12.0587351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0587779Z outputs = self.model( 2025-09-07T08:02:12.0588174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0588605Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0589026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0589454Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0589841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0590182Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0590609Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0591057Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0591502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0591996Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0592130Z 2025-09-07T08:02:12.0592225Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0592563Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0592870Z return mod(**inputs) 2025-09-07T08:02:12.0593268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0593689Z outputs = self.model( 2025-09-07T08:02:12.0594077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0594578Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0595003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0595461Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0595792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0596133Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0596565Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0597037Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0597203Z 2025-09-07T08:02:12.0597300Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0597644Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0597953Z return mod(**inputs) 2025-09-07T08:02:12.0598359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0598789Z outputs = self.model( 2025-09-07T08:02:12.0599183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0599604Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0600030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0600460Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0600782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0601141Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0601559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0602031Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0602399Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0602730Z return self.act(input) 2025-09-07T08:02:12.0602830Z 2025-09-07T08:02:12.0602920Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0603268Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0603616Z return mod(**inputs) 2025-09-07T08:02:12.0604019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0604439Z outputs = self.model( 2025-09-07T08:02:12.0604832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0605265Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0605679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0606150Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0606477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0606821Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0607247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 309, in forward 2025-09-07T08:02:12.0607678Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0607804Z 2025-09-07T08:02:12.0607901Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0608314Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0608621Z return mod(**inputs) 2025-09-07T08:02:12.0609024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0609451Z outputs = self.model( 2025-09-07T08:02:12.0610041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0610481Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0610900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0611331Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0611669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0612018Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0612441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0612893Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0613331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0613831Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0614036Z 2025-09-07T08:02:12.0614135Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0614468Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0614783Z return mod(**inputs) 2025-09-07T08:02:12.0615193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0615611Z outputs = self.model( 2025-09-07T08:02:12.0616015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0616433Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0616845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0617282Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0617702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0618046Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0618464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0618916Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0619347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0619846Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0619971Z 2025-09-07T08:02:12.0620063Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0620390Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0620704Z return mod(**inputs) 2025-09-07T08:02:12.0624183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0624659Z outputs = self.model( 2025-09-07T08:02:12.0625091Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0625673Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0626105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0626550Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0626895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0627246Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0627678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0628130Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0628591Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0629039Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0629185Z 2025-09-07T08:02:12.0629261Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0629457Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0629660Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0629844Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0630077Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0630442Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0630768Z return mod(**inputs) 2025-09-07T08:02:12.0631179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0631614Z outputs = self.model( 2025-09-07T08:02:12.0632022Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0632454Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0632901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0633330Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0633675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0634038Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0634474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0634982Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0635430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0635890Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0636341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0636813Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0637037Z 2025-09-07T08:02:12.0637148Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0637493Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0637810Z return mod(**inputs) 2025-09-07T08:02:12.0638226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0638658Z outputs = self.model( 2025-09-07T08:02:12.0639508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0639955Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0640416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0640869Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0641207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0641568Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0641998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0642460Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0642904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0643363Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0643793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0644239Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0644407Z 2025-09-07T08:02:12.0644505Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0644858Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0645181Z return mod(**inputs) 2025-09-07T08:02:12.0645581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0646012Z outputs = self.model( 2025-09-07T08:02:12.0646427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0646853Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0647266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0647691Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0648034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0648381Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0648815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0649254Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0649805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0650236Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0650360Z 2025-09-07T08:02:12.0650460Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0650800Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0651109Z return mod(**inputs) 2025-09-07T08:02:12.0651514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0651977Z outputs = self.model( 2025-09-07T08:02:12.0652381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0652814Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0653275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0653705Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0654030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0654418Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0654843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0655349Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0655528Z 2025-09-07T08:02:12.0655623Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0655969Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0656282Z return mod(**inputs) 2025-09-07T08:02:12.0656690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0657121Z outputs = self.model( 2025-09-07T08:02:12.0657531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0657984Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0658430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0658867Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0659205Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0659567Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0659997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0660473Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0660839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0661164Z return self.act(input) 2025-09-07T08:02:12.0661276Z 2025-09-07T08:02:12.0661372Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0661720Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0662037Z return mod(**inputs) 2025-09-07T08:02:12.0662443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0662870Z outputs = self.model( 2025-09-07T08:02:12.0663271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0663743Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0664159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0664590Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0664919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0665273Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0665766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 309, in forward 2025-09-07T08:02:12.0666232Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0666378Z 2025-09-07T08:02:12.0666472Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0666814Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0667134Z return mod(**inputs) 2025-09-07T08:02:12.0667568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0668002Z outputs = self.model( 2025-09-07T08:02:12.0668461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0668898Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0669318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0669741Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0670071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0670418Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0670850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0671297Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0671734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0672240Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0672447Z 2025-09-07T08:02:12.0672539Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0672889Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0673204Z return mod(**inputs) 2025-09-07T08:02:12.0673602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0674033Z outputs = self.model( 2025-09-07T08:02:12.0674434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0674866Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0675289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0675714Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0676047Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0676400Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0676829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0677269Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0677754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0678200Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0678328Z 2025-09-07T08:02:12.0678429Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0678776Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0679088Z return mod(**inputs) 2025-09-07T08:02:12.0679499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0679975Z outputs = self.model( 2025-09-07T08:02:12.0680398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0680838Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0681305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0681747Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0682093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0682491Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0682928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0683385Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0683836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0684278Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0684412Z 2025-09-07T08:02:12.0684500Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0684697Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0684898Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0685109Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0685339Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0685694Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0686015Z return mod(**inputs) 2025-09-07T08:02:12.0686430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0686869Z outputs = self.model( 2025-09-07T08:02:12.0687276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0687707Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0688135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0688571Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0688913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0689266Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0689695Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0690144Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0690589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0691047Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0691492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0692021Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0692210Z 2025-09-07T08:02:12.0692305Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0692656Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0692981Z return mod(**inputs) 2025-09-07T08:02:12.0693384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0693852Z outputs = self.model( 2025-09-07T08:02:12.0694260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0694694Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0695117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0695547Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0695926Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0696281Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0696746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0697198Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0697639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0698085Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0698517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0698978Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0699133Z 2025-09-07T08:02:12.0699237Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0699575Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0699898Z return mod(**inputs) 2025-09-07T08:02:12.0700307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0700734Z outputs = self.model( 2025-09-07T08:02:12.0701139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0701566Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0701986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0702421Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0702753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0703095Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0703533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0703980Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0704421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0704864Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0704990Z 2025-09-07T08:02:12.0705084Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0705427Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0705842Z return mod(**inputs) 2025-09-07T08:02:12.0706264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0706700Z outputs = self.model( 2025-09-07T08:02:12.0707109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0707545Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0707975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0708452Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0708798Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0709150Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0709774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0710282Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0710454Z 2025-09-07T08:02:12.0710559Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0710974Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0711297Z return mod(**inputs) 2025-09-07T08:02:12.0711709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0712148Z outputs = self.model( 2025-09-07T08:02:12.0712559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0713000Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0713438Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0713874Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0714216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0714576Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0715008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0715486Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0715864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0716201Z return self.act(input) 2025-09-07T08:02:12.0716304Z 2025-09-07T08:02:12.0716408Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0716754Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0717075Z return mod(**inputs) 2025-09-07T08:02:12.0717487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0717920Z outputs = self.model( 2025-09-07T08:02:12.0718321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0718756Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0719182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0719615Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0719952Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0720370Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0720811Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 309, in forward 2025-09-07T08:02:12.0721258Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0721388Z 2025-09-07T08:02:12.0721495Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0721839Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0722217Z return mod(**inputs) 2025-09-07T08:02:12.0722635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0723075Z outputs = self.model( 2025-09-07T08:02:12.0723486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0723922Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0724427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0724866Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0725241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0725601Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0726030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0726491Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0726940Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0727454Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0727657Z 2025-09-07T08:02:12.0727762Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0728105Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0728424Z return mod(**inputs) 2025-09-07T08:02:12.0728835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0729261Z outputs = self.model( 2025-09-07T08:02:12.0729665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0730092Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0730514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0730944Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0731278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0731628Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0732055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0732498Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0732937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0733369Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0733493Z 2025-09-07T08:02:12.0733584Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0733925Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0734294Z return mod(**inputs) 2025-09-07T08:02:12.0734709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0735133Z outputs = self.model( 2025-09-07T08:02:12.0735534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0735966Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0736381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0736848Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0737179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0737516Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0737997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0738457Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0738918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0739404Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0739542Z 2025-09-07T08:02:12.0739618Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0739821Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0740022Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0740214Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0740431Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0740791Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0741118Z return mod(**inputs) 2025-09-07T08:02:12.0741535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0741966Z outputs = self.model( 2025-09-07T08:02:12.0742379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0742817Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0743249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0743683Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0744019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0744376Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0744808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0745264Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0745759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0746215Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0746656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0747134Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0747316Z 2025-09-07T08:02:12.0747419Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0747771Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0748083Z return mod(**inputs) 2025-09-07T08:02:12.0748544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0748978Z outputs = self.model( 2025-09-07T08:02:12.0749380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0749817Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0750233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0750701Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0751038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0751388Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0761175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0761755Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0762242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0762706Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0763194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0763656Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0763827Z 2025-09-07T08:02:12.0763929Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0764290Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0764615Z return mod(**inputs) 2025-09-07T08:02:12.0765031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0765479Z outputs = self.model( 2025-09-07T08:02:12.0765894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0766328Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0766764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0767205Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0767557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0767916Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0768351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0768808Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0769247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0769683Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0769813Z 2025-09-07T08:02:12.0769913Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0770268Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0770593Z return mod(**inputs) 2025-09-07T08:02:12.0770999Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0771426Z outputs = self.model( 2025-09-07T08:02:12.0771827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0772315Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0772749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0773188Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0773533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0773893Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0774328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0774845Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0775020Z 2025-09-07T08:02:12.0775330Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0775683Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0776009Z return mod(**inputs) 2025-09-07T08:02:12.0776461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0776898Z outputs = self.model( 2025-09-07T08:02:12.0777341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0777778Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0778194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0778633Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0778964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0779312Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0779750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0780218Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0780592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0780927Z return self.act(input) 2025-09-07T08:02:12.0781034Z 2025-09-07T08:02:12.0781132Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0781474Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0781783Z return mod(**inputs) 2025-09-07T08:02:12.0782183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0782611Z outputs = self.model( 2025-09-07T08:02:12.0783020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0783444Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0783858Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0784279Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0784606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0784949Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0785378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 309, in forward 2025-09-07T08:02:12.0785893Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0786025Z 2025-09-07T08:02:12.0786117Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0786503Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0786815Z return mod(**inputs) 2025-09-07T08:02:12.0787214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0787638Z outputs = self.model( 2025-09-07T08:02:12.0788040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0788525Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0788944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0789368Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0789690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0790039Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0790499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0790956Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0791434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0791949Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0792157Z 2025-09-07T08:02:12.0792254Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0792602Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0792912Z return mod(**inputs) 2025-09-07T08:02:12.0793312Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0793739Z outputs = self.model( 2025-09-07T08:02:12.0794140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0794568Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0794991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0795423Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0795750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0796100Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0796523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0796967Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0797402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0797833Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0797962Z 2025-09-07T08:02:12.0798054Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0798393Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0798701Z return mod(**inputs) 2025-09-07T08:02:12.0799094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0799512Z outputs = self.model( 2025-09-07T08:02:12.0799911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0800385Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0800800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0801222Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0801547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0801892Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0802311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0802793Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0803228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0803313Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0803319Z 2025-09-07T08:02:12.0803393Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0803504Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0803573Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0803639Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0803734Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0803956Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0804018Z return mod(**inputs) 2025-09-07T08:02:12.0804324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0804385Z outputs = self.model( 2025-09-07T08:02:12.0804690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0804756Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0805063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0805126Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0805337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0805411Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0805707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0805787Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0806083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0806177Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0806474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0806594Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0806598Z 2025-09-07T08:02:12.0806697Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0806887Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0806948Z return mod(**inputs) 2025-09-07T08:02:12.0807250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0807312Z outputs = self.model( 2025-09-07T08:02:12.0807615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0807679Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0808024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0808086Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0808306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0808373Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0808670Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0808788Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0809089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0809173Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0809453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0809594Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0809605Z 2025-09-07T08:02:12.0809910Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0810179Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0810243Z return mod(**inputs) 2025-09-07T08:02:12.0810545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0810612Z outputs = self.model( 2025-09-07T08:02:12.0810913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0810978Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0811281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0811348Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0811564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0811632Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0811933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 296, in forward 2025-09-07T08:02:12.0812018Z hidden_states, attn_weights = self.self_attn( 2025-09-07T08:02:12.0812321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0812398Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0812402Z 2025-09-07T08:02:12.0812490Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0812681Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0812739Z return mod(**inputs) 2025-09-07T08:02:12.0813041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0813103Z outputs = self.model( 2025-09-07T08:02:12.0813406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0813477Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0813775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0813839Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0814057Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0814179Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0814490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0814601Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0814604Z 2025-09-07T08:02:12.0814699Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0814885Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0815180Z return mod(**inputs) 2025-09-07T08:02:12.0815487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0815546Z outputs = self.model( 2025-09-07T08:02:12.0815851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0815916Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0816270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0816334Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0816585Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0816651Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0816950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 307, in forward 2025-09-07T08:02:12.0817054Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0817257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0817322Z return self.act(input) 2025-09-07T08:02:12.0817325Z 2025-09-07T08:02:12.0817411Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0817596Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0817652Z return mod(**inputs) 2025-09-07T08:02:12.0817956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0818014Z outputs = self.model( 2025-09-07T08:02:12.0818312Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1195, in forward 2025-09-07T08:02:12.0818377Z encoder_outputs = self.encoder( 2025-09-07T08:02:12.0818679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 812, in forward 2025-09-07T08:02:12.0818738Z layer_outputs = encoder_layer( 2025-09-07T08:02:12.0818949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0819013Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0819311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 309, in forward 2025-09-07T08:02:12.0819382Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0819386Z 2025-09-07T08:02:12.0819473Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0819656Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0819713Z return mod(**inputs) 2025-09-07T08:02:12.0820040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0820096Z outputs = self.model( 2025-09-07T08:02:12.0820451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0820514Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0820817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0820884Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0821091Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0821158Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0821496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0821585Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0821884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0822064Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0822068Z 2025-09-07T08:02:12.0822160Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0822344Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0822437Z return mod(**inputs) 2025-09-07T08:02:12.0822740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0822800Z outputs = self.model( 2025-09-07T08:02:12.0823104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0823165Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0823464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0823528Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0823736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0823803Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0824106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0824195Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0824492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0824564Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0824567Z 2025-09-07T08:02:12.0824654Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0824837Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0824899Z return mod(**inputs) 2025-09-07T08:02:12.0825196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0825255Z outputs = self.model( 2025-09-07T08:02:12.0825553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0825676Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0825984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0826045Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0826254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0826359Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0826663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0826745Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0827046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0827125Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0827163Z 2025-09-07T08:02:12.0827239Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0827315Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0827384Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0827451Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0827561Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0827761Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0827827Z return mod(**inputs) 2025-09-07T08:02:12.0828176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0828242Z outputs = self.model( 2025-09-07T08:02:12.0828589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0828660Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0828975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0829042Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0829272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0829352Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0829661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0829762Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0830071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0830169Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0830462Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0830591Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0830601Z 2025-09-07T08:02:12.0830697Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0830887Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0830958Z return mod(**inputs) 2025-09-07T08:02:12.0831266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0831334Z outputs = self.model( 2025-09-07T08:02:12.0831641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0831707Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0832015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0832081Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0832304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0832374Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0832718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0832811Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0833119Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0833211Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0833495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0833641Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0833644Z 2025-09-07T08:02:12.0833737Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0833928Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0834001Z return mod(**inputs) 2025-09-07T08:02:12.0834355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0834426Z outputs = self.model( 2025-09-07T08:02:12.0834818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0834887Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0835204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0835272Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0835493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0835561Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0835874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0835959Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0836259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0836341Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0836345Z 2025-09-07T08:02:12.0836437Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0836635Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0836694Z return mod(**inputs) 2025-09-07T08:02:12.0837004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0837063Z outputs = self.model( 2025-09-07T08:02:12.0837367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0837438Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0837742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0837813Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0838026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0838097Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0838404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0838503Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0838811Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0838994Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0838997Z 2025-09-07T08:02:12.0839093Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0839284Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0839343Z return mod(**inputs) 2025-09-07T08:02:12.0839651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0839745Z outputs = self.model( 2025-09-07T08:02:12.0840056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0840121Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0840423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0840525Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0840743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0840818Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0841167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0841274Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0841584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0841659Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0841663Z 2025-09-07T08:02:12.0841767Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0841963Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0842030Z return mod(**inputs) 2025-09-07T08:02:12.0842338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0842404Z outputs = self.model( 2025-09-07T08:02:12.0842714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0842781Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0843093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0843157Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0843382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0843455Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0843764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0843869Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0844169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0844253Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0844258Z 2025-09-07T08:02:12.0844333Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0844403Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0844477Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0844543Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0844646Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0844872Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0844937Z return mod(**inputs) 2025-09-07T08:02:12.0845251Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0845310Z outputs = self.model( 2025-09-07T08:02:12.0845620Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0845687Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0846035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0846099Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0846309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0846387Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0846723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0846826Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0847159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0847251Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0847551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0847670Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0847674Z 2025-09-07T08:02:12.0847772Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0847960Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0848027Z return mod(**inputs) 2025-09-07T08:02:12.0848336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0848397Z outputs = self.model( 2025-09-07T08:02:12.0848707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0848772Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0849083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0849148Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0849362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0849445Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0849748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0849847Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0850146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0850235Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0850522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0850620Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0850624Z 2025-09-07T08:02:12.0850720Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0850908Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0851008Z return mod(**inputs) 2025-09-07T08:02:12.0851316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0851377Z outputs = self.model( 2025-09-07T08:02:12.0851690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0851754Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0852065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0852162Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0852384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0852451Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0852790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0852891Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0853226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0853304Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0853307Z 2025-09-07T08:02:12.0853396Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0853593Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0853653Z return mod(**inputs) 2025-09-07T08:02:12.0853956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0854029Z outputs = self.model( 2025-09-07T08:02:12.0854335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0854404Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0854708Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0854773Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0855000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0855072Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0855385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.0855500Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0855505Z 2025-09-07T08:02:12.0855602Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0855792Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0855851Z return mod(**inputs) 2025-09-07T08:02:12.0856163Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0856224Z outputs = self.model( 2025-09-07T08:02:12.0856542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0856610Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0856909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0856981Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0857238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0857316Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0857621Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.0857727Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0857944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0858044Z return self.act(input) 2025-09-07T08:02:12.0858047Z 2025-09-07T08:02:12.0858146Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0858334Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0858398Z return mod(**inputs) 2025-09-07T08:02:12.0858700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0858794Z outputs = self.model( 2025-09-07T08:02:12.0859105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0859171Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0859510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0859576Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0859794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0859870Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0860173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:02:12.0860258Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0860261Z 2025-09-07T08:02:12.0860352Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0860543Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0860601Z return mod(**inputs) 2025-09-07T08:02:12.0860904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0860971Z outputs = self.model( 2025-09-07T08:02:12.0861273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0861342Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0861642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0861708Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0861931Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0862000Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0862311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0862400Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0862708Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0862853Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0862857Z 2025-09-07T08:02:12.0862949Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0863143Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0863237Z return mod(**inputs) 2025-09-07T08:02:12.0863552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0863611Z outputs = self.model( 2025-09-07T08:02:12.0863916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0863988Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0864292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0864399Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0864614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0864691Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0865039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0865126Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0865471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0865543Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0865546Z 2025-09-07T08:02:12.0865694Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0865885Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0865951Z return mod(**inputs) 2025-09-07T08:02:12.0866260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0866322Z outputs = self.model( 2025-09-07T08:02:12.0866631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0866696Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0867008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0867072Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0867283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0867360Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0867661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0867752Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0868054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0868141Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0868145Z 2025-09-07T08:02:12.0868219Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0868289Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0868369Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0868438Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0868538Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0868728Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0868787Z return mod(**inputs) 2025-09-07T08:02:12.0869099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0869161Z outputs = self.model( 2025-09-07T08:02:12.0869515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0869579Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0869879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0869952Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0870164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0870276Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0870581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0870666Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0870981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0871105Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0871408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0871562Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0871565Z 2025-09-07T08:02:12.0871663Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0871850Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0871912Z return mod(**inputs) 2025-09-07T08:02:12.0872220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0872279Z outputs = self.model( 2025-09-07T08:02:12.0872587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0872654Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0872963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0873032Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0873245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0873321Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0873622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0873714Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0874016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0874104Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0874400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0874496Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0874500Z 2025-09-07T08:02:12.0874597Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0874782Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0874848Z return mod(**inputs) 2025-09-07T08:02:12.0875152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0875211Z outputs = self.model( 2025-09-07T08:02:12.0875519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0875618Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0875931Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0875995Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0876210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0876283Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0876619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0876712Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0877011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0877090Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0877093Z 2025-09-07T08:02:12.0877211Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0877400Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0877465Z return mod(**inputs) 2025-09-07T08:02:12.0877798Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0877867Z outputs = self.model( 2025-09-07T08:02:12.0878176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0878245Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0878551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0878615Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0878832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0878898Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0879205Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0879300Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0879600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0879744Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0879748Z 2025-09-07T08:02:12.0879836Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0880028Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0880085Z return mod(**inputs) 2025-09-07T08:02:12.0880385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0880447Z outputs = self.model( 2025-09-07T08:02:12.0880749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0880816Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0881121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0881188Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0881401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0881505Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0881813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0881907Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0882215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0882284Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0882288Z 2025-09-07T08:02:12.0882414Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0882602Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0882659Z return mod(**inputs) 2025-09-07T08:02:12.0882967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0883026Z outputs = self.model( 2025-09-07T08:02:12.0883360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0883424Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0883759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0883827Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0884038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0884110Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0884406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0884497Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0884805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0884883Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0884886Z 2025-09-07T08:02:12.0884961Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0885029Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0885101Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0885166Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0885255Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0885448Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0885506Z return mod(**inputs) 2025-09-07T08:02:12.0885810Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0885869Z outputs = self.model( 2025-09-07T08:02:12.0886169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0886242Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0886555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0886620Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0886829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0886898Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0887205Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0887296Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0887641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0887724Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0888016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0888136Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0888139Z 2025-09-07T08:02:12.0888228Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0888473Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0888531Z return mod(**inputs) 2025-09-07T08:02:12.0888838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0888897Z outputs = self.model( 2025-09-07T08:02:12.0889237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0889303Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0889603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0889704Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0889918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0889990Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0890290Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0890379Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0890681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0890763Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0891048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0891142Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0891146Z 2025-09-07T08:02:12.0891238Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0891422Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0891478Z return mod(**inputs) 2025-09-07T08:02:12.0891786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0891844Z outputs = self.model( 2025-09-07T08:02:12.0892147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0892211Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0892511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0892579Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0892789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0892862Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0893160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0893256Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0893556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0893663Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0893666Z 2025-09-07T08:02:12.0893757Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0893939Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0894002Z return mod(**inputs) 2025-09-07T08:02:12.0894309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0894413Z outputs = self.model( 2025-09-07T08:02:12.0894719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0894782Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0895087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0895184Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0895404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0895471Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0895806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.0895921Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0895926Z 2025-09-07T08:02:12.0896016Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0896203Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0896261Z return mod(**inputs) 2025-09-07T08:02:12.0896560Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0896622Z outputs = self.model( 2025-09-07T08:02:12.0896925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0896993Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0897294Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0897361Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0897571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0897638Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0897941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.0898042Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0898250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0898311Z return self.act(input) 2025-09-07T08:02:12.0898314Z 2025-09-07T08:02:12.0898401Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0898592Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0898649Z return mod(**inputs) 2025-09-07T08:02:12.0898950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0899008Z outputs = self.model( 2025-09-07T08:02:12.0899308Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0899406Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0899710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0899777Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0899988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0900058Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0900358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:02:12.0900469Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0900472Z 2025-09-07T08:02:12.0900568Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0900752Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0900816Z return mod(**inputs) 2025-09-07T08:02:12.0901150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0901211Z outputs = self.model( 2025-09-07T08:02:12.0901513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0901611Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0901919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0901983Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0902211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0902279Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0902592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0902689Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0902992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0903133Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0903136Z 2025-09-07T08:02:12.0903223Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0903411Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0903469Z return mod(**inputs) 2025-09-07T08:02:12.0903768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0903831Z outputs = self.model( 2025-09-07T08:02:12.0904131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0904197Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0904496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0904560Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0904774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0904841Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0905142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0905226Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0905533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0905674Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0905677Z 2025-09-07T08:02:12.0905768Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0905957Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0906014Z return mod(**inputs) 2025-09-07T08:02:12.0906321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0906415Z outputs = self.model( 2025-09-07T08:02:12.0906718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0906783Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0907082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0907150Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0907394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0907464Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0907797Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0907881Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0908186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0908262Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0908266Z 2025-09-07T08:02:12.0908340Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0908409Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0908478Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0908548Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0908636Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0908823Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0908879Z return mod(**inputs) 2025-09-07T08:02:12.0909184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0909246Z outputs = self.model( 2025-09-07T08:02:12.0909547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0909772Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0910073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0910142Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0910355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0910421Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0910726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0910809Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0911109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0911195Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0911480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0911690Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0911693Z 2025-09-07T08:02:12.0911782Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0911969Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0912027Z return mod(**inputs) 2025-09-07T08:02:12.0912333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0912389Z outputs = self.model( 2025-09-07T08:02:12.0912758Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0912825Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0913124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0913197Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0913457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0913527Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0913883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0913970Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0914270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0914358Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0914644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0914745Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0914748Z 2025-09-07T08:02:12.0914838Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0915027Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0915083Z return mod(**inputs) 2025-09-07T08:02:12.0915389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0915446Z outputs = self.model( 2025-09-07T08:02:12.0915745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0915812Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0916115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0916180Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0916394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0916464Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0916764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0916853Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0917155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0917226Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0917229Z 2025-09-07T08:02:12.0917322Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0917506Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0917602Z return mod(**inputs) 2025-09-07T08:02:12.0917907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0917963Z outputs = self.model( 2025-09-07T08:02:12.0918267Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0918327Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0918628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0918722Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0918932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0918999Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0919296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0919427Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0919731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0919906Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0919909Z 2025-09-07T08:02:12.0920002Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0920191Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0920247Z return mod(**inputs) 2025-09-07T08:02:12.0920545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0920609Z outputs = self.model( 2025-09-07T08:02:12.0920909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0920972Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0921274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0921338Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0921552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0921619Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0921916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0922010Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0922308Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0922383Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0922386Z 2025-09-07T08:02:12.0922474Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0922658Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0922715Z return mod(**inputs) 2025-09-07T08:02:12.0923016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0923078Z outputs = self.model( 2025-09-07T08:02:12.0923377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0923439Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0923734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0923846Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0924060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0924122Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0924423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0924515Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0924852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0924925Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0924929Z 2025-09-07T08:02:12.0924999Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0925069Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0925135Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0925233Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0925323Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0925509Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0925604Z return mod(**inputs) 2025-09-07T08:02:12.0925910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0925971Z outputs = self.model( 2025-09-07T08:02:12.0926269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0926334Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0926635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0926699Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0926913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0926978Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0927286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0927376Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0927676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0927765Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0928049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0928169Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0928174Z 2025-09-07T08:02:12.0928262Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0928448Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0928503Z return mod(**inputs) 2025-09-07T08:02:12.0928803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0928867Z outputs = self.model( 2025-09-07T08:02:12.0929164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0929230Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0929529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0929630Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0929846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0929910Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0930215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0930303Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0930641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0930724Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0931007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0931105Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0931109Z 2025-09-07T08:02:12.0931289Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0931483Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0931539Z return mod(**inputs) 2025-09-07T08:02:12.0931891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0931954Z outputs = self.model( 2025-09-07T08:02:12.0932261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0932329Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0932629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0932698Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0932912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0932979Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0933286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0933377Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0933677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0933750Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0933754Z 2025-09-07T08:02:12.0933846Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0934031Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0934088Z return mod(**inputs) 2025-09-07T08:02:12.0934395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0934453Z outputs = self.model( 2025-09-07T08:02:12.0934759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0934819Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0935120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0935189Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0935396Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0935468Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0935828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.0935937Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0935945Z 2025-09-07T08:02:12.0936039Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0936230Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0936294Z return mod(**inputs) 2025-09-07T08:02:12.0936601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0936697Z outputs = self.model( 2025-09-07T08:02:12.0937002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0937067Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0937402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0937467Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0937688Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0937792Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0938099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.0938208Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0938416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0938483Z return self.act(input) 2025-09-07T08:02:12.0938487Z 2025-09-07T08:02:12.0938579Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0938776Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0938833Z return mod(**inputs) 2025-09-07T08:02:12.0939145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0939213Z outputs = self.model( 2025-09-07T08:02:12.0939518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0939591Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0939903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0939971Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0940196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0940265Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0940578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:02:12.0940651Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0940654Z 2025-09-07T08:02:12.0940749Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0940934Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0940994Z return mod(**inputs) 2025-09-07T08:02:12.0941300Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0941356Z outputs = self.model( 2025-09-07T08:02:12.0941660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0941766Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0942070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0942139Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0942353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0942425Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0942724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0942863Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0943164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0943309Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0943313Z 2025-09-07T08:02:12.0943440Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0943632Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0943696Z return mod(**inputs) 2025-09-07T08:02:12.0944029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0944089Z outputs = self.model( 2025-09-07T08:02:12.0944401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0944465Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0944771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0944837Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0945053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0945121Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0945423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0945515Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0945873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0945956Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0945960Z 2025-09-07T08:02:12.0946058Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0946252Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0946314Z return mod(**inputs) 2025-09-07T08:02:12.0946626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0946691Z outputs = self.model( 2025-09-07T08:02:12.0946991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0947063Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0947363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0947429Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0947653Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0947720Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0948082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0948175Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0948482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0948561Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0948565Z 2025-09-07T08:02:12.0948637Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0948745Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0948814Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0948885Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0948975Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0949163Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0949225Z return mod(**inputs) 2025-09-07T08:02:12.0949561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0949625Z outputs = self.model( 2025-09-07T08:02:12.0949962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0950027Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0950337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0950402Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0950616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0950684Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0950985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0951076Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0951380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0951472Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0951762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0951888Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0951892Z 2025-09-07T08:02:12.0951983Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0952167Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0952230Z return mod(**inputs) 2025-09-07T08:02:12.0952532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0952595Z outputs = self.model( 2025-09-07T08:02:12.0952893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0952968Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0953270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0953332Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0953552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0953619Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0953925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0954045Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0954348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0954436Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0954717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0954855Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0954858Z 2025-09-07T08:02:12.0954948Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0955139Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0955198Z return mod(**inputs) 2025-09-07T08:02:12.0955503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0955613Z outputs = self.model( 2025-09-07T08:02:12.0955922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0956020Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0956330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0956400Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0956628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0956697Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0957007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0957097Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0957403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0957476Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0957479Z 2025-09-07T08:02:12.0957574Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0957770Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0957831Z return mod(**inputs) 2025-09-07T08:02:12.0958144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0958204Z outputs = self.model( 2025-09-07T08:02:12.0958505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0958579Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0958882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0958951Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0959170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0959244Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0959548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0959648Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0959955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0960133Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0960137Z 2025-09-07T08:02:12.0960238Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0960422Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0960479Z return mod(**inputs) 2025-09-07T08:02:12.0960787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0960880Z outputs = self.model( 2025-09-07T08:02:12.0961186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0961248Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0961552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0961617Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0961859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0961931Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0962269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0962371Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0962672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0962748Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0962756Z 2025-09-07T08:02:12.0962848Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0963035Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0963096Z return mod(**inputs) 2025-09-07T08:02:12.0963396Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0963460Z outputs = self.model( 2025-09-07T08:02:12.0963761Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0963826Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0964131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0964195Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0964409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0964476Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0964774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0964870Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0965174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0965254Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0965257Z 2025-09-07T08:02:12.0965327Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0965402Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0965469Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0965536Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0965627Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0965812Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0965911Z return mod(**inputs) 2025-09-07T08:02:12.0966219Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0966279Z outputs = self.model( 2025-09-07T08:02:12.0966586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0966647Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0966951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0967058Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0967272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0967344Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0967680Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0967779Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0968079Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0968365Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0968662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0968787Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0968791Z 2025-09-07T08:02:12.0968881Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0969065Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0969132Z return mod(**inputs) 2025-09-07T08:02:12.0969437Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0969495Z outputs = self.model( 2025-09-07T08:02:12.0969803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0969869Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0970178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0970242Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0970459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0970526Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0970826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0970925Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0971225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0971314Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0971596Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0971695Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0971699Z 2025-09-07T08:02:12.0971789Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0971977Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0972086Z return mod(**inputs) 2025-09-07T08:02:12.0972394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0972459Z outputs = self.model( 2025-09-07T08:02:12.0972769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0972835Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0973139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0973245Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0973462Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0973528Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0973832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.0973956Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.0974260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0974367Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0974370Z 2025-09-07T08:02:12.0974461Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0974653Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0974714Z return mod(**inputs) 2025-09-07T08:02:12.0975015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0975078Z outputs = self.model( 2025-09-07T08:02:12.0975379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0975449Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0975750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0975818Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0976033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0976100Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0976409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.0976520Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0976524Z 2025-09-07T08:02:12.0976618Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0976804Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0976862Z return mod(**inputs) 2025-09-07T08:02:12.0977168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0977226Z outputs = self.model( 2025-09-07T08:02:12.0977531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0977597Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0977899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0977961Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0978173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0978281Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0978584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.0978691Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.0978898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.0978960Z return self.act(input) 2025-09-07T08:02:12.0978963Z 2025-09-07T08:02:12.0979057Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0979301Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0979366Z return mod(**inputs) 2025-09-07T08:02:12.0979670Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0979738Z outputs = self.model( 2025-09-07T08:02:12.0980073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0980137Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0980479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0980544Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0980760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0980832Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0981135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:02:12.0981212Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.0981217Z 2025-09-07T08:02:12.0981309Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0981503Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0981558Z return mod(**inputs) 2025-09-07T08:02:12.0981866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0981926Z outputs = self.model( 2025-09-07T08:02:12.0982227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0982295Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0982598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0982664Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0982875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0982942Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0983249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0983340Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0983643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.0983783Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.0983787Z 2025-09-07T08:02:12.0983881Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0984066Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0984157Z return mod(**inputs) 2025-09-07T08:02:12.0984467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0984525Z outputs = self.model( 2025-09-07T08:02:12.0984830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0984893Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0985194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0985300Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0985514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0985587Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0985924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0986055Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0986359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.0986428Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.0986463Z 2025-09-07T08:02:12.0986559Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0986743Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0986810Z return mod(**inputs) 2025-09-07T08:02:12.0987110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0987168Z outputs = self.model( 2025-09-07T08:02:12.0987474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0987541Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0987848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0987910Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0988129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0988196Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0988501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0988589Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0988888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.0988968Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.0988973Z 2025-09-07T08:02:12.0989042Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0989111Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0989180Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0989247Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.0989344Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0989531Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0989591Z return mod(**inputs) 2025-09-07T08:02:12.0989898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0989957Z outputs = self.model( 2025-09-07T08:02:12.0990260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0990357Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0990672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0990735Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0990950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0991021Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0991360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0991451Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0991759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0991847Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0992175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.0992298Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.0992302Z 2025-09-07T08:02:12.0992426Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0992618Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0992684Z return mod(**inputs) 2025-09-07T08:02:12.0992995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0993054Z outputs = self.model( 2025-09-07T08:02:12.0993363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0993426Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0993730Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0993794Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0994011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0994084Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0994388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0994479Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0994777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.0994864Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.0995149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.0995247Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.0995251Z 2025-09-07T08:02:12.0995343Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0995531Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0995595Z return mod(**inputs) 2025-09-07T08:02:12.0995897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0995956Z outputs = self.model( 2025-09-07T08:02:12.0996264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0996362Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0996673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0996735Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0996957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0997024Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0997321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.0997443Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.0997743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.0997819Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.0997824Z 2025-09-07T08:02:12.0997914Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.0998133Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.0998192Z return mod(**inputs) 2025-09-07T08:02:12.0998532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.0998597Z outputs = self.model( 2025-09-07T08:02:12.0998898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.0998965Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.0999262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.0999324Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.0999539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.0999604Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.0999908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1000002Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1000298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.1000443Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.1000446Z 2025-09-07T08:02:12.1000540Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1000732Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1000792Z return mod(**inputs) 2025-09-07T08:02:12.1001101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1001158Z outputs = self.model( 2025-09-07T08:02:12.1001460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1001528Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1001825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1001895Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1002106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1002179Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1002537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1002635Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1002941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.1003011Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.1003014Z 2025-09-07T08:02:12.1003110Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1003295Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1003387Z return mod(**inputs) 2025-09-07T08:02:12.1003691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1003749Z outputs = self.model( 2025-09-07T08:02:12.1004064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1004160Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1004475Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1004570Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1004783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1004860Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1005158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1005255Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1005555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.1005635Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.1005644Z 2025-09-07T08:02:12.1005717Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1005785Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1005860Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1005931Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1006019Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1006207Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1006267Z return mod(**inputs) 2025-09-07T08:02:12.1006574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1006635Z outputs = self.model( 2025-09-07T08:02:12.1006942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1007006Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1007307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1007378Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1007591Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1007662Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1007963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1008051Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1008350Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1008470Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1008759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.1008878Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.1008883Z 2025-09-07T08:02:12.1008977Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1009161Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1009254Z return mod(**inputs) 2025-09-07T08:02:12.1009562Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1009788Z outputs = self.model( 2025-09-07T08:02:12.1010118Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1010261Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1010568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1010640Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1010914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1010989Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1011296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1011391Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1011687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1011771Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1012061Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.1012154Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.1012157Z 2025-09-07T08:02:12.1012255Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1024138Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1024239Z return mod(**inputs) 2025-09-07T08:02:12.1024595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1024665Z outputs = self.model( 2025-09-07T08:02:12.1025007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1025083Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1025397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1025463Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1025774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1025852Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1026174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1026277Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1026596Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.1026780Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.1026784Z 2025-09-07T08:02:12.1026889Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1027106Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1027167Z return mod(**inputs) 2025-09-07T08:02:12.1027503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1027566Z outputs = self.model( 2025-09-07T08:02:12.1027882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1028007Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1028312Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1028381Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1028640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1028715Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1029060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.1029176Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.1029180Z 2025-09-07T08:02:12.1029280Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1029484Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1029546Z return mod(**inputs) 2025-09-07T08:02:12.1029856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1029917Z outputs = self.model( 2025-09-07T08:02:12.1030221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1030285Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1030604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1030667Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1030886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1030959Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1031262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.1031368Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.1031575Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.1031637Z return self.act(input) 2025-09-07T08:02:12.1031641Z 2025-09-07T08:02:12.1031734Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1031925Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1031985Z return mod(**inputs) 2025-09-07T08:02:12.1032288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1032348Z outputs = self.model( 2025-09-07T08:02:12.1032650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1032712Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1033014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1033115Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1033334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1033400Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1033705Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:02:12.1033778Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.1033816Z 2025-09-07T08:02:12.1033909Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1034101Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1034157Z return mod(**inputs) 2025-09-07T08:02:12.1034458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1034517Z outputs = self.model( 2025-09-07T08:02:12.1034852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1034920Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1035253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1035319Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1035532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1035600Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1035902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1035993Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1036294Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.1036436Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.1036440Z 2025-09-07T08:02:12.1036538Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1036726Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1036785Z return mod(**inputs) 2025-09-07T08:02:12.1037097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1037153Z outputs = self.model( 2025-09-07T08:02:12.1037463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1037529Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1037839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1037903Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1038123Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1038199Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1038501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1038600Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1038906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.1039021Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.1039026Z 2025-09-07T08:02:12.1039125Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1039316Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1039382Z return mod(**inputs) 2025-09-07T08:02:12.1039689Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1039753Z outputs = self.model( 2025-09-07T08:02:12.1040054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1040153Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1040459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1040526Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1040784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1040852Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1041208Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1041299Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1041598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.1041681Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.1041684Z 2025-09-07T08:02:12.1041758Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1041831Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1041897Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1041965Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1042060Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1042246Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1042307Z return mod(**inputs) 2025-09-07T08:02:12.1042612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1042669Z outputs = self.model( 2025-09-07T08:02:12.1042974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1043037Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1043339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1043404Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1043617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1043686Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1043982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1044072Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1044369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1044466Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1044761Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.1044886Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.1044927Z 2025-09-07T08:02:12.1045027Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1045224Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1045287Z return mod(**inputs) 2025-09-07T08:02:12.1045596Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1045652Z outputs = self.model( 2025-09-07T08:02:12.1045960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1046057Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1046362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1046422Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1046646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1046743Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1047056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1047180Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1047482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1047576Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1047864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.1047964Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.1047975Z 2025-09-07T08:02:12.1048066Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1048256Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1048313Z return mod(**inputs) 2025-09-07T08:02:12.1048618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1048680Z outputs = self.model( 2025-09-07T08:02:12.1048982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1049047Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1049353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1049414Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1049637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1049706Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1050012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1050100Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1050405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.1050482Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.1050487Z 2025-09-07T08:02:12.1050577Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1050772Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1050834Z return mod(**inputs) 2025-09-07T08:02:12.1051143Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1051248Z outputs = self.model( 2025-09-07T08:02:12.1051551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1051622Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1051923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1051988Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1052243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1052310Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1052624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1052730Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1053064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.1053210Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.1053214Z 2025-09-07T08:02:12.1053339Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1053539Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1053598Z return mod(**inputs) 2025-09-07T08:02:12.1053908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1053966Z outputs = self.model( 2025-09-07T08:02:12.1054274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1054338Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1054641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1054711Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1054927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1054998Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1055301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1055392Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1055694Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.1055767Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.1055770Z 2025-09-07T08:02:12.1055870Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1056057Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1056115Z return mod(**inputs) 2025-09-07T08:02:12.1056432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1056491Z outputs = self.model( 2025-09-07T08:02:12.1056804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1056865Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1057168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1057270Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1057482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1057550Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1057849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1057949Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1058248Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.1058361Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.1058365Z 2025-09-07T08:02:12.1058436Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1058503Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1058578Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1058646Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1058905Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1059097Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1059154Z return mod(**inputs) 2025-09-07T08:02:12.1059494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1059553Z outputs = self.model( 2025-09-07T08:02:12.1059860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1059926Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1060229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1060294Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1060505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1060572Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1060873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1060965Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1061262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1061351Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1061646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.1061769Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.1061774Z 2025-09-07T08:02:12.1061867Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1062054Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1062111Z return mod(**inputs) 2025-09-07T08:02:12.1062416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1062472Z outputs = self.model( 2025-09-07T08:02:12.1062775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1062836Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1063138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1063239Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1063452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1063521Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1063823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1063924Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1064222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1064338Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1064625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.1064719Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.1064725Z 2025-09-07T08:02:12.1064821Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1065056Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1065123Z return mod(**inputs) 2025-09-07T08:02:12.1065457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1065519Z outputs = self.model( 2025-09-07T08:02:12.1065876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1065948Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1066252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1066315Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1066531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1066607Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1066906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1067008Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1067307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.1067382Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.1067386Z 2025-09-07T08:02:12.1067475Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1067662Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1067723Z return mod(**inputs) 2025-09-07T08:02:12.1068026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1068087Z outputs = self.model( 2025-09-07T08:02:12.1068388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1068451Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1068754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1068816Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1069030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1069093Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1069397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.1069550Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.1069553Z 2025-09-07T08:02:12.1069641Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1069829Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1069888Z return mod(**inputs) 2025-09-07T08:02:12.1070192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1070282Z outputs = self.model( 2025-09-07T08:02:12.1070582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1070648Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1070949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1071050Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1071263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1071333Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1071663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.1071765Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.1071978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.1072040Z return self.act(input) 2025-09-07T08:02:12.1072043Z 2025-09-07T08:02:12.1072139Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1072325Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1072382Z return mod(**inputs) 2025-09-07T08:02:12.1072688Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1072743Z outputs = self.model( 2025-09-07T08:02:12.1073049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1073110Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1073418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1073481Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1073690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1073762Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1074063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:02:12.1074140Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.1074143Z 2025-09-07T08:02:12.1074232Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1074420Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1074482Z return mod(**inputs) 2025-09-07T08:02:12.1074779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1074845Z outputs = self.model( 2025-09-07T08:02:12.1075144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1075211Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1075550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1075615Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1075830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1075897Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1076204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1076329Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1076627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.1076774Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.1076779Z 2025-09-07T08:02:12.1076870Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1077092Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1077149Z return mod(**inputs) 2025-09-07T08:02:12.1077490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1077547Z outputs = self.model( 2025-09-07T08:02:12.1077848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1077916Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1078214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1078278Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1078489Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1078557Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1078860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1078943Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1079249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.1079319Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.1079323Z 2025-09-07T08:02:12.1079414Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1079597Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1079652Z return mod(**inputs) 2025-09-07T08:02:12.1079963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1080022Z outputs = self.model( 2025-09-07T08:02:12.1080331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1080393Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1080695Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1080766Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1080978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1081049Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1081350Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1081475Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1081775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.1081853Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.1081859Z 2025-09-07T08:02:12.1081938Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1082009Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1082084Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1082184Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1082273Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1082463Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1082525Z return mod(**inputs) 2025-09-07T08:02:12.1082833Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1082921Z outputs = self.model( 2025-09-07T08:02:12.1083224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1083290Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1083622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1083694Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1083904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1083973Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1084275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1084363Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1084672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1084760Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1085054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.1085175Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.1085180Z 2025-09-07T08:02:12.1085273Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1085458Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1085515Z return mod(**inputs) 2025-09-07T08:02:12.1085815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1085874Z outputs = self.model( 2025-09-07T08:02:12.1086193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1086256Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1086563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1086624Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1086835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1086901Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1087199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1087320Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1087619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1087705Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1087994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.1088092Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.1088142Z 2025-09-07T08:02:12.1088235Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1088419Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1088478Z return mod(**inputs) 2025-09-07T08:02:12.1088778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1088836Z outputs = self.model( 2025-09-07T08:02:12.1089173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1089237Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1089574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1089635Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1089849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1089914Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1090211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1090298Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1090597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.1090667Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.1090671Z 2025-09-07T08:02:12.1090756Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1090945Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1090998Z return mod(**inputs) 2025-09-07T08:02:12.1091301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1091360Z outputs = self.model( 2025-09-07T08:02:12.1091671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1091744Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1092053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1092119Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1092344Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1092417Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1092726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1092829Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1093126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.1093269Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.1093307Z 2025-09-07T08:02:12.1093407Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1093612Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1093672Z return mod(**inputs) 2025-09-07T08:02:12.1093985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1094045Z outputs = self.model( 2025-09-07T08:02:12.1094347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1094451Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1094750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1094816Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1095065Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1095140Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1095441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1095569Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1095872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.1095944Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.1095946Z 2025-09-07T08:02:12.1096047Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1096237Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1096299Z return mod(**inputs) 2025-09-07T08:02:12.1096608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1096665Z outputs = self.model( 2025-09-07T08:02:12.1096971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1097034Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1097337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1097404Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1097617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1097688Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1097987Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1098091Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1098392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.1098471Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.1098479Z 2025-09-07T08:02:12.1098555Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1098622Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1098701Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1098767Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1098863Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1099056Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1099113Z return mod(**inputs) 2025-09-07T08:02:12.1099466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1099526Z outputs = self.model( 2025-09-07T08:02:12.1099835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1099903Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1100204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1100313Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1100530Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1100607Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1100913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1101047Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1101359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1101451Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1101785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.1101915Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.1101921Z 2025-09-07T08:02:12.1102023Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1102218Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1102277Z return mod(**inputs) 2025-09-07T08:02:12.1102593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1102656Z outputs = self.model( 2025-09-07T08:02:12.1102963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1103026Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1103332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1103402Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1103619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1103694Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1103995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1104093Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1104394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1104479Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1104773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.1104866Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.1104871Z 2025-09-07T08:02:12.1104968Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1105156Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1105213Z return mod(**inputs) 2025-09-07T08:02:12.1105523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1105669Z outputs = self.model( 2025-09-07T08:02:12.1105981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1106044Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1106351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1106414Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1106665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1106742Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1107041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1107143Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1107475Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.1107549Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.1107559Z 2025-09-07T08:02:12.1107698Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1107888Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1107953Z return mod(**inputs) 2025-09-07T08:02:12.1108257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1108322Z outputs = self.model( 2025-09-07T08:02:12.1108623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1108685Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1108995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1109058Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1109280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1109349Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1109823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.1109948Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.1109951Z 2025-09-07T08:02:12.1110043Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1110237Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1110295Z return mod(**inputs) 2025-09-07T08:02:12.1110605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1110662Z outputs = self.model( 2025-09-07T08:02:12.1110965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1111033Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1111335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1111402Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1111613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1111680Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1112077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.1112185Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.1112400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.1112466Z return self.act(input) 2025-09-07T08:02:12.1112470Z 2025-09-07T08:02:12.1112568Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1112758Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1112869Z return mod(**inputs) 2025-09-07T08:02:12.1113186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1113244Z outputs = self.model( 2025-09-07T08:02:12.1113560Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1113674Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1113982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1114104Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1114324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1114401Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1114706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:02:12.1114783Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.1114786Z 2025-09-07T08:02:12.1114877Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1115066Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1115133Z return mod(**inputs) 2025-09-07T08:02:12.1115439Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1115506Z outputs = self.model( 2025-09-07T08:02:12.1115808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1115873Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1116180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1116245Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1116464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1116534Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1116841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1116931Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1117233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.1117383Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.1117388Z 2025-09-07T08:02:12.1117480Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1117671Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1117728Z return mod(**inputs) 2025-09-07T08:02:12.1118029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1118136Z outputs = self.model( 2025-09-07T08:02:12.1118446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1118519Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1118826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1118895Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1119197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1119265Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1119575Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1119664Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1120001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.1120071Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.1120075Z 2025-09-07T08:02:12.1120202Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1120391Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1120446Z return mod(**inputs) 2025-09-07T08:02:12.1120757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1120816Z outputs = self.model( 2025-09-07T08:02:12.1121125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1121190Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1121493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1121560Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1121772Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1121844Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1122144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1122229Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1122532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.1122608Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.1122612Z 2025-09-07T08:02:12.1122690Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1122759Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1122831Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1122897Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1122985Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1123177Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1123234Z return mod(**inputs) 2025-09-07T08:02:12.1123542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1123599Z outputs = self.model( 2025-09-07T08:02:12.1123902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1124009Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1124312Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1124381Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1124591Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1124659Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1124963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1125079Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1125385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1125473Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1125807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.1125930Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.1125934Z 2025-09-07T08:02:12.1126025Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1126258Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1126315Z return mod(**inputs) 2025-09-07T08:02:12.1126624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1126684Z outputs = self.model( 2025-09-07T08:02:12.1126994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1127056Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1127363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1127431Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1127641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1127714Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1128012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1128096Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1128399Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1128482Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1128773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.1128873Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.1128877Z 2025-09-07T08:02:12.1128970Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1129159Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1129215Z return mod(**inputs) 2025-09-07T08:02:12.1129522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1129581Z outputs = self.model( 2025-09-07T08:02:12.1129889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1129950Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1130308Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1130380Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1130593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1130665Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1130967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 398, in forward 2025-09-07T08:02:12.1131091Z hidden_states, self_attn_weights = self.self_attn( 2025-09-07T08:02:12.1131391Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.1131460Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.1131464Z 2025-09-07T08:02:12.1131558Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1131778Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1131841Z return mod(**inputs) 2025-09-07T08:02:12.1132142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1132252Z outputs = self.model( 2025-09-07T08:02:12.1132562Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1132625Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1132932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1132994Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1133211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1133280Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1133583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1133689Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1133993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 199, in forward 2025-09-07T08:02:12.1134138Z query_states = self.q_proj(hidden_states).view(*q_input_shape).transpose(1, 2) 2025-09-07T08:02:12.1134143Z 2025-09-07T08:02:12.1134234Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1134420Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1134482Z return mod(**inputs) 2025-09-07T08:02:12.1134782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1134849Z outputs = self.model( 2025-09-07T08:02:12.1135148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1135213Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1135517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1135581Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1135798Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1135864Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1136169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1136296Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1136596Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 218, in forward 2025-09-07T08:02:12.1136669Z key_states = self.k_proj(current_states) 2025-09-07T08:02:12.1136672Z 2025-09-07T08:02:12.1136761Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1136951Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1137169Z return mod(**inputs) 2025-09-07T08:02:12.1137476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1137532Z outputs = self.model( 2025-09-07T08:02:12.1137834Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1137905Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1138256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1138326Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1138573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1138640Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1138943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1139040Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1139346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 219, in forward 2025-09-07T08:02:12.1139421Z value_states = self.v_proj(current_states) 2025-09-07T08:02:12.1139424Z 2025-09-07T08:02:12.1139501Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1139570Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1139639Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1139713Z cudagraph partition due to non gpu ops 2025-09-07T08:02:12.1139803Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1139995Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1140050Z return mod(**inputs) 2025-09-07T08:02:12.1140354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1140417Z outputs = self.model( 2025-09-07T08:02:12.1140718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1140786Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1141089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1141152Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1141368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1141433Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1141736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1141831Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1142132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1142255Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1142545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 81, in sdpa_attention_forward 2025-09-07T08:02:12.1142666Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:12.1142669Z 2025-09-07T08:02:12.1142759Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1142950Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1143007Z return mod(**inputs) 2025-09-07T08:02:12.1143346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1143408Z outputs = self.model( 2025-09-07T08:02:12.1143709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1143779Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1144110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1144179Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1144419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1144487Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1144794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1144889Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1145198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 237, in forward 2025-09-07T08:02:12.1145278Z attn_output, attn_weights = attention_interface( 2025-09-07T08:02:12.1145573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/integrations/sdpa_attention.py", line 91, in sdpa_attention_forward 2025-09-07T08:02:12.1145738Z attn_output = attn_output.transpose(1, 2).contiguous() 2025-09-07T08:02:12.1145742Z 2025-09-07T08:02:12.1145831Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1146025Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1146080Z return mod(**inputs) 2025-09-07T08:02:12.1146388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1146450Z outputs = self.model( 2025-09-07T08:02:12.1146752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1146825Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1147124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1147193Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1147409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1147481Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1147782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 415, in forward 2025-09-07T08:02:12.1147877Z hidden_states, cross_attn_weights = self.encoder_attn( 2025-09-07T08:02:12.1148184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 251, in forward 2025-09-07T08:02:12.1148253Z attn_output = self.out_proj(attn_output) 2025-09-07T08:02:12.1148295Z 2025-09-07T08:02:12.1148389Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1148572Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1148628Z return mod(**inputs) 2025-09-07T08:02:12.1148936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1148992Z outputs = self.model( 2025-09-07T08:02:12.1149296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1149393Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1149713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1149775Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1149991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1150092Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1150393Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.1150538Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.1150543Z 2025-09-07T08:02:12.1150637Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1150827Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1150892Z return mod(**inputs) 2025-09-07T08:02:12.1151194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1151253Z outputs = self.model( 2025-09-07T08:02:12.1151553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1151627Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1151928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1151986Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1152204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1152269Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1152571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 430, in forward 2025-09-07T08:02:12.1152671Z hidden_states = self.activation_fn(self.fc1(hidden_states)) 2025-09-07T08:02:12.1152878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:12.1152946Z return self.act(input) 2025-09-07T08:02:12.1152949Z 2025-09-07T08:02:12.1153041Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1153233Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1153288Z return mod(**inputs) 2025-09-07T08:02:12.1153597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1375, in forward 2025-09-07T08:02:12.1153653Z outputs = self.model( 2025-09-07T08:02:12.1153958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1213, in forward 2025-09-07T08:02:12.1154026Z decoder_outputs = self.decoder( 2025-09-07T08:02:12.1154326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1057, in forward 2025-09-07T08:02:12.1154445Z layer_outputs = decoder_layer( 2025-09-07T08:02:12.1154658Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:12.1154721Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:12.1155025Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 432, in forward 2025-09-07T08:02:12.1155097Z hidden_states = self.fc2(hidden_states) 2025-09-07T08:02:12.1155100Z 2025-09-07T08:02:12.1155190Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1155412Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1155473Z return mod(**inputs) 2025-09-07T08:02:12.1155773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1393, in forward 2025-09-07T08:02:12.1155885Z lm_logits = self.lm_head(outputs[0]) + self.final_logits_bias 2025-09-07T08:02:12.1155889Z 2025-09-07T08:02:12.1156032Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:12.1156222Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:12.1156284Z return mod(**inputs) 2025-09-07T08:02:12.1156625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/blenderbot_small/modeling_blenderbot_small.py", line 1398, in forward 2025-09-07T08:02:12.1156783Z masked_lm_loss = loss_fct(lm_logits.view(-1, self.config.vocab_size), labels.view(-1)) 2025-09-07T08:02:12.1156790Z 2025-09-07T08:02:19.7617835Z pass 2025-09-07T08:02:19.7618221Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:02:22.7437257Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:02:22.7438111Z import pynvml # type: ignore[import] 2025-09-07T08:02:25.4010920Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:02:25.4011844Z from pkg_resources import resource_filename 2025-09-07T08:02:26.0434861Z 2025-09-07T08:02:27.6329752Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:02:27.6330048Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:02:27.6536083Z cpu eval CamemBert 2025-09-07T08:02:28.1385150Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:02:28.2988880Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:02:28.4487278Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:02:36.4254656Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4255133Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4255476Z return mod(**inputs) 2025-09-07T08:02:36.4255909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4256343Z outputs = self.roberta( 2025-09-07T08:02:36.4256749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 886, in forward 2025-09-07T08:02:36.4257242Z embedding_output = self.embeddings( 2025-09-07T08:02:36.4257663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 90, in forward 2025-09-07T08:02:36.4258634Z position_ids = create_position_ids_from_input_ids(input_ids, self.padding_idx, past_key_values_length) 2025-09-07T08:02:36.4259261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1590, in create_position_ids_from_input_ids 2025-09-07T08:02:36.4259763Z mask = input_ids.ne(padding_idx).int() 2025-09-07T08:02:36.4259904Z 2025-09-07T08:02:36.4259987Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4260295Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4260493Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4260688Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4260885Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4261076Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4261264Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4261462Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4261654Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4261924Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4262119Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4262325Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4262561Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4263020Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4263363Z return mod(**inputs) 2025-09-07T08:02:36.4263768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4264181Z outputs = self.roberta( 2025-09-07T08:02:36.4264582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 886, in forward 2025-09-07T08:02:36.4265003Z embedding_output = self.embeddings( 2025-09-07T08:02:36.4265422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 90, in forward 2025-09-07T08:02:36.4266034Z position_ids = create_position_ids_from_input_ids(input_ids, self.padding_idx, past_key_values_length) 2025-09-07T08:02:36.4266657Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1591, in create_position_ids_from_input_ids 2025-09-07T08:02:36.4267263Z incremental_indices = (torch.cumsum(mask, dim=1).type_as(mask) + past_key_values_length) * mask 2025-09-07T08:02:36.4267504Z 2025-09-07T08:02:36.4267750Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4268107Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4268421Z return mod(**inputs) 2025-09-07T08:02:36.4268815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4269224Z outputs = self.roberta( 2025-09-07T08:02:36.4269605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 886, in forward 2025-09-07T08:02:36.4270013Z embedding_output = self.embeddings( 2025-09-07T08:02:36.4270407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 90, in forward 2025-09-07T08:02:36.4270945Z position_ids = create_position_ids_from_input_ids(input_ids, self.padding_idx, past_key_values_length) 2025-09-07T08:02:36.4271560Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1591, in create_position_ids_from_input_ids 2025-09-07T08:02:36.4272135Z incremental_indices = (torch.cumsum(mask, dim=1).type_as(mask) + past_key_values_length) * mask 2025-09-07T08:02:36.4272367Z 2025-09-07T08:02:36.4272516Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4272866Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4273195Z return mod(**inputs) 2025-09-07T08:02:36.4273569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4273982Z outputs = self.roberta( 2025-09-07T08:02:36.4274374Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4274845Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4275243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4275648Z layer_outputs = layer_module( 2025-09-07T08:02:36.4276013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4276382Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4276832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4277260Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4277676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4278084Z return func(*args, **kwargs) 2025-09-07T08:02:36.4278485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4278893Z self_outputs = self.self( 2025-09-07T08:02:36.4279267Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4279640Z return func(*args, **kwargs) 2025-09-07T08:02:36.4280044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4280595Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4280859Z 2025-09-07T08:02:36.4280970Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4281334Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4281656Z return mod(**inputs) 2025-09-07T08:02:36.4282046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4282458Z outputs = self.roberta( 2025-09-07T08:02:36.4282846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4283255Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4283659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4284060Z layer_outputs = layer_module( 2025-09-07T08:02:36.4284407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4284760Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4285168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4285583Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4285957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4286331Z return func(*args, **kwargs) 2025-09-07T08:02:36.4286711Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4287163Z self_outputs = self.self( 2025-09-07T08:02:36.4287521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4287888Z return func(*args, **kwargs) 2025-09-07T08:02:36.4288272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4288672Z self.key(current_states) 2025-09-07T08:02:36.4288787Z 2025-09-07T08:02:36.4288887Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4289285Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4289619Z return mod(**inputs) 2025-09-07T08:02:36.4290005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4290417Z outputs = self.roberta( 2025-09-07T08:02:36.4290840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4291252Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4291644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4292074Z layer_outputs = layer_module( 2025-09-07T08:02:36.4292413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4292774Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4293183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4293597Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4293964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4294330Z return func(*args, **kwargs) 2025-09-07T08:02:36.4294731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4295142Z self_outputs = self.self( 2025-09-07T08:02:36.4295486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4295857Z return func(*args, **kwargs) 2025-09-07T08:02:36.4296244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4296651Z self.value(current_states) 2025-09-07T08:02:36.4296761Z 2025-09-07T08:02:36.4296845Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4297071Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4297430Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4297755Z return mod(**inputs) 2025-09-07T08:02:36.4298137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4298540Z outputs = self.roberta( 2025-09-07T08:02:36.4298912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4299317Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4299710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4300110Z layer_outputs = layer_module( 2025-09-07T08:02:36.4300443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4300801Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4301243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4301652Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4302020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4302376Z return func(*args, **kwargs) 2025-09-07T08:02:36.4302762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4303158Z self_outputs = self.self( 2025-09-07T08:02:36.4303548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4303904Z return func(*args, **kwargs) 2025-09-07T08:02:36.4304297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4304760Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4304948Z 2025-09-07T08:02:36.4305108Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4305456Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4305817Z return mod(**inputs) 2025-09-07T08:02:36.4306230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4306633Z outputs = self.roberta( 2025-09-07T08:02:36.4307006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4307409Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4307793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4308191Z layer_outputs = layer_module( 2025-09-07T08:02:36.4308535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4308890Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4309280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4309853Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4310220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4310592Z return func(*args, **kwargs) 2025-09-07T08:02:36.4310986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4311443Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4311893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4312323Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4312464Z 2025-09-07T08:02:36.4312575Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4312946Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4313273Z return mod(**inputs) 2025-09-07T08:02:36.4313656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4314057Z outputs = self.roberta( 2025-09-07T08:02:36.4314439Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4314845Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4315235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4315717Z layer_outputs = layer_module( 2025-09-07T08:02:36.4316055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4316407Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4316806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4317227Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4317628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4318084Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4318520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4318999Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4319503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4319921Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4320053Z 2025-09-07T08:02:36.4320161Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4320568Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4320889Z return mod(**inputs) 2025-09-07T08:02:36.4321268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4321671Z outputs = self.roberta( 2025-09-07T08:02:36.4322051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4322454Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4322845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4323246Z layer_outputs = layer_module( 2025-09-07T08:02:36.4323583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4323937Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4324332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4324750Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4325144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4325535Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4325961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4326438Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4326886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4327329Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4327715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4328056Z return self.act(input) 2025-09-07T08:02:36.4328163Z 2025-09-07T08:02:36.4328267Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4328619Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4328940Z return mod(**inputs) 2025-09-07T08:02:36.4329317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4329762Z outputs = self.roberta( 2025-09-07T08:02:36.4330144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4330546Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4330947Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4331347Z layer_outputs = layer_module( 2025-09-07T08:02:36.4331678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4332073Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4332476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4332889Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4333290Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4333710Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4334144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4334669Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4335128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4335542Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4335676Z 2025-09-07T08:02:36.4335776Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4336126Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4336444Z return mod(**inputs) 2025-09-07T08:02:36.4336823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4337221Z outputs = self.roberta( 2025-09-07T08:02:36.4337595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4337998Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4338395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4338797Z layer_outputs = layer_module( 2025-09-07T08:02:36.4339127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4339479Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4339877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4340289Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4340661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4341034Z return func(*args, **kwargs) 2025-09-07T08:02:36.4341421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4354183Z self_outputs = self.self( 2025-09-07T08:02:36.4354644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4355046Z return func(*args, **kwargs) 2025-09-07T08:02:36.4355473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4356055Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4356424Z 2025-09-07T08:02:36.4356535Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4356910Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4357237Z return mod(**inputs) 2025-09-07T08:02:36.4357643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4358072Z outputs = self.roberta( 2025-09-07T08:02:36.4358482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4358945Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4359348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4359756Z layer_outputs = layer_module( 2025-09-07T08:02:36.4360123Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4360530Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4360943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4361353Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4361778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4362162Z return func(*args, **kwargs) 2025-09-07T08:02:36.4362556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4362958Z self_outputs = self.self( 2025-09-07T08:02:36.4363337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4363715Z return func(*args, **kwargs) 2025-09-07T08:02:36.4364112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4364519Z self.key(current_states) 2025-09-07T08:02:36.4364633Z 2025-09-07T08:02:36.4364739Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4365110Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4365445Z return mod(**inputs) 2025-09-07T08:02:36.4365836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4366243Z outputs = self.roberta( 2025-09-07T08:02:36.4366630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4367036Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4367438Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4367843Z layer_outputs = layer_module( 2025-09-07T08:02:36.4368185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4368551Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4368959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4369372Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4369753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4370122Z return func(*args, **kwargs) 2025-09-07T08:02:36.4370515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4372196Z self_outputs = self.self( 2025-09-07T08:02:36.4372569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4372939Z return func(*args, **kwargs) 2025-09-07T08:02:36.4373331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4373735Z self.value(current_states) 2025-09-07T08:02:36.4373849Z 2025-09-07T08:02:36.4373936Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4374172Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4374571Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4374898Z return mod(**inputs) 2025-09-07T08:02:36.4375282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4375696Z outputs = self.roberta( 2025-09-07T08:02:36.4376107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4376513Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4376908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4377341Z layer_outputs = layer_module( 2025-09-07T08:02:36.4377687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4378053Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4378459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4378877Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4379256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4379628Z return func(*args, **kwargs) 2025-09-07T08:02:36.4380004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4380403Z self_outputs = self.self( 2025-09-07T08:02:36.4380760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4381128Z return func(*args, **kwargs) 2025-09-07T08:02:36.4381502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4381961Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4382151Z 2025-09-07T08:02:36.4382249Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4382605Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4382930Z return mod(**inputs) 2025-09-07T08:02:36.4383302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4383705Z outputs = self.roberta( 2025-09-07T08:02:36.4384086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4384488Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4384878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4385277Z layer_outputs = layer_module( 2025-09-07T08:02:36.4385696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4386055Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4386511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4386923Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4387297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4387666Z return func(*args, **kwargs) 2025-09-07T08:02:36.4388051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4388511Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4388998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4389416Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4389558Z 2025-09-07T08:02:36.4389657Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4390018Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4390378Z return mod(**inputs) 2025-09-07T08:02:36.4390763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4391174Z outputs = self.roberta( 2025-09-07T08:02:36.4391592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4392003Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4392399Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4392798Z layer_outputs = layer_module( 2025-09-07T08:02:36.4393138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4393499Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4393909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4394318Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4394728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4395127Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4395564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4396054Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4396499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4396912Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4397055Z 2025-09-07T08:02:36.4397156Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4397515Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4397837Z return mod(**inputs) 2025-09-07T08:02:36.4398211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4398616Z outputs = self.roberta( 2025-09-07T08:02:36.4399000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4399406Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4399793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4400198Z layer_outputs = layer_module( 2025-09-07T08:02:36.4400542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4400947Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4401351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4401759Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4402157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4402543Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4403086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4403564Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4404004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4404453Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4404898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4405251Z return self.act(input) 2025-09-07T08:02:36.4405361Z 2025-09-07T08:02:36.4405466Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4405852Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4406178Z return mod(**inputs) 2025-09-07T08:02:36.4406560Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4406972Z outputs = self.roberta( 2025-09-07T08:02:36.4407348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4407758Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4408155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4408564Z layer_outputs = layer_module( 2025-09-07T08:02:36.4408909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4409263Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4409852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4410269Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4410667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4411062Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4411490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4411982Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4412435Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4412854Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4412990Z 2025-09-07T08:02:36.4413095Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4413442Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4413768Z return mod(**inputs) 2025-09-07T08:02:36.4414147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4414549Z outputs = self.roberta( 2025-09-07T08:02:36.4414928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4415430Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4415822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4416229Z layer_outputs = layer_module( 2025-09-07T08:02:36.4416572Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4416930Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4417324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4417795Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4418175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4418551Z return func(*args, **kwargs) 2025-09-07T08:02:36.4418993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4419394Z self_outputs = self.self( 2025-09-07T08:02:36.4419751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4420120Z return func(*args, **kwargs) 2025-09-07T08:02:36.4420562Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4421114Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4421380Z 2025-09-07T08:02:36.4421479Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4421830Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4422152Z return mod(**inputs) 2025-09-07T08:02:36.4422535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4422936Z outputs = self.roberta( 2025-09-07T08:02:36.4423315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4423721Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4424114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4424517Z layer_outputs = layer_module( 2025-09-07T08:02:36.4424849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4425206Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4425676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4426091Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4426466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4426831Z return func(*args, **kwargs) 2025-09-07T08:02:36.4427217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4427614Z self_outputs = self.self( 2025-09-07T08:02:36.4427966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4428327Z return func(*args, **kwargs) 2025-09-07T08:02:36.4428709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4429110Z self.key(current_states) 2025-09-07T08:02:36.4429279Z 2025-09-07T08:02:36.4429383Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4429733Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4430043Z return mod(**inputs) 2025-09-07T08:02:36.4430420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4430827Z outputs = self.roberta( 2025-09-07T08:02:36.4431203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4431653Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4432040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4432448Z layer_outputs = layer_module( 2025-09-07T08:02:36.4432781Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4433140Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4433574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4434003Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4434409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4434779Z return func(*args, **kwargs) 2025-09-07T08:02:36.4435160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4435553Z self_outputs = self.self( 2025-09-07T08:02:36.4435902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4436264Z return func(*args, **kwargs) 2025-09-07T08:02:36.4436648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4437041Z self.value(current_states) 2025-09-07T08:02:36.4437161Z 2025-09-07T08:02:36.4437239Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4437469Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4437820Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4438137Z return mod(**inputs) 2025-09-07T08:02:36.4438506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4438913Z outputs = self.roberta( 2025-09-07T08:02:36.4439290Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4439692Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4440085Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4440479Z layer_outputs = layer_module( 2025-09-07T08:02:36.4440814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4441163Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4441569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4441971Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4442341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4442705Z return func(*args, **kwargs) 2025-09-07T08:02:36.4443089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4443534Z self_outputs = self.self( 2025-09-07T08:02:36.4443875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4444238Z return func(*args, **kwargs) 2025-09-07T08:02:36.4444618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4445074Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4445257Z 2025-09-07T08:02:36.4445358Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4445753Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4446070Z return mod(**inputs) 2025-09-07T08:02:36.4446442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4446845Z outputs = self.roberta( 2025-09-07T08:02:36.4447278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4447682Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4448077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4448517Z layer_outputs = layer_module( 2025-09-07T08:02:36.4448858Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4449209Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4449608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4450016Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4450389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4450762Z return func(*args, **kwargs) 2025-09-07T08:02:36.4451143Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4451600Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4452053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4452467Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4452603Z 2025-09-07T08:02:36.4452700Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4453052Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4453368Z return mod(**inputs) 2025-09-07T08:02:36.4453747Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4454154Z outputs = self.roberta( 2025-09-07T08:02:36.4454526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4454930Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4455325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4455725Z layer_outputs = layer_module( 2025-09-07T08:02:36.4456059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4456408Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4456807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4457218Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4457661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4458054Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4458491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4458974Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4459420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4459888Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4460018Z 2025-09-07T08:02:36.4460112Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4460463Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4460782Z return mod(**inputs) 2025-09-07T08:02:36.4461198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4461604Z outputs = self.roberta( 2025-09-07T08:02:36.4461974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4462407Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4462803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4463205Z layer_outputs = layer_module( 2025-09-07T08:02:36.4463531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4463885Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4464284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4464697Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4465096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4465484Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4465959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4466436Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4466878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4467311Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4467682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4468027Z return self.act(input) 2025-09-07T08:02:36.4468139Z 2025-09-07T08:02:36.4468235Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4468591Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4468913Z return mod(**inputs) 2025-09-07T08:02:36.4469284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4469693Z outputs = self.roberta( 2025-09-07T08:02:36.4470072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4470478Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4470864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4471263Z layer_outputs = layer_module( 2025-09-07T08:02:36.4471639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4471997Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4472398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4472803Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4473197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4473589Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4474051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4474545Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4474994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4475407Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4475577Z 2025-09-07T08:02:36.4475674Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4476026Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4476346Z return mod(**inputs) 2025-09-07T08:02:36.4476749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4477156Z outputs = self.roberta( 2025-09-07T08:02:36.4477536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4477935Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4478317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4478719Z layer_outputs = layer_module( 2025-09-07T08:02:36.4479055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4479410Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4479808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4480209Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4480586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4480957Z return func(*args, **kwargs) 2025-09-07T08:02:36.4481345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4481745Z self_outputs = self.self( 2025-09-07T08:02:36.4482089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4482457Z return func(*args, **kwargs) 2025-09-07T08:02:36.4482847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4483397Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4483658Z 2025-09-07T08:02:36.4483756Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4484115Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4484432Z return mod(**inputs) 2025-09-07T08:02:36.4484815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4485213Z outputs = self.roberta( 2025-09-07T08:02:36.4485597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4486044Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4486431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4486856Z layer_outputs = layer_module( 2025-09-07T08:02:36.4487190Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4487552Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4487988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4488405Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4488777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4489151Z return func(*args, **kwargs) 2025-09-07T08:02:36.4489573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4489985Z self_outputs = self.self( 2025-09-07T08:02:36.4490330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4490734Z return func(*args, **kwargs) 2025-09-07T08:02:36.4491117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4491532Z self.key(current_states) 2025-09-07T08:02:36.4491647Z 2025-09-07T08:02:36.4491741Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4492084Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4492417Z return mod(**inputs) 2025-09-07T08:02:36.4492802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4493197Z outputs = self.roberta( 2025-09-07T08:02:36.4493588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4493989Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4494388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4494786Z layer_outputs = layer_module( 2025-09-07T08:02:36.4495142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4495492Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4495885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4496303Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4496689Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4497049Z return func(*args, **kwargs) 2025-09-07T08:02:36.4497453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4497845Z self_outputs = self.self( 2025-09-07T08:02:36.4498196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4498558Z return func(*args, **kwargs) 2025-09-07T08:02:36.4498956Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4499353Z self.value(current_states) 2025-09-07T08:02:36.4499463Z 2025-09-07T08:02:36.4499538Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4499807Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4500173Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4500484Z return mod(**inputs) 2025-09-07T08:02:36.4500857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4501282Z outputs = self.roberta( 2025-09-07T08:02:36.4501659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4502096Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4502501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4502892Z layer_outputs = layer_module( 2025-09-07T08:02:36.4503221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4503570Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4503997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4504406Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4504803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4505192Z return func(*args, **kwargs) 2025-09-07T08:02:36.4505665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4506079Z self_outputs = self.self( 2025-09-07T08:02:36.4506436Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4506801Z return func(*args, **kwargs) 2025-09-07T08:02:36.4507196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4507656Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4507837Z 2025-09-07T08:02:36.4507940Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4508292Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4508613Z return mod(**inputs) 2025-09-07T08:02:36.4508992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4509394Z outputs = self.roberta( 2025-09-07T08:02:36.4509917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4510340Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4510742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4511141Z layer_outputs = layer_module( 2025-09-07T08:02:36.4511486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4511842Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4512243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4512648Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4513026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4513394Z return func(*args, **kwargs) 2025-09-07T08:02:36.4513774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4514327Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4514781Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4515195Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4515329Z 2025-09-07T08:02:36.4515433Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4515781Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4516100Z return mod(**inputs) 2025-09-07T08:02:36.4516528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4516930Z outputs = self.roberta( 2025-09-07T08:02:36.4517309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4517704Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4518147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4518551Z layer_outputs = layer_module( 2025-09-07T08:02:36.4518890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4519292Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4519696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4520107Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4520500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4520885Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4521312Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4521801Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4522250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4522659Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4522786Z 2025-09-07T08:02:36.4522888Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4523231Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4523546Z return mod(**inputs) 2025-09-07T08:02:36.4523922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4524322Z outputs = self.roberta( 2025-09-07T08:02:36.4524699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4525102Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4525491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4525889Z layer_outputs = layer_module( 2025-09-07T08:02:36.4526226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4526572Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4526967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4527374Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4527768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4528231Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4528658Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4529137Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4529577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4530009Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4530377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4530745Z return self.act(input) 2025-09-07T08:02:36.4530853Z 2025-09-07T08:02:36.4530950Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4531301Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4531620Z return mod(**inputs) 2025-09-07T08:02:36.4532023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4532434Z outputs = self.roberta( 2025-09-07T08:02:36.4532830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4533260Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4533648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4534042Z layer_outputs = layer_module( 2025-09-07T08:02:36.4534371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4534717Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4535112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4535518Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4535905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4536289Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4536715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4537197Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4537648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4538049Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4538182Z 2025-09-07T08:02:36.4538277Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4538621Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4538934Z return mod(**inputs) 2025-09-07T08:02:36.4539304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4539697Z outputs = self.roberta( 2025-09-07T08:02:36.4540074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4540476Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4540860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4541256Z layer_outputs = layer_module( 2025-09-07T08:02:36.4541582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4541923Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4542361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4542767Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4543133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4543501Z return func(*args, **kwargs) 2025-09-07T08:02:36.4543879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4544310Z self_outputs = self.self( 2025-09-07T08:02:36.4544651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4545014Z return func(*args, **kwargs) 2025-09-07T08:02:36.4545400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4546018Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4546285Z 2025-09-07T08:02:36.4546390Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4546735Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4547301Z return mod(**inputs) 2025-09-07T08:02:36.4547679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4548085Z outputs = self.roberta( 2025-09-07T08:02:36.4548462Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4548858Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4549246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4549649Z layer_outputs = layer_module( 2025-09-07T08:02:36.4549986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4550334Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4550732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4551130Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4551500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4551863Z return func(*args, **kwargs) 2025-09-07T08:02:36.4552242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4552637Z self_outputs = self.self( 2025-09-07T08:02:36.4552986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4553346Z return func(*args, **kwargs) 2025-09-07T08:02:36.4553719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4554108Z self.key(current_states) 2025-09-07T08:02:36.4554225Z 2025-09-07T08:02:36.4554552Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4554913Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4555231Z return mod(**inputs) 2025-09-07T08:02:36.4555622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4556037Z outputs = self.roberta( 2025-09-07T08:02:36.4556419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4556879Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4557286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4557691Z layer_outputs = layer_module( 2025-09-07T08:02:36.4558026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4558381Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4558786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4559250Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4559632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4559993Z return func(*args, **kwargs) 2025-09-07T08:02:36.4560414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4560819Z self_outputs = self.self( 2025-09-07T08:02:36.4561179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4561548Z return func(*args, **kwargs) 2025-09-07T08:02:36.4562003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4562423Z self.value(current_states) 2025-09-07T08:02:36.4562536Z 2025-09-07T08:02:36.4562624Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4562859Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4563213Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4563543Z return mod(**inputs) 2025-09-07T08:02:36.4563933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4564346Z outputs = self.roberta( 2025-09-07T08:02:36.4564725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4565135Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4565529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4565931Z layer_outputs = layer_module( 2025-09-07T08:02:36.4566275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4566627Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4567030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4567446Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4567829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4568200Z return func(*args, **kwargs) 2025-09-07T08:02:36.4568583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4568987Z self_outputs = self.self( 2025-09-07T08:02:36.4569337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4569705Z return func(*args, **kwargs) 2025-09-07T08:02:36.4570082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4570541Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4570787Z 2025-09-07T08:02:36.4570887Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4571252Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4571571Z return mod(**inputs) 2025-09-07T08:02:36.4571946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4572354Z outputs = self.roberta( 2025-09-07T08:02:36.4572741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4573190Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4573588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4573999Z layer_outputs = layer_module( 2025-09-07T08:02:36.4574348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4574705Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4575153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4575574Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4575983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4576361Z return func(*args, **kwargs) 2025-09-07T08:02:36.4576743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4577195Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4577635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4578046Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4578188Z 2025-09-07T08:02:36.4578289Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4578642Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4578958Z return mod(**inputs) 2025-09-07T08:02:36.4579327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4579723Z outputs = self.roberta( 2025-09-07T08:02:36.4580100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4580496Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4580878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4581267Z layer_outputs = layer_module( 2025-09-07T08:02:36.4581601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4581947Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4582340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4582743Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4583140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4583535Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4583970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4584455Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4584895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4585367Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4585503Z 2025-09-07T08:02:36.4585650Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4586005Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4586328Z return mod(**inputs) 2025-09-07T08:02:36.4586696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4587163Z outputs = self.roberta( 2025-09-07T08:02:36.4587540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4587942Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4588325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4588728Z layer_outputs = layer_module( 2025-09-07T08:02:36.4589106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4589469Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4589907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4590317Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4590719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4591112Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4591542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4592027Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4592464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4592903Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4593281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4593620Z return self.act(input) 2025-09-07T08:02:36.4593728Z 2025-09-07T08:02:36.4593834Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4594178Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4594497Z return mod(**inputs) 2025-09-07T08:02:36.4594873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4595273Z outputs = self.roberta( 2025-09-07T08:02:36.4595647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4596050Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4596443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4596839Z layer_outputs = layer_module( 2025-09-07T08:02:36.4597183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4597529Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4597931Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4598342Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4598737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4599209Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4599638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4600126Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4600582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4600997Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4601130Z 2025-09-07T08:02:36.4601268Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4601622Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4601981Z return mod(**inputs) 2025-09-07T08:02:36.4602383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4602792Z outputs = self.roberta( 2025-09-07T08:02:36.4603207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4603635Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4604061Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4604479Z layer_outputs = layer_module( 2025-09-07T08:02:36.4604819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4605174Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4605592Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4605998Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4606373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4606741Z return func(*args, **kwargs) 2025-09-07T08:02:36.4607128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4607532Z self_outputs = self.self( 2025-09-07T08:02:36.4607888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4608262Z return func(*args, **kwargs) 2025-09-07T08:02:36.4608644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4609184Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4609449Z 2025-09-07T08:02:36.4609551Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4610033Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4610353Z return mod(**inputs) 2025-09-07T08:02:36.4610728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4611152Z outputs = self.roberta( 2025-09-07T08:02:36.4611543Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4611943Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4612338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4612734Z layer_outputs = layer_module( 2025-09-07T08:02:36.4613090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4613550Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4613966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4614394Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4614777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4615157Z return func(*args, **kwargs) 2025-09-07T08:02:36.4615568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4616033Z self_outputs = self.self( 2025-09-07T08:02:36.4616379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4616745Z return func(*args, **kwargs) 2025-09-07T08:02:36.4617124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4617522Z self.key(current_states) 2025-09-07T08:02:36.4617702Z 2025-09-07T08:02:36.4617809Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4618154Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4618482Z return mod(**inputs) 2025-09-07T08:02:36.4618907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4619316Z outputs = self.roberta( 2025-09-07T08:02:36.4619687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4620124Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4620541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4620964Z layer_outputs = layer_module( 2025-09-07T08:02:36.4621297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4621654Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4622062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4622493Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4622871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4623230Z return func(*args, **kwargs) 2025-09-07T08:02:36.4623605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4624007Z self_outputs = self.self( 2025-09-07T08:02:36.4624360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4624729Z return func(*args, **kwargs) 2025-09-07T08:02:36.4625120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4625526Z self.value(current_states) 2025-09-07T08:02:36.4625709Z 2025-09-07T08:02:36.4625790Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4626022Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4626372Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4626687Z return mod(**inputs) 2025-09-07T08:02:36.4627072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4627471Z outputs = self.roberta( 2025-09-07T08:02:36.4627855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4628382Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4628791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4629201Z layer_outputs = layer_module( 2025-09-07T08:02:36.4629547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4629912Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4630352Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4630771Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4631147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4631525Z return func(*args, **kwargs) 2025-09-07T08:02:36.4631948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4632353Z self_outputs = self.self( 2025-09-07T08:02:36.4632710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4633115Z return func(*args, **kwargs) 2025-09-07T08:02:36.4633503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4633956Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4634143Z 2025-09-07T08:02:36.4634240Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4634592Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4634915Z return mod(**inputs) 2025-09-07T08:02:36.4635298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4635695Z outputs = self.roberta( 2025-09-07T08:02:36.4636077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4636479Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4636873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4637275Z layer_outputs = layer_module( 2025-09-07T08:02:36.4637628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4645395Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4645854Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4646302Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4646703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4647091Z return func(*args, **kwargs) 2025-09-07T08:02:36.4647485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4647936Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4648384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4648797Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4648931Z 2025-09-07T08:02:36.4649040Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4649416Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4649831Z return mod(**inputs) 2025-09-07T08:02:36.4650247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4650660Z outputs = self.roberta( 2025-09-07T08:02:36.4651053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4651451Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4651847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4652298Z layer_outputs = layer_module( 2025-09-07T08:02:36.4652643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4653009Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4653416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4653876Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4654283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4654678Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4655159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4655663Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4656121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4656545Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4656684Z 2025-09-07T08:02:36.4656795Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4657160Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4657482Z return mod(**inputs) 2025-09-07T08:02:36.4657870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4658275Z outputs = self.roberta( 2025-09-07T08:02:36.4658662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4659057Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4659449Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4659847Z layer_outputs = layer_module( 2025-09-07T08:02:36.4660193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4660553Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4660951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4661359Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4661755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4662149Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4662583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4663058Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4663503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4663938Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4664367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4664704Z return self.act(input) 2025-09-07T08:02:36.4664818Z 2025-09-07T08:02:36.4664916Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4665281Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4665682Z return mod(**inputs) 2025-09-07T08:02:36.4666063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4666508Z outputs = self.roberta( 2025-09-07T08:02:36.4666892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4667291Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4667690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4668090Z layer_outputs = layer_module( 2025-09-07T08:02:36.4668467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4668834Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4669278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4669699Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4670096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4670491Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4670926Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4671417Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4671876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4672282Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4672423Z 2025-09-07T08:02:36.4672525Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4672881Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4672942Z return mod(**inputs) 2025-09-07T08:02:36.4673224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4673287Z outputs = self.roberta( 2025-09-07T08:02:36.4673563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4673633Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4673902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4673974Z layer_outputs = layer_module( 2025-09-07T08:02:36.4674197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4674274Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4674542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4674623Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4674869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4674933Z return func(*args, **kwargs) 2025-09-07T08:02:36.4675204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4675313Z self_outputs = self.self( 2025-09-07T08:02:36.4675559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4675623Z return func(*args, **kwargs) 2025-09-07T08:02:36.4675897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4676111Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4676164Z 2025-09-07T08:02:36.4676264Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4676462Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4676523Z return mod(**inputs) 2025-09-07T08:02:36.4676802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4676868Z outputs = self.roberta( 2025-09-07T08:02:36.4677180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4677256Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4677567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4677642Z layer_outputs = layer_module( 2025-09-07T08:02:36.4677861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4677934Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4678205Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4678280Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4678523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4678585Z return func(*args, **kwargs) 2025-09-07T08:02:36.4678859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4678924Z self_outputs = self.self( 2025-09-07T08:02:36.4679160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4679224Z return func(*args, **kwargs) 2025-09-07T08:02:36.4679494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4679562Z self.key(current_states) 2025-09-07T08:02:36.4679565Z 2025-09-07T08:02:36.4679657Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4679846Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4679910Z return mod(**inputs) 2025-09-07T08:02:36.4680184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4680253Z outputs = self.roberta( 2025-09-07T08:02:36.4680523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4680586Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4680856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4680920Z layer_outputs = layer_module( 2025-09-07T08:02:36.4681140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4681207Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4681519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4681590Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4681823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4681892Z return func(*args, **kwargs) 2025-09-07T08:02:36.4682161Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4682267Z self_outputs = self.self( 2025-09-07T08:02:36.4682508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4682574Z return func(*args, **kwargs) 2025-09-07T08:02:36.4682854Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4682925Z self.value(current_states) 2025-09-07T08:02:36.4682928Z 2025-09-07T08:02:36.4683042Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4683142Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4683333Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4683433Z return mod(**inputs) 2025-09-07T08:02:36.4683712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4683783Z outputs = self.roberta( 2025-09-07T08:02:36.4684054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4684125Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4684392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4684458Z layer_outputs = layer_module( 2025-09-07T08:02:36.4684678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4684746Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4685019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4685092Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4685326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4685393Z return func(*args, **kwargs) 2025-09-07T08:02:36.4685660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4685724Z self_outputs = self.self( 2025-09-07T08:02:36.4685958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4686021Z return func(*args, **kwargs) 2025-09-07T08:02:36.4686294Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4686422Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4686426Z 2025-09-07T08:02:36.4686524Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4686712Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4686775Z return mod(**inputs) 2025-09-07T08:02:36.4687046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4687105Z outputs = self.roberta( 2025-09-07T08:02:36.4687375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4687491Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4687762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4687823Z layer_outputs = layer_module( 2025-09-07T08:02:36.4688035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4688108Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4688412Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4688489Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4688724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4688794Z return func(*args, **kwargs) 2025-09-07T08:02:36.4689097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4689219Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4689523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4689601Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4689605Z 2025-09-07T08:02:36.4689703Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4689901Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4689961Z return mod(**inputs) 2025-09-07T08:02:36.4690236Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4690298Z outputs = self.roberta( 2025-09-07T08:02:36.4690570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4690636Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4690908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4690971Z layer_outputs = layer_module( 2025-09-07T08:02:36.4691183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4691253Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4691522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4691599Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4691857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4691929Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4692241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4692357Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4692630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4692702Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4692707Z 2025-09-07T08:02:36.4692800Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4692986Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4693042Z return mod(**inputs) 2025-09-07T08:02:36.4693324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4693435Z outputs = self.roberta( 2025-09-07T08:02:36.4693712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4693778Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4694046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4694117Z layer_outputs = layer_module( 2025-09-07T08:02:36.4694329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4694448Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4694717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4694798Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4695094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4695164Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4695490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4695631Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4695908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4696013Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4696222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4696289Z return self.act(input) 2025-09-07T08:02:36.4696293Z 2025-09-07T08:02:36.4696384Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4696576Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4696633Z return mod(**inputs) 2025-09-07T08:02:36.4696908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4696973Z outputs = self.roberta( 2025-09-07T08:02:36.4697244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4697311Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4697583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4697650Z layer_outputs = layer_module( 2025-09-07T08:02:36.4697861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4697935Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4698203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4698278Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4698530Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4698598Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4698898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4699022Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4699291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4699416Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4699419Z 2025-09-07T08:02:36.4699511Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4699700Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4699760Z return mod(**inputs) 2025-09-07T08:02:36.4700033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4700095Z outputs = self.roberta( 2025-09-07T08:02:36.4700366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4700465Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4700736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4700799Z layer_outputs = layer_module( 2025-09-07T08:02:36.4701014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4701258Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4701529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4701604Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4701879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4701943Z return func(*args, **kwargs) 2025-09-07T08:02:36.4702222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4702285Z self_outputs = self.self( 2025-09-07T08:02:36.4702523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4702584Z return func(*args, **kwargs) 2025-09-07T08:02:36.4702853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4703057Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4703061Z 2025-09-07T08:02:36.4703153Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4703343Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4703399Z return mod(**inputs) 2025-09-07T08:02:36.4703671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4703733Z outputs = self.roberta( 2025-09-07T08:02:36.4704003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4704070Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4704346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4704410Z layer_outputs = layer_module( 2025-09-07T08:02:36.4704624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4704695Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4704961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4705032Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4705268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4705330Z return func(*args, **kwargs) 2025-09-07T08:02:36.4705666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4705769Z self_outputs = self.self( 2025-09-07T08:02:36.4706003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4706069Z return func(*args, **kwargs) 2025-09-07T08:02:36.4706335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4706401Z self.key(current_states) 2025-09-07T08:02:36.4706405Z 2025-09-07T08:02:36.4706530Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4706717Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4706779Z return mod(**inputs) 2025-09-07T08:02:36.4707050Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4707116Z outputs = self.roberta( 2025-09-07T08:02:36.4707413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4707483Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4707794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4707860Z layer_outputs = layer_module( 2025-09-07T08:02:36.4708077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4708144Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4708415Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4708488Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4708726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4708791Z return func(*args, **kwargs) 2025-09-07T08:02:36.4709063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4709136Z self_outputs = self.self( 2025-09-07T08:02:36.4709379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4709451Z return func(*args, **kwargs) 2025-09-07T08:02:36.4709888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4709958Z self.value(current_states) 2025-09-07T08:02:36.4709961Z 2025-09-07T08:02:36.4710046Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4710140Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4710347Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4710413Z return mod(**inputs) 2025-09-07T08:02:36.4710691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4710762Z outputs = self.roberta( 2025-09-07T08:02:36.4711033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4711106Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4711379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4711449Z layer_outputs = layer_module( 2025-09-07T08:02:36.4711679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4711838Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4712120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4712194Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4712443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4712509Z return func(*args, **kwargs) 2025-09-07T08:02:36.4712776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4712904Z self_outputs = self.self( 2025-09-07T08:02:36.4713140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4713207Z return func(*args, **kwargs) 2025-09-07T08:02:36.4713476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4713668Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4713672Z 2025-09-07T08:02:36.4713773Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4713965Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4714081Z return mod(**inputs) 2025-09-07T08:02:36.4714358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4714426Z outputs = self.roberta( 2025-09-07T08:02:36.4714704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4714772Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4715048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4715115Z layer_outputs = layer_module( 2025-09-07T08:02:36.4715341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4715411Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4715682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4715763Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4716000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4716072Z return func(*args, **kwargs) 2025-09-07T08:02:36.4716344Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4716466Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4716745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4716822Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4716826Z 2025-09-07T08:02:36.4716926Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4717116Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4717184Z return mod(**inputs) 2025-09-07T08:02:36.4717455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4717520Z outputs = self.roberta( 2025-09-07T08:02:36.4717796Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4717863Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4718178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4718246Z layer_outputs = layer_module( 2025-09-07T08:02:36.4718462Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4718545Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4718826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4718919Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4719220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4719303Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4719611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4719731Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4720045Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4720125Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4720128Z 2025-09-07T08:02:36.4720279Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4720484Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4720550Z return mod(**inputs) 2025-09-07T08:02:36.4720841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4720909Z outputs = self.roberta( 2025-09-07T08:02:36.4721192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4721262Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4721541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4721610Z layer_outputs = layer_module( 2025-09-07T08:02:36.4721832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4721917Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4722187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4722274Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4722535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4722607Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4722924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4723038Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4723319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4723425Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4723642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4723709Z return self.act(input) 2025-09-07T08:02:36.4723713Z 2025-09-07T08:02:36.4723811Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4724016Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4724081Z return mod(**inputs) 2025-09-07T08:02:36.4724365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4724467Z outputs = self.roberta( 2025-09-07T08:02:36.4724740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4724816Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4725089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4725161Z layer_outputs = layer_module( 2025-09-07T08:02:36.4725415Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4725489Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4725769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4725846Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4726144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4726214Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4726525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4726685Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4726958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4727045Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4727049Z 2025-09-07T08:02:36.4727142Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4727340Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4727401Z return mod(**inputs) 2025-09-07T08:02:36.4727676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4727745Z outputs = self.roberta( 2025-09-07T08:02:36.4728014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4728092Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4728360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4728437Z layer_outputs = layer_module( 2025-09-07T08:02:36.4728654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4728725Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4729002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4729077Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4729328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4729398Z return func(*args, **kwargs) 2025-09-07T08:02:36.4729667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4729743Z self_outputs = self.self( 2025-09-07T08:02:36.4729981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4730053Z return func(*args, **kwargs) 2025-09-07T08:02:36.4730322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4730540Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4730578Z 2025-09-07T08:02:36.4730678Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4730874Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4730946Z return mod(**inputs) 2025-09-07T08:02:36.4731225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4731294Z outputs = self.roberta( 2025-09-07T08:02:36.4731562Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4731663Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4731942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4732012Z layer_outputs = layer_module( 2025-09-07T08:02:36.4732269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4732342Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4732631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4732748Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4732990Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4733066Z return func(*args, **kwargs) 2025-09-07T08:02:36.4733336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4733408Z self_outputs = self.self( 2025-09-07T08:02:36.4733645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4733711Z return func(*args, **kwargs) 2025-09-07T08:02:36.4733987Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4734052Z self.key(current_states) 2025-09-07T08:02:36.4734055Z 2025-09-07T08:02:36.4734156Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4734348Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4734410Z return mod(**inputs) 2025-09-07T08:02:36.4734692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4734757Z outputs = self.roberta( 2025-09-07T08:02:36.4735035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4735105Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4735381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4735447Z layer_outputs = layer_module( 2025-09-07T08:02:36.4735663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4735741Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4736013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4736095Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4736331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4736396Z return func(*args, **kwargs) 2025-09-07T08:02:36.4736671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4736777Z self_outputs = self.self( 2025-09-07T08:02:36.4737020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4737083Z return func(*args, **kwargs) 2025-09-07T08:02:36.4737355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4737428Z self.value(current_states) 2025-09-07T08:02:36.4737431Z 2025-09-07T08:02:36.4737508Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4737642Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4737831Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4737899Z return mod(**inputs) 2025-09-07T08:02:36.4738171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4738236Z outputs = self.roberta( 2025-09-07T08:02:36.4738544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4738610Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4738917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4738981Z layer_outputs = layer_module( 2025-09-07T08:02:36.4739197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4739277Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4739545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4739628Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4739866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4739937Z return func(*args, **kwargs) 2025-09-07T08:02:36.4740207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4740273Z self_outputs = self.self( 2025-09-07T08:02:36.4740518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4740579Z return func(*args, **kwargs) 2025-09-07T08:02:36.4740858Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4740987Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4740991Z 2025-09-07T08:02:36.4741083Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4741282Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4741342Z return mod(**inputs) 2025-09-07T08:02:36.4741632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4741698Z outputs = self.roberta( 2025-09-07T08:02:36.4741975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4742052Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4742322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4742399Z layer_outputs = layer_module( 2025-09-07T08:02:36.4742623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4742740Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4743012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4743089Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4743338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4743405Z return func(*args, **kwargs) 2025-09-07T08:02:36.4743683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4743842Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4744116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4744205Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4744211Z 2025-09-07T08:02:36.4744311Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4744567Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4744631Z return mod(**inputs) 2025-09-07T08:02:36.4744917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4745013Z outputs = self.roberta( 2025-09-07T08:02:36.4745284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4745358Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4745741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4745815Z layer_outputs = layer_module( 2025-09-07T08:02:36.4746039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4746114Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4746394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4746472Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4746746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4746819Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4747133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4747252Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4747521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4747605Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4747609Z 2025-09-07T08:02:36.4747710Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4747910Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4747973Z return mod(**inputs) 2025-09-07T08:02:36.4748251Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4748321Z outputs = self.roberta( 2025-09-07T08:02:36.4748590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4748666Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4748938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4749013Z layer_outputs = layer_module( 2025-09-07T08:02:36.4749296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4749367Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4749644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4749721Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4749986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4750090Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4750400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4750519Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4750795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4750946Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4751157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4751223Z return self.act(input) 2025-09-07T08:02:36.4751235Z 2025-09-07T08:02:36.4751432Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4751629Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4751701Z return mod(**inputs) 2025-09-07T08:02:36.4751977Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4752048Z outputs = self.roberta( 2025-09-07T08:02:36.4752318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4752387Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4752665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4752730Z layer_outputs = layer_module( 2025-09-07T08:02:36.4752959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4753032Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4753301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4753383Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4753638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4753714Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4754018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4754151Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4754421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4754498Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4754501Z 2025-09-07T08:02:36.4754602Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4754792Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4754860Z return mod(**inputs) 2025-09-07T08:02:36.4755134Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4755195Z outputs = self.roberta( 2025-09-07T08:02:36.4755516Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4755584Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4755860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4755924Z layer_outputs = layer_module( 2025-09-07T08:02:36.4756148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4756219Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4756523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4756605Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4756849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4756924Z return func(*args, **kwargs) 2025-09-07T08:02:36.4757227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4757295Z self_outputs = self.self( 2025-09-07T08:02:36.4757574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4757638Z return func(*args, **kwargs) 2025-09-07T08:02:36.4757916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4758119Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4758123Z 2025-09-07T08:02:36.4758224Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4758414Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4758479Z return mod(**inputs) 2025-09-07T08:02:36.4758760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4758828Z outputs = self.roberta( 2025-09-07T08:02:36.4759101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4759167Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4759431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4759498Z layer_outputs = layer_module( 2025-09-07T08:02:36.4759712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4759784Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4760052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4760128Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4760361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4760421Z return func(*args, **kwargs) 2025-09-07T08:02:36.4760692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4760755Z self_outputs = self.self( 2025-09-07T08:02:36.4760993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4761054Z return func(*args, **kwargs) 2025-09-07T08:02:36.4761321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4761432Z self.key(current_states) 2025-09-07T08:02:36.4761435Z 2025-09-07T08:02:36.4761524Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4761716Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4761772Z return mod(**inputs) 2025-09-07T08:02:36.4762043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4762108Z outputs = self.roberta( 2025-09-07T08:02:36.4762377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4762485Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4762750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4762816Z layer_outputs = layer_module( 2025-09-07T08:02:36.4763030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4763130Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4763400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4763471Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4763744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4763805Z return func(*args, **kwargs) 2025-09-07T08:02:36.4764077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4764144Z self_outputs = self.self( 2025-09-07T08:02:36.4764377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4764443Z return func(*args, **kwargs) 2025-09-07T08:02:36.4764709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4764773Z self.value(current_states) 2025-09-07T08:02:36.4764782Z 2025-09-07T08:02:36.4764857Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4764948Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4765139Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4765196Z return mod(**inputs) 2025-09-07T08:02:36.4765473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4765533Z outputs = self.roberta( 2025-09-07T08:02:36.4765806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4765878Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4766146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4766214Z layer_outputs = layer_module( 2025-09-07T08:02:36.4766424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4766491Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4766763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4766836Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4767074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4767135Z return func(*args, **kwargs) 2025-09-07T08:02:36.4767403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4767505Z self_outputs = self.self( 2025-09-07T08:02:36.4767739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4767807Z return func(*args, **kwargs) 2025-09-07T08:02:36.4768073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4768208Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4768265Z 2025-09-07T08:02:36.4768357Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4768541Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4768606Z return mod(**inputs) 2025-09-07T08:02:36.4768878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4768944Z outputs = self.roberta( 2025-09-07T08:02:36.4769243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4769306Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4769616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4769679Z layer_outputs = layer_module( 2025-09-07T08:02:36.4769896Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4769962Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4770233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4770306Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4770540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4770630Z return func(*args, **kwargs) 2025-09-07T08:02:36.4770911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4771031Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4771301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4771378Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4771386Z 2025-09-07T08:02:36.4771477Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4771663Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4771724Z return mod(**inputs) 2025-09-07T08:02:36.4771997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4772064Z outputs = self.roberta( 2025-09-07T08:02:36.4772331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4772395Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4772669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4772731Z layer_outputs = layer_module( 2025-09-07T08:02:36.4772948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4773013Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4773280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4773394Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4773654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4773727Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4774030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4774148Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4774418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4774524Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4774527Z 2025-09-07T08:02:36.4774621Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4774806Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4774874Z return mod(**inputs) 2025-09-07T08:02:36.4775187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4775250Z outputs = self.roberta( 2025-09-07T08:02:36.4775556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4775621Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4775897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4775962Z layer_outputs = layer_module( 2025-09-07T08:02:36.4776178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4776249Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4776517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4776593Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4776846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4776920Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4777221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4777324Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4777598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4777702Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4777912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4777974Z return self.act(input) 2025-09-07T08:02:36.4777978Z 2025-09-07T08:02:36.4778076Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4778261Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4778319Z return mod(**inputs) 2025-09-07T08:02:36.4778593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4778651Z outputs = self.roberta( 2025-09-07T08:02:36.4778923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4778987Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4779257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4779358Z layer_outputs = layer_module( 2025-09-07T08:02:36.4779573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4779644Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4779912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4779985Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4780240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4780527Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4780840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4780963Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4781238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4781339Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4781343Z 2025-09-07T08:02:36.4781434Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4781659Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4781719Z return mod(**inputs) 2025-09-07T08:02:36.4781993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4782054Z outputs = self.roberta( 2025-09-07T08:02:36.4782321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4782391Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4782660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4782729Z layer_outputs = layer_module( 2025-09-07T08:02:36.4782942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4783014Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4783284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4783358Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4783603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4783665Z return func(*args, **kwargs) 2025-09-07T08:02:36.4783934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4783998Z self_outputs = self.self( 2025-09-07T08:02:36.4784235Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4784301Z return func(*args, **kwargs) 2025-09-07T08:02:36.4784570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4784775Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4784778Z 2025-09-07T08:02:36.4784866Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4785062Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4785122Z return mod(**inputs) 2025-09-07T08:02:36.4785391Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4785490Z outputs = self.roberta( 2025-09-07T08:02:36.4785816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4785882Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4786152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4786216Z layer_outputs = layer_module( 2025-09-07T08:02:36.4786436Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4786541Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4786813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4786884Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4787116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4787181Z return func(*args, **kwargs) 2025-09-07T08:02:36.4787481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4787549Z self_outputs = self.self( 2025-09-07T08:02:36.4787817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4787882Z return func(*args, **kwargs) 2025-09-07T08:02:36.4788150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4788215Z self.key(current_states) 2025-09-07T08:02:36.4788219Z 2025-09-07T08:02:36.4788316Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4788502Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4788563Z return mod(**inputs) 2025-09-07T08:02:36.4788833Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4788895Z outputs = self.roberta( 2025-09-07T08:02:36.4789166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4789233Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4789506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4789572Z layer_outputs = layer_module( 2025-09-07T08:02:36.4789785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4789851Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4790116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4790192Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4790425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4790488Z return func(*args, **kwargs) 2025-09-07T08:02:36.4790755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4790817Z self_outputs = self.self( 2025-09-07T08:02:36.4791052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4791113Z return func(*args, **kwargs) 2025-09-07T08:02:36.4791386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4791448Z self.value(current_states) 2025-09-07T08:02:36.4791500Z 2025-09-07T08:02:36.4791575Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4791669Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4791853Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4791915Z return mod(**inputs) 2025-09-07T08:02:36.4792188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4792251Z outputs = self.roberta( 2025-09-07T08:02:36.4792519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4792616Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4792897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4792958Z layer_outputs = layer_module( 2025-09-07T08:02:36.4793176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4793276Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4793545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4793654Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4793890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4793955Z return func(*args, **kwargs) 2025-09-07T08:02:36.4794223Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4794285Z self_outputs = self.self( 2025-09-07T08:02:36.4794524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4794586Z return func(*args, **kwargs) 2025-09-07T08:02:36.4794858Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4794980Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4794984Z 2025-09-07T08:02:36.4795080Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4795266Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4795329Z return mod(**inputs) 2025-09-07T08:02:36.4795608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4795669Z outputs = self.roberta( 2025-09-07T08:02:36.4795942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4796007Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4796273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4796340Z layer_outputs = layer_module( 2025-09-07T08:02:36.4796552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4796622Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4796887Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4796964Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4797198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4797258Z return func(*args, **kwargs) 2025-09-07T08:02:36.4797525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4797686Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4797982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4798062Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4798067Z 2025-09-07T08:02:36.4798157Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4798352Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4798443Z return mod(**inputs) 2025-09-07T08:02:36.4798724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4798784Z outputs = self.roberta( 2025-09-07T08:02:36.4799055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4799119Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4799417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4799482Z layer_outputs = layer_module( 2025-09-07T08:02:36.4799727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4799803Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4800070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4800147Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4800406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4800474Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4800780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4800894Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4801162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4801235Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4801239Z 2025-09-07T08:02:36.4801328Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4801516Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4801573Z return mod(**inputs) 2025-09-07T08:02:36.4801848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4801907Z outputs = self.roberta( 2025-09-07T08:02:36.4802177Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4802247Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4802515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4802583Z layer_outputs = layer_module( 2025-09-07T08:02:36.4802797Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4802864Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4803135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4803207Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4803461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4803564Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4803867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4803971Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4804240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4804343Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4804586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4804652Z return self.act(input) 2025-09-07T08:02:36.4804655Z 2025-09-07T08:02:36.4804750Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4804939Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4805004Z return mod(**inputs) 2025-09-07T08:02:36.4805311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4805379Z outputs = self.roberta( 2025-09-07T08:02:36.4805683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4805752Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4806017Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4806082Z layer_outputs = layer_module( 2025-09-07T08:02:36.4806303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4806370Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4806645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4806720Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4806971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4807041Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4807340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4807467Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4807733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4807808Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4807812Z 2025-09-07T08:02:36.4807906Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4808095Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4808159Z return mod(**inputs) 2025-09-07T08:02:36.4808432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4808498Z outputs = self.roberta( 2025-09-07T08:02:36.4808764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4808829Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4809101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4809162Z layer_outputs = layer_module( 2025-09-07T08:02:36.4809380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4809484Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4809891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4809971Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4810216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4810283Z return func(*args, **kwargs) 2025-09-07T08:02:36.4810553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4810685Z self_outputs = self.self( 2025-09-07T08:02:36.4810924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4810986Z return func(*args, **kwargs) 2025-09-07T08:02:36.4811257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 325, in forward 2025-09-07T08:02:36.4811507Z self.query(hidden_states).view(bsz, -1, self.num_attention_heads, self.attention_head_size).transpose(1, 2) 2025-09-07T08:02:36.4811511Z 2025-09-07T08:02:36.4811612Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4811865Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4811927Z return mod(**inputs) 2025-09-07T08:02:36.4812201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4812264Z outputs = self.roberta( 2025-09-07T08:02:36.4812532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4812595Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4812863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4812931Z layer_outputs = layer_module( 2025-09-07T08:02:36.4813142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4813214Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4813482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4813560Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4813796Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4813858Z return func(*args, **kwargs) 2025-09-07T08:02:36.4814129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4814192Z self_outputs = self.self( 2025-09-07T08:02:36.4814431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4814490Z return func(*args, **kwargs) 2025-09-07T08:02:36.4814760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 353, in forward 2025-09-07T08:02:36.4814825Z self.key(current_states) 2025-09-07T08:02:36.4814829Z 2025-09-07T08:02:36.4814922Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4815114Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4815170Z return mod(**inputs) 2025-09-07T08:02:36.4815445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4815506Z outputs = self.roberta( 2025-09-07T08:02:36.4815824Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4815895Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4816160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4816230Z layer_outputs = layer_module( 2025-09-07T08:02:36.4816442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4816512Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4816818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4816890Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4817128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4817191Z return func(*args, **kwargs) 2025-09-07T08:02:36.4817493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4817555Z self_outputs = self.self( 2025-09-07T08:02:36.4817821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4817891Z return func(*args, **kwargs) 2025-09-07T08:02:36.4818157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 358, in forward 2025-09-07T08:02:36.4818235Z self.value(current_states) 2025-09-07T08:02:36.4818238Z 2025-09-07T08:02:36.4818318Z cudagraph partition due to non gpu ops 2025-09-07T08:02:36.4818409Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4818600Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4818661Z return mod(**inputs) 2025-09-07T08:02:36.4818937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4818997Z outputs = self.roberta( 2025-09-07T08:02:36.4819270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4819335Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4819599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4819670Z layer_outputs = layer_module( 2025-09-07T08:02:36.4819883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4819954Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4820222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4820298Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4820535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4820595Z return func(*args, **kwargs) 2025-09-07T08:02:36.4820870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 467, in forward 2025-09-07T08:02:36.4820931Z self_outputs = self.self( 2025-09-07T08:02:36.4821165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4821228Z return func(*args, **kwargs) 2025-09-07T08:02:36.4821493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 389, in forward 2025-09-07T08:02:36.4821658Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:02:36.4821661Z 2025-09-07T08:02:36.4821754Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4821944Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4822002Z return mod(**inputs) 2025-09-07T08:02:36.4822272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4822335Z outputs = self.roberta( 2025-09-07T08:02:36.4822601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4822707Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4822975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4823040Z layer_outputs = layer_module( 2025-09-07T08:02:36.4823258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4823355Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4823627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 540, in forward 2025-09-07T08:02:36.4823730Z self_attention_outputs = self.attention( 2025-09-07T08:02:36.4823972Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/utils/deprecation.py", line 172, in wrapped_func 2025-09-07T08:02:36.4824036Z return func(*args, **kwargs) 2025-09-07T08:02:36.4824302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 477, in forward 2025-09-07T08:02:36.4824426Z attention_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:02:36.4824693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 413, in forward 2025-09-07T08:02:36.4824772Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4824777Z 2025-09-07T08:02:36.4824868Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4825056Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4825118Z return mod(**inputs) 2025-09-07T08:02:36.4825389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4825456Z outputs = self.roberta( 2025-09-07T08:02:36.4825767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4825833Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4826100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4826166Z layer_outputs = layer_module( 2025-09-07T08:02:36.4826383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4826451Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4826725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4826801Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4827059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4827139Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4827441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4827556Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4827868Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 493, in forward 2025-09-07T08:02:36.4827947Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4827950Z 2025-09-07T08:02:36.4828044Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4828229Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4828291Z return mod(**inputs) 2025-09-07T08:02:36.4828561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4828663Z outputs = self.roberta( 2025-09-07T08:02:36.4828935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4828998Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4829271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4829367Z layer_outputs = layer_module( 2025-09-07T08:02:36.4829587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4829656Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4829955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4830036Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4830291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4830363Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4830666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 578, in feed_forward_chunk 2025-09-07T08:02:36.4830778Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:02:36.4831046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 494, in forward 2025-09-07T08:02:36.4831149Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:02:36.4831364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:02:36.4831425Z return self.act(input) 2025-09-07T08:02:36.4831429Z 2025-09-07T08:02:36.4831525Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4831714Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4831777Z return mod(**inputs) 2025-09-07T08:02:36.4832051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1038, in forward 2025-09-07T08:02:36.4832114Z outputs = self.roberta( 2025-09-07T08:02:36.4832387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 950, in forward 2025-09-07T08:02:36.4832451Z encoder_outputs = self.encoder( 2025-09-07T08:02:36.4832724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 632, in forward 2025-09-07T08:02:36.4832786Z layer_outputs = layer_module( 2025-09-07T08:02:36.4833002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:02:36.4833075Z return super().__call__(*args, **kwargs) 2025-09-07T08:02:36.4833342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 570, in forward 2025-09-07T08:02:36.4833419Z layer_output = apply_chunking_to_forward( 2025-09-07T08:02:36.4833673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:02:36.4833782Z return forward_fn(*input_tensors) 2025-09-07T08:02:36.4834086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 579, in feed_forward_chunk 2025-09-07T08:02:36.4834211Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:02:36.4834487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 507, in forward 2025-09-07T08:02:36.4834600Z hidden_states = self.dense(hidden_states) 2025-09-07T08:02:36.4834603Z 2025-09-07T08:02:36.4834701Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4834888Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4834946Z return mod(**inputs) 2025-09-07T08:02:36.4835224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1052, in forward 2025-09-07T08:02:36.4835365Z prediction_scores = self.lm_head(sequence_output) 2025-09-07T08:02:36.4835645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 756, in forward 2025-09-07T08:02:36.4835712Z x = self.dense(features) 2025-09-07T08:02:36.4835746Z 2025-09-07T08:02:36.4835840Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4836034Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4836096Z return mod(**inputs) 2025-09-07T08:02:36.4836375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1052, in forward 2025-09-07T08:02:36.4836462Z prediction_scores = self.lm_head(sequence_output) 2025-09-07T08:02:36.4836740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 761, in forward 2025-09-07T08:02:36.4836804Z x = self.decoder(x) 2025-09-07T08:02:36.4836809Z 2025-09-07T08:02:36.4836899Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:02:36.4837090Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:02:36.4837147Z return mod(**inputs) 2025-09-07T08:02:36.4837423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/camembert/modeling_camembert.py", line 1059, in forward 2025-09-07T08:02:36.4837604Z masked_lm_loss = loss_fct(prediction_scores.view(-1, self.config.vocab_size), labels.view(-1)) 2025-09-07T08:02:36.4837607Z 2025-09-07T08:02:42.8469012Z pass 2025-09-07T08:02:42.8469408Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:02:45.7660752Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:02:45.7661625Z import pynvml # type: ignore[import] 2025-09-07T08:02:48.4365642Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:02:48.4366580Z from pkg_resources import resource_filename 2025-09-07T08:02:49.0639514Z 2025-09-07T08:03:00.0292563Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:03:00.0293145Z loading model: 0it [00:10, ?it/s] 2025-09-07T08:03:00.1031565Z cpu eval DebertaV2ForMaskedLM 2025-09-07T08:03:00.3421997Z pass_due_to_skip 2025-09-07T08:03:00.3425737Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:03:02.5904986Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:03:02.5905859Z import pynvml # type: ignore[import] 2025-09-07T08:03:05.2796952Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:03:05.2798276Z from pkg_resources import resource_filename 2025-09-07T08:03:05.9335640Z 2025-09-07T08:03:15.4731733Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:03:15.4732352Z loading model: 0it [00:09, ?it/s] 2025-09-07T08:03:15.5390648Z cpu eval DebertaV2ForQuestionAnswering 2025-09-07T08:03:17.8306633Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:03:18.4695220Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:03:19.1080937Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:03:32.3628891Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3629348Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3629730Z return mod(**inputs) 2025-09-07T08:03:32.3630161Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3630594Z outputs = self.deberta( 2025-09-07T08:03:32.3631003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3631431Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3631853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3632293Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3632700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3633082Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3633510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3633946Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3634371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3634828Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3635244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.3635768Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.3636015Z 2025-09-07T08:03:32.3636133Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3636496Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3636828Z return mod(**inputs) 2025-09-07T08:03:32.3637222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3637642Z outputs = self.deberta( 2025-09-07T08:03:32.3638090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3638855Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3639258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3639682Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3640059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3640415Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3640822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3641419Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3641839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3642249Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3642738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.3643264Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3643505Z 2025-09-07T08:03:32.3643619Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3644056Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3644390Z return mod(**inputs) 2025-09-07T08:03:32.3644786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3645192Z outputs = self.deberta( 2025-09-07T08:03:32.3645583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3645998Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3646397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3646908Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3647295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3647662Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3648061Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3648486Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3648903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3649309Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3649722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.3650246Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.3650845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.3651363Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.3651553Z 2025-09-07T08:03:32.3651666Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3652030Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3652355Z return mod(**inputs) 2025-09-07T08:03:32.3652747Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3653213Z outputs = self.deberta( 2025-09-07T08:03:32.3663404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3663892Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3664332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3664762Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3665145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3665589Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3666082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3666519Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3666945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3667406Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3667819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.3668420Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.3668700Z 2025-09-07T08:03:32.3668816Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3669203Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3669534Z return mod(**inputs) 2025-09-07T08:03:32.3669945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3670361Z outputs = self.deberta( 2025-09-07T08:03:32.3670748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3671170Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3671606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3672034Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3672412Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3672783Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3673197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3673634Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3674055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3674472Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3674865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.3675408Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.3675692Z 2025-09-07T08:03:32.3675801Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3676174Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3676505Z return mod(**inputs) 2025-09-07T08:03:32.3676892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3677299Z outputs = self.deberta( 2025-09-07T08:03:32.3677685Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3678154Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3678810Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3679242Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3679611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3679974Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3680428Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3680859Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3681280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3681715Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3682172Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.3682720Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3682992Z 2025-09-07T08:03:32.3683131Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3683505Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3683841Z return mod(**inputs) 2025-09-07T08:03:32.3684242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3684656Z outputs = self.deberta( 2025-09-07T08:03:32.3685039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3685457Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3685847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3686275Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3686644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3687013Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3687426Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3687852Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3688294Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3688702Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3689119Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.3689648Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3690206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.3690720Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.3690914Z 2025-09-07T08:03:32.3691016Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3691388Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3691710Z return mod(**inputs) 2025-09-07T08:03:32.3692100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3692560Z outputs = self.deberta( 2025-09-07T08:03:32.3692949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3693361Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3693750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3694170Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3694535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3694941Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3695363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3695778Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3696212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3696650Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3697069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.3697483Z context_layer = torch.bmm( 2025-09-07T08:03:32.3697631Z 2025-09-07T08:03:32.3697733Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3698089Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3698421Z return mod(**inputs) 2025-09-07T08:03:32.3698799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3699208Z outputs = self.deberta( 2025-09-07T08:03:32.3699583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3700000Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3700406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3700821Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3701178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3701539Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3701942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3702368Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3702787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3703184Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3703589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.3704116Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.3704361Z 2025-09-07T08:03:32.3704467Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3704825Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3705149Z return mod(**inputs) 2025-09-07T08:03:32.3705567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3706031Z outputs = self.deberta( 2025-09-07T08:03:32.3706416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3706889Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3707283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3707698Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3708064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3708421Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3708830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3709296Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3709899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.3710367Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.3710952Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.3711376Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3711521Z 2025-09-07T08:03:32.3711620Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3712068Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3712415Z return mod(**inputs) 2025-09-07T08:03:32.3712804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3713230Z outputs = self.deberta( 2025-09-07T08:03:32.3713607Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3714038Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3714446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3714866Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3715243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3715604Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3716019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.3716466Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.3716929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.3717340Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3717484Z 2025-09-07T08:03:32.3717585Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3717936Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3718282Z return mod(**inputs) 2025-09-07T08:03:32.3718666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3719068Z outputs = self.deberta( 2025-09-07T08:03:32.3719443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3719881Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3720266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3720676Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3721039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3721514Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3721915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.3722362Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.3722796Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.3723231Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.3723679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.3724017Z return self.act(input) 2025-09-07T08:03:32.3724123Z 2025-09-07T08:03:32.3724229Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3724581Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3724918Z return mod(**inputs) 2025-09-07T08:03:32.3725334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3725757Z outputs = self.deberta( 2025-09-07T08:03:32.3726180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3726596Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3726996Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3727428Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3727795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3728157Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3728556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.3729031Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.3729517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.3729945Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3730086Z 2025-09-07T08:03:32.3730191Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3730539Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3730867Z return mod(**inputs) 2025-09-07T08:03:32.3731254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3731656Z outputs = self.deberta( 2025-09-07T08:03:32.3732043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3732443Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3732840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3733255Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3733619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3733969Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3734380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3734806Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3735244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3735720Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3736122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.3736646Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.3736901Z 2025-09-07T08:03:32.3737003Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3737363Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3737742Z return mod(**inputs) 2025-09-07T08:03:32.3738118Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3738527Z outputs = self.deberta( 2025-09-07T08:03:32.3738905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3739310Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3739738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3740154Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3740555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3740921Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3741326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3741746Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3742160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3742566Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3742966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.3743477Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3743713Z 2025-09-07T08:03:32.3743831Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3744184Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3744505Z return mod(**inputs) 2025-09-07T08:03:32.3744886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3745290Z outputs = self.deberta( 2025-09-07T08:03:32.3745718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3746137Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3746535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3746947Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3747304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3747653Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3748052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3748468Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3748886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3749289Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3749740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.3750258Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.3750814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.3751311Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.3751495Z 2025-09-07T08:03:32.3751599Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3751985Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3752311Z return mod(**inputs) 2025-09-07T08:03:32.3752699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3753105Z outputs = self.deberta( 2025-09-07T08:03:32.3753507Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3753914Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3754307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3754753Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3755114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3755471Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3755871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3756284Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3756702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3757106Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3757498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.3758049Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.3758317Z 2025-09-07T08:03:32.3758413Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3758763Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3759083Z return mod(**inputs) 2025-09-07T08:03:32.3759454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3759854Z outputs = self.deberta( 2025-09-07T08:03:32.3760228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3760635Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3761016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3761433Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3761789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3762147Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3762546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3762955Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3763370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3763818Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3764222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.3764751Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.3765010Z 2025-09-07T08:03:32.3765111Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3765466Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3765825Z return mod(**inputs) 2025-09-07T08:03:32.3766207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3766608Z outputs = self.deberta( 2025-09-07T08:03:32.3766978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3767386Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3767829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3768253Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3768641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3769001Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3769404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3769824Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3770238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3770638Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3771036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.3771558Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3771804Z 2025-09-07T08:03:32.3771912Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3772261Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3772576Z return mod(**inputs) 2025-09-07T08:03:32.3772966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3773378Z outputs = self.deberta( 2025-09-07T08:03:32.3773768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3774176Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3774573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3774988Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3775360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3775722Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3776120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3776546Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3776963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3777369Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3777837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.3778370Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3778938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.3779435Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.3779628Z 2025-09-07T08:03:32.3779766Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3780130Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3780452Z return mod(**inputs) 2025-09-07T08:03:32.3780839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3781248Z outputs = self.deberta( 2025-09-07T08:03:32.3781670Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3782084Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3782505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3782931Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3783292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3783651Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3784051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3784468Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3784891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3785297Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3785738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.3786138Z context_layer = torch.bmm( 2025-09-07T08:03:32.3786262Z 2025-09-07T08:03:32.3786362Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3786717Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3787042Z return mod(**inputs) 2025-09-07T08:03:32.3787515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3787919Z outputs = self.deberta( 2025-09-07T08:03:32.3788301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3788711Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3789107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3789526Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3789879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3790239Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3790641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3791062Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3791472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3791931Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3792336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.3792856Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.3793097Z 2025-09-07T08:03:32.3793203Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3793546Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3793910Z return mod(**inputs) 2025-09-07T08:03:32.3794287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3794689Z outputs = self.deberta( 2025-09-07T08:03:32.3795070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3795468Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3795896Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3796317Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3797732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3798123Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3798527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3798958Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3799377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.3799824Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.3800275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.3800684Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3800830Z 2025-09-07T08:03:32.3800931Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3801285Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3801613Z return mod(**inputs) 2025-09-07T08:03:32.3801991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3802399Z outputs = self.deberta( 2025-09-07T08:03:32.3802779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3803181Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3803574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3803980Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3804341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3804696Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3805096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.3805543Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.3805980Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.3806392Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3806529Z 2025-09-07T08:03:32.3806670Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3807020Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3807333Z return mod(**inputs) 2025-09-07T08:03:32.3807713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3808116Z outputs = self.deberta( 2025-09-07T08:03:32.3808509Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3808953Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3809337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3809898Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3810259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3810620Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3811098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.3811547Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.3812045Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.3812491Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.3812874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.3813214Z return self.act(input) 2025-09-07T08:03:32.3813323Z 2025-09-07T08:03:32.3813424Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3813777Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3814101Z return mod(**inputs) 2025-09-07T08:03:32.3814484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3814882Z outputs = self.deberta( 2025-09-07T08:03:32.3815261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3815663Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3816054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3816465Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3816816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3817170Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3817569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.3818029Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.3818488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.3818900Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3819043Z 2025-09-07T08:03:32.3819139Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3819490Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3819816Z return mod(**inputs) 2025-09-07T08:03:32.3820184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3820586Z outputs = self.deberta( 2025-09-07T08:03:32.3821017Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3821426Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3821823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3822228Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3822583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3822935Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3823398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3823820Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3824230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3824642Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3825075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.3825604Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.3825905Z 2025-09-07T08:03:32.3826046Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3826398Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3826725Z return mod(**inputs) 2025-09-07T08:03:32.3827098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3827499Z outputs = self.deberta( 2025-09-07T08:03:32.3827869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3828278Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3828669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3829084Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3829443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3829796Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3830195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3830614Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3831035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3831442Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3831836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.3832349Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3832589Z 2025-09-07T08:03:32.3832688Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3833039Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3833359Z return mod(**inputs) 2025-09-07T08:03:32.3833727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3834128Z outputs = self.deberta( 2025-09-07T08:03:32.3834505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3834961Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3835351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3835771Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3836127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3836483Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3836879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3837332Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3837749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3838148Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3838550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.3839101Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.3839704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.3840203Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.3840385Z 2025-09-07T08:03:32.3840479Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3840827Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3841137Z return mod(**inputs) 2025-09-07T08:03:32.3841502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3841903Z outputs = self.deberta( 2025-09-07T08:03:32.3842274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3842688Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3843077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3843491Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3843843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3844193Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3844583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3844991Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3845409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3845878Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3846299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.3846868Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.3847134Z 2025-09-07T08:03:32.3847241Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3847591Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3847906Z return mod(**inputs) 2025-09-07T08:03:32.3848274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3848668Z outputs = self.deberta( 2025-09-07T08:03:32.3849081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3849484Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3849885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3850313Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3850708Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3851061Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3851512Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3851922Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3852329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3852723Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3853152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.3853689Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.3853981Z 2025-09-07T08:03:32.3854080Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3854427Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3854742Z return mod(**inputs) 2025-09-07T08:03:32.3855124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3855538Z outputs = self.deberta( 2025-09-07T08:03:32.3855918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3856326Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3856714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3857124Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3857481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3857834Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3858237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3858656Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3859076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3859481Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3859885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.3860407Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3860659Z 2025-09-07T08:03:32.3860759Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3861107Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3861429Z return mod(**inputs) 2025-09-07T08:03:32.3861801Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3862196Z outputs = self.deberta( 2025-09-07T08:03:32.3862576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3863024Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3863419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3863833Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3864186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3864538Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3864937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3865396Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3865860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3866257Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3866692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.3867218Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3867804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.3868307Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.3868488Z 2025-09-07T08:03:32.3868589Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3868947Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3869266Z return mod(**inputs) 2025-09-07T08:03:32.3869649Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3870053Z outputs = self.deberta( 2025-09-07T08:03:32.3870429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3870831Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3871230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3871641Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3871989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3872347Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3872749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3873171Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3873594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3873989Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3874388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.3874793Z context_layer = torch.bmm( 2025-09-07T08:03:32.3874910Z 2025-09-07T08:03:32.3875014Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3875363Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3875682Z return mod(**inputs) 2025-09-07T08:03:32.3876059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3876463Z outputs = self.deberta( 2025-09-07T08:03:32.3876836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3877318Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3877712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3878124Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3878481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3878837Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3879265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3879680Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3880094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3880503Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3880930Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.3881451Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.3881696Z 2025-09-07T08:03:32.3881827Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3882181Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3882504Z return mod(**inputs) 2025-09-07T08:03:32.3882881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3883279Z outputs = self.deberta( 2025-09-07T08:03:32.3883655Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3884060Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3884447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3884849Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3885213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3885577Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3885978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3886398Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3886805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.3887253Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.3887697Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.3888109Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3888244Z 2025-09-07T08:03:32.3888350Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3888694Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3889015Z return mod(**inputs) 2025-09-07T08:03:32.3889389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3889789Z outputs = self.deberta( 2025-09-07T08:03:32.3890157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3890578Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3891016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3891432Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3891786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3892134Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3892535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.3893026Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.3893473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.3893885Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3894020Z 2025-09-07T08:03:32.3894120Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3894500Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3894825Z return mod(**inputs) 2025-09-07T08:03:32.3895201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3895634Z outputs = self.deberta( 2025-09-07T08:03:32.3896007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3896411Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3896806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3897221Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3897571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3897928Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3898330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.3898775Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.3899217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.3899644Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.3900023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.3900361Z return self.act(input) 2025-09-07T08:03:32.3900467Z 2025-09-07T08:03:32.3900569Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3900911Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3901229Z return mod(**inputs) 2025-09-07T08:03:32.3901602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3902008Z outputs = self.deberta( 2025-09-07T08:03:32.3902390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3902786Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3903176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3903593Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3903948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3904299Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3904736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.3905198Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.3905712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.3906131Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3906263Z 2025-09-07T08:03:32.3906366Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3906702Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3907064Z return mod(**inputs) 2025-09-07T08:03:32.3907441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3907845Z outputs = self.deberta( 2025-09-07T08:03:32.3908227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3908656Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3909049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3909454Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3910000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3910357Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3910776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3911195Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3911616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3912021Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3912417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.3912938Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.3913187Z 2025-09-07T08:03:32.3913289Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3913639Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3913961Z return mod(**inputs) 2025-09-07T08:03:32.3914328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3914727Z outputs = self.deberta( 2025-09-07T08:03:32.3915106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3915512Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3915904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3916311Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3916669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3917027Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3917425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3917842Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3918257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3918724Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3919130Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.3919639Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3919874Z 2025-09-07T08:03:32.3919973Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3920327Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3920645Z return mod(**inputs) 2025-09-07T08:03:32.3921076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3921479Z outputs = self.deberta( 2025-09-07T08:03:32.3921848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3922249Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3922689Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3923110Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3923518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3923872Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3924276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3924703Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3925116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3925513Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3925918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.3926438Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.3926997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.3927503Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.3927688Z 2025-09-07T08:03:32.3927792Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3928141Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3928466Z return mod(**inputs) 2025-09-07T08:03:32.3928841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3929244Z outputs = self.deberta( 2025-09-07T08:03:32.3929613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3930016Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3930413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3930825Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3931182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3931533Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3931935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3932353Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3932839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3933246Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3933639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.3934179Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.3934450Z 2025-09-07T08:03:32.3934551Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3934959Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3935290Z return mod(**inputs) 2025-09-07T08:03:32.3935677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3936088Z outputs = self.deberta( 2025-09-07T08:03:32.3936479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3949134Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3949584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3950060Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3950434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3950795Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3951201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3951624Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3952040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3952444Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3952847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.3953385Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.3953653Z 2025-09-07T08:03:32.3953759Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3954120Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3954443Z return mod(**inputs) 2025-09-07T08:03:32.3954835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3955252Z outputs = self.deberta( 2025-09-07T08:03:32.3955636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3956040Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3956431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3956842Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3957200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3957558Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3957955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3958394Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3958837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3959310Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3959745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.3960298Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3960548Z 2025-09-07T08:03:32.3960668Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3961042Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3961448Z return mod(**inputs) 2025-09-07T08:03:32.3961857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3962272Z outputs = self.deberta( 2025-09-07T08:03:32.3962656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3963058Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3963504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3963927Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3964333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3964701Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3965112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3965536Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3965953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3966354Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3966754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.3967293Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.3967872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.3968379Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.3968565Z 2025-09-07T08:03:32.3968674Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3969057Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3969382Z return mod(**inputs) 2025-09-07T08:03:32.3969770Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3970179Z outputs = self.deberta( 2025-09-07T08:03:32.3970566Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3970972Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3971365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3971774Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3972144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3972513Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3972915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3973346Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3973805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3974210Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3974618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.3975011Z context_layer = torch.bmm( 2025-09-07T08:03:32.3975130Z 2025-09-07T08:03:32.3975237Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3975591Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3975965Z return mod(**inputs) 2025-09-07T08:03:32.3976362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3976759Z outputs = self.deberta( 2025-09-07T08:03:32.3977148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3977584Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3977976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3978383Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3978808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3979168Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3979569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3980029Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3980441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.3980845Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.3981249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.3981792Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.3982042Z 2025-09-07T08:03:32.3982146Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3982516Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3982834Z return mod(**inputs) 2025-09-07T08:03:32.3983223Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3983635Z outputs = self.deberta( 2025-09-07T08:03:32.3984021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3984417Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3984807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3985225Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3985586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3986009Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3986416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.3986844Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.3987275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.3987720Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.3988211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.3988618Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3988769Z 2025-09-07T08:03:32.3988868Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3989223Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3989559Z return mod(**inputs) 2025-09-07T08:03:32.3989934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3990374Z outputs = self.deberta( 2025-09-07T08:03:32.3990759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3991165Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3991843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3992274Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3992630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3993023Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3993434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.3993872Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.3994331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.3994736Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.3994884Z 2025-09-07T08:03:32.3994985Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.3995345Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.3995656Z return mod(**inputs) 2025-09-07T08:03:32.3996024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.3996425Z outputs = self.deberta( 2025-09-07T08:03:32.3996832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.3997227Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.3997614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.3998023Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.3998382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.3998736Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.3999129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.3999599Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4000085Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4000549Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4000953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4001288Z return self.act(input) 2025-09-07T08:03:32.4001399Z 2025-09-07T08:03:32.4001520Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4001878Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4002267Z return mod(**inputs) 2025-09-07T08:03:32.4002669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4003088Z outputs = self.deberta( 2025-09-07T08:03:32.4003467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4003869Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4004263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4004717Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4005073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4005448Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4005855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4006359Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4006815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4007259Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4007412Z 2025-09-07T08:03:32.4007508Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4007851Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4008179Z return mod(**inputs) 2025-09-07T08:03:32.4008577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4008980Z outputs = self.deberta( 2025-09-07T08:03:32.4009386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4009988Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4010404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4010817Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4011202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4011557Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4011969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4012409Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4012819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4013234Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4013629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4014170Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4014416Z 2025-09-07T08:03:32.4014519Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4014894Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4015238Z return mod(**inputs) 2025-09-07T08:03:32.4015618Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4016038Z outputs = self.deberta( 2025-09-07T08:03:32.4016413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4016921Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4017321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4017747Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4018119Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4018473Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4018890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4019382Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4019800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4020234Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4020687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4021196Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4021439Z 2025-09-07T08:03:32.4021600Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4021968Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4022293Z return mod(**inputs) 2025-09-07T08:03:32.4022685Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4023083Z outputs = self.deberta( 2025-09-07T08:03:32.4023451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4023854Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4024240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4024640Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4024994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4025351Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4025802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4026224Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4026633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4027031Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4027424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4027933Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4028486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4028973Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4029156Z 2025-09-07T08:03:32.4029251Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4029597Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4029911Z return mod(**inputs) 2025-09-07T08:03:32.4030279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4030722Z outputs = self.deberta( 2025-09-07T08:03:32.4031091Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4031482Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4031864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4032275Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4032627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4033030Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4033435Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4033856Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4034266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4034709Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4035111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4035694Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4035972Z 2025-09-07T08:03:32.4036082Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4036435Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4036760Z return mod(**inputs) 2025-09-07T08:03:32.4037141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4037551Z outputs = self.deberta( 2025-09-07T08:03:32.4037935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4038336Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4038729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4039143Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4039505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4039869Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4040260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4040678Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4041093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4041501Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4041894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4042429Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4042700Z 2025-09-07T08:03:32.4042798Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4043153Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4043476Z return mod(**inputs) 2025-09-07T08:03:32.4043848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4044248Z outputs = self.deberta( 2025-09-07T08:03:32.4044623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4045077Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4045477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4045881Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4046243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4046602Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4047052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4047473Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4047885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4048294Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4048727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4049257Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4049504Z 2025-09-07T08:03:32.4049641Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4049986Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4050308Z return mod(**inputs) 2025-09-07T08:03:32.4050690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4051098Z outputs = self.deberta( 2025-09-07T08:03:32.4051471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4051880Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4052274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4052699Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4053058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4053408Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4053814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4054232Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4054646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4055048Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4055441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4055961Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4056520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4057019Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4057202Z 2025-09-07T08:03:32.4057305Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4057645Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4057961Z return mod(**inputs) 2025-09-07T08:03:32.4058337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4058816Z outputs = self.deberta( 2025-09-07T08:03:32.4059186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4059595Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4059991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4060405Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4060771Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4061160Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4061561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4061978Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4062431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4062843Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4063254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4063692Z context_layer = torch.bmm( 2025-09-07T08:03:32.4063816Z 2025-09-07T08:03:32.4063914Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4064107Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4064182Z return mod(**inputs) 2025-09-07T08:03:32.4064458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4064531Z outputs = self.deberta( 2025-09-07T08:03:32.4064799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4064870Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4065149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4065229Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4065456Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4065530Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4065847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4065939Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4066211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4066293Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4066561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4066754Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4066758Z 2025-09-07T08:03:32.4066854Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4067046Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4067118Z return mod(**inputs) 2025-09-07T08:03:32.4067394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4067462Z outputs = self.deberta( 2025-09-07T08:03:32.4067729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4067844Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4068118Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4068195Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4068418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4068487Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4068764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4068881Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4069151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4069271Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4069578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4069670Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4069673Z 2025-09-07T08:03:32.4069769Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4070001Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4070064Z return mod(**inputs) 2025-09-07T08:03:32.4070338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4070417Z outputs = self.deberta( 2025-09-07T08:03:32.4070683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4070757Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4071030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4071110Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4071332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4071405Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4071680Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4071793Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4072069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4072146Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4072150Z 2025-09-07T08:03:32.4072245Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4072444Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4072506Z return mod(**inputs) 2025-09-07T08:03:32.4072789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4072854Z outputs = self.deberta( 2025-09-07T08:03:32.4073121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4073198Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4073465Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4073547Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4073759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4073863Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4074143Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4074252Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4074537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4074644Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4074932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4074998Z return self.act(input) 2025-09-07T08:03:32.4075001Z 2025-09-07T08:03:32.4075096Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4075293Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4075356Z return mod(**inputs) 2025-09-07T08:03:32.4075666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4075730Z outputs = self.deberta( 2025-09-07T08:03:32.4076036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4076114Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4076386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4076474Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4076688Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4076766Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4077034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4077167Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4077445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4077524Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4077528Z 2025-09-07T08:03:32.4077632Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4077817Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4077881Z return mod(**inputs) 2025-09-07T08:03:32.4078158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4078220Z outputs = self.deberta( 2025-09-07T08:03:32.4078498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4078567Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4078841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4078920Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4079136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4079216Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4079484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4079576Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4079845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4079970Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4080250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4080436Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4080440Z 2025-09-07T08:03:32.4080542Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4080732Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4080839Z return mod(**inputs) 2025-09-07T08:03:32.4081113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4081177Z outputs = self.deberta( 2025-09-07T08:03:32.4081453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4081522Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4081830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4081907Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4082209Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4082289Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4082563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4082659Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4082931Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4083013Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4083282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4083461Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4083466Z 2025-09-07T08:03:32.4083577Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4083767Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4083837Z return mod(**inputs) 2025-09-07T08:03:32.4084111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4084175Z outputs = self.deberta( 2025-09-07T08:03:32.4084448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4084518Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4084793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4084871Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4085094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4085164Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4085430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4085524Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4085789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4085868Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4086180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4086375Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4086698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4086821Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4086825Z 2025-09-07T08:03:32.4086930Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4087153Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4087224Z return mod(**inputs) 2025-09-07T08:03:32.4087498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4087564Z outputs = self.deberta( 2025-09-07T08:03:32.4087872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4087940Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4088251Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4088328Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4088544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4088625Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4088894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4088986Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4089256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4089333Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4089600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4089809Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4089813Z 2025-09-07T08:03:32.4089912Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4090100Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4090169Z return mod(**inputs) 2025-09-07T08:03:32.4090441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4090511Z outputs = self.deberta( 2025-09-07T08:03:32.4090789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4090860Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4091132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4091207Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4091423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4091496Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4091762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4091848Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4092111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4092224Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4092494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4092694Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4092697Z 2025-09-07T08:03:32.4092794Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4092979Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4093097Z return mod(**inputs) 2025-09-07T08:03:32.4093370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4093435Z outputs = self.deberta( 2025-09-07T08:03:32.4093702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4093803Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4094080Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4094157Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4094404Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4094473Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4094748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4094829Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4095096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4095173Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4095440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4095628Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4095632Z 2025-09-07T08:03:32.4095723Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4095909Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4095971Z return mod(**inputs) 2025-09-07T08:03:32.4096241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4096306Z outputs = self.deberta( 2025-09-07T08:03:32.4096575Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4096651Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4096921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4096996Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4097215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4097282Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4097552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4097635Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4097906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4097982Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4098296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4098481Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4098788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4098916Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4098919Z 2025-09-07T08:03:32.4099046Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4099234Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4099298Z return mod(**inputs) 2025-09-07T08:03:32.4099568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4099632Z outputs = self.deberta( 2025-09-07T08:03:32.4099933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4100001Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4100329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4100403Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4100622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4100694Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4100961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4101043Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4101313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4101389Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4101657Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4101728Z context_layer = torch.bmm( 2025-09-07T08:03:32.4101731Z 2025-09-07T08:03:32.4101822Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4102006Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4102076Z return mod(**inputs) 2025-09-07T08:03:32.4102349Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4102418Z outputs = self.deberta( 2025-09-07T08:03:32.4102683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4102756Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4103024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4103099Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4103318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4103386Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4103664Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4103745Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4104011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4104149Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4104430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4104617Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4104620Z 2025-09-07T08:03:32.4104712Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4104902Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4104995Z return mod(**inputs) 2025-09-07T08:03:32.4105268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4105333Z outputs = self.deberta( 2025-09-07T08:03:32.4105599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4105723Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4106027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4106102Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4106357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4106426Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4106699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4106781Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4107048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4107159Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4107431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4107513Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4107517Z 2025-09-07T08:03:32.4107609Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4107800Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4107860Z return mod(**inputs) 2025-09-07T08:03:32.4108129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4108194Z outputs = self.deberta( 2025-09-07T08:03:32.4108460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4108537Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4108808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4108888Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4109104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4109176Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4109448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4109559Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4109989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4110067Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4110070Z 2025-09-07T08:03:32.4110230Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4110426Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4110490Z return mod(**inputs) 2025-09-07T08:03:32.4110769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4110833Z outputs = self.deberta( 2025-09-07T08:03:32.4111103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4111222Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4111492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4111572Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4111786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4111860Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4112175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4112284Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4112602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4112707Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4112923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4112988Z return self.act(input) 2025-09-07T08:03:32.4112992Z 2025-09-07T08:03:32.4113089Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4113277Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4113336Z return mod(**inputs) 2025-09-07T08:03:32.4113616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4113676Z outputs = self.deberta( 2025-09-07T08:03:32.4113947Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4114013Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4114278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4114357Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4114567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4114643Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4114908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4115035Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4115308Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4115384Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4115388Z 2025-09-07T08:03:32.4115483Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4115670Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4115733Z return mod(**inputs) 2025-09-07T08:03:32.4116002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4116066Z outputs = self.deberta( 2025-09-07T08:03:32.4116379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4116448Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4116721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4116801Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4117024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4117101Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4117405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4117496Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4117762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4117838Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4118137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4118323Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4118357Z 2025-09-07T08:03:32.4118459Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4118651Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4118717Z return mod(**inputs) 2025-09-07T08:03:32.4118992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4119052Z outputs = self.deberta( 2025-09-07T08:03:32.4119323Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4119392Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4119669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4119748Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4119969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4120039Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4120307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4120395Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4120660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4120738Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4121005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4121177Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4121186Z 2025-09-07T08:03:32.4121281Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4121474Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4121541Z return mod(**inputs) 2025-09-07T08:03:32.4121812Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4121881Z outputs = self.deberta( 2025-09-07T08:03:32.4122149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4122248Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4122522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4122598Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4122817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4122888Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4123154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4123276Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4123544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4123620Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4123889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4124120Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4124463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4124586Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4124589Z 2025-09-07T08:03:32.4124687Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4124878Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4124943Z return mod(**inputs) 2025-09-07T08:03:32.4125215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4125284Z outputs = self.deberta( 2025-09-07T08:03:32.4125558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4125623Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4125896Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4125971Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4126187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4126257Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4126522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4126611Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4126877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4126952Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4127218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4127429Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4127433Z 2025-09-07T08:03:32.4127525Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4127715Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4127779Z return mod(**inputs) 2025-09-07T08:03:32.4128050Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4128113Z outputs = self.deberta( 2025-09-07T08:03:32.4128419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4128486Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4128759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4128835Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4129053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4129153Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4129425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4129506Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4129776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4129853Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4130153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4130380Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4130383Z 2025-09-07T08:03:32.4130474Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4130659Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4130728Z return mod(**inputs) 2025-09-07T08:03:32.4131001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4131066Z outputs = self.deberta( 2025-09-07T08:03:32.4131335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4131407Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4131675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4131749Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4131968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4132035Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4132306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4132388Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4132651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4132724Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4132990Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4133180Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4133184Z 2025-09-07T08:03:32.4133276Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4133465Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4133524Z return mod(**inputs) 2025-09-07T08:03:32.4133793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4133858Z outputs = self.deberta( 2025-09-07T08:03:32.4134122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4134229Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4134502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4134579Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4134798Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4134869Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4135135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4135247Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4135520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4135587Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4135887Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4136083Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4136421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4136545Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4136548Z 2025-09-07T08:03:32.4136640Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4136830Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4136889Z return mod(**inputs) 2025-09-07T08:03:32.4137161Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4137231Z outputs = self.deberta( 2025-09-07T08:03:32.4137500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4137574Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4137840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4137915Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4138132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4138203Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4138472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4138551Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4138823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4138891Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4139158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4139229Z context_layer = torch.bmm( 2025-09-07T08:03:32.4139233Z 2025-09-07T08:03:32.4139322Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4139513Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4139573Z return mod(**inputs) 2025-09-07T08:03:32.4139840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4139909Z outputs = self.deberta( 2025-09-07T08:03:32.4140174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4140283Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4140550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4140625Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4140844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4140912Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4141223Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4141304Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4141572Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4141640Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4141939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4142130Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4142133Z 2025-09-07T08:03:32.4142253Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4142449Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4142510Z return mod(**inputs) 2025-09-07T08:03:32.4142780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4142844Z outputs = self.deberta( 2025-09-07T08:03:32.4143110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4143182Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4143454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4143530Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4143745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4143815Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4144086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4144168Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4144437Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4144548Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4144822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4144904Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4144908Z 2025-09-07T08:03:32.4145000Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4145195Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4145252Z return mod(**inputs) 2025-09-07T08:03:32.4145523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4145584Z outputs = self.deberta( 2025-09-07T08:03:32.4145905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4145978Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4146285Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4146369Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4146584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4146654Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4146923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4147079Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4147357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4147431Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4147434Z 2025-09-07T08:03:32.4147532Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4147749Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4147807Z return mod(**inputs) 2025-09-07T08:03:32.4148085Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4148180Z outputs = self.deberta( 2025-09-07T08:03:32.4148454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4148521Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4148789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4148868Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4149078Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4149157Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4149425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4149535Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4149805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4149912Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4150126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4150191Z return self.act(input) 2025-09-07T08:03:32.4150194Z 2025-09-07T08:03:32.4150286Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4150472Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4150532Z return mod(**inputs) 2025-09-07T08:03:32.4150806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4150865Z outputs = self.deberta( 2025-09-07T08:03:32.4151138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4151202Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4151480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4151563Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4151792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4151869Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4152176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4152309Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4152576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4152659Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4152662Z 2025-09-07T08:03:32.4152761Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4152992Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4153060Z return mod(**inputs) 2025-09-07T08:03:32.4153334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4153396Z outputs = self.deberta( 2025-09-07T08:03:32.4153671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4153769Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4154045Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4154151Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4154375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4154446Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4154717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4154807Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4155075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4155153Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4155420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4155606Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4155615Z 2025-09-07T08:03:32.4155709Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4155901Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4155964Z return mod(**inputs) 2025-09-07T08:03:32.4156234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4156299Z outputs = self.deberta( 2025-09-07T08:03:32.4156566Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4156635Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4156911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4156987Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4157202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4157273Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4157542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4157629Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4157894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4158005Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4158276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4158452Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4158456Z 2025-09-07T08:03:32.4158549Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4158737Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4158802Z return mod(**inputs) 2025-09-07T08:03:32.4159109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4159177Z outputs = self.deberta( 2025-09-07T08:03:32.4159443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4159510Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4159814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4159891Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4160142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4160212Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4160485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4160571Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4160840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4160915Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4161183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4161364Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4161673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4161799Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4161803Z 2025-09-07T08:03:32.4161895Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4162084Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4162148Z return mod(**inputs) 2025-09-07T08:03:32.4162420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4162489Z outputs = self.deberta( 2025-09-07T08:03:32.4162755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4162822Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4163096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4163170Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4163392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4163463Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4163736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4163819Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4164126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4164204Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4164473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4164688Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4164691Z 2025-09-07T08:03:32.4164782Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4165003Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4165070Z return mod(**inputs) 2025-09-07T08:03:32.4165343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4165411Z outputs = self.deberta( 2025-09-07T08:03:32.4165713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4165790Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4166059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4166166Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4166387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4166460Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4166732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4166812Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4167081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4167155Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4167423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4167623Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4167626Z 2025-09-07T08:03:32.4167719Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4167909Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4167971Z return mod(**inputs) 2025-09-07T08:03:32.4168250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4168332Z outputs = self.deberta( 2025-09-07T08:03:32.4168599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4168675Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4168940Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4169016Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4169237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4169307Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4169579Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4169660Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4169932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4170052Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4170323Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4170512Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4170516Z 2025-09-07T08:03:32.4170616Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4170811Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4170908Z return mod(**inputs) 2025-09-07T08:03:32.4171180Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4171248Z outputs = self.deberta( 2025-09-07T08:03:32.4171518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4171592Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4171888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4171969Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4172216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4172285Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4172561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4172644Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4172917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4172984Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4173254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4173441Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4173749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4173873Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4173879Z 2025-09-07T08:03:32.4173970Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4174163Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4174223Z return mod(**inputs) 2025-09-07T08:03:32.4174494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4174562Z outputs = self.deberta( 2025-09-07T08:03:32.4174829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4174900Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4175165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4175240Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4175464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4175535Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4175809Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4175890Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4176204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4176272Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4176538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4176614Z context_layer = torch.bmm( 2025-09-07T08:03:32.4176618Z 2025-09-07T08:03:32.4176708Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4176899Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4176993Z return mod(**inputs) 2025-09-07T08:03:32.4177265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4177333Z outputs = self.deberta( 2025-09-07T08:03:32.4177600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4177734Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4178004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4178088Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4178333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4178405Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4178679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4178758Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4179033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4179106Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4179372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4179558Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4179562Z 2025-09-07T08:03:32.4179655Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4179849Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4179912Z return mod(**inputs) 2025-09-07T08:03:32.4180187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4180247Z outputs = self.deberta( 2025-09-07T08:03:32.4180515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4180591Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4180856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4180937Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4181152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4181220Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4181494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4181575Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4181847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4181993Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4182268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4182345Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4182348Z 2025-09-07T08:03:32.4182441Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4182636Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4182696Z return mod(**inputs) 2025-09-07T08:03:32.4182971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4183064Z outputs = self.deberta( 2025-09-07T08:03:32.4183334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4183404Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4183707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4183792Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4184007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4184115Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4184385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4184503Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4184776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4184852Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4184855Z 2025-09-07T08:03:32.4184953Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4185142Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4185203Z return mod(**inputs) 2025-09-07T08:03:32.4185479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4185541Z outputs = self.deberta( 2025-09-07T08:03:32.4185852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4185920Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4186192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4186268Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4186500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4186579Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4186849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4186963Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4187233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4187336Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4187551Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4187615Z return self.act(input) 2025-09-07T08:03:32.4187618Z 2025-09-07T08:03:32.4187716Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4187902Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4188006Z return mod(**inputs) 2025-09-07T08:03:32.4188282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4188343Z outputs = self.deberta( 2025-09-07T08:03:32.4188616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4188682Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4188950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4189060Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4189273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4189350Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4189620Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4189780Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4190051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4190177Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4190180Z 2025-09-07T08:03:32.4190273Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4190465Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4190530Z return mod(**inputs) 2025-09-07T08:03:32.4190800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4190866Z outputs = self.deberta( 2025-09-07T08:03:32.4191132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4191199Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4191467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4191543Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4191762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4191830Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4192102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4192191Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4192458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4192535Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4192806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4192990Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4192995Z 2025-09-07T08:03:32.4193088Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4193274Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4193340Z return mod(**inputs) 2025-09-07T08:03:32.4193611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4193678Z outputs = self.deberta( 2025-09-07T08:03:32.4193945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4194046Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4194319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4194394Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4194614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4194683Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4194991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4195071Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4195338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4195418Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4195716Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4195896Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4195899Z 2025-09-07T08:03:32.4196021Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4196215Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4196275Z return mod(**inputs) 2025-09-07T08:03:32.4196548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4196613Z outputs = self.deberta( 2025-09-07T08:03:32.4196878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4196950Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4197217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4197296Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4197514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4197583Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4197857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4197940Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4198208Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4198283Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4198549Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4198738Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4199047Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4199174Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4199178Z 2025-09-07T08:03:32.4199270Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4199458Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4199523Z return mod(**inputs) 2025-09-07T08:03:32.4199798Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4199902Z outputs = self.deberta( 2025-09-07T08:03:32.4200174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4200246Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4200516Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4200594Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4200812Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4200915Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4201189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4201270Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4201538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4201642Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4201915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4202152Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4202156Z 2025-09-07T08:03:32.4202247Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4202441Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4202501Z return mod(**inputs) 2025-09-07T08:03:32.4202774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4202844Z outputs = self.deberta( 2025-09-07T08:03:32.4203114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4203184Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4203451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4203528Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4203748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4203818Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4204088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4204169Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4204440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4204509Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4204779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4204982Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4204985Z 2025-09-07T08:03:32.4205075Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4205265Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4205325Z return mod(**inputs) 2025-09-07T08:03:32.4205595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4205662Z outputs = self.deberta( 2025-09-07T08:03:32.4205930Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4206035Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4206307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4206386Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4206601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4206667Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4206976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4207056Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4207329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4207400Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4207698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4207890Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4207893Z 2025-09-07T08:03:32.4208015Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4208207Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4208268Z return mod(**inputs) 2025-09-07T08:03:32.4208543Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4208605Z outputs = self.deberta( 2025-09-07T08:03:32.4208872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4208943Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4209211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4209288Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4209503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4209570Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4210001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4210093Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4210373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4210444Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4210719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4210908Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4211217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4211347Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4211352Z 2025-09-07T08:03:32.4211450Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4211651Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4211714Z return mod(**inputs) 2025-09-07T08:03:32.4211994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4212134Z outputs = self.deberta( 2025-09-07T08:03:32.4212407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4212481Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4212751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4212835Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4213052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4213181Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4218775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4218890Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4219325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4219410Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4219704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4219836Z context_layer = torch.bmm( 2025-09-07T08:03:32.4219840Z 2025-09-07T08:03:32.4219951Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4220162Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4220234Z return mod(**inputs) 2025-09-07T08:03:32.4220526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4220599Z outputs = self.deberta( 2025-09-07T08:03:32.4220902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4220987Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4221263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4221350Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4221580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4221657Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4221943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4222032Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4222303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4222382Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4222656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4222847Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4222851Z 2025-09-07T08:03:32.4222957Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4223167Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4223231Z return mod(**inputs) 2025-09-07T08:03:32.4223518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4223589Z outputs = self.deberta( 2025-09-07T08:03:32.4223858Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4223980Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4224253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4224338Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4224566Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4224640Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4224913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4225052Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4225328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4225447Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4225820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4225908Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4225911Z 2025-09-07T08:03:32.4226006Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4226241Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4226305Z return mod(**inputs) 2025-09-07T08:03:32.4226590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4226663Z outputs = self.deberta( 2025-09-07T08:03:32.4226934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4227007Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4227276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4227358Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4227578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4227652Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4227927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4228043Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4228314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4228390Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4228393Z 2025-09-07T08:03:32.4228489Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4228688Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4228751Z return mod(**inputs) 2025-09-07T08:03:32.4229027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4229088Z outputs = self.deberta( 2025-09-07T08:03:32.4229361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4229428Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4229697Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4229778Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4229992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4230100Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4230370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4230477Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4230749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4230853Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4231100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4231164Z return self.act(input) 2025-09-07T08:03:32.4231167Z 2025-09-07T08:03:32.4231262Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4231453Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4231512Z return mod(**inputs) 2025-09-07T08:03:32.4231821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4231885Z outputs = self.deberta( 2025-09-07T08:03:32.4232189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4232255Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4232523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4232604Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4232816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4232890Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4233157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4233285Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4233561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4233637Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4233641Z 2025-09-07T08:03:32.4233740Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4233930Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4233994Z return mod(**inputs) 2025-09-07T08:03:32.4234264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4234324Z outputs = self.deberta( 2025-09-07T08:03:32.4234597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4234662Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4234933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4235009Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4235222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4235293Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4235559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4235645Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4235912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4236034Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4236303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4236491Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4236496Z 2025-09-07T08:03:32.4236592Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4236778Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4236876Z return mod(**inputs) 2025-09-07T08:03:32.4237150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4237211Z outputs = self.deberta( 2025-09-07T08:03:32.4237485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4237553Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4237860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4237939Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4238190Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4238261Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4238532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4238620Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4238885Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4238962Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4239231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4239404Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4239412Z 2025-09-07T08:03:32.4239505Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4239694Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4239757Z return mod(**inputs) 2025-09-07T08:03:32.4240029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4240096Z outputs = self.deberta( 2025-09-07T08:03:32.4240362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4240429Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4240704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4240778Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4240997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4241064Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4241331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4241419Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4241686Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4241762Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4242067Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4242253Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4242568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4242694Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4242704Z 2025-09-07T08:03:32.4242846Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4243036Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4243103Z return mod(**inputs) 2025-09-07T08:03:32.4243375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4243442Z outputs = self.deberta( 2025-09-07T08:03:32.4243741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4243808Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4244115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4244191Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4244409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4244479Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4244745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4244833Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4245101Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4245175Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4245439Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4245656Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4245660Z 2025-09-07T08:03:32.4245750Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4245941Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4246005Z return mod(**inputs) 2025-09-07T08:03:32.4246278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4246345Z outputs = self.deberta( 2025-09-07T08:03:32.4246612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4246678Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4246949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4247025Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4247243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4247313Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4247584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4247665Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4247932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4248038Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4248305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4248503Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4248506Z 2025-09-07T08:03:32.4248597Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4248783Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4248877Z return mod(**inputs) 2025-09-07T08:03:32.4249149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4249213Z outputs = self.deberta( 2025-09-07T08:03:32.4249479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4249577Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4249846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4249925Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4250175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4250247Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4250521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4250603Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4250865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4250939Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4251209Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4251397Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4251401Z 2025-09-07T08:03:32.4251494Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4251686Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4251747Z return mod(**inputs) 2025-09-07T08:03:32.4252019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4252085Z outputs = self.deberta( 2025-09-07T08:03:32.4252353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4252423Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4252690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4252764Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4252982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4253051Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4253322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4253403Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4253674Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4253776Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4254046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4254233Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4254540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4254664Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4254701Z 2025-09-07T08:03:32.4254795Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4254984Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4255043Z return mod(**inputs) 2025-09-07T08:03:32.4255318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4255383Z outputs = self.deberta( 2025-09-07T08:03:32.4255682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4255751Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4256058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4256135Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4256355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4256426Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4256699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4256780Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4257049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4257122Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4257389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4257462Z context_layer = torch.bmm( 2025-09-07T08:03:32.4257466Z 2025-09-07T08:03:32.4257558Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4257747Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4257806Z return mod(**inputs) 2025-09-07T08:03:32.4258076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4258144Z outputs = self.deberta( 2025-09-07T08:03:32.4258411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4258484Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4258751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4258824Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4259042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4259111Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4259382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4259462Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4259736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4259841Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4260111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4260298Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4260301Z 2025-09-07T08:03:32.4260396Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4260590Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4260681Z return mod(**inputs) 2025-09-07T08:03:32.4260953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4261019Z outputs = self.deberta( 2025-09-07T08:03:32.4261287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4261360Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4261660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4261739Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4261984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4262055Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4262331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4262414Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4262685Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4262795Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4263078Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4263160Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4263164Z 2025-09-07T08:03:32.4263257Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4263455Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4263515Z return mod(**inputs) 2025-09-07T08:03:32.4263790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4263856Z outputs = self.deberta( 2025-09-07T08:03:32.4264124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4264194Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4264467Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4264561Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4264784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4264861Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4265140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4265258Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4265532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4265611Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4265615Z 2025-09-07T08:03:32.4265836Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4266036Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4266096Z return mod(**inputs) 2025-09-07T08:03:32.4266380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4266448Z outputs = self.deberta( 2025-09-07T08:03:32.4266718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4266822Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4267095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4267179Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4267397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4267477Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4267775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4267890Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4268444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4268553Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4268775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4268842Z return self.act(input) 2025-09-07T08:03:32.4268845Z 2025-09-07T08:03:32.4268947Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4269138Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4269201Z return mod(**inputs) 2025-09-07T08:03:32.4269477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4269538Z outputs = self.deberta( 2025-09-07T08:03:32.4269808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4269875Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4270141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4270224Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4270441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4270515Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4270785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4270916Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4271182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4271258Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4271262Z 2025-09-07T08:03:32.4271359Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4271547Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4271609Z return mod(**inputs) 2025-09-07T08:03:32.4271878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4271940Z outputs = self.deberta( 2025-09-07T08:03:32.4272254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4272326Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4272599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4272674Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4272893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4272997Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4273263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4273358Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4273623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4273704Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4274003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4274189Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4274231Z 2025-09-07T08:03:32.4274327Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4274518Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4274582Z return mod(**inputs) 2025-09-07T08:03:32.4274852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4274918Z outputs = self.deberta( 2025-09-07T08:03:32.4275188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4275255Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4275526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4275603Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4275821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4275888Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4276158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4276248Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4276518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4276598Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4276867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4277046Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4277049Z 2025-09-07T08:03:32.4277140Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4277328Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4277390Z return mod(**inputs) 2025-09-07T08:03:32.4277660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4277726Z outputs = self.deberta( 2025-09-07T08:03:32.4277994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4278112Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4278385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4278460Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4278677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4278745Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4279015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4279163Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4279434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4279506Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4279812Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4280013Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4280374Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4280508Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4280512Z 2025-09-07T08:03:32.4280607Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4280802Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4280870Z return mod(**inputs) 2025-09-07T08:03:32.4281144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4281218Z outputs = self.deberta( 2025-09-07T08:03:32.4281490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4281562Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4281836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4281927Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4282143Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4282217Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4282489Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4282573Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4282850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4282922Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4283188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4283408Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4283411Z 2025-09-07T08:03:32.4283505Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4283708Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4283770Z return mod(**inputs) 2025-09-07T08:03:32.4284064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4284126Z outputs = self.deberta( 2025-09-07T08:03:32.4284444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4284516Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4284784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4284875Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4285090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4285192Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4285464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4285548Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4285820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4285891Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4286195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4286445Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4286449Z 2025-09-07T08:03:32.4286544Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4286743Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4286804Z return mod(**inputs) 2025-09-07T08:03:32.4287084Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4287150Z outputs = self.deberta( 2025-09-07T08:03:32.4287418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4287507Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4287774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4287854Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4288072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4288154Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4288422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4288502Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4288773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4288847Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4289122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4289304Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4289308Z 2025-09-07T08:03:32.4289406Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4289602Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4289665Z return mod(**inputs) 2025-09-07T08:03:32.4289947Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4290007Z outputs = self.deberta( 2025-09-07T08:03:32.4290281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4290385Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4290656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4290752Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4290965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4291040Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4291309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4291430Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4291714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4291787Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4292092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4292271Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4292617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4292736Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4292741Z 2025-09-07T08:03:32.4292836Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4293032Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4293099Z return mod(**inputs) 2025-09-07T08:03:32.4293377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4293445Z outputs = self.deberta( 2025-09-07T08:03:32.4293721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4293795Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4294064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4294148Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4294363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4294439Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4294709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4294791Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4295068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4295136Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4295407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4295483Z context_layer = torch.bmm( 2025-09-07T08:03:32.4295487Z 2025-09-07T08:03:32.4295585Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4295773Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4295836Z return mod(**inputs) 2025-09-07T08:03:32.4296113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4296180Z outputs = self.deberta( 2025-09-07T08:03:32.4296489Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4296557Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4296829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4296915Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4297137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4297221Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4297535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4297627Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4297903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4297976Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4298289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4298478Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4298481Z 2025-09-07T08:03:32.4298616Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4298814Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4298878Z return mod(**inputs) 2025-09-07T08:03:32.4299160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4299224Z outputs = self.deberta( 2025-09-07T08:03:32.4299497Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4299569Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4299837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4299923Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4300154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4300233Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4300504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4300594Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4300861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4300975Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4301255Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4301336Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4301339Z 2025-09-07T08:03:32.4301441Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4301632Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4301694Z return mod(**inputs) 2025-09-07T08:03:32.4301976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4302040Z outputs = self.deberta( 2025-09-07T08:03:32.4302314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4302417Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4302696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4302772Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4302988Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4303068Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4303336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4303490Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4303760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4303837Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4303846Z 2025-09-07T08:03:32.4303944Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4304166Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4304238Z return mod(**inputs) 2025-09-07T08:03:32.4304515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4304616Z outputs = self.deberta( 2025-09-07T08:03:32.4304888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4304957Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4305230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4305305Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4305526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4305598Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4305920Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4306044Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4306317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4306432Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4306646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4306718Z return self.act(input) 2025-09-07T08:03:32.4306722Z 2025-09-07T08:03:32.4306822Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4307017Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4307086Z return mod(**inputs) 2025-09-07T08:03:32.4307364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4307433Z outputs = self.deberta( 2025-09-07T08:03:32.4307703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4307775Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4308049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4308125Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4308348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4308418Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4308737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4308864Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4309134Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4309221Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4309224Z 2025-09-07T08:03:32.4309317Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4309544Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4309778Z return mod(**inputs) 2025-09-07T08:03:32.4310054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4310124Z outputs = self.deberta( 2025-09-07T08:03:32.4310487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4310564Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4310835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4310965Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4311193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4311274Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4311561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4311650Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4311924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4312000Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4312271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4312463Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4312468Z 2025-09-07T08:03:32.4312567Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4312772Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4312836Z return mod(**inputs) 2025-09-07T08:03:32.4313114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4313179Z outputs = self.deberta( 2025-09-07T08:03:32.4313449Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4313526Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4313796Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4313883Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4314102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4314178Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4314452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4314538Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4314811Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4314934Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4315211Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4315387Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4315391Z 2025-09-07T08:03:32.4315489Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4315686Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4315747Z return mod(**inputs) 2025-09-07T08:03:32.4316075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4316139Z outputs = self.deberta( 2025-09-07T08:03:32.4316412Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4316487Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4316788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4316873Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4317121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4317201Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4317470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4317554Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4317826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4317895Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4318168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4318350Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4318665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4318798Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4318802Z 2025-09-07T08:03:32.4318897Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4319094Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4319156Z return mod(**inputs) 2025-09-07T08:03:32.4319436Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4319500Z outputs = self.deberta( 2025-09-07T08:03:32.4319770Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4319843Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4320115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4320198Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4320415Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4320485Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4320757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4320840Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4321151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4321223Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4321498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4321709Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4321712Z 2025-09-07T08:03:32.4321804Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4322032Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4322092Z return mod(**inputs) 2025-09-07T08:03:32.4322373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4322438Z outputs = self.deberta( 2025-09-07T08:03:32.4322741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4322815Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4323083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4323201Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4323418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4323496Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4323763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4323844Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4324116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4324189Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4324464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4324659Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4324663Z 2025-09-07T08:03:32.4324761Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4324953Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4325014Z return mod(**inputs) 2025-09-07T08:03:32.4325291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4325353Z outputs = self.deberta( 2025-09-07T08:03:32.4325626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4325694Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4325963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4326045Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4326257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4326333Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4326600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4326682Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4326954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4327060Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4327338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4327526Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4327529Z 2025-09-07T08:03:32.4327628Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4327815Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4327914Z return mod(**inputs) 2025-09-07T08:03:32.4328196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4328257Z outputs = self.deberta( 2025-09-07T08:03:32.4328544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4328616Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4328934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4329017Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4329262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4329341Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4329612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4329700Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4329969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4330040Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4330319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4330503Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4330821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4330940Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4330945Z 2025-09-07T08:03:32.4331044Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4331236Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4331297Z return mod(**inputs) 2025-09-07T08:03:32.4331574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4331638Z outputs = self.deberta( 2025-09-07T08:03:32.4331911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4331977Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4332245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4332324Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4332537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4332614Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4332879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4332966Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4333273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4333343Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4333621Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4333691Z context_layer = torch.bmm( 2025-09-07T08:03:32.4333695Z 2025-09-07T08:03:32.4333792Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4333979Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4334088Z return mod(**inputs) 2025-09-07T08:03:32.4334367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4334430Z outputs = self.deberta( 2025-09-07T08:03:32.4334707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4334805Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4335075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4335158Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4335403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4335482Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4335754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4335840Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4336106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4336177Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4336451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4336633Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4336636Z 2025-09-07T08:03:32.4336736Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4336924Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4336994Z return mod(**inputs) 2025-09-07T08:03:32.4337270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4337332Z outputs = self.deberta( 2025-09-07T08:03:32.4337610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4337684Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4337962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4338039Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4338252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4338329Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4338595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4338686Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4338953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4339105Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4339387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4339466Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4339469Z 2025-09-07T08:03:32.4339569Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4339758Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4339825Z return mod(**inputs) 2025-09-07T08:03:32.4340096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4340191Z outputs = self.deberta( 2025-09-07T08:03:32.4340468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4340537Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4340840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4340914Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4341131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4341238Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4341520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4341647Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4341917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4342003Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4342007Z 2025-09-07T08:03:32.4342103Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4342302Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4342367Z return mod(**inputs) 2025-09-07T08:03:32.4342639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4342707Z outputs = self.deberta( 2025-09-07T08:03:32.4342974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4343044Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4343317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4343397Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4343619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4343694Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4343968Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4344078Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4344347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4344455Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4344664Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4344733Z return self.act(input) 2025-09-07T08:03:32.4344736Z 2025-09-07T08:03:32.4344830Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4345018Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4345119Z return mod(**inputs) 2025-09-07T08:03:32.4345394Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4345459Z outputs = self.deberta( 2025-09-07T08:03:32.4345782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4345854Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4346120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4346231Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4346450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4346517Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4347004Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4347131Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4347400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4347515Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4347519Z 2025-09-07T08:03:32.4347868Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4348080Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4348143Z return mod(**inputs) 2025-09-07T08:03:32.4348432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4348497Z outputs = self.deberta( 2025-09-07T08:03:32.4348772Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4348846Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4349115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4349202Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4349423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4349500Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4349772Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4349859Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4350129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4350203Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4350471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4350658Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4350663Z 2025-09-07T08:03:32.4350762Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4350957Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4351021Z return mod(**inputs) 2025-09-07T08:03:32.4351299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4351360Z outputs = self.deberta( 2025-09-07T08:03:32.4351627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4351734Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4352003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4352086Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4352304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4352379Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4352681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4352765Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4353031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4353101Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4353414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4353590Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4353593Z 2025-09-07T08:03:32.4353716Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4353907Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4353968Z return mod(**inputs) 2025-09-07T08:03:32.4354244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4354304Z outputs = self.deberta( 2025-09-07T08:03:32.4354574Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4354640Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4354907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4354988Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4355201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4355273Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4355538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4355620Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4355888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4355955Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4356228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4356407Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4356726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4356853Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4356857Z 2025-09-07T08:03:32.4356951Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4357142Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4357203Z return mod(**inputs) 2025-09-07T08:03:32.4357479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4357589Z outputs = self.deberta( 2025-09-07T08:03:32.4357864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4357931Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4358200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4358279Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4358494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4358602Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4358872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4358952Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4359222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4359322Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4359593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4359836Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4359839Z 2025-09-07T08:03:32.4359935Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4360125Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4360185Z return mod(**inputs) 2025-09-07T08:03:32.4360458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4360520Z outputs = self.deberta( 2025-09-07T08:03:32.4360790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4360854Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4361120Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4361199Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4361414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4361486Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4361753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4361837Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4362105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4362176Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4362448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4362647Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4362650Z 2025-09-07T08:03:32.4362746Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4362935Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4362995Z return mod(**inputs) 2025-09-07T08:03:32.4363270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4363330Z outputs = self.deberta( 2025-09-07T08:03:32.4363637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4363704Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4363978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4364051Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4364265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4364338Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4364644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4364727Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4364993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4365061Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4365363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4365554Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4365558Z 2025-09-07T08:03:32.4365680Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4365869Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4365931Z return mod(**inputs) 2025-09-07T08:03:32.4366203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4366263Z outputs = self.deberta( 2025-09-07T08:03:32.4366537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4366606Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4366881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4366955Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4367167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4367240Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4367506Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4367593Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4367855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4367927Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4368194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4368372Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4368683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4368803Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4368807Z 2025-09-07T08:03:32.4368903Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4369092Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4369155Z return mod(**inputs) 2025-09-07T08:03:32.4369426Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4369520Z outputs = self.deberta( 2025-09-07T08:03:32.4369797Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4369862Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4370138Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4370211Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4370422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4370525Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4370791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4370875Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4371178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4371245Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4371515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4371615Z context_layer = torch.bmm( 2025-09-07T08:03:32.4371618Z 2025-09-07T08:03:32.4371714Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4371901Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4371965Z return mod(**inputs) 2025-09-07T08:03:32.4372234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4372298Z outputs = self.deberta( 2025-09-07T08:03:32.4372569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4372636Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4372908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4372981Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4373198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4373273Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4373539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4373623Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4373887Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4373961Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4374225Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4374408Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4374411Z 2025-09-07T08:03:32.4374508Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4374694Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4374756Z return mod(**inputs) 2025-09-07T08:03:32.4375026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4375088Z outputs = self.deberta( 2025-09-07T08:03:32.4375356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4375478Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4375755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4375831Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4376044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4376114Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4376380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4376499Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4376768Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4376885Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4377185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4377265Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4377271Z 2025-09-07T08:03:32.4377362Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4377597Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4377663Z return mod(**inputs) 2025-09-07T08:03:32.4377936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4378001Z outputs = self.deberta( 2025-09-07T08:03:32.4378265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4378333Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4378600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4378675Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4378890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4378959Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4379227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4379343Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4379611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4379690Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4379695Z 2025-09-07T08:03:32.4379788Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4379981Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4380038Z return mod(**inputs) 2025-09-07T08:03:32.4380306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4380371Z outputs = self.deberta( 2025-09-07T08:03:32.4380638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4380707Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4380974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4381048Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4381263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4381363Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4381637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4381744Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4382014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4382118Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4382365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4382432Z return self.act(input) 2025-09-07T08:03:32.4382435Z 2025-09-07T08:03:32.4382529Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4382725Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4382786Z return mod(**inputs) 2025-09-07T08:03:32.4383088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4383154Z outputs = self.deberta( 2025-09-07T08:03:32.4383454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4383528Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4383794Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4383872Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4384088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4384156Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4384432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4384555Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4384829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4384904Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4384908Z 2025-09-07T08:03:32.4384997Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4385188Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4385246Z return mod(**inputs) 2025-09-07T08:03:32.4385518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4385578Z outputs = self.deberta( 2025-09-07T08:03:32.4385888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4385959Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4386228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4386309Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4386524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4386596Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4386863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4386947Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4387216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4387326Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4387600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4387783Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4387787Z 2025-09-07T08:03:32.4387882Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4388070Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4388161Z return mod(**inputs) 2025-09-07T08:03:32.4388436Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4388498Z outputs = self.deberta( 2025-09-07T08:03:32.4388769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4388866Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4389134Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4389217Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4389462Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4389538Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4389808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4389890Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4390158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4390230Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4390504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4390676Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4390679Z 2025-09-07T08:03:32.4390778Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4390964Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4391026Z return mod(**inputs) 2025-09-07T08:03:32.4391299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4391361Z outputs = self.deberta( 2025-09-07T08:03:32.4391630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4391695Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4391962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4392039Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4392254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4392325Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4392593Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4392679Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4392945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4393013Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4393324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4393501Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4393814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4393933Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4393936Z 2025-09-07T08:03:32.4394062Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4394250Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4394307Z return mod(**inputs) 2025-09-07T08:03:32.4394580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4394642Z outputs = self.deberta( 2025-09-07T08:03:32.4394942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4395006Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4395305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4395384Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4395597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4395671Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4395936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4396018Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4396288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4396356Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4396625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4396828Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4396832Z 2025-09-07T08:03:32.4396926Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4397112Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4397170Z return mod(**inputs) 2025-09-07T08:03:32.4397443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4397505Z outputs = self.deberta( 2025-09-07T08:03:32.4397774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4397837Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4398104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4398181Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4398392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4398465Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4398733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4398814Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4399077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4399183Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4399456Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4399649Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4399651Z 2025-09-07T08:03:32.4399745Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4399929Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4400025Z return mod(**inputs) 2025-09-07T08:03:32.4400297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4400357Z outputs = self.deberta( 2025-09-07T08:03:32.4400626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4400737Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4401009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4401082Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4401323Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4401398Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4401668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4401754Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4402024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4402098Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4402369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4402555Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4402558Z 2025-09-07T08:03:32.4402653Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4402840Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4402907Z return mod(**inputs) 2025-09-07T08:03:32.4403179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4403241Z outputs = self.deberta( 2025-09-07T08:03:32.4403521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4403588Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4403863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4403937Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4404155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4404226Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4404492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4404585Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4404856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4404966Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4405237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4405414Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4405728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4405843Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4405878Z 2025-09-07T08:03:32.4405976Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4406163Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4406228Z return mod(**inputs) 2025-09-07T08:03:32.4406507Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4406572Z outputs = self.deberta( 2025-09-07T08:03:32.4406880Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4406946Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4407252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4407329Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4407548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4407617Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4407886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4407972Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4408242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4408316Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4408583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4408652Z context_layer = torch.bmm( 2025-09-07T08:03:32.4408656Z 2025-09-07T08:03:32.4408752Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4408942Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4409008Z return mod(**inputs) 2025-09-07T08:03:32.4409279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4409342Z outputs = self.deberta( 2025-09-07T08:03:32.4409737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4409811Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4410088Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4410162Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4410382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4410450Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4410719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4410809Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4411111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4411243Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4411518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4411697Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4411707Z 2025-09-07T08:03:32.4411801Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4411988Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4412106Z return mod(**inputs) 2025-09-07T08:03:32.4412378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4412441Z outputs = self.deberta( 2025-09-07T08:03:32.4412709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4412777Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4413105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4413180Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4413445Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4413517Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4413789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4413877Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4414145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4414261Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4414535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4414617Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4414621Z 2025-09-07T08:03:32.4414709Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4414897Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4414958Z return mod(**inputs) 2025-09-07T08:03:32.4415234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4415301Z outputs = self.deberta( 2025-09-07T08:03:32.4415570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4415637Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4415910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4415986Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4416204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4416274Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4416542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4416656Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4416925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4417003Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4417044Z 2025-09-07T08:03:32.4417134Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4417333Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4417393Z return mod(**inputs) 2025-09-07T08:03:32.4417665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4417735Z outputs = self.deberta( 2025-09-07T08:03:32.4418003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4418111Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4418381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4418459Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4418672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4418744Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4419050Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4419159Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4419464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4419567Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4419779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4419849Z return self.act(input) 2025-09-07T08:03:32.4419853Z 2025-09-07T08:03:32.4419945Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4420137Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4420197Z return mod(**inputs) 2025-09-07T08:03:32.4420473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4420534Z outputs = self.deberta( 2025-09-07T08:03:32.4420806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4420882Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4421148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4421229Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4421442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4421513Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4421785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4421910Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4422183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4422257Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4422260Z 2025-09-07T08:03:32.4422355Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4422542Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4422600Z return mod(**inputs) 2025-09-07T08:03:32.4422873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4422932Z outputs = self.deberta( 2025-09-07T08:03:32.4423251Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4423317Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4423585Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4423663Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4423875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4423997Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4424269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4424349Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4424625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4424698Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4425003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4425187Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4425222Z 2025-09-07T08:03:32.4425320Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4425507Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4425569Z return mod(**inputs) 2025-09-07T08:03:32.4425898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4425963Z outputs = self.deberta( 2025-09-07T08:03:32.4426248Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4426323Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4426606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4426682Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4426901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4426978Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4427249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4427341Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4427608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4427682Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4427951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4428124Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4428128Z 2025-09-07T08:03:32.4428227Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4428417Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4428483Z return mod(**inputs) 2025-09-07T08:03:32.4428752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4428816Z outputs = self.deberta( 2025-09-07T08:03:32.4429089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4429194Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4429470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4429547Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4429762Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4429838Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4430103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4430234Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4430502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4430574Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4430879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4431063Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4431409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4431531Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4431534Z 2025-09-07T08:03:32.4431631Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4431820Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4431879Z return mod(**inputs) 2025-09-07T08:03:32.4432150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4432212Z outputs = self.deberta( 2025-09-07T08:03:32.4432485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4432556Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4432826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4432902Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4433115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4433194Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4433466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4433553Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4433826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4433897Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4434167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4434370Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4434374Z 2025-09-07T08:03:32.4434470Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4434656Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4434720Z return mod(**inputs) 2025-09-07T08:03:32.4434989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4435087Z outputs = self.deberta( 2025-09-07T08:03:32.4435366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4435431Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4435701Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4435777Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4435991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4436098Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4436368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4436454Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4436721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4436825Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4437097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4437322Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4437325Z 2025-09-07T08:03:32.4437424Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4437611Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4437681Z return mod(**inputs) 2025-09-07T08:03:32.4437951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4438012Z outputs = self.deberta( 2025-09-07T08:03:32.4438286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4438352Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4438625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4438698Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4438914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4438983Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4439252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4439337Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4439605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4439679Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4439949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4440133Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4440141Z 2025-09-07T08:03:32.4440234Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4440422Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4440490Z return mod(**inputs) 2025-09-07T08:03:32.4440761Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4440825Z outputs = self.deberta( 2025-09-07T08:03:32.4441092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4441191Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4441466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4441542Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4441759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4441827Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4442092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4442210Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4442476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4442549Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4442849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4443033Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4443373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4443494Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4443498Z 2025-09-07T08:03:32.4443595Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4443784Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4443844Z return mod(**inputs) 2025-09-07T08:03:32.4444115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4444182Z outputs = self.deberta( 2025-09-07T08:03:32.4444450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4444513Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4444788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4444863Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4445080Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4445148Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4445415Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4445501Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4445769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4445846Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4446112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4446185Z context_layer = torch.bmm( 2025-09-07T08:03:32.4446188Z 2025-09-07T08:03:32.4446277Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4446464Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4446530Z return mod(**inputs) 2025-09-07T08:03:32.4446800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4446865Z outputs = self.deberta( 2025-09-07T08:03:32.4447192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4447262Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4447531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4447608Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4447827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4447897Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4448198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4448282Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4448550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4448624Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4448919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4449109Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4449141Z 2025-09-07T08:03:32.4449232Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4449422Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4449488Z return mod(**inputs) 2025-09-07T08:03:32.4449757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4449822Z outputs = self.deberta( 2025-09-07T08:03:32.4450089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4450158Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4450432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4450506Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4450727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4450796Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4451064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4451146Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4451413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4451527Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4451801Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4451879Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4451883Z 2025-09-07T08:03:32.4451972Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4452163Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4452222Z return mod(**inputs) 2025-09-07T08:03:32.4452494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4452564Z outputs = self.deberta( 2025-09-07T08:03:32.4452829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4452936Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4453207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4453286Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4453503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4453572Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4453846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4453987Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4454259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4454337Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4454342Z 2025-09-07T08:03:32.4454435Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4454660Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4454720Z return mod(**inputs) 2025-09-07T08:03:32.4454994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4455087Z outputs = self.deberta( 2025-09-07T08:03:32.4455359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4455430Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4455698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4455776Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4455989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4456061Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4456332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4456439Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4456714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4456818Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4457031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4457095Z return self.act(input) 2025-09-07T08:03:32.4457099Z 2025-09-07T08:03:32.4457189Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4457377Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4457436Z return mod(**inputs) 2025-09-07T08:03:32.4457710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4457771Z outputs = self.deberta( 2025-09-07T08:03:32.4458036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4458109Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4458373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4458456Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4458667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4458739Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4459045Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4459167Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4459437Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4459514Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4459518Z 2025-09-07T08:03:32.4459614Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4459832Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4459891Z return mod(**inputs) 2025-09-07T08:03:32.4460164Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4460224Z outputs = self.deberta( 2025-09-07T08:03:32.4460529Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4460596Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4460870Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4460978Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4461194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4461272Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4461536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4461623Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4461903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4461975Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4462249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4462431Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4462434Z 2025-09-07T08:03:32.4462531Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4462726Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4462794Z return mod(**inputs) 2025-09-07T08:03:32.4473390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4473488Z outputs = self.deberta( 2025-09-07T08:03:32.4473815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4473900Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4474200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4474300Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4474537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4474621Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4474901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4474993Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4475266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4475410Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4475690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4475875Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4475879Z 2025-09-07T08:03:32.4475994Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4476205Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4476318Z return mod(**inputs) 2025-09-07T08:03:32.4476628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4476699Z outputs = self.deberta( 2025-09-07T08:03:32.4476976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4477051Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4477357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4477448Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4477712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4477794Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4478064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4478160Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4478435Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4478511Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4478790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4478982Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4479304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4479436Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4479440Z 2025-09-07T08:03:32.4479544Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4479750Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4479811Z return mod(**inputs) 2025-09-07T08:03:32.4480108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4480179Z outputs = self.deberta( 2025-09-07T08:03:32.4480474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4480543Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4480811Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4480896Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4481117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4481196Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4481464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4481551Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4481859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4481932Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4482204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4482418Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4482422Z 2025-09-07T08:03:32.4482529Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4482766Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4482828Z return mod(**inputs) 2025-09-07T08:03:32.4483113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4483179Z outputs = self.deberta( 2025-09-07T08:03:32.4483481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4483550Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4483820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4483933Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4484151Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4484230Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4484497Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4484585Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4484851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4484924Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4485196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4485392Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4485396Z 2025-09-07T08:03:32.4485493Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4485683Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4485744Z return mod(**inputs) 2025-09-07T08:03:32.4486023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4486085Z outputs = self.deberta( 2025-09-07T08:03:32.4486364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4486431Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4486702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4486779Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4486994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4487066Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4487336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4487419Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4487684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4487790Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4488066Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4488261Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4488265Z 2025-09-07T08:03:32.4488361Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4488553Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4488650Z return mod(**inputs) 2025-09-07T08:03:32.4488923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4488983Z outputs = self.deberta( 2025-09-07T08:03:32.4489251Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4489317Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4489619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4489696Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4489961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4490036Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4490307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4490395Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4490659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4490732Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4490999Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4491180Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4491497Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4491626Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4491632Z 2025-09-07T08:03:32.4491729Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4491917Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4491980Z return mod(**inputs) 2025-09-07T08:03:32.4492252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4492315Z outputs = self.deberta( 2025-09-07T08:03:32.4492586Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4492653Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4492927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4493000Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4493213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4493289Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4493553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4493641Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4493947Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4494016Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4494285Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4494352Z context_layer = torch.bmm( 2025-09-07T08:03:32.4494356Z 2025-09-07T08:03:32.4494451Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4494637Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4494733Z return mod(**inputs) 2025-09-07T08:03:32.4495003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4495063Z outputs = self.deberta( 2025-09-07T08:03:32.4495344Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4495440Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4495714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4495820Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4496042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4496120Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4496392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4496479Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4496748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4496826Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4497093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4497278Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4497283Z 2025-09-07T08:03:32.4497381Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4497573Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4497640Z return mod(**inputs) 2025-09-07T08:03:32.4497911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4497976Z outputs = self.deberta( 2025-09-07T08:03:32.4498246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4498316Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4498587Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4498664Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4498886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4498955Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4499221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4499314Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4499580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4499738Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4500019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4500099Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4500108Z 2025-09-07T08:03:32.4500202Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4500392Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4500456Z return mod(**inputs) 2025-09-07T08:03:32.4500764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4500831Z outputs = self.deberta( 2025-09-07T08:03:32.4501099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4501169Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4501472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4501550Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4501773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4501872Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4502141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4502260Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4502528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4502605Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4502611Z 2025-09-07T08:03:32.4502702Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4502892Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4502951Z return mod(**inputs) 2025-09-07T08:03:32.4503222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4503289Z outputs = self.deberta( 2025-09-07T08:03:32.4503555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4503627Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4503890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4503966Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4504186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4504257Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4504526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4504631Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4504902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4505007Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4505216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4505286Z return self.act(input) 2025-09-07T08:03:32.4505289Z 2025-09-07T08:03:32.4505378Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4505571Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4505753Z return mod(**inputs) 2025-09-07T08:03:32.4506030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4506098Z outputs = self.deberta( 2025-09-07T08:03:32.4506365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4506441Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4506707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4506821Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4507034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4507100Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4507407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4507539Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4507813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4507918Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4507922Z 2025-09-07T08:03:32.4508017Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4508209Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4508271Z return mod(**inputs) 2025-09-07T08:03:32.4508545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4508606Z outputs = self.deberta( 2025-09-07T08:03:32.4508898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4508969Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4509250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4509332Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4509550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4509788Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4510062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4510150Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4510421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4510496Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4510775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4510967Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4510972Z 2025-09-07T08:03:32.4511073Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4511270Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4511333Z return mod(**inputs) 2025-09-07T08:03:32.4511612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4511673Z outputs = self.deberta( 2025-09-07T08:03:32.4511942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4512262Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4512535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4512615Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4512830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4512909Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4513232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4513320Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4513590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4513663Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4514001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4514179Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4514182Z 2025-09-07T08:03:32.4514329Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4514527Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4514588Z return mod(**inputs) 2025-09-07T08:03:32.4514863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4514923Z outputs = self.deberta( 2025-09-07T08:03:32.4515198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4515264Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4515539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4515614Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4515828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4515901Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4516171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4516259Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4516528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4516595Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4516871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4517049Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4517368Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4517495Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4517499Z 2025-09-07T08:03:32.4517600Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4517791Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4517851Z return mod(**inputs) 2025-09-07T08:03:32.4518127Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4518230Z outputs = self.deberta( 2025-09-07T08:03:32.4518505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4518571Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4518842Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4518924Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4519137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4519268Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4519536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4519622Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4519923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4519993Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4520264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4520505Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4520509Z 2025-09-07T08:03:32.4520604Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4520795Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4520856Z return mod(**inputs) 2025-09-07T08:03:32.4521133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4521196Z outputs = self.deberta( 2025-09-07T08:03:32.4521470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4521535Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4521800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4521876Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4522089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4522164Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4522433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4522518Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4522785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4522858Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4523129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4523324Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4523327Z 2025-09-07T08:03:32.4523424Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4523613Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4523681Z return mod(**inputs) 2025-09-07T08:03:32.4523952Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4524015Z outputs = self.deberta( 2025-09-07T08:03:32.4524325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4524393Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4524664Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4524741Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4524955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4525031Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4525331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4525417Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4525684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4525759Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4526055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4526242Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4526246Z 2025-09-07T08:03:32.4526376Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4526567Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4526634Z return mod(**inputs) 2025-09-07T08:03:32.4526903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4526962Z outputs = self.deberta( 2025-09-07T08:03:32.4527229Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4527297Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4527569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4527643Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4527861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4527930Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4528195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4528286Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4528550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4528622Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4528890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4529066Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4529376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4529495Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4529500Z 2025-09-07T08:03:32.4529601Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4529788Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4529854Z return mod(**inputs) 2025-09-07T08:03:32.4530134Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4530233Z outputs = self.deberta( 2025-09-07T08:03:32.4530508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4530574Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4530849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4530924Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4531145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4531255Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4531526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4531610Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4531915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4531992Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4532261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4532365Z context_layer = torch.bmm( 2025-09-07T08:03:32.4532368Z 2025-09-07T08:03:32.4532465Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4532656Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4532720Z return mod(**inputs) 2025-09-07T08:03:32.4532993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4533055Z outputs = self.deberta( 2025-09-07T08:03:32.4533329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4533397Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4533670Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4533744Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4533960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4534029Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4534295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4534381Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4534648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4534722Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4534989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4535172Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4535179Z 2025-09-07T08:03:32.4535268Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4535466Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4535525Z return mod(**inputs) 2025-09-07T08:03:32.4535799Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4535869Z outputs = self.deberta( 2025-09-07T08:03:32.4536140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4536251Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4536522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4536599Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4536819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4536891Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4537221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4537303Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4537580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4537695Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4537999Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4538085Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4538089Z 2025-09-07T08:03:32.4538184Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4538411Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4538470Z return mod(**inputs) 2025-09-07T08:03:32.4538746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4538814Z outputs = self.deberta( 2025-09-07T08:03:32.4539084Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4539158Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4539429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4539509Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4539721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4539791Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4540062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4540177Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4540452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4540528Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4540532Z 2025-09-07T08:03:32.4540628Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4540825Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4540886Z return mod(**inputs) 2025-09-07T08:03:32.4541159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4541224Z outputs = self.deberta( 2025-09-07T08:03:32.4541494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4541562Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4541831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4541913Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4542128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4542241Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4542512Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4542624Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4542901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4543006Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4543253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4543318Z return self.act(input) 2025-09-07T08:03:32.4543322Z 2025-09-07T08:03:32.4543420Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4543608Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4543670Z return mod(**inputs) 2025-09-07T08:03:32.4543983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4544050Z outputs = self.deberta( 2025-09-07T08:03:32.4544371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4544440Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4544717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4544802Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4545015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4545089Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4545362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4545486Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4545822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4545900Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4545904Z 2025-09-07T08:03:32.4546000Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4546188Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4546255Z return mod(**inputs) 2025-09-07T08:03:32.4546525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4546587Z outputs = self.deberta( 2025-09-07T08:03:32.4546862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4546927Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4547199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4547274Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4547487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4547564Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4547831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4547917Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4548184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4548299Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4548571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4548756Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4548760Z 2025-09-07T08:03:32.4548856Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4549042Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4549144Z return mod(**inputs) 2025-09-07T08:03:32.4549416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4549478Z outputs = self.deberta( 2025-09-07T08:03:32.4549753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4549852Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4550133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4550208Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4550456Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4550525Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4550796Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4550884Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4551149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4551227Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4551495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4551669Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4551678Z 2025-09-07T08:03:32.4551772Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4551963Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4552032Z return mod(**inputs) 2025-09-07T08:03:32.4552305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4552373Z outputs = self.deberta( 2025-09-07T08:03:32.4552639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4552708Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4552981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4553055Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4553275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4553345Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4553610Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4553701Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4553971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4554046Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4554355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4554543Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4554854Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4554974Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4554984Z 2025-09-07T08:03:32.4555117Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4555307Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4555372Z return mod(**inputs) 2025-09-07T08:03:32.4555640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4555713Z outputs = self.deberta( 2025-09-07T08:03:32.4556026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4556094Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4556406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4556482Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4556703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4556772Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4557040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4557128Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4557398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4557472Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4557741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4557953Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4557957Z 2025-09-07T08:03:32.4558049Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4558237Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4558300Z return mod(**inputs) 2025-09-07T08:03:32.4558569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4558643Z outputs = self.deberta( 2025-09-07T08:03:32.4558912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4558979Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4559252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4559327Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4559549Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4559618Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4559895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4559977Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4560246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4560373Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4560641Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4560840Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4560844Z 2025-09-07T08:03:32.4560938Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4561126Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4561222Z return mod(**inputs) 2025-09-07T08:03:32.4561492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4561562Z outputs = self.deberta( 2025-09-07T08:03:32.4561828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4561932Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4562206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4562312Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4562533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4562604Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4562884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4562965Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4563233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4563310Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4563577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4563769Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4563773Z 2025-09-07T08:03:32.4563866Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4564057Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4564116Z return mod(**inputs) 2025-09-07T08:03:32.4564386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4564453Z outputs = self.deberta( 2025-09-07T08:03:32.4564718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4564792Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4565060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4565136Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4565357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4565427Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4565702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4565787Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4566064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4566169Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4566443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4566630Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4566937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4567061Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4567100Z 2025-09-07T08:03:32.4567196Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4567390Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4567451Z return mod(**inputs) 2025-09-07T08:03:32.4567722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4567793Z outputs = self.deberta( 2025-09-07T08:03:32.4568095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4568169Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4568471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4568549Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4568773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4568845Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4569118Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4569199Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4569473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4569549Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4569816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4569892Z context_layer = torch.bmm( 2025-09-07T08:03:32.4569896Z 2025-09-07T08:03:32.4569990Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4570187Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4570247Z return mod(**inputs) 2025-09-07T08:03:32.4570523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4570595Z outputs = self.deberta( 2025-09-07T08:03:32.4570863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4570939Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4571209Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4571292Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4571517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4571592Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4571873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4571959Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4572232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4572345Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4572616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4572810Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4572815Z 2025-09-07T08:03:32.4572914Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4573115Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4573212Z return mod(**inputs) 2025-09-07T08:03:32.4573491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4573563Z outputs = self.deberta( 2025-09-07T08:03:32.4573835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4573912Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4574214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4574298Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4574549Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4574622Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4574898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4574982Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4575255Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4575371Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4575642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4575729Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4575732Z 2025-09-07T08:03:32.4575829Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4576034Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4576094Z return mod(**inputs) 2025-09-07T08:03:32.4576374Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4576439Z outputs = self.deberta( 2025-09-07T08:03:32.4576706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4576781Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4577048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4577128Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4577348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4577421Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4577693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4577803Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4578079Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4578152Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4578206Z 2025-09-07T08:03:32.4578306Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4578499Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4578562Z return mod(**inputs) 2025-09-07T08:03:32.4578841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4578902Z outputs = self.deberta( 2025-09-07T08:03:32.4579176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4579273Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4579541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4579623Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4579836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4579916Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4580213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4580328Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4580647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4580756Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4580973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4581040Z return self.act(input) 2025-09-07T08:03:32.4581044Z 2025-09-07T08:03:32.4581142Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4581332Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4581393Z return mod(**inputs) 2025-09-07T08:03:32.4581674Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4581737Z outputs = self.deberta( 2025-09-07T08:03:32.4582011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4582077Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4582347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4582430Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4582642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4582732Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4583015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4583150Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4583420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4583495Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4583499Z 2025-09-07T08:03:32.4583598Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4583787Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4583856Z return mod(**inputs) 2025-09-07T08:03:32.4584129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4584225Z outputs = self.deberta( 2025-09-07T08:03:32.4584503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4584569Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4584845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4584921Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4585142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4585247Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4585520Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4585611Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4585941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4586060Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4586337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4586565Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4586576Z 2025-09-07T08:03:32.4586679Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4586874Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4586947Z return mod(**inputs) 2025-09-07T08:03:32.4587222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4587294Z outputs = self.deberta( 2025-09-07T08:03:32.4587563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4587634Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4587908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4587990Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4588213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4588283Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4588556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4588646Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4588916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4588993Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4589263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4589447Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4589450Z 2025-09-07T08:03:32.4589545Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4589734Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4589801Z return mod(**inputs) 2025-09-07T08:03:32.4590072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4590139Z outputs = self.deberta( 2025-09-07T08:03:32.4590406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4590516Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4590789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4590869Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4591098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4591166Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4591448Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4591569Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4591838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4591914Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4592213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4592403Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4592749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4592881Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4592885Z 2025-09-07T08:03:32.4592981Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4593170Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4593235Z return mod(**inputs) 2025-09-07T08:03:32.4593508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4593579Z outputs = self.deberta( 2025-09-07T08:03:32.4593849Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4593917Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4594192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4594270Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4594488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4594558Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4594831Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4594914Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4595186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4595264Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4595534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4595746Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4595750Z 2025-09-07T08:03:32.4595841Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4596030Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4596097Z return mod(**inputs) 2025-09-07T08:03:32.4596372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4596475Z outputs = self.deberta( 2025-09-07T08:03:32.4596746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4596825Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4597089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4597168Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4597386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4597488Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4597758Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4597840Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4598104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4598209Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4598481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4598711Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4598715Z 2025-09-07T08:03:32.4598804Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4598998Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4599059Z return mod(**inputs) 2025-09-07T08:03:32.4599328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4599393Z outputs = self.deberta( 2025-09-07T08:03:32.4599662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4599730Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4599993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4600067Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4600286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4600356Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4600631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4600710Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4600983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4601052Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4601323Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4601513Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4601518Z 2025-09-07T08:03:32.4601607Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4601797Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4601857Z return mod(**inputs) 2025-09-07T08:03:32.4602130Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4602195Z outputs = self.deberta( 2025-09-07T08:03:32.4602461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4602565Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4602836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4602913Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4603125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4603192Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4603464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4603581Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4603851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4603920Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4604233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4604417Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4604754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4604882Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4604887Z 2025-09-07T08:03:32.4604977Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4605169Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4605228Z return mod(**inputs) 2025-09-07T08:03:32.4605498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4605567Z outputs = self.deberta( 2025-09-07T08:03:32.4605835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4605903Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4606169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4606247Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4606461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4606531Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4606803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4606883Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4607152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4607217Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4607487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4607556Z context_layer = torch.bmm( 2025-09-07T08:03:32.4607560Z 2025-09-07T08:03:32.4607648Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4607839Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4607896Z return mod(**inputs) 2025-09-07T08:03:32.4608166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4608227Z outputs = self.deberta( 2025-09-07T08:03:32.4608532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4608605Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4608874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4608950Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4609160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4609264Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4609533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4609765Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4610038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4610110Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4610468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4610655Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4610705Z 2025-09-07T08:03:32.4610797Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4610992Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4611053Z return mod(**inputs) 2025-09-07T08:03:32.4611329Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4611391Z outputs = self.deberta( 2025-09-07T08:03:32.4611655Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4611729Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4611995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4612075Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4612288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4612357Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4612633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4612713Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4612984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4613097Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4613372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4613450Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4613454Z 2025-09-07T08:03:32.4613545Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4613738Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4613795Z return mod(**inputs) 2025-09-07T08:03:32.4614068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4614129Z outputs = self.deberta( 2025-09-07T08:03:32.4614396Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4614568Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4614838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4614914Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4615129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4615202Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4615470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4615629Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4615901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4615973Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4615979Z 2025-09-07T08:03:32.4616077Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4616297Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4616358Z return mod(**inputs) 2025-09-07T08:03:32.4616633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4616728Z outputs = self.deberta( 2025-09-07T08:03:32.4617021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4617088Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4617359Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4617432Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4617646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4617724Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4617990Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4618100Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4618369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4618473Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4618683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4618747Z return self.act(input) 2025-09-07T08:03:32.4618750Z 2025-09-07T08:03:32.4618844Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4619032Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4619094Z return mod(**inputs) 2025-09-07T08:03:32.4619365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4619426Z outputs = self.deberta( 2025-09-07T08:03:32.4619697Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4619763Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4620034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4620109Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4620319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4620389Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4620696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4620825Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4621094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4621171Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4621175Z 2025-09-07T08:03:32.4621265Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4621487Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4621549Z return mod(**inputs) 2025-09-07T08:03:32.4621820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4621885Z outputs = self.deberta( 2025-09-07T08:03:32.4622189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4622256Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4622528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4622635Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4622863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4622936Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4623208Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4623294Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4623564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4623640Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4623904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4624089Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4624093Z 2025-09-07T08:03:32.4624190Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4624379Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4624442Z return mod(**inputs) 2025-09-07T08:03:32.4624714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4624780Z outputs = self.deberta( 2025-09-07T08:03:32.4625046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4625120Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4625386Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4625466Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4625739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4625812Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4626086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4626166Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4626433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4626549Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4626817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4626993Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4626997Z 2025-09-07T08:03:32.4627089Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4627284Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4627392Z return mod(**inputs) 2025-09-07T08:03:32.4627665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4627731Z outputs = self.deberta( 2025-09-07T08:03:32.4627995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4628068Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4628366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4628444Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4628698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4628769Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4629040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4629123Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4629395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4629464Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4629735Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4629920Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4630231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4630360Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4630366Z 2025-09-07T08:03:32.4630456Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4630644Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4630707Z return mod(**inputs) 2025-09-07T08:03:32.4630981Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4631050Z outputs = self.deberta( 2025-09-07T08:03:32.4631319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4631386Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4631656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4631731Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4631951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4632020Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4632290Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4632372Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4632678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4632751Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4633019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4633228Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4633231Z 2025-09-07T08:03:32.4633321Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4633547Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4633604Z return mod(**inputs) 2025-09-07T08:03:32.4633873Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4633945Z outputs = self.deberta( 2025-09-07T08:03:32.4634240Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4634311Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4634580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4634688Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4634917Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4634993Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4635272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4635363Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4635638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4635711Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4635979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4636183Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4636187Z 2025-09-07T08:03:32.4636284Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4636481Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4636545Z return mod(**inputs) 2025-09-07T08:03:32.4636818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4636886Z outputs = self.deberta( 2025-09-07T08:03:32.4637157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4637233Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4637499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4637584Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4637798Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4637871Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4638139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4638221Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4638491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4638595Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4638864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4639056Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4639061Z 2025-09-07T08:03:32.4639154Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4639347Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4639443Z return mod(**inputs) 2025-09-07T08:03:32.4639721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4639781Z outputs = self.deberta( 2025-09-07T08:03:32.4640050Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4640120Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4640416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4640494Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4640741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4640811Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4641081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4641164Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4641433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4641503Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4641774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4641956Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4642260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4642383Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4642389Z 2025-09-07T08:03:32.4642480Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4642671Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4642729Z return mod(**inputs) 2025-09-07T08:03:32.4643005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4643072Z outputs = self.deberta( 2025-09-07T08:03:32.4643342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4643412Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4643678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4643755Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4643974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4644044Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4644315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4644428Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4644704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4644774Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4645043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4645112Z context_layer = torch.bmm( 2025-09-07T08:03:32.4645115Z 2025-09-07T08:03:32.4645208Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4645437Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4645496Z return mod(**inputs) 2025-09-07T08:03:32.4645767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4645827Z outputs = self.deberta( 2025-09-07T08:03:32.4646096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4646195Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4646469Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4646580Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4646796Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4646870Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4647157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4647246Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4647517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4647589Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4647862Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4648044Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4648049Z 2025-09-07T08:03:32.4648140Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4648332Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4648392Z return mod(**inputs) 2025-09-07T08:03:32.4648669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4648730Z outputs = self.deberta( 2025-09-07T08:03:32.4648994Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4649064Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4649333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4649411Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4649626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4649697Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4649966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4650046Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4650317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4650486Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4650760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4650838Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4650841Z 2025-09-07T08:03:32.4650933Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4651123Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4651181Z return mod(**inputs) 2025-09-07T08:03:32.4651505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4651564Z outputs = self.deberta( 2025-09-07T08:03:32.4651836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4651903Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4652203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4652284Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4652501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4652605Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4652874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4652988Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4653260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4653336Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4653341Z 2025-09-07T08:03:32.4653438Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4653635Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4653697Z return mod(**inputs) 2025-09-07T08:03:32.4653967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4654028Z outputs = self.deberta( 2025-09-07T08:03:32.4654299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4654366Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4654633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4654706Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4654916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4654991Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4655259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4655368Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4655635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4655744Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4655954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4656020Z return self.act(input) 2025-09-07T08:03:32.4656023Z 2025-09-07T08:03:32.4656118Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4656311Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4656407Z return mod(**inputs) 2025-09-07T08:03:32.4656679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4656738Z outputs = self.deberta( 2025-09-07T08:03:32.4657012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4657076Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4657343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4657449Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4657675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4657748Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4658054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4658187Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4658485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4658566Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4658569Z 2025-09-07T08:03:32.4658660Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4658852Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4658915Z return mod(**inputs) 2025-09-07T08:03:32.4659188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4659256Z outputs = self.deberta( 2025-09-07T08:03:32.4659524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4659593Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4659861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4659938Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4660156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4660227Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4660498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4660583Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4660848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4660926Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4661193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4661383Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4661386Z 2025-09-07T08:03:32.4661480Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4661670Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4661731Z return mod(**inputs) 2025-09-07T08:03:32.4662000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4662066Z outputs = self.deberta( 2025-09-07T08:03:32.4662333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4662439Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4662706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4662779Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4662998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4663066Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4663370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4663450Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4663722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4663790Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4664094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4664275Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4664279Z 2025-09-07T08:03:32.4664401Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4664595Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4664656Z return mod(**inputs) 2025-09-07T08:03:32.4664935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4665002Z outputs = self.deberta( 2025-09-07T08:03:32.4665282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4665351Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4665620Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4665756Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4665975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4666044Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4666315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4666396Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4666668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4666735Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4667018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4667203Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4667519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4667646Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4667652Z 2025-09-07T08:03:32.4667746Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4667943Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4668002Z return mod(**inputs) 2025-09-07T08:03:32.4668272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4668375Z outputs = self.deberta( 2025-09-07T08:03:32.4668647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4668717Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4668983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4669059Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4669279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4669380Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4669656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4669738Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4670044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4670112Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4670379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4670639Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4670643Z 2025-09-07T08:03:32.4670736Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4670933Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4670990Z return mod(**inputs) 2025-09-07T08:03:32.4671260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4671328Z outputs = self.deberta( 2025-09-07T08:03:32.4671597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4671665Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4671931Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4672009Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4672222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4672290Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4672558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4672635Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4672907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4672977Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4673242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4673446Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4673449Z 2025-09-07T08:03:32.4673561Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4673754Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4673814Z return mod(**inputs) 2025-09-07T08:03:32.4674090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4674149Z outputs = self.deberta( 2025-09-07T08:03:32.4674455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4674527Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4674791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4674876Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4675087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4675156Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4675461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4675541Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4675813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4675883Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4676184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4676372Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4676419Z 2025-09-07T08:03:32.4676510Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4676703Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4676763Z return mod(**inputs) 2025-09-07T08:03:32.4677039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4677099Z outputs = self.deberta( 2025-09-07T08:03:32.4677369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4677440Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4677711Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4677790Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4678003Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4678074Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4678343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4678425Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4678696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4678765Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4679036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4679213Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4679525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4679642Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4679646Z 2025-09-07T08:03:32.4679738Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4679928Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4679986Z return mod(**inputs) 2025-09-07T08:03:32.4680262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4680359Z outputs = self.deberta( 2025-09-07T08:03:32.4680633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4680704Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4680975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4681054Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4681306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4681380Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4681648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4681734Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4682041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4682109Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4682395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4682493Z context_layer = torch.bmm( 2025-09-07T08:03:32.4682496Z 2025-09-07T08:03:32.4682588Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4682787Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4682846Z return mod(**inputs) 2025-09-07T08:03:32.4683126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4683188Z outputs = self.deberta( 2025-09-07T08:03:32.4683465Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4683534Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4683803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4683888Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4684110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4684186Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4684455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4684538Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4684806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4684877Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4685148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4685332Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4685336Z 2025-09-07T08:03:32.4685435Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4685628Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4685689Z return mod(**inputs) 2025-09-07T08:03:32.4685964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4686026Z outputs = self.deberta( 2025-09-07T08:03:32.4686296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4686397Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4686667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4686749Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4686964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4687037Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4687340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4687424Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4687692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4687808Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4688118Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4688218Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4688221Z 2025-09-07T08:03:32.4688349Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4688548Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4688607Z return mod(**inputs) 2025-09-07T08:03:32.4688884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4688944Z outputs = self.deberta( 2025-09-07T08:03:32.4689217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4689285Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4689553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4689632Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4689846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4689921Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4690187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4690301Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4690569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4690643Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4690649Z 2025-09-07T08:03:32.4690745Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4690935Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4690999Z return mod(**inputs) 2025-09-07T08:03:32.4691266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4691328Z outputs = self.deberta( 2025-09-07T08:03:32.4691603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4691670Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4691941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4692017Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4692232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4692336Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4692604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4692715Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4692989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4693098Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4693342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4693404Z return self.act(input) 2025-09-07T08:03:32.4693412Z 2025-09-07T08:03:32.4693503Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4693695Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4693756Z return mod(**inputs) 2025-09-07T08:03:32.4694079Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4694148Z outputs = self.deberta( 2025-09-07T08:03:32.4694451Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4694518Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4694791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4694870Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4695086Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4695155Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4695425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4695555Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4695823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4695900Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4695905Z 2025-09-07T08:03:32.4695997Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4696191Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4696248Z return mod(**inputs) 2025-09-07T08:03:32.4696518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4696583Z outputs = self.deberta( 2025-09-07T08:03:32.4696852Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4696923Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4697189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4697264Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4697486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4697554Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4697824Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4697907Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4698178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4698282Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4698553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4698742Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4698746Z 2025-09-07T08:03:32.4698837Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4699026Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4699114Z return mod(**inputs) 2025-09-07T08:03:32.4699390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4699454Z outputs = self.deberta( 2025-09-07T08:03:32.4699718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4699819Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4700087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4700164Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4700411Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4700481Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4700753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4700831Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4701103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4701170Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4701440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4701617Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4701621Z 2025-09-07T08:03:32.4701713Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4701903Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4701963Z return mod(**inputs) 2025-09-07T08:03:32.4702237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4702297Z outputs = self.deberta( 2025-09-07T08:03:32.4702565Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4702634Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4702900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4702979Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4703191Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4703257Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4703527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4703609Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4703878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4703979Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4704255Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4704434Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4704746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4704872Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4704908Z 2025-09-07T08:03:32.4705001Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4705192Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4705253Z return mod(**inputs) 2025-09-07T08:03:32.4705523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4705590Z outputs = self.deberta( 2025-09-07T08:03:32.4705970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4706038Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4706366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4706446Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4706659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4706731Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4707001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4707084Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4707360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4707427Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4707691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4707902Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4707907Z 2025-09-07T08:03:32.4708001Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4708197Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4708255Z return mod(**inputs) 2025-09-07T08:03:32.4708532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4708595Z outputs = self.deberta( 2025-09-07T08:03:32.4708861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4708931Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4709197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4709277Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4709488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4709558Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4709957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4710045Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4710327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4710458Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4710735Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4710938Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4710941Z 2025-09-07T08:03:32.4711040Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4711283Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4711346Z return mod(**inputs) 2025-09-07T08:03:32.4711626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4711691Z outputs = self.deberta( 2025-09-07T08:03:32.4711965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4712082Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4712352Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4712479Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4712697Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4712771Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4713043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4713122Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4713390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4713460Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4713731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4713912Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4713917Z 2025-09-07T08:03:32.4714016Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4714213Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4714274Z return mod(**inputs) 2025-09-07T08:03:32.4714555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4714615Z outputs = self.deberta( 2025-09-07T08:03:32.4714886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4714956Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4715224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4715308Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4715526Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4715598Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4715865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4715956Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4716224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4716327Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4716606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4716788Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4717104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4717227Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4717280Z 2025-09-07T08:03:32.4717376Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4717572Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4717630Z return mod(**inputs) 2025-09-07T08:03:32.4717907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4717969Z outputs = self.deberta( 2025-09-07T08:03:32.4718275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4718345Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4718648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4718732Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4718952Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4722402Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4722744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4722847Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4723157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4723234Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4723524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4723599Z context_layer = torch.bmm( 2025-09-07T08:03:32.4723603Z 2025-09-07T08:03:32.4723709Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4723918Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4723984Z return mod(**inputs) 2025-09-07T08:03:32.4724274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4724341Z outputs = self.deberta( 2025-09-07T08:03:32.4724622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4724698Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4724962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4725048Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4725269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4725348Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4725624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4725710Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4725990Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4726124Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4726401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4726592Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4726597Z 2025-09-07T08:03:32.4726695Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4726898Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4726997Z return mod(**inputs) 2025-09-07T08:03:32.4727280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4727345Z outputs = self.deberta( 2025-09-07T08:03:32.4727615Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4727726Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4727996Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4728078Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4728333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4728411Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4728693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4728778Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4729049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4729181Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4729459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4729538Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4729542Z 2025-09-07T08:03:32.4729642Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4729843Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4729905Z return mod(**inputs) 2025-09-07T08:03:32.4730187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4730248Z outputs = self.deberta( 2025-09-07T08:03:32.4730517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4730583Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4730853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4730936Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4731153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4731230Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4731498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4731613Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4731883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4731959Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4731998Z 2025-09-07T08:03:32.4732098Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4732293Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4732360Z return mod(**inputs) 2025-09-07T08:03:32.4732635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4732697Z outputs = self.deberta( 2025-09-07T08:03:32.4732969Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4733069Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4733341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4733416Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4733628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4733737Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4734007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4734120Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4734427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4734543Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4734763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4734829Z return self.act(input) 2025-09-07T08:03:32.4734832Z 2025-09-07T08:03:32.4734929Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4735128Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4735193Z return mod(**inputs) 2025-09-07T08:03:32.4735471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4735535Z outputs = self.deberta( 2025-09-07T08:03:32.4735806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4735872Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4736143Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4736223Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4736438Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4736516Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4736786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4736918Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4737189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4737271Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4737275Z 2025-09-07T08:03:32.4737368Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4737561Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4737624Z return mod(**inputs) 2025-09-07T08:03:32.4737894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4738000Z outputs = self.deberta( 2025-09-07T08:03:32.4738269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4738337Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4738606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4738682Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4738903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4739004Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4739275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4739362Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4739633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4739744Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4740013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4740234Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4740239Z 2025-09-07T08:03:32.4740332Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4740525Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4740588Z return mod(**inputs) 2025-09-07T08:03:32.4740860Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4740926Z outputs = self.deberta( 2025-09-07T08:03:32.4741193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4741263Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4741528Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4741605Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4741824Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4741891Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4742160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4742242Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4742508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4742584Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4742851Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4743029Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4743033Z 2025-09-07T08:03:32.4743124Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4743316Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4743377Z return mod(**inputs) 2025-09-07T08:03:32.4743645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4743709Z outputs = self.deberta( 2025-09-07T08:03:32.4743978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4744101Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4744371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4744444Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4744660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4744728Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4744996Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4745370Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4745642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4745768Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4746070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4746258Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4746600Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4746731Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4746735Z 2025-09-07T08:03:32.4746828Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4747021Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4747083Z return mod(**inputs) 2025-09-07T08:03:32.4747356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4747424Z outputs = self.deberta( 2025-09-07T08:03:32.4747696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4747762Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4748031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4748105Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4748326Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4748395Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4748663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4748744Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4749013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4749087Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4749353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4749570Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4749574Z 2025-09-07T08:03:32.4749663Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4749857Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4749915Z return mod(**inputs) 2025-09-07T08:03:32.4750181Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4750281Z outputs = self.deberta( 2025-09-07T08:03:32.4750548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4750613Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4750882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4750962Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4751177Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4751279Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4751553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4751635Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4751905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4752008Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4752287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4752524Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4752528Z 2025-09-07T08:03:32.4752623Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4752821Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4752881Z return mod(**inputs) 2025-09-07T08:03:32.4753158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4753222Z outputs = self.deberta( 2025-09-07T08:03:32.4753492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4753561Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4753827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4753909Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4754122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4754193Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4754461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4754548Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4754815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4754887Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4755155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4755342Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4755347Z 2025-09-07T08:03:32.4755438Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4755627Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4755689Z return mod(**inputs) 2025-09-07T08:03:32.4755965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4756027Z outputs = self.deberta( 2025-09-07T08:03:32.4756292Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4756396Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4756665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4756744Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4756961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4757033Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4757334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4757417Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4757686Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4757756Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4758054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4758236Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4758578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4758703Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4758708Z 2025-09-07T08:03:32.4758798Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4758988Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4759046Z return mod(**inputs) 2025-09-07T08:03:32.4759320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4759380Z outputs = self.deberta( 2025-09-07T08:03:32.4759645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4759713Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4759978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4760056Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4760269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4760337Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4760608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4760692Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4760962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4761027Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4761297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4761362Z context_layer = torch.bmm( 2025-09-07T08:03:32.4761365Z 2025-09-07T08:03:32.4761456Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4761643Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4761701Z return mod(**inputs) 2025-09-07T08:03:32.4761975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4762036Z outputs = self.deberta( 2025-09-07T08:03:32.4762342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4762410Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4762675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4762754Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4762965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4763069Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4763336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4763417Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4763688Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4763759Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4764066Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4764250Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4764299Z 2025-09-07T08:03:32.4764392Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4764586Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4764647Z return mod(**inputs) 2025-09-07T08:03:32.4764922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4764983Z outputs = self.deberta( 2025-09-07T08:03:32.4765254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4765322Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4765588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4765666Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4765879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4765952Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4766221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4766303Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4766573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4766683Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4766955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4767029Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4767033Z 2025-09-07T08:03:32.4767127Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4767312Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4767369Z return mod(**inputs) 2025-09-07T08:03:32.4767647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4767707Z outputs = self.deberta( 2025-09-07T08:03:32.4767975Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4768073Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4768346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4768423Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4768637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4768713Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4768978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4769136Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4769406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4769481Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4769487Z 2025-09-07T08:03:32.4769581Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4769807Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4769873Z return mod(**inputs) 2025-09-07T08:03:32.4770178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4770243Z outputs = self.deberta( 2025-09-07T08:03:32.4770517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4770584Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4770856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4770930Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4771148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4771218Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4771485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4771596Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4771863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4771969Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4772178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4772243Z return self.act(input) 2025-09-07T08:03:32.4772247Z 2025-09-07T08:03:32.4772343Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4772531Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4772592Z return mod(**inputs) 2025-09-07T08:03:32.4772861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4772922Z outputs = self.deberta( 2025-09-07T08:03:32.4773195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4773259Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4773530Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4773606Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4773820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4773931Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4774203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4774327Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4774596Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4774677Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4774681Z 2025-09-07T08:03:32.4774772Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4775001Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4775062Z return mod(**inputs) 2025-09-07T08:03:32.4775330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4775400Z outputs = self.deberta( 2025-09-07T08:03:32.4775700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4775770Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4776037Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4776144Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4776364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4776437Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4776710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4776790Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4777053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4777128Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4777397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4777589Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4777592Z 2025-09-07T08:03:32.4777685Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4777879Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4777936Z return mod(**inputs) 2025-09-07T08:03:32.4778206Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4778272Z outputs = self.deberta( 2025-09-07T08:03:32.4778540Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4778616Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4778883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4778958Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4779178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4779251Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4779524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4779605Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4779871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4779974Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4780244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 237, in forward 2025-09-07T08:03:32.4780423Z key_layer = self.transpose_for_scores(self.key_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4780426Z 2025-09-07T08:03:32.4780518Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4780712Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4780814Z return mod(**inputs) 2025-09-07T08:03:32.4781084Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4781148Z outputs = self.deberta( 2025-09-07T08:03:32.4781415Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4781484Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4781783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4781865Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4782108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4782179Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4782453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4782535Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4782808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4782877Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4783144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 236, in forward 2025-09-07T08:03:32.4783326Z query_layer = self.transpose_for_scores(self.query_proj(query_states), self.num_attention_heads) 2025-09-07T08:03:32.4783647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4783769Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4783774Z 2025-09-07T08:03:32.4783868Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4784063Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4784125Z return mod(**inputs) 2025-09-07T08:03:32.4784403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4784466Z outputs = self.deberta( 2025-09-07T08:03:32.4784733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4784804Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4785074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4785156Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4785373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4785448Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4785778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4785862Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4786176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4786247Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4786522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4786727Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4786731Z 2025-09-07T08:03:32.4786831Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4787052Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4787110Z return mod(**inputs) 2025-09-07T08:03:32.4787385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4787451Z outputs = self.deberta( 2025-09-07T08:03:32.4787776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4787844Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4788115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4788228Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4788447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4788526Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4788793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4788874Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4789152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4789223Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4789499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 248, in forward 2025-09-07T08:03:32.4789693Z attention_scores = torch.bmm(query_layer, key_layer.transpose(-1, -2) / scale.to(dtype=query_layer.dtype)) 2025-09-07T08:03:32.4789697Z 2025-09-07T08:03:32.4789793Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4789980Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4790039Z return mod(**inputs) 2025-09-07T08:03:32.4790315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4790376Z outputs = self.deberta( 2025-09-07T08:03:32.4790654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4790720Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4790986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4791066Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4791280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4791355Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4791625Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4791711Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4791978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4792082Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4792358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4792542Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4792547Z 2025-09-07T08:03:32.4792645Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4792831Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4792928Z return mod(**inputs) 2025-09-07T08:03:32.4793203Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4793263Z outputs = self.deberta( 2025-09-07T08:03:32.4793537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4793606Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4793912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4793987Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4794233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4794316Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4794597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4794692Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4794963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4795041Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4795319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 238, in forward 2025-09-07T08:03:32.4795507Z value_layer = self.transpose_for_scores(self.value_proj(hidden_states), self.num_attention_heads) 2025-09-07T08:03:32.4795827Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 194, in transpose_for_scores 2025-09-07T08:03:32.4795952Z return x.permute(0, 2, 1, 3).contiguous().view(-1, x.size(1), x.size(-1)) 2025-09-07T08:03:32.4795957Z 2025-09-07T08:03:32.4796065Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4796263Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4796328Z return mod(**inputs) 2025-09-07T08:03:32.4796611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4796679Z outputs = self.deberta( 2025-09-07T08:03:32.4796955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4797025Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4797302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4797387Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4797611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4797695Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4797962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4798099Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4798369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4798441Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4798714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 268, in forward 2025-09-07T08:03:32.4798783Z context_layer = torch.bmm( 2025-09-07T08:03:32.4798787Z 2025-09-07T08:03:32.4798888Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4799120Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4799187Z return mod(**inputs) 2025-09-07T08:03:32.4799464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4799529Z outputs = self.deberta( 2025-09-07T08:03:32.4799837Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4799906Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4800182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4800297Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4800518Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4800598Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4800867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4800955Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4801222Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 371, in forward 2025-09-07T08:03:32.4801296Z self_output, att_matrix = self.self( 2025-09-07T08:03:32.4801577Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 272, in forward 2025-09-07T08:03:32.4801763Z context_layer.view(-1, self.num_attention_heads, context_layer.size(-2), context_layer.size(-1)) 2025-09-07T08:03:32.4801767Z 2025-09-07T08:03:32.4801870Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4802063Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4802134Z return mod(**inputs) 2025-09-07T08:03:32.4802408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4802471Z outputs = self.deberta( 2025-09-07T08:03:32.4802745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4802815Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4803087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4803162Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4803383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4803456Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4803726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 438, in forward 2025-09-07T08:03:32.4803812Z attention_output, att_matrix = self.attention( 2025-09-07T08:03:32.4804079Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 381, in forward 2025-09-07T08:03:32.4804240Z attention_output = self.output(self_output, query_states) 2025-09-07T08:03:32.4804513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 52, in forward 2025-09-07T08:03:32.4804594Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4804597Z 2025-09-07T08:03:32.4804698Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4804889Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4804955Z return mod(**inputs) 2025-09-07T08:03:32.4805262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4805333Z outputs = self.deberta( 2025-09-07T08:03:32.4805603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4805673Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4806014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4806091Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4806345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4806417Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4806692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4806813Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4807082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 400, in forward 2025-09-07T08:03:32.4807162Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4807167Z 2025-09-07T08:03:32.4807261Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4807454Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4807516Z return mod(**inputs) 2025-09-07T08:03:32.4807790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4807858Z outputs = self.deberta( 2025-09-07T08:03:32.4808124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4808200Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4808466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4808541Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4808761Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4808833Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4809106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 446, in forward 2025-09-07T08:03:32.4809212Z intermediate_output = self.intermediate(attention_output) 2025-09-07T08:03:32.4809479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 401, in forward 2025-09-07T08:03:32.4809596Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:03:32.4810043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:32.4810116Z return self.act(input) 2025-09-07T08:03:32.4810119Z 2025-09-07T08:03:32.4810213Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4810501Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4810562Z return mod(**inputs) 2025-09-07T08:03:32.4810839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1231, in forward 2025-09-07T08:03:32.4810907Z outputs = self.deberta( 2025-09-07T08:03:32.4811176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 786, in forward 2025-09-07T08:03:32.4811251Z encoder_outputs = self.encoder( 2025-09-07T08:03:32.4811515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 659, in forward 2025-09-07T08:03:32.4811662Z output_states, attn_weights = layer_module( 2025-09-07T08:03:32.4811883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:32.4811954Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:32.4812284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 447, in forward 2025-09-07T08:03:32.4812411Z layer_output = self.output(intermediate_output, attention_output) 2025-09-07T08:03:32.4812738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 415, in forward 2025-09-07T08:03:32.4812815Z hidden_states = self.dense(hidden_states) 2025-09-07T08:03:32.4812819Z 2025-09-07T08:03:32.4812908Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4813105Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4813166Z return mod(**inputs) 2025-09-07T08:03:32.4813446Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1244, in forward 2025-09-07T08:03:32.4813523Z logits = self.qa_outputs(sequence_output) 2025-09-07T08:03:32.4813527Z 2025-09-07T08:03:32.4813622Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4813817Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4813877Z return mod(**inputs) 2025-09-07T08:03:32.4814153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1262, in forward 2025-09-07T08:03:32.4814252Z start_loss = loss_fct(start_logits, start_positions) 2025-09-07T08:03:32.4814255Z 2025-09-07T08:03:32.4814355Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:32.4814543Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:32.4814601Z return mod(**inputs) 2025-09-07T08:03:32.4814875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/deberta_v2/modeling_deberta_v2.py", line 1263, in forward 2025-09-07T08:03:32.4814969Z end_loss = loss_fct(end_logits, end_positions) 2025-09-07T08:03:32.4814973Z 2025-09-07T08:03:42.6072274Z pass 2025-09-07T08:03:42.6072673Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:03:46.1922159Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:03:46.1923020Z import pynvml # type: ignore[import] 2025-09-07T08:03:48.8662511Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:03:48.8663748Z from pkg_resources import resource_filename 2025-09-07T08:03:49.4938244Z 2025-09-07T08:03:50.4607951Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:03:50.4611532Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:03:50.4723376Z cpu eval DistilBertForMaskedLM 2025-09-07T08:03:50.6119304Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:03:50.6692092Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:03:50.7247323Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:03:57.0427783Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0428077Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0428287Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0428493Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0428694Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0428928Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0429561Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0429960Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0430308Z return mod(**inputs) 2025-09-07T08:03:57.0430846Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0431292Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0431720Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0432141Z return self.transformer( 2025-09-07T08:03:57.0432546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0432959Z layer_outputs = layer_module( 2025-09-07T08:03:57.0433320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0433697Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0434106Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0434524Z sa_output = self.attention( 2025-09-07T08:03:57.0434931Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:03:57.0435408Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:03:57.0435591Z 2025-09-07T08:03:57.0435699Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0436059Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0436401Z return mod(**inputs) 2025-09-07T08:03:57.0436783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0437201Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0437634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0438030Z return self.transformer( 2025-09-07T08:03:57.0438418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0438833Z layer_outputs = layer_module( 2025-09-07T08:03:57.0439174Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0439525Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0439933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0440431Z sa_output = self.attention( 2025-09-07T08:03:57.0440823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:03:57.0441280Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0441451Z 2025-09-07T08:03:57.0441555Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0441905Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0442225Z return mod(**inputs) 2025-09-07T08:03:57.0442678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0443090Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0443490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0443922Z return self.transformer( 2025-09-07T08:03:57.0444346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0444761Z layer_outputs = layer_module( 2025-09-07T08:03:57.0445131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0445486Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0445890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0446300Z sa_output = self.attention( 2025-09-07T08:03:57.0446704Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:03:57.0447173Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0447355Z 2025-09-07T08:03:57.0447522Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0447764Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0448128Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0448452Z return mod(**inputs) 2025-09-07T08:03:57.0448848Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0449264Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0449668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0450077Z return self.transformer( 2025-09-07T08:03:57.0450471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0450875Z layer_outputs = layer_module( 2025-09-07T08:03:57.0451226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0451584Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0451997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0452407Z sa_output = self.attention( 2025-09-07T08:03:57.0452791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:03:57.0453258Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:03:57.0453444Z 2025-09-07T08:03:57.0453544Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0453906Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0454221Z return mod(**inputs) 2025-09-07T08:03:57.0454650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0455061Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0455460Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0455863Z return self.transformer( 2025-09-07T08:03:57.0456247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0456696Z layer_outputs = layer_module( 2025-09-07T08:03:57.0457035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0457392Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0457804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0458203Z sa_output = self.attention( 2025-09-07T08:03:57.0458627Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:03:57.0459045Z attn_output = self.out_lin(attn_output) 2025-09-07T08:03:57.0459175Z 2025-09-07T08:03:57.0459274Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0459657Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0459975Z return mod(**inputs) 2025-09-07T08:03:57.0460354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0460759Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0461154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0461575Z return self.transformer( 2025-09-07T08:03:57.0461963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0462363Z layer_outputs = layer_module( 2025-09-07T08:03:57.0462702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0463056Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0463453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0463895Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0464331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0464871Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0465407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0465870Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0466286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:03:57.0466697Z x = self.lin1(input) 2025-09-07T08:03:57.0466793Z 2025-09-07T08:03:57.0466898Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0467244Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0467563Z return mod(**inputs) 2025-09-07T08:03:57.0467939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0468346Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0468790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0469191Z return self.transformer( 2025-09-07T08:03:57.0469584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0469993Z layer_outputs = layer_module( 2025-09-07T08:03:57.0470338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0470691Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0471129Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0471571Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0472008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0472582Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0473102Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0473485Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0473962Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:03:57.0474394Z x = self.activation(x) 2025-09-07T08:03:57.0474718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:57.0475046Z return self.act(input) 2025-09-07T08:03:57.0475153Z 2025-09-07T08:03:57.0475251Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0475604Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0475927Z return mod(**inputs) 2025-09-07T08:03:57.0476308Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0476711Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0477105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0477508Z return self.transformer( 2025-09-07T08:03:57.0477892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0478302Z layer_outputs = layer_module( 2025-09-07T08:03:57.0478631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0478983Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0479387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0479832Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0480262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0480802Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0481316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0481711Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0482125Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:03:57.0482525Z x = self.lin2(x) 2025-09-07T08:03:57.0482627Z 2025-09-07T08:03:57.0482769Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0483120Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0483440Z return mod(**inputs) 2025-09-07T08:03:57.0483816Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0484220Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0484614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0485060Z return self.transformer( 2025-09-07T08:03:57.0485443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0485847Z layer_outputs = layer_module( 2025-09-07T08:03:57.0486176Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0486534Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0486967Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0487371Z sa_output = self.attention( 2025-09-07T08:03:57.0487784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:03:57.0488250Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:03:57.0488433Z 2025-09-07T08:03:57.0488529Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0488876Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0489191Z return mod(**inputs) 2025-09-07T08:03:57.0489558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0489971Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0490370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0490774Z return self.transformer( 2025-09-07T08:03:57.0491161Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0491561Z layer_outputs = layer_module( 2025-09-07T08:03:57.0491892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0492241Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0492642Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0493036Z sa_output = self.attention( 2025-09-07T08:03:57.0493421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:03:57.0493870Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0494039Z 2025-09-07T08:03:57.0494140Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0494481Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0494786Z return mod(**inputs) 2025-09-07T08:03:57.0495157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0495559Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0495950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0496348Z return self.transformer( 2025-09-07T08:03:57.0496725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0497181Z layer_outputs = layer_module( 2025-09-07T08:03:57.0497514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0497866Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0498267Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0498673Z sa_output = self.attention( 2025-09-07T08:03:57.0499093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:03:57.0499545Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0499716Z 2025-09-07T08:03:57.0499798Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0500018Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0500393Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0500713Z return mod(**inputs) 2025-09-07T08:03:57.0501090Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0501528Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0501925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0502327Z return self.transformer( 2025-09-07T08:03:57.0502713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0503113Z layer_outputs = layer_module( 2025-09-07T08:03:57.0503435Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0503790Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0504192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0504591Z sa_output = self.attention( 2025-09-07T08:03:57.0504985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:03:57.0505442Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:03:57.0505629Z 2025-09-07T08:03:57.0505778Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0506145Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0506468Z return mod(**inputs) 2025-09-07T08:03:57.0506857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0507270Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0507680Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0508092Z return self.transformer( 2025-09-07T08:03:57.0508488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0508890Z layer_outputs = layer_module( 2025-09-07T08:03:57.0509228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0509586Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0510175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0510580Z sa_output = self.attention( 2025-09-07T08:03:57.0510963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:03:57.0511456Z attn_output = self.out_lin(attn_output) 2025-09-07T08:03:57.0511594Z 2025-09-07T08:03:57.0511693Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0512049Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0512379Z return mod(**inputs) 2025-09-07T08:03:57.0512753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0513221Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0513621Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0514026Z return self.transformer( 2025-09-07T08:03:57.0514405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0514817Z layer_outputs = layer_module( 2025-09-07T08:03:57.0516396Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0516773Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0517262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0517701Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0518145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0518681Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0519205Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0519602Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0520011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:03:57.0520417Z x = self.lin1(input) 2025-09-07T08:03:57.0520525Z 2025-09-07T08:03:57.0520625Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0520982Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0521299Z return mod(**inputs) 2025-09-07T08:03:57.0521684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0522097Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0522507Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0522914Z return self.transformer( 2025-09-07T08:03:57.0523303Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0523709Z layer_outputs = layer_module( 2025-09-07T08:03:57.0524053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0524456Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0524883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0525326Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0525770Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0526315Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0526889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0527289Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0527693Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:03:57.0528118Z x = self.activation(x) 2025-09-07T08:03:57.0528441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:57.0528813Z return self.act(input) 2025-09-07T08:03:57.0528915Z 2025-09-07T08:03:57.0529022Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0529380Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0529701Z return mod(**inputs) 2025-09-07T08:03:57.0530084Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0530544Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0530939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0531342Z return self.transformer( 2025-09-07T08:03:57.0531765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0532172Z layer_outputs = layer_module( 2025-09-07T08:03:57.0532514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0532862Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0533266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0533706Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0534149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0534683Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0535185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0535573Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0535984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:03:57.0536386Z x = self.lin2(x) 2025-09-07T08:03:57.0536478Z 2025-09-07T08:03:57.0536581Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0536929Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0537243Z return mod(**inputs) 2025-09-07T08:03:57.0537623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0538034Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0538420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0538821Z return self.transformer( 2025-09-07T08:03:57.0539204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0539611Z layer_outputs = layer_module( 2025-09-07T08:03:57.0539945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0540288Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0540734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0541140Z sa_output = self.attention( 2025-09-07T08:03:57.0541532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:03:57.0541989Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:03:57.0542164Z 2025-09-07T08:03:57.0542257Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0542612Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0543011Z return mod(**inputs) 2025-09-07T08:03:57.0543399Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0543812Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0544219Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0544663Z return self.transformer( 2025-09-07T08:03:57.0545055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0545459Z layer_outputs = layer_module( 2025-09-07T08:03:57.0545879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0546240Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0546658Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0547069Z sa_output = self.attention( 2025-09-07T08:03:57.0547458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:03:57.0547908Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0548086Z 2025-09-07T08:03:57.0548186Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0548540Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0548862Z return mod(**inputs) 2025-09-07T08:03:57.0549233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0549638Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0550036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0550440Z return self.transformer( 2025-09-07T08:03:57.0550820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0551219Z layer_outputs = layer_module( 2025-09-07T08:03:57.0551556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0551917Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0552325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0552735Z sa_output = self.attention( 2025-09-07T08:03:57.0553112Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:03:57.0553566Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0553751Z 2025-09-07T08:03:57.0553831Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0554060Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0554403Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0554768Z return mod(**inputs) 2025-09-07T08:03:57.0555144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0555556Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0555950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0556343Z return self.transformer( 2025-09-07T08:03:57.0556737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0557191Z layer_outputs = layer_module( 2025-09-07T08:03:57.0557531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0557880Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0558279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0558729Z sa_output = self.attention( 2025-09-07T08:03:57.0559114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:03:57.0559616Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:03:57.0559798Z 2025-09-07T08:03:57.0559897Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0560232Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0560549Z return mod(**inputs) 2025-09-07T08:03:57.0560924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0561326Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0561710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0562117Z return self.transformer( 2025-09-07T08:03:57.0562604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0563012Z layer_outputs = layer_module( 2025-09-07T08:03:57.0563351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0563698Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0564109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0564511Z sa_output = self.attention( 2025-09-07T08:03:57.0564893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:03:57.0565307Z attn_output = self.out_lin(attn_output) 2025-09-07T08:03:57.0565450Z 2025-09-07T08:03:57.0565546Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0565891Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0566206Z return mod(**inputs) 2025-09-07T08:03:57.0566582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0566979Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0567375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0567781Z return self.transformer( 2025-09-07T08:03:57.0568168Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0568568Z layer_outputs = layer_module( 2025-09-07T08:03:57.0568943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0569289Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0569692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0570135Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0570565Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0571141Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0571655Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0572049Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0572461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:03:57.0572895Z x = self.lin1(input) 2025-09-07T08:03:57.0572997Z 2025-09-07T08:03:57.0573091Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0573470Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0573791Z return mod(**inputs) 2025-09-07T08:03:57.0574163Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0574564Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0574958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0575357Z return self.transformer( 2025-09-07T08:03:57.0575741Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0576145Z layer_outputs = layer_module( 2025-09-07T08:03:57.0576468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0576816Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0577224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0584909Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0585450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0586079Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0586633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0587041Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0587463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:03:57.0587885Z x = self.activation(x) 2025-09-07T08:03:57.0588218Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:57.0588557Z return self.act(input) 2025-09-07T08:03:57.0588668Z 2025-09-07T08:03:57.0588780Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0589148Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0589478Z return mod(**inputs) 2025-09-07T08:03:57.0589874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0590399Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0590815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0591239Z return self.transformer( 2025-09-07T08:03:57.0591635Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0592050Z layer_outputs = layer_module( 2025-09-07T08:03:57.0592397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0592802Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0593217Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0593666Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0594107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0594763Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0595286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0595730Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0596144Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:03:57.0596555Z x = self.lin2(x) 2025-09-07T08:03:57.0596651Z 2025-09-07T08:03:57.0596750Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0597120Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0597442Z return mod(**inputs) 2025-09-07T08:03:57.0597829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0598243Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0598634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0599039Z return self.transformer( 2025-09-07T08:03:57.0599424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0599829Z layer_outputs = layer_module( 2025-09-07T08:03:57.0600175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0600531Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0600937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0601348Z sa_output = self.attention( 2025-09-07T08:03:57.0601742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:03:57.0602192Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:03:57.0602378Z 2025-09-07T08:03:57.0602476Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0602829Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0603157Z return mod(**inputs) 2025-09-07T08:03:57.0603537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0603935Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0604330Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0604784Z return self.transformer( 2025-09-07T08:03:57.0605167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0605601Z layer_outputs = layer_module( 2025-09-07T08:03:57.0605948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0606303Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0606714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0607163Z sa_output = self.attention( 2025-09-07T08:03:57.0607548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:03:57.0608005Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0608188Z 2025-09-07T08:03:57.0608285Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0608671Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0608999Z return mod(**inputs) 2025-09-07T08:03:57.0609370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0610024Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0610428Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0610842Z return self.transformer( 2025-09-07T08:03:57.0611226Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0611623Z layer_outputs = layer_module( 2025-09-07T08:03:57.0611960Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0612314Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0612718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0613123Z sa_output = self.attention( 2025-09-07T08:03:57.0613507Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:03:57.0613960Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0614141Z 2025-09-07T08:03:57.0614218Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0614444Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0614782Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0615094Z return mod(**inputs) 2025-09-07T08:03:57.0615474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0615882Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0616279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0616674Z return self.transformer( 2025-09-07T08:03:57.0617060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0617462Z layer_outputs = layer_module( 2025-09-07T08:03:57.0617795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0618139Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0618541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0619028Z sa_output = self.attention( 2025-09-07T08:03:57.0619416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:03:57.0619879Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:03:57.0620059Z 2025-09-07T08:03:57.0620154Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0620500Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0620820Z return mod(**inputs) 2025-09-07T08:03:57.0621245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0621653Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0622041Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0622443Z return self.transformer( 2025-09-07T08:03:57.0622894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0623304Z layer_outputs = layer_module( 2025-09-07T08:03:57.0623632Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0624015Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0624422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0624820Z sa_output = self.attention( 2025-09-07T08:03:57.0625204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:03:57.0625616Z attn_output = self.out_lin(attn_output) 2025-09-07T08:03:57.0625817Z 2025-09-07T08:03:57.0625911Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0626257Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0626576Z return mod(**inputs) 2025-09-07T08:03:57.0626949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0627351Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0627742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0628142Z return self.transformer( 2025-09-07T08:03:57.0628523Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0628923Z layer_outputs = layer_module( 2025-09-07T08:03:57.0629252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0629605Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0630009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0630447Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0630876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0631422Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0631953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0632348Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0632757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:03:57.0633213Z x = self.lin1(input) 2025-09-07T08:03:57.0633316Z 2025-09-07T08:03:57.0633412Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0633767Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0634088Z return mod(**inputs) 2025-09-07T08:03:57.0634473Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0634881Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0635278Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0635727Z return self.transformer( 2025-09-07T08:03:57.0636115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0636523Z layer_outputs = layer_module( 2025-09-07T08:03:57.0636892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0637264Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0637672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0638144Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0638579Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0639119Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0639630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0640016Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0640424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:03:57.0640830Z x = self.activation(x) 2025-09-07T08:03:57.0641149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:57.0641484Z return self.act(input) 2025-09-07T08:03:57.0641585Z 2025-09-07T08:03:57.0641693Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0642044Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0642357Z return mod(**inputs) 2025-09-07T08:03:57.0642732Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0643141Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0643533Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0643934Z return self.transformer( 2025-09-07T08:03:57.0644318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0644720Z layer_outputs = layer_module( 2025-09-07T08:03:57.0645059Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0645412Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0645807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0646247Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0646677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0647261Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0647775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0648156Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0648557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:03:57.0648957Z x = self.lin2(x) 2025-09-07T08:03:57.0649049Z 2025-09-07T08:03:57.0649151Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0649535Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0649845Z return mod(**inputs) 2025-09-07T08:03:57.0650219Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0650630Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0651064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0651468Z return self.transformer( 2025-09-07T08:03:57.0651889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0652294Z layer_outputs = layer_module( 2025-09-07T08:03:57.0652626Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0652980Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0653376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0653784Z sa_output = self.attention( 2025-09-07T08:03:57.0654177Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:03:57.0654640Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:03:57.0654815Z 2025-09-07T08:03:57.0654915Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0655253Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0655571Z return mod(**inputs) 2025-09-07T08:03:57.0655949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0656358Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0656843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0657301Z return self.transformer( 2025-09-07T08:03:57.0657712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0658140Z layer_outputs = layer_module( 2025-09-07T08:03:57.0658492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0658855Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0659269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0659682Z sa_output = self.attention( 2025-09-07T08:03:57.0660074Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:03:57.0660532Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0660705Z 2025-09-07T08:03:57.0660810Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0661165Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0661539Z return mod(**inputs) 2025-09-07T08:03:57.0661921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0662330Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0662725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0663123Z return self.transformer( 2025-09-07T08:03:57.0663510Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0663955Z layer_outputs = layer_module( 2025-09-07T08:03:57.0664295Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0664647Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0665093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0665502Z sa_output = self.attention( 2025-09-07T08:03:57.0665974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:03:57.0666469Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0666647Z 2025-09-07T08:03:57.0666726Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0666958Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0667316Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0667632Z return mod(**inputs) 2025-09-07T08:03:57.0668005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0668419Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0668818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0669225Z return self.transformer( 2025-09-07T08:03:57.0669612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0670009Z layer_outputs = layer_module( 2025-09-07T08:03:57.0670349Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0670707Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0671117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0671524Z sa_output = self.attention( 2025-09-07T08:03:57.0671903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:03:57.0672366Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:03:57.0672553Z 2025-09-07T08:03:57.0672649Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0672992Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0673308Z return mod(**inputs) 2025-09-07T08:03:57.0676228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0676664Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0677089Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0677500Z return self.transformer( 2025-09-07T08:03:57.0677901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0678316Z layer_outputs = layer_module( 2025-09-07T08:03:57.0678665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0679029Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0679444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0679886Z sa_output = self.attention( 2025-09-07T08:03:57.0680272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:03:57.0680764Z attn_output = self.out_lin(attn_output) 2025-09-07T08:03:57.0680906Z 2025-09-07T08:03:57.0681010Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0681371Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0681695Z return mod(**inputs) 2025-09-07T08:03:57.0682110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0682522Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0682958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0683369Z return self.transformer( 2025-09-07T08:03:57.0683749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0684160Z layer_outputs = layer_module( 2025-09-07T08:03:57.0684502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0684862Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0685275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0685732Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0686170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0686715Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0687239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0687637Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0688040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:03:57.0688449Z x = self.lin1(input) 2025-09-07T08:03:57.0688555Z 2025-09-07T08:03:57.0688655Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0689014Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0689335Z return mod(**inputs) 2025-09-07T08:03:57.0689703Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0690147Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0690545Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0691050Z return self.transformer( 2025-09-07T08:03:57.0691430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0691848Z layer_outputs = layer_module( 2025-09-07T08:03:57.0692189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0692546Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0692953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0693383Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0693825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0694356Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0694918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0695310Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0695708Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:03:57.0696120Z x = self.activation(x) 2025-09-07T08:03:57.0696476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:57.0696816Z return self.act(input) 2025-09-07T08:03:57.0696915Z 2025-09-07T08:03:57.0697020Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0697406Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0697738Z return mod(**inputs) 2025-09-07T08:03:57.0698133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0698549Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0698943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0699351Z return self.transformer( 2025-09-07T08:03:57.0699744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0700146Z layer_outputs = layer_module( 2025-09-07T08:03:57.0700480Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0700834Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0701238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0701680Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0702113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0702641Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0703145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0703537Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0703941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:03:57.0704346Z x = self.lin2(x) 2025-09-07T08:03:57.0704439Z 2025-09-07T08:03:57.0704540Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0704938Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0705258Z return mod(**inputs) 2025-09-07T08:03:57.0705638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0706119Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0706508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0706916Z return self.transformer( 2025-09-07T08:03:57.0707309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0707718Z layer_outputs = layer_module( 2025-09-07T08:03:57.0708052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0708399Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0708805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0709476Z sa_output = self.attention( 2025-09-07T08:03:57.0710014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:03:57.0710487Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:03:57.0710667Z 2025-09-07T08:03:57.0710826Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0711186Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0711509Z return mod(**inputs) 2025-09-07T08:03:57.0711944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0712367Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0712778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0713202Z return self.transformer( 2025-09-07T08:03:57.0713596Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0714004Z layer_outputs = layer_module( 2025-09-07T08:03:57.0714336Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0714694Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0715100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0715510Z sa_output = self.attention( 2025-09-07T08:03:57.0715900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:03:57.0716349Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0716525Z 2025-09-07T08:03:57.0716621Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0716970Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0717288Z return mod(**inputs) 2025-09-07T08:03:57.0717660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0718066Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0718461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0718864Z return self.transformer( 2025-09-07T08:03:57.0719244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0719722Z layer_outputs = layer_module( 2025-09-07T08:03:57.0720062Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0720415Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0720819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0721229Z sa_output = self.attention( 2025-09-07T08:03:57.0721606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:03:57.0722060Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:03:57.0722239Z 2025-09-07T08:03:57.0722319Z cudagraph partition due to non gpu ops 2025-09-07T08:03:57.0722546Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0722888Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0723286Z return mod(**inputs) 2025-09-07T08:03:57.0723665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0724069Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0724465Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0724865Z return self.transformer( 2025-09-07T08:03:57.0725283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0725694Z layer_outputs = layer_module( 2025-09-07T08:03:57.0726063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0726423Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0726820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0727227Z sa_output = self.attention( 2025-09-07T08:03:57.0727614Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:03:57.0728075Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:03:57.0728257Z 2025-09-07T08:03:57.0728362Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0728706Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0729022Z return mod(**inputs) 2025-09-07T08:03:57.0729396Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0729801Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0730186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0730596Z return self.transformer( 2025-09-07T08:03:57.0730991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0731393Z layer_outputs = layer_module( 2025-09-07T08:03:57.0731716Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0732060Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0732455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:03:57.0732846Z sa_output = self.attention( 2025-09-07T08:03:57.0733227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:03:57.0733704Z attn_output = self.out_lin(attn_output) 2025-09-07T08:03:57.0733833Z 2025-09-07T08:03:57.0733929Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0734263Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0734570Z return mod(**inputs) 2025-09-07T08:03:57.0734941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0735345Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0735734Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0736122Z return self.transformer( 2025-09-07T08:03:57.0736499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0736901Z layer_outputs = layer_module( 2025-09-07T08:03:57.0737264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0737609Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0738001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0738436Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0738897Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0739437Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0739983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0740374Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0740780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:03:57.0741181Z x = self.lin1(input) 2025-09-07T08:03:57.0741277Z 2025-09-07T08:03:57.0741374Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0741708Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0742014Z return mod(**inputs) 2025-09-07T08:03:57.0742384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0742783Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0743178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0743572Z return self.transformer( 2025-09-07T08:03:57.0743950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0744347Z layer_outputs = layer_module( 2025-09-07T08:03:57.0744668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0745013Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0745402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0745894Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0746324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0746854Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0747408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0747788Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0748192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:03:57.0748592Z x = self.activation(x) 2025-09-07T08:03:57.0748905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:03:57.0749228Z return self.act(input) 2025-09-07T08:03:57.0749332Z 2025-09-07T08:03:57.0749425Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0749767Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0750078Z return mod(**inputs) 2025-09-07T08:03:57.0750443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 826, in forward 2025-09-07T08:03:57.0750897Z dlbrt_output = self.distilbert( 2025-09-07T08:03:57.0751289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:03:57.0751689Z return self.transformer( 2025-09-07T08:03:57.0752068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:03:57.0752465Z layer_outputs = layer_module( 2025-09-07T08:03:57.0752818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:03:57.0753174Z return super().__call__(*args, **kwargs) 2025-09-07T08:03:57.0753606Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:03:57.0754043Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:03:57.0754469Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:03:57.0754995Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:03:57.0755496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:03:57.0755878Z return forward_fn(*input_tensors) 2025-09-07T08:03:57.0756275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:03:57.0756673Z x = self.lin2(x) 2025-09-07T08:03:57.0756764Z 2025-09-07T08:03:57.0756856Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0757199Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0757510Z return mod(**inputs) 2025-09-07T08:03:57.0757877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 836, in forward 2025-09-07T08:03:57.0758361Z prediction_logits = self.vocab_transform(hidden_states) # (bs, seq_length, dim) 2025-09-07T08:03:57.0758578Z 2025-09-07T08:03:57.0758667Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0759001Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0759305Z return mod(**inputs) 2025-09-07T08:03:57.0759672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 839, in forward 2025-09-07T08:03:57.0760180Z prediction_logits = self.vocab_projector(prediction_logits) # (bs, seq_length, vocab_size) 2025-09-07T08:03:57.0760422Z 2025-09-07T08:03:57.0760512Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:03:57.0760893Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:03:57.0761202Z return mod(**inputs) 2025-09-07T08:03:57.0761566Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 843, in forward 2025-09-07T08:03:57.0762095Z mlm_loss = self.mlm_loss_fct(prediction_logits.view(-1, prediction_logits.size(-1)), labels.view(-1)) 2025-09-07T08:03:57.0762344Z 2025-09-07T08:04:02.7645735Z pass 2025-09-07T08:04:02.7646185Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:04:05.5648562Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:04:05.5649424Z import pynvml # type: ignore[import] 2025-09-07T08:04:08.2588408Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:04:08.2589599Z from pkg_resources import resource_filename 2025-09-07T08:04:08.8998833Z 2025-09-07T08:04:09.6610162Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:04:09.6610514Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:04:09.6723794Z cpu eval DistilBertForQuestionAnswering 2025-09-07T08:04:09.7962745Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:04:09.8473816Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:04:09.8985233Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:04:16.2287862Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2288193Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2288400Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2288594Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2288797Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2288997Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2294412Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2294899Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2295261Z return mod(**inputs) 2025-09-07T08:04:16.2295707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2296168Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2296598Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2297040Z return self.transformer( 2025-09-07T08:04:16.2297501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2297934Z layer_outputs = layer_module( 2025-09-07T08:04:16.2298293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2298665Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2299080Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2299494Z sa_output = self.attention( 2025-09-07T08:04:16.2299902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:04:16.2300778Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:04:16.2300973Z 2025-09-07T08:04:16.2301084Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2301457Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2301782Z return mod(**inputs) 2025-09-07T08:04:16.2302178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2302595Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2303009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2303428Z return self.transformer( 2025-09-07T08:04:16.2303817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2304227Z layer_outputs = layer_module( 2025-09-07T08:04:16.2304558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2305026Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2305432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2305893Z sa_output = self.attention( 2025-09-07T08:04:16.2306273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:04:16.2306811Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2306994Z 2025-09-07T08:04:16.2307095Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2307526Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2307856Z return mod(**inputs) 2025-09-07T08:04:16.2308242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2308666Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2309077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2309485Z return self.transformer( 2025-09-07T08:04:16.2310031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2310440Z layer_outputs = layer_module( 2025-09-07T08:04:16.2310779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2311135Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2311541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2311947Z sa_output = self.attention( 2025-09-07T08:04:16.2312341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:04:16.2312794Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2312969Z 2025-09-07T08:04:16.2313055Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2313285Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2313634Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2313954Z return mod(**inputs) 2025-09-07T08:04:16.2314339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2314756Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2315231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2315633Z return self.transformer( 2025-09-07T08:04:16.2316017Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2316420Z layer_outputs = layer_module( 2025-09-07T08:04:16.2316765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2317117Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2317536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2317943Z sa_output = self.attention( 2025-09-07T08:04:16.2318339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:04:16.2318809Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:04:16.2319046Z 2025-09-07T08:04:16.2319148Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2319506Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2319830Z return mod(**inputs) 2025-09-07T08:04:16.2320220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2320638Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2321092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2321502Z return self.transformer( 2025-09-07T08:04:16.2321934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2322348Z layer_outputs = layer_module( 2025-09-07T08:04:16.2322682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2323042Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2323450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2323852Z sa_output = self.attention( 2025-09-07T08:04:16.2324238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:04:16.2324646Z attn_output = self.out_lin(attn_output) 2025-09-07T08:04:16.2324784Z 2025-09-07T08:04:16.2324880Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2325230Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2325544Z return mod(**inputs) 2025-09-07T08:04:16.2325925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2326337Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2326742Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2327143Z return self.transformer( 2025-09-07T08:04:16.2327527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2327925Z layer_outputs = layer_module( 2025-09-07T08:04:16.2328255Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2328603Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2329007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2329500Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2329933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2330469Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2330987Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2331382Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2331787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:04:16.2332184Z x = self.lin1(input) 2025-09-07T08:04:16.2332288Z 2025-09-07T08:04:16.2332386Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2332739Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2333099Z return mod(**inputs) 2025-09-07T08:04:16.2333476Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2333884Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2334289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2334692Z return self.transformer( 2025-09-07T08:04:16.2335117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2335523Z layer_outputs = layer_module( 2025-09-07T08:04:16.2335895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2336252Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2336656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2337096Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2337524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2338052Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2338563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2338950Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2339353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:04:16.2339753Z x = self.activation(x) 2025-09-07T08:04:16.2340067Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:04:16.2340405Z return self.act(input) 2025-09-07T08:04:16.2340504Z 2025-09-07T08:04:16.2340605Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2340953Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2341265Z return mod(**inputs) 2025-09-07T08:04:16.2341643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2342055Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2342461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2342863Z return self.transformer( 2025-09-07T08:04:16.2343246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2343694Z layer_outputs = layer_module( 2025-09-07T08:04:16.2344033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2344385Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2344782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2345214Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2345649Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2346250Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2346783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2347219Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2347620Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:04:16.2348019Z x = self.lin2(x) 2025-09-07T08:04:16.2348112Z 2025-09-07T08:04:16.2348214Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2348559Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2348927Z return mod(**inputs) 2025-09-07T08:04:16.2349304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2349721Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2350161Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2350580Z return self.transformer( 2025-09-07T08:04:16.2350965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2351373Z layer_outputs = layer_module( 2025-09-07T08:04:16.2351706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2352058Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2352456Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2352858Z sa_output = self.attention( 2025-09-07T08:04:16.2353246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:04:16.2353704Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:04:16.2353878Z 2025-09-07T08:04:16.2353979Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2354319Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2354635Z return mod(**inputs) 2025-09-07T08:04:16.2355012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2355429Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2355830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2356238Z return self.transformer( 2025-09-07T08:04:16.2356624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2357033Z layer_outputs = layer_module( 2025-09-07T08:04:16.2357413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2357761Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2358165Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2358568Z sa_output = self.attention( 2025-09-07T08:04:16.2358954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:04:16.2359405Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2359575Z 2025-09-07T08:04:16.2359670Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2360016Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2360334Z return mod(**inputs) 2025-09-07T08:04:16.2360714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2361160Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2361564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2361972Z return self.transformer( 2025-09-07T08:04:16.2362353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2362756Z layer_outputs = layer_module( 2025-09-07T08:04:16.2363117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2363469Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2363912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2364319Z sa_output = self.attention( 2025-09-07T08:04:16.2364702Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:04:16.2365146Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2365324Z 2025-09-07T08:04:16.2365400Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2365628Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2365973Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2366282Z return mod(**inputs) 2025-09-07T08:04:16.2366661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2367078Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2367485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2367890Z return self.transformer( 2025-09-07T08:04:16.2368272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2368675Z layer_outputs = layer_module( 2025-09-07T08:04:16.2369007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2369364Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2369774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2370169Z sa_output = self.attention( 2025-09-07T08:04:16.2370553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:04:16.2371025Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:04:16.2379346Z 2025-09-07T08:04:16.2379502Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2379902Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2380249Z return mod(**inputs) 2025-09-07T08:04:16.2380684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2381122Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2381546Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2381964Z return self.transformer( 2025-09-07T08:04:16.2382362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2382780Z layer_outputs = layer_module( 2025-09-07T08:04:16.2383141Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2383589Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2384015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2384431Z sa_output = self.attention( 2025-09-07T08:04:16.2384830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:04:16.2385296Z attn_output = self.out_lin(attn_output) 2025-09-07T08:04:16.2385443Z 2025-09-07T08:04:16.2385548Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2386012Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2386390Z return mod(**inputs) 2025-09-07T08:04:16.2386790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2387220Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2387645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2388055Z return self.transformer( 2025-09-07T08:04:16.2388457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2388862Z layer_outputs = layer_module( 2025-09-07T08:04:16.2389214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2389571Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2389992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2390439Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2390875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2391423Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2391953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2392356Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2392770Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:04:16.2393172Z x = self.lin1(input) 2025-09-07T08:04:16.2393280Z 2025-09-07T08:04:16.2393379Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2393741Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2394116Z return mod(**inputs) 2025-09-07T08:04:16.2394499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2394916Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2395331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2395741Z return self.transformer( 2025-09-07T08:04:16.2396135Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2396539Z layer_outputs = layer_module( 2025-09-07T08:04:16.2396878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2397238Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2397649Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2398133Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2398564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2399102Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2399657Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2400060Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2400472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:04:16.2400918Z x = self.activation(x) 2025-09-07T08:04:16.2401245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:04:16.2401587Z return self.act(input) 2025-09-07T08:04:16.2401689Z 2025-09-07T08:04:16.2401797Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2402162Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2402485Z return mod(**inputs) 2025-09-07T08:04:16.2402877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2403297Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2403714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2404120Z return self.transformer( 2025-09-07T08:04:16.2404522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2404934Z layer_outputs = layer_module( 2025-09-07T08:04:16.2405287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2405653Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2406058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2406499Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2406940Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2407480Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2407993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2408426Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2408832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:04:16.2409239Z x = self.lin2(x) 2025-09-07T08:04:16.2409336Z 2025-09-07T08:04:16.2409443Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2409967Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2410292Z return mod(**inputs) 2025-09-07T08:04:16.2410686Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2411106Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2411522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2411928Z return self.transformer( 2025-09-07T08:04:16.2412321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2412828Z layer_outputs = layer_module( 2025-09-07T08:04:16.2413170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2413533Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2413934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2414390Z sa_output = self.attention( 2025-09-07T08:04:16.2414788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:04:16.2415302Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:04:16.2415488Z 2025-09-07T08:04:16.2415596Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2415945Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2416271Z return mod(**inputs) 2025-09-07T08:04:16.2416655Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2417075Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2417479Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2417888Z return self.transformer( 2025-09-07T08:04:16.2418275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2418683Z layer_outputs = layer_module( 2025-09-07T08:04:16.2419027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2419379Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2419788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2420191Z sa_output = self.attention( 2025-09-07T08:04:16.2420580Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:04:16.2421037Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2421209Z 2025-09-07T08:04:16.2421305Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2421656Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2421975Z return mod(**inputs) 2025-09-07T08:04:16.2422360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2422855Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2423271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2423675Z return self.transformer( 2025-09-07T08:04:16.2424061Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2424468Z layer_outputs = layer_module( 2025-09-07T08:04:16.2424806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2425164Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2425571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2426044Z sa_output = self.attention( 2025-09-07T08:04:16.2426441Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:04:16.2426934Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2427120Z 2025-09-07T08:04:16.2427203Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2427438Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2427795Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2428109Z return mod(**inputs) 2025-09-07T08:04:16.2428531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2428961Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2429408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2429821Z return self.transformer( 2025-09-07T08:04:16.2430201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2430612Z layer_outputs = layer_module( 2025-09-07T08:04:16.2430957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2431318Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2431723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2432129Z sa_output = self.attention( 2025-09-07T08:04:16.2432532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:04:16.2433015Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:04:16.2433196Z 2025-09-07T08:04:16.2433306Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2433655Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2433972Z return mod(**inputs) 2025-09-07T08:04:16.2434358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2434773Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2435182Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2435584Z return self.transformer( 2025-09-07T08:04:16.2435970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2436375Z layer_outputs = layer_module( 2025-09-07T08:04:16.2436719Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2437136Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2437538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2437941Z sa_output = self.attention( 2025-09-07T08:04:16.2438327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:04:16.2438741Z attn_output = self.out_lin(attn_output) 2025-09-07T08:04:16.2438874Z 2025-09-07T08:04:16.2438984Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2439326Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2439648Z return mod(**inputs) 2025-09-07T08:04:16.2440029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2440451Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2440888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2441299Z return self.transformer( 2025-09-07T08:04:16.2441678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2442086Z layer_outputs = layer_module( 2025-09-07T08:04:16.2442471Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2442822Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2443231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2443712Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2444159Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2444699Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2445214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2445608Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2446019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:04:16.2446424Z x = self.lin1(input) 2025-09-07T08:04:16.2446519Z 2025-09-07T08:04:16.2446622Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2446973Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2447289Z return mod(**inputs) 2025-09-07T08:04:16.2447670Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2448087Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2448492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2448897Z return self.transformer( 2025-09-07T08:04:16.2449284Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2449691Z layer_outputs = layer_module( 2025-09-07T08:04:16.2450022Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2450371Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2450783Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2451335Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2451774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2452309Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2452821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2453207Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2453612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:04:16.2454019Z x = self.activation(x) 2025-09-07T08:04:16.2454340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:04:16.2454671Z return self.act(input) 2025-09-07T08:04:16.2454781Z 2025-09-07T08:04:16.2454911Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2455263Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2455581Z return mod(**inputs) 2025-09-07T08:04:16.2455963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2456373Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2456822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2457234Z return self.transformer( 2025-09-07T08:04:16.2459008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2459435Z layer_outputs = layer_module( 2025-09-07T08:04:16.2459774Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2460126Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2460531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2460971Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2461402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2461939Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2462450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2462843Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2463252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:04:16.2463648Z x = self.lin2(x) 2025-09-07T08:04:16.2463748Z 2025-09-07T08:04:16.2463845Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2464193Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2464511Z return mod(**inputs) 2025-09-07T08:04:16.2464893Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2465307Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2465770Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2466184Z return self.transformer( 2025-09-07T08:04:16.2466571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2467071Z layer_outputs = layer_module( 2025-09-07T08:04:16.2467405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2467764Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2468169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2468577Z sa_output = self.attention( 2025-09-07T08:04:16.2468964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:04:16.2469422Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:04:16.2469604Z 2025-09-07T08:04:16.2469698Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2470048Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2470411Z return mod(**inputs) 2025-09-07T08:04:16.2470784Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2471210Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2471629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2472036Z return self.transformer( 2025-09-07T08:04:16.2472459Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2472863Z layer_outputs = layer_module( 2025-09-07T08:04:16.2473241Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2473603Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2474013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2474424Z sa_output = self.attention( 2025-09-07T08:04:16.2474801Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:04:16.2475253Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2475432Z 2025-09-07T08:04:16.2475526Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2475872Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2476185Z return mod(**inputs) 2025-09-07T08:04:16.2476567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2476980Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2477388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2477793Z return self.transformer( 2025-09-07T08:04:16.2478169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2478573Z layer_outputs = layer_module( 2025-09-07T08:04:16.2478903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2479256Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2479671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2480086Z sa_output = self.attention( 2025-09-07T08:04:16.2480474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:04:16.2480970Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2481146Z 2025-09-07T08:04:16.2481228Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2481449Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2481791Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2482107Z return mod(**inputs) 2025-09-07T08:04:16.2482488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2482903Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2483300Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2483710Z return self.transformer( 2025-09-07T08:04:16.2484097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2484547Z layer_outputs = layer_module( 2025-09-07T08:04:16.2484878Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2485229Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2485628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2486030Z sa_output = self.attention( 2025-09-07T08:04:16.2486454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:04:16.2486918Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:04:16.2487105Z 2025-09-07T08:04:16.2487230Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2487584Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2487902Z return mod(**inputs) 2025-09-07T08:04:16.2488281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2488694Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2489098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2489500Z return self.transformer( 2025-09-07T08:04:16.2489884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2490286Z layer_outputs = layer_module( 2025-09-07T08:04:16.2490608Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2490955Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2491358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2491766Z sa_output = self.attention( 2025-09-07T08:04:16.2492146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:04:16.2492557Z attn_output = self.out_lin(attn_output) 2025-09-07T08:04:16.2492697Z 2025-09-07T08:04:16.2492792Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2493134Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2493450Z return mod(**inputs) 2025-09-07T08:04:16.2493822Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2494232Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2494677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2495083Z return self.transformer( 2025-09-07T08:04:16.2495466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2495864Z layer_outputs = layer_module( 2025-09-07T08:04:16.2496194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2496545Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2496946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2497382Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2497824Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2498358Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2498932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2499325Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2499727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:04:16.2500135Z x = self.lin1(input) 2025-09-07T08:04:16.2500284Z 2025-09-07T08:04:16.2500439Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2500785Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2501101Z return mod(**inputs) 2025-09-07T08:04:16.2501511Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2501939Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2502350Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2502756Z return self.transformer( 2025-09-07T08:04:16.2503140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2503538Z layer_outputs = layer_module( 2025-09-07T08:04:16.2503869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2504219Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2504622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2505059Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2505490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2506107Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2506628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2507025Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2507429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:04:16.2507840Z x = self.activation(x) 2025-09-07T08:04:16.2508162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:04:16.2508497Z return self.act(input) 2025-09-07T08:04:16.2508642Z 2025-09-07T08:04:16.2508745Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2509088Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2509406Z return mod(**inputs) 2025-09-07T08:04:16.2509934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2510364Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2510786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2511196Z return self.transformer( 2025-09-07T08:04:16.2511588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2511998Z layer_outputs = layer_module( 2025-09-07T08:04:16.2512341Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2512699Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2513209Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2513658Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2514098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2514679Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2515197Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2515594Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2516076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:04:16.2516489Z x = self.lin2(x) 2025-09-07T08:04:16.2516584Z 2025-09-07T08:04:16.2516687Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2517035Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2517355Z return mod(**inputs) 2025-09-07T08:04:16.2517746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2518164Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2518579Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2518979Z return self.transformer( 2025-09-07T08:04:16.2519369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2519779Z layer_outputs = layer_module( 2025-09-07T08:04:16.2520122Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2520473Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2520884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2521288Z sa_output = self.attention( 2025-09-07T08:04:16.2521682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:04:16.2522135Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:04:16.2522310Z 2025-09-07T08:04:16.2522407Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2522756Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2523134Z return mod(**inputs) 2025-09-07T08:04:16.2523515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2523936Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2524335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2524739Z return self.transformer( 2025-09-07T08:04:16.2525140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2525552Z layer_outputs = layer_module( 2025-09-07T08:04:16.2525889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2526233Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2526653Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2527097Z sa_output = self.attention( 2025-09-07T08:04:16.2527492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:04:16.2527940Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2528114Z 2025-09-07T08:04:16.2528207Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2528581Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2528899Z return mod(**inputs) 2025-09-07T08:04:16.2529274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2529713Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2530115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2530517Z return self.transformer( 2025-09-07T08:04:16.2530896Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2531295Z layer_outputs = layer_module( 2025-09-07T08:04:16.2531617Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2531963Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2532367Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2532764Z sa_output = self.attention( 2025-09-07T08:04:16.2533142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:04:16.2533593Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2533765Z 2025-09-07T08:04:16.2533839Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2534061Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2534397Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2534703Z return mod(**inputs) 2025-09-07T08:04:16.2535070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2535487Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2535908Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2536304Z return self.transformer( 2025-09-07T08:04:16.2536678Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2537124Z layer_outputs = layer_module( 2025-09-07T08:04:16.2537452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2537793Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2538187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2538584Z sa_output = self.attention( 2025-09-07T08:04:16.2538964Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:04:16.2539419Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:04:16.2539596Z 2025-09-07T08:04:16.2539690Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2540023Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2540332Z return mod(**inputs) 2025-09-07T08:04:16.2540701Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2541154Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2541547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2541942Z return self.transformer( 2025-09-07T08:04:16.2542353Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2542751Z layer_outputs = layer_module( 2025-09-07T08:04:16.2543073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2543441Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2543839Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2544237Z sa_output = self.attention( 2025-09-07T08:04:16.2544613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:04:16.2545038Z attn_output = self.out_lin(attn_output) 2025-09-07T08:04:16.2545168Z 2025-09-07T08:04:16.2545261Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2545598Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2545967Z return mod(**inputs) 2025-09-07T08:04:16.2546342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2546748Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2547142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2547537Z return self.transformer( 2025-09-07T08:04:16.2547910Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2548304Z layer_outputs = layer_module( 2025-09-07T08:04:16.2548621Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2548962Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2549356Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2549789Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2550221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2550795Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2551305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2551687Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2552084Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:04:16.2552480Z x = self.lin1(input) 2025-09-07T08:04:16.2552575Z 2025-09-07T08:04:16.2552670Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2553012Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2553318Z return mod(**inputs) 2025-09-07T08:04:16.2553688Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2554092Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2554489Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2554928Z return self.transformer( 2025-09-07T08:04:16.2555304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2555699Z layer_outputs = layer_module( 2025-09-07T08:04:16.2556053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2556400Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2556795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2557282Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2557706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2558228Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2558738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2559116Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2559516Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:04:16.2559915Z x = self.activation(x) 2025-09-07T08:04:16.2560234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:04:16.2560561Z return self.act(input) 2025-09-07T08:04:16.2560664Z 2025-09-07T08:04:16.2560759Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2561103Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2561410Z return mod(**inputs) 2025-09-07T08:04:16.2561777Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2562203Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2562602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2563002Z return self.transformer( 2025-09-07T08:04:16.2563376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2563775Z layer_outputs = layer_module( 2025-09-07T08:04:16.2564105Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2564489Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2564886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2565313Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2565737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2566263Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2566769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2567152Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2567547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:04:16.2567938Z x = self.lin2(x) 2025-09-07T08:04:16.2568035Z 2025-09-07T08:04:16.2568126Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2568503Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2568813Z return mod(**inputs) 2025-09-07T08:04:16.2569186Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2569594Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2570045Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2570451Z return self.transformer( 2025-09-07T08:04:16.2570863Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2571267Z layer_outputs = layer_module( 2025-09-07T08:04:16.2571594Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2571939Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2572335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2572729Z sa_output = self.attention( 2025-09-07T08:04:16.2573108Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 390, in forward 2025-09-07T08:04:16.2573560Z q = shape(self.q_lin(query)) # (bs, n_heads, q_length, dim_per_head) 2025-09-07T08:04:16.2573735Z 2025-09-07T08:04:16.2573831Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2574171Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2574478Z return mod(**inputs) 2025-09-07T08:04:16.2574856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2575264Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2575660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2576051Z return self.transformer( 2025-09-07T08:04:16.2576423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2576823Z layer_outputs = layer_module( 2025-09-07T08:04:16.2577148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2577491Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2577886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2578325Z sa_output = self.attention( 2025-09-07T08:04:16.2578706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 391, in forward 2025-09-07T08:04:16.2579156Z k = shape(self.k_lin(key)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2579325Z 2025-09-07T08:04:16.2579422Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2579755Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2580063Z return mod(**inputs) 2025-09-07T08:04:16.2580439Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2580854Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2581253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2581654Z return self.transformer( 2025-09-07T08:04:16.2582035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2582473Z layer_outputs = layer_module( 2025-09-07T08:04:16.2582800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2583140Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2583572Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2583978Z sa_output = self.attention( 2025-09-07T08:04:16.2584357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 392, in forward 2025-09-07T08:04:16.2584834Z v = shape(self.v_lin(value)) # (bs, n_heads, k_length, dim_per_head) 2025-09-07T08:04:16.2585009Z 2025-09-07T08:04:16.2585082Z cudagraph partition due to non gpu ops 2025-09-07T08:04:16.2585303Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2585640Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2586010Z return mod(**inputs) 2025-09-07T08:04:16.2586379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2586785Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2587188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2587582Z return self.transformer( 2025-09-07T08:04:16.2587959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2588359Z layer_outputs = layer_module( 2025-09-07T08:04:16.2588684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2589030Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2589427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2589824Z sa_output = self.attention( 2025-09-07T08:04:16.2590195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 402, in forward 2025-09-07T08:04:16.2590656Z attn_output = torch.nn.functional.scaled_dot_product_attention( 2025-09-07T08:04:16.2590837Z 2025-09-07T08:04:16.2590930Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2591270Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2591579Z return mod(**inputs) 2025-09-07T08:04:16.2591993Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2592403Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2592806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2593201Z return self.transformer( 2025-09-07T08:04:16.2593578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2593994Z layer_outputs = layer_module( 2025-09-07T08:04:16.2594332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2594691Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2595097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 476, in forward 2025-09-07T08:04:16.2595501Z sa_output = self.attention( 2025-09-07T08:04:16.2595928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 412, in forward 2025-09-07T08:04:16.2596345Z attn_output = self.out_lin(attn_output) 2025-09-07T08:04:16.2596481Z 2025-09-07T08:04:16.2596591Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2596936Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2597250Z return mod(**inputs) 2025-09-07T08:04:16.2597666Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2598088Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2598525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2598931Z return self.transformer( 2025-09-07T08:04:16.2599316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2599719Z layer_outputs = layer_module( 2025-09-07T08:04:16.2600055Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2600409Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2600808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2601248Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2601684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2602221Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2602739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2603131Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2603543Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 431, in ff_chunk 2025-09-07T08:04:16.2603951Z x = self.lin1(input) 2025-09-07T08:04:16.2604047Z 2025-09-07T08:04:16.2604154Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2604506Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2604825Z return mod(**inputs) 2025-09-07T08:04:16.2605200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2605621Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2606071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2606472Z return self.transformer( 2025-09-07T08:04:16.2606857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2607266Z layer_outputs = layer_module( 2025-09-07T08:04:16.2607607Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2607962Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2608364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2608799Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2609237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2609908Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2610484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2610874Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2611286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 432, in ff_chunk 2025-09-07T08:04:16.2611701Z x = self.activation(x) 2025-09-07T08:04:16.2612073Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:04:16.2612412Z return self.act(input) 2025-09-07T08:04:16.2612525Z 2025-09-07T08:04:16.2612622Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2613032Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2613365Z return mod(**inputs) 2025-09-07T08:04:16.2613749Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1031, in forward 2025-09-07T08:04:16.2614159Z distilbert_output = self.distilbert( 2025-09-07T08:04:16.2614569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 736, in forward 2025-09-07T08:04:16.2614973Z return self.transformer( 2025-09-07T08:04:16.2615361Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 541, in forward 2025-09-07T08:04:16.2615765Z layer_outputs = layer_module( 2025-09-07T08:04:16.2616095Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:04:16.2616448Z return super().__call__(*args, **kwargs) 2025-09-07T08:04:16.2616853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 494, in forward 2025-09-07T08:04:16.2617292Z ffn_output = self.ffn(sa_output) # (bs, seq_length, dim) 2025-09-07T08:04:16.2617733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 428, in forward 2025-09-07T08:04:16.2618269Z return apply_chunking_to_forward(self.ff_chunk, self.chunk_size_feed_forward, self.seq_len_dim, input) 2025-09-07T08:04:16.2618788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:04:16.2619179Z return forward_fn(*input_tensors) 2025-09-07T08:04:16.2619581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 433, in ff_chunk 2025-09-07T08:04:16.2619978Z x = self.lin2(x) 2025-09-07T08:04:16.2620078Z 2025-09-07T08:04:16.2620234Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2620587Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2620912Z return mod(**inputs) 2025-09-07T08:04:16.2621289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1043, in forward 2025-09-07T08:04:16.2621740Z logits = self.qa_outputs(hidden_states) # (bs, max_query_len, 2) 2025-09-07T08:04:16.2621923Z 2025-09-07T08:04:16.2622020Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2622358Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2622673Z return mod(**inputs) 2025-09-07T08:04:16.2623052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1061, in forward 2025-09-07T08:04:16.2623485Z start_loss = loss_fct(start_logits, start_positions) 2025-09-07T08:04:16.2623646Z 2025-09-07T08:04:16.2623735Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:04:16.2624134Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:04:16.2624450Z return mod(**inputs) 2025-09-07T08:04:16.2624821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/distilbert/modeling_distilbert.py", line 1062, in forward 2025-09-07T08:04:16.2625255Z end_loss = loss_fct(end_logits, end_positions) 2025-09-07T08:04:16.2625405Z 2025-09-07T08:04:21.2114986Z pass 2025-09-07T08:04:21.2115827Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:04:23.2379783Z accuracy pass_rate=86.67% 2025-09-07T08:04:23.2384064Z calls_captured gmean=0.00x mean=470.933x 2025-09-07T08:04:23.2386624Z unique_graphs gmean=0.00x mean=1.067x 2025-09-07T08:04:23.2388516Z graph_breaks gmean=0.00x mean=0.267x 2025-09-07T08:04:23.2390647Z unique_graph_breaks gmean=0.00x mean=0.067x 2025-09-07T08:04:23.2392823Z autograd_captures gmean=0.00x mean=0.000x 2025-09-07T08:04:23.2394753Z autograd_compiles gmean=0.00x mean=0.000x 2025-09-07T08:04:23.2396799Z cudagraph_skips gmean=0.00x mean=1.067x 2025-09-07T08:04:23.2397924Z compilation_latency mean=18.344 seconds 2025-09-07T08:04:24.0613260Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *cppwrapper-true* ]] 2025-09-07T08:04:24.0613781Z + TORCHINDUCTOR_CPP_WRAPPER=1 2025-09-07T08:04:24.0614772Z + taskset -c 0-94 python benchmarks/dynamo/huggingface.py --accuracy --no-translation-validation --inference --bfloat16 --backend inductor --disable-cudagraphs --device cpu --total-partitions 3 --partition-id 0 --output /var/lib/jenkins/workspace/test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv 2025-09-07T08:04:24.8393197Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:04:24.8394097Z import pynvml # type: ignore[import] 2025-09-07T08:04:27.5339584Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:04:27.5340476Z from pkg_resources import resource_filename 2025-09-07T08:04:28.9692464Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:04:28.9693749Z import pynvml # type: ignore[import] 2025-09-07T08:04:31.6438901Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:04:31.6439803Z from pkg_resources import resource_filename 2025-09-07T08:04:32.2911596Z 2025-09-07T08:04:34.5288413Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:04:34.5288732Z loading model: 0it [00:02, ?it/s] 2025-09-07T08:04:34.5423659Z cpu eval AlbertForMaskedLM 2025-09-07T08:04:37.7619000Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:04:38.6188040Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:04:39.4723368Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:00.1087654Z pass 2025-09-07T08:05:00.1090203Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:03.2576113Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:05:03.2577450Z import pynvml # type: ignore[import] 2025-09-07T08:05:05.9361875Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:05:05.9362789Z from pkg_resources import resource_filename 2025-09-07T08:05:06.5744213Z 2025-09-07T08:05:08.7642844Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:05:08.7643135Z loading model: 0it [00:02, ?it/s] 2025-09-07T08:05:08.7773566Z cpu eval AlbertForQuestionAnswering 2025-09-07T08:05:11.9842288Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:12.8358947Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:13.7526945Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:31.7609315Z pass 2025-09-07T08:05:31.7609776Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:34.9039692Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:05:34.9040540Z import pynvml # type: ignore[import] 2025-09-07T08:05:37.5843662Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:05:37.5844721Z from pkg_resources import resource_filename 2025-09-07T08:05:38.2617133Z 2025-09-07T08:05:40.5788000Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:05:40.5789052Z loading model: 0it [00:02, ?it/s] 2025-09-07T08:05:40.6087052Z cpu eval AllenaiLongformerBase 2025-09-07T08:05:41.9101596Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:42.4198013Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:42.8968319Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:05:43.0577196Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] Graph break from `Tensor.item()`, consider setting: 2025-09-07T08:05:43.0577869Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] torch._dynamo.config.capture_scalar_outputs = True 2025-09-07T08:05:43.0578408Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] or: 2025-09-07T08:05:43.0578920Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] env TORCHDYNAMO_CAPTURE_SCALAR_OUTPUTS=1 2025-09-07T08:05:43.0579511Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] to include these operations in the captured graph. 2025-09-07T08:05:43.0579998Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] 2025-09-07T08:05:43.0580841Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] Graph break: from user code at: 2025-09-07T08:05:43.0581517Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 533, in forward_pass 2025-09-07T08:05:43.0582198Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] return mod(**inputs) 2025-09-07T08:05:43.0583067Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1703, in forward 2025-09-07T08:05:43.0583912Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] outputs = self.longformer( 2025-09-07T08:05:43.0584669Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1600, in forward 2025-09-07T08:05:43.0585416Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] encoder_outputs = self.encoder( 2025-09-07T08:05:43.0586219Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1244, in forward 2025-09-07T08:05:43.0586998Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] is_global_attn = is_index_global_attn.flatten().any().item() 2025-09-07T08:05:43.0587494Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] 2025-09-07T08:05:43.0587868Z W0907 08:05:43.057106 18645 site-packages/torch/_dynamo/variables/tensor.py:1048] [0/0] 2025-09-07T08:07:44.4232967Z pass 2025-09-07T08:07:44.4233397Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:07:48.6544397Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:07:48.6545227Z import pynvml # type: ignore[import] 2025-09-07T08:07:51.3472470Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:07:51.3473485Z from pkg_resources import resource_filename 2025-09-07T08:07:51.9948915Z 2025-09-07T08:07:55.2889499Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:07:55.2889856Z loading model: 0it [00:03, ?it/s] 2025-09-07T08:07:55.3220828Z cpu eval BartForCausalLM 2025-09-07T08:07:56.4869513Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:07:56.8321089Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:07:57.1328840Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:08:17.9253951Z pass 2025-09-07T08:08:17.9254361Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:08:21.1919072Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:08:21.1920224Z import pynvml # type: ignore[import] 2025-09-07T08:08:23.8854636Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:08:23.8855654Z from pkg_resources import resource_filename 2025-09-07T08:08:24.5680707Z 2025-09-07T08:08:30.5078708Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:08:30.5079154Z loading model: 0it [00:05, ?it/s] 2025-09-07T08:08:30.5567970Z cpu eval BartForConditionalGeneration 2025-09-07T08:08:33.0396870Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:08:33.8075573Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:08:34.5432409Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:09:18.7386968Z pass 2025-09-07T08:09:18.7387365Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:09:22.5268113Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:09:22.5269008Z import pynvml # type: ignore[import] 2025-09-07T08:09:25.2102806Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:09:25.2103765Z from pkg_resources import resource_filename 2025-09-07T08:09:25.8452982Z 2025-09-07T08:09:27.3473793Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:09:27.3474093Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:09:27.3683050Z cpu eval BertForMaskedLM 2025-09-07T08:09:27.8530349Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:09:28.0048328Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:09:28.1525097Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:09:47.6150435Z pass 2025-09-07T08:09:47.6150831Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:09:50.7104399Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:09:50.7105611Z import pynvml # type: ignore[import] 2025-09-07T08:09:53.3861972Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:09:53.3862939Z from pkg_resources import resource_filename 2025-09-07T08:09:54.0247639Z 2025-09-07T08:09:55.3685603Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:09:55.3685908Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:09:55.3894333Z cpu eval BertForQuestionAnswering 2025-09-07T08:09:55.8144421Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:09:55.9573829Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:09:56.0977565Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:10:15.3659330Z pass 2025-09-07T08:10:15.3659704Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:10:18.3927600Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:10:18.3928439Z import pynvml # type: ignore[import] 2025-09-07T08:10:21.0655210Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:10:21.0656141Z from pkg_resources import resource_filename 2025-09-07T08:10:21.6931709Z 2025-09-07T08:10:46.2323700Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:10:46.2324020Z loading model: 0it [00:24, ?it/s] 2025-09-07T08:10:46.3751803Z cpu eval BlenderbotForCausalLM 2025-09-07T08:10:46.8632426Z pass_due_to_skip 2025-09-07T08:10:46.8634894Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:10:49.8337356Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:10:49.8338213Z import pynvml # type: ignore[import] 2025-09-07T08:10:52.5064005Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:10:52.5064980Z from pkg_resources import resource_filename 2025-09-07T08:10:53.1699554Z 2025-09-07T08:10:54.0952001Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:10:54.0952351Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:10:54.1113300Z cpu eval BlenderbotSmallForCausalLM 2025-09-07T08:10:54.3109222Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:10:54.3810831Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:10:54.4498253Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:11:10.5993127Z pass 2025-09-07T08:11:10.5993533Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:11:13.5570448Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:11:13.5571305Z import pynvml # type: ignore[import] 2025-09-07T08:11:16.2346675Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:11:16.2347626Z from pkg_resources import resource_filename 2025-09-07T08:11:16.8896419Z 2025-09-07T08:11:18.1728991Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:11:18.1729326Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:11:18.1974046Z cpu eval BlenderbotSmallForConditionalGeneration 2025-09-07T08:11:18.5753467Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:11:18.7198740Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:11:18.8646099Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:11:48.6414712Z pass 2025-09-07T08:11:48.6417613Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:11:51.9538878Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:11:51.9539745Z import pynvml # type: ignore[import] 2025-09-07T08:11:54.6348083Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:11:54.6349021Z from pkg_resources import resource_filename 2025-09-07T08:11:55.3108772Z 2025-09-07T08:11:56.9110357Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:11:56.9110675Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:11:56.9313847Z cpu eval CamemBert 2025-09-07T08:11:57.4179743Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:11:57.5779229Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:11:57.7279955Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:12:17.3348147Z pass 2025-09-07T08:12:17.3348553Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:12:20.4383246Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:12:20.4384133Z import pynvml # type: ignore[import] 2025-09-07T08:12:23.1135745Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:12:23.1137077Z from pkg_resources import resource_filename 2025-09-07T08:12:23.7398457Z 2025-09-07T08:12:34.6689576Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:12:34.6690176Z loading model: 0it [00:10, ?it/s] 2025-09-07T08:12:34.7459901Z cpu eval DebertaV2ForMaskedLM 2025-09-07T08:12:34.9869490Z pass_due_to_skip 2025-09-07T08:12:34.9872805Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:12:37.2000713Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:12:37.2001578Z import pynvml # type: ignore[import] 2025-09-07T08:12:39.8832040Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:12:39.8833229Z from pkg_resources import resource_filename 2025-09-07T08:12:40.5571273Z 2025-09-07T08:12:50.0980720Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:12:50.0981379Z loading model: 0it [00:09, ?it/s] 2025-09-07T08:12:50.1726440Z cpu eval DebertaV2ForQuestionAnswering 2025-09-07T08:12:52.4642738Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:12:53.0976806Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:12:53.7984572Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:13:35.4902852Z pass 2025-09-07T08:13:35.4903640Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:13:39.5412217Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:13:39.5413159Z import pynvml # type: ignore[import] 2025-09-07T08:13:42.2254237Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:13:42.2255151Z from pkg_resources import resource_filename 2025-09-07T08:13:42.8701300Z 2025-09-07T08:13:43.8397470Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:13:43.8398144Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:13:43.8516568Z cpu eval DistilBertForMaskedLM 2025-09-07T08:13:43.9921884Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:13:44.0498204Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:13:44.1050346Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:13:58.4144967Z pass 2025-09-07T08:13:58.4145364Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:01.3051153Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:14:01.3051993Z import pynvml # type: ignore[import] 2025-09-07T08:14:03.9810215Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:14:03.9811437Z from pkg_resources import resource_filename 2025-09-07T08:14:04.6048993Z 2025-09-07T08:14:05.3692805Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:14:05.3693363Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:14:05.3809593Z cpu eval DistilBertForQuestionAnswering 2025-09-07T08:14:05.5065210Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:05.5581590Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:05.6096211Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:19.7381424Z pass 2025-09-07T08:14:19.7381837Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:21.9418075Z accuracy pass_rate=86.67% 2025-09-07T08:14:21.9422242Z calls_captured gmean=0.00x mean=470.933x 2025-09-07T08:14:21.9424438Z unique_graphs gmean=0.00x mean=1.067x 2025-09-07T08:14:21.9426485Z graph_breaks gmean=0.00x mean=0.267x 2025-09-07T08:14:21.9428801Z unique_graph_breaks gmean=0.00x mean=0.067x 2025-09-07T08:14:21.9430752Z autograd_captures gmean=0.00x mean=0.000x 2025-09-07T08:14:21.9432950Z autograd_compiles gmean=0.00x mean=0.000x 2025-09-07T08:14:21.9435108Z cudagraph_skips gmean=0.00x mean=0.000x 2025-09-07T08:14:21.9435637Z compilation_latency mean=26.185 seconds 2025-09-07T08:14:22.7549551Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *freezing_cudagraphs-true* ]] 2025-09-07T08:14:22.7550686Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *freeze_autotune_cudagraphs-true* ]] 2025-09-07T08:14:22.7551475Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *aotinductor-true* ]] 2025-09-07T08:14:22.7551939Z + [[ inference == \i\n\f\e\r\e\n\c\e ]] 2025-09-07T08:14:22.7552137Z + [[ accuracy == \a\c\c\u\r\a\c\y ]] 2025-09-07T08:14:22.7553049Z + taskset -c 0-94 python benchmarks/dynamo/huggingface.py --accuracy --no-translation-validation --inference --bfloat16 --export --disable-cudagraphs --device cpu --total-partitions 3 --partition-id 0 --output /var/lib/jenkins/workspace/test/test-reports/inductor_export_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv 2025-09-07T08:14:23.5400904Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:14:23.5401745Z import pynvml # type: ignore[import] 2025-09-07T08:14:26.2290198Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:14:26.2291144Z from pkg_resources import resource_filename 2025-09-07T08:14:27.8542032Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:14:27.8542857Z import pynvml # type: ignore[import] 2025-09-07T08:14:30.5315748Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:14:30.5317100Z from pkg_resources import resource_filename 2025-09-07T08:14:31.1661828Z 2025-09-07T08:14:33.4031157Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:14:33.4031438Z loading model: 0it [00:02, ?it/s] 2025-09-07T08:14:33.4161874Z cpu eval AlbertForMaskedLM 2025-09-07T08:14:36.6572938Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:37.4992353Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:38.3347227Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:45.5939333Z pass 2025-09-07T08:14:45.5939723Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:47.6249221Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:14:47.6250384Z import pynvml # type: ignore[import] 2025-09-07T08:14:50.3026759Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:14:50.3027672Z from pkg_resources import resource_filename 2025-09-07T08:14:50.9638886Z 2025-09-07T08:14:53.1506994Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:14:53.1507280Z loading model: 0it [00:02, ?it/s] 2025-09-07T08:14:53.1639715Z cpu eval AlbertForQuestionAnswering 2025-09-07T08:14:56.3776901Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:57.2218713Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:14:58.0486472Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:05.2500498Z pass 2025-09-07T08:15:05.2500875Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:07.2431501Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:15:07.2432355Z import pynvml # type: ignore[import] 2025-09-07T08:15:09.9225759Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:15:09.9226684Z from pkg_resources import resource_filename 2025-09-07T08:15:10.5631847Z 2025-09-07T08:15:12.8784287Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:15:12.8784621Z loading model: 0it [00:02, ?it/s] 2025-09-07T08:15:12.9085565Z cpu eval AllenaiLongformerBase 2025-09-07T08:15:14.1628832Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:14.6713150Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:15.1449259Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:16.0630701Z ERROR:common: 2025-09-07T08:15:16.0630936Z Traceback (most recent call last): 2025-09-07T08:15:16.0631329Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 2320, in check_accuracy 2025-09-07T08:15:16.0631693Z optimized_model_iter_fn = optimize_ctx( 2025-09-07T08:15:16.0632029Z File "/var/lib/jenkins/workspace/benchmarks/dynamo/common.py", line 1523, in export 2025-09-07T08:15:16.0632354Z ep = torch.export.export( 2025-09-07T08:15:16.0632727Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/__init__.py", line 311, in export 2025-09-07T08:15:16.0633056Z raise e 2025-09-07T08:15:16.0633342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/__init__.py", line 277, in export 2025-09-07T08:15:16.0633653Z return _export( 2025-09-07T08:15:16.0633951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/_trace.py", line 1163, in wrapper 2025-09-07T08:15:16.0634259Z raise e 2025-09-07T08:15:16.0634535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/_trace.py", line 1129, in wrapper 2025-09-07T08:15:16.0635202Z ep = fn(*args, **kwargs) 2025-09-07T08:15:16.0635544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/exported_program.py", line 124, in wrapper 2025-09-07T08:15:16.0635913Z return fn(*args, **kwargs) 2025-09-07T08:15:16.0636220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/_trace.py", line 2255, in _export 2025-09-07T08:15:16.0636545Z ep = _export_for_training( 2025-09-07T08:15:16.0636934Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/_trace.py", line 1163, in wrapper 2025-09-07T08:15:16.0637245Z raise e 2025-09-07T08:15:16.0637525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/_trace.py", line 1129, in wrapper 2025-09-07T08:15:16.0637923Z ep = fn(*args, **kwargs) 2025-09-07T08:15:16.0638258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/exported_program.py", line 124, in wrapper 2025-09-07T08:15:16.0638608Z return fn(*args, **kwargs) 2025-09-07T08:15:16.0638959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/_trace.py", line 2071, in _export_for_training 2025-09-07T08:15:16.0639323Z export_artifact = export_func( 2025-09-07T08:15:16.0639679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/_trace.py", line 1415, in _strict_export 2025-09-07T08:15:16.0640039Z gm_torch_level = _export_to_torch_ir( 2025-09-07T08:15:16.0640421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/export/_trace.py", line 812, in _export_to_torch_ir 2025-09-07T08:15:16.0640794Z gm_torch_level, _ = torch._dynamo.export( 2025-09-07T08:15:16.0641148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/_dynamo/eval_frame.py", line 2002, in inner 2025-09-07T08:15:16.0641489Z result_traced = opt_f(*args, **kwargs) 2025-09-07T08:15:16.0641832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T08:15:16.0642175Z return super().__call__(*args, **kwargs) 2025-09-07T08:15:16.0642555Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T08:15:16.0642928Z return self._call_impl(*args, **kwargs) 2025-09-07T08:15:16.0643286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0643627Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0643986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/_dynamo/eval_frame.py", line 841, in compile_wrapper 2025-09-07T08:15:16.0644399Z raise e.with_traceback(None) from e.__cause__ # User compiler error 2025-09-07T08:15:16.0644969Z torch._dynamo.exc.UserError: Consider annotating your code using torch._check*(). Could not guard on data-dependent expression Eq(u0, 1) (unhinted: Eq(u0, 1)). (Size-like symbols: none) 2025-09-07T08:15:16.0645474Z 2025-09-07T08:15:16.0646039Z consider using data-dependent friendly APIs such as guard_or_false, guard_or_true and statically_known_trueCaused by: if is_global_attn: # transformers/models/longformer/modeling_longformer.py:554 in forward (_dynamo/variables/tensor.py:1435 in evaluate_expr) 2025-09-07T08:15:16.0646752Z For more information, run with TORCH_LOGS="dynamic" 2025-09-07T08:15:16.0647084Z For extended logs when we create symbols, also add TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="u0" 2025-09-07T08:15:16.0647485Z If you suspect the guard was triggered from C++, add TORCHDYNAMO_EXTENDED_DEBUG_CPP=1 2025-09-07T08:15:16.0648013Z For more debugging help, see https://docs.google.com/document/d/1HSuTTVvYH1pTew89Rtpeu84Ht3nQEFTYhAX3Ypa_xJs/edit?usp=sharing 2025-09-07T08:15:16.0648349Z 2025-09-07T08:15:16.0648427Z User Stack (most recent call last): 2025-09-07T08:15:16.0648631Z (snipped, see stack below for prefix) 2025-09-07T08:15:16.0649060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1703, in forward 2025-09-07T08:15:16.0649524Z outputs = self.longformer( 2025-09-07T08:15:16.0649859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0650217Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0650624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1600, in forward 2025-09-07T08:15:16.0651047Z encoder_outputs = self.encoder( 2025-09-07T08:15:16.0651417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0651777Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0652227Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in forward 2025-09-07T08:15:16.0652638Z layer_outputs = layer_module( 2025-09-07T08:15:16.0652974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0653321Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0653737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:15:16.0654178Z self_attn_outputs = self.attention( 2025-09-07T08:15:16.0654524Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0654870Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0655283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:15:16.0655696Z self_outputs = self.self( 2025-09-07T08:15:16.0656016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0656363Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0656779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 554, in forward 2025-09-07T08:15:16.0657183Z if is_global_attn: 2025-09-07T08:15:16.0657282Z 2025-09-07T08:15:16.0657402Z For C++ stack trace, run with TORCHDYNAMO_EXTENDED_DEBUG_CPP=1 2025-09-07T08:15:16.0657855Z For more information about this error, see: https://pytorch.org/docs/main/generated/exportdb/index.html#constrain-as-size-example 2025-09-07T08:15:16.0658196Z 2025-09-07T08:15:16.0658253Z from user code: 2025-09-07T08:15:16.0658638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1703, in forward 2025-09-07T08:15:16.0659055Z outputs = self.longformer( 2025-09-07T08:15:16.0659384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0659771Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0660183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1600, in forward 2025-09-07T08:15:16.0660597Z encoder_outputs = self.encoder( 2025-09-07T08:15:16.0660933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0661272Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0661680Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in forward 2025-09-07T08:15:16.0662090Z layer_outputs = layer_module( 2025-09-07T08:15:16.0662425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0662771Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0663170Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:15:16.0663626Z self_attn_outputs = self.attention( 2025-09-07T08:15:16.0663973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0664318Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0664720Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:15:16.0665182Z self_outputs = self.self( 2025-09-07T08:15:16.0665509Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T08:15:16.0665932Z return forward_call(*args, **kwargs) 2025-09-07T08:15:16.0666421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 554, in forward 2025-09-07T08:15:16.0666826Z if is_global_attn: 2025-09-07T08:15:16.0666929Z 2025-09-07T08:15:16.0667279Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T08:15:16.0667693Z 2025-09-07T08:15:16.0667696Z 2025-09-07T08:15:16.0668200Z The error above occurred when calling torch.export.export. If you would like to view some more information about this error, and get a list of all other errors that may occur in your export call, you can replace your `export()` call with `draft_export()`. 2025-09-07T08:15:16.0668884Z TorchDynamo optimized model failed to run because of following error 2025-09-07T08:15:16.1944510Z fail_to_run 2025-09-07T08:15:16.1944839Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:18.1496842Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:15:18.1497766Z import pynvml # type: ignore[import] 2025-09-07T08:15:20.8387742Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:15:20.8388717Z from pkg_resources import resource_filename 2025-09-07T08:15:21.4642236Z 2025-09-07T08:15:24.7545726Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:15:24.7546065Z loading model: 0it [00:03, ?it/s] 2025-09-07T08:15:24.7924801Z cpu eval BartForCausalLM 2025-09-07T08:15:25.8936489Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:26.2224135Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:26.5229326Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:33.5922392Z pass 2025-09-07T08:15:33.5922785Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:35.6127359Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:15:35.6128202Z import pynvml # type: ignore[import] 2025-09-07T08:15:38.2941576Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:15:38.2942782Z from pkg_resources import resource_filename 2025-09-07T08:15:38.9746164Z 2025-09-07T08:15:44.9536821Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:15:44.9537525Z loading model: 0it [00:05, ?it/s] 2025-09-07T08:15:45.0027679Z cpu eval BartForConditionalGeneration 2025-09-07T08:15:47.4322943Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:48.2212822Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:48.9482429Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:15:58.1824742Z pass 2025-09-07T08:15:58.1825451Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:00.4464612Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:16:00.4465469Z import pynvml # type: ignore[import] 2025-09-07T08:16:03.1345549Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:16:03.1346508Z from pkg_resources import resource_filename 2025-09-07T08:16:03.7852665Z 2025-09-07T08:16:05.2949791Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:16:05.2950438Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:16:05.3159998Z cpu eval BertForMaskedLM 2025-09-07T08:16:05.8039132Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:05.9620416Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:06.1140797Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:12.1756656Z pass 2025-09-07T08:16:12.1757056Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:14.1114107Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:16:14.1114968Z import pynvml # type: ignore[import] 2025-09-07T08:16:16.8042578Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:16:16.8043747Z from pkg_resources import resource_filename 2025-09-07T08:16:17.6699855Z 2025-09-07T08:16:18.9723503Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:16:18.9723787Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:16:18.9929710Z cpu eval BertForQuestionAnswering 2025-09-07T08:16:19.4178931Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:19.5602908Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:19.7027169Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:25.6666323Z pass 2025-09-07T08:16:25.6666735Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:27.5719288Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:16:27.5720110Z import pynvml # type: ignore[import] 2025-09-07T08:16:30.2600005Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:16:30.2600944Z from pkg_resources import resource_filename 2025-09-07T08:16:30.8981484Z 2025-09-07T08:16:55.5020324Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:16:55.5020638Z loading model: 0it [00:24, ?it/s] 2025-09-07T08:16:55.6465937Z cpu eval BlenderbotForCausalLM 2025-09-07T08:16:56.1369487Z pass_due_to_skip 2025-09-07T08:16:56.1372272Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:16:59.1626242Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:16:59.1627120Z import pynvml # type: ignore[import] 2025-09-07T08:17:01.8481232Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:17:01.8482177Z from pkg_resources import resource_filename 2025-09-07T08:17:02.5107029Z 2025-09-07T08:17:03.4349282Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:17:03.4350311Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:17:03.4511970Z cpu eval BlenderbotSmallForCausalLM 2025-09-07T08:17:03.6499383Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:03.7207853Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:03.7894996Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:09.4180493Z pass 2025-09-07T08:17:09.4180899Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:11.2683697Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:17:11.2684874Z import pynvml # type: ignore[import] 2025-09-07T08:17:13.9468016Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:17:13.9468949Z from pkg_resources import resource_filename 2025-09-07T08:17:14.5819749Z 2025-09-07T08:17:15.8679224Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:17:15.8679502Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:17:15.8926988Z cpu eval BlenderbotSmallForConditionalGeneration 2025-09-07T08:17:16.2720285Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:16.4154572Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:16.5583981Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:23.1254221Z pass 2025-09-07T08:17:23.1254615Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:25.0736583Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:17:25.0737419Z import pynvml # type: ignore[import] 2025-09-07T08:17:27.7571350Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:17:27.7572333Z from pkg_resources import resource_filename 2025-09-07T08:17:28.4111847Z 2025-09-07T08:17:29.9968503Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:17:29.9968914Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:17:30.0170377Z cpu eval CamemBert 2025-09-07T08:17:30.4939045Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:30.6616640Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:30.8168129Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:36.8937159Z pass 2025-09-07T08:17:36.8942891Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:38.8391634Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:17:38.8392527Z import pynvml # type: ignore[import] 2025-09-07T08:17:41.5252581Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:17:41.5259429Z from pkg_resources import resource_filename 2025-09-07T08:17:42.1646695Z 2025-09-07T08:17:53.1182987Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:17:53.1183578Z loading model: 0it [00:10, ?it/s] 2025-09-07T08:17:53.2017857Z cpu eval DebertaV2ForMaskedLM 2025-09-07T08:17:53.4425941Z pass_due_to_skip 2025-09-07T08:17:53.4429195Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:17:55.6569524Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:17:55.6570360Z import pynvml # type: ignore[import] 2025-09-07T08:17:58.3443747Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:17:58.3444669Z from pkg_resources import resource_filename 2025-09-07T08:17:59.0108603Z 2025-09-07T08:18:08.5055238Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:18:08.5062613Z loading model: 0it [00:09, ?it/s] 2025-09-07T08:18:08.5780301Z cpu eval DebertaV2ForQuestionAnswering 2025-09-07T08:18:10.8734229Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:11.5032242Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:12.1339226Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:21.9527742Z pass 2025-09-07T08:18:21.9528514Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:24.5405035Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:18:24.5405908Z import pynvml # type: ignore[import] 2025-09-07T08:18:27.2241785Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:18:27.2242803Z from pkg_resources import resource_filename 2025-09-07T08:18:27.8979729Z 2025-09-07T08:18:28.8708623Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:18:28.8709015Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:18:28.8823836Z cpu eval DistilBertForMaskedLM 2025-09-07T08:18:29.0221309Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:29.0802899Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:29.1345501Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:33.9352087Z pass 2025-09-07T08:18:33.9352471Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:35.7945310Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:18:35.7946175Z import pynvml # type: ignore[import] 2025-09-07T08:18:38.4788500Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:18:38.4789707Z from pkg_resources import resource_filename 2025-09-07T08:18:39.1433407Z 2025-09-07T08:18:39.9099024Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:18:39.9099359Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:18:39.9215853Z cpu eval DistilBertForQuestionAnswering 2025-09-07T08:18:40.0473326Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:40.0990931Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:40.1496212Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:45.6121268Z pass 2025-09-07T08:18:45.6121671Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:18:46.6626709Z accuracy pass_rate=80.00% 2025-09-07T08:18:46.6631439Z calls_captured gmean=0.00x mean=351.800x 2025-09-07T08:18:46.6633522Z unique_graphs gmean=0.00x mean=0.800x 2025-09-07T08:18:46.6635657Z graph_breaks gmean=0.00x mean=0.000x 2025-09-07T08:18:46.6637715Z unique_graph_breaks gmean=0.00x mean=0.000x 2025-09-07T08:18:46.6639874Z autograd_captures gmean=0.00x mean=0.000x 2025-09-07T08:18:46.6641778Z autograd_compiles gmean=0.00x mean=0.000x 2025-09-07T08:18:46.6643724Z cudagraph_skips gmean=0.00x mean=0.000x 2025-09-07T08:18:46.6644660Z compilation_latency mean=4.374 seconds 2025-09-07T08:18:47.4913588Z + taskset -c 0-94 python benchmarks/dynamo/huggingface.py --accuracy --no-translation-validation --inference --bfloat16 --export-aot-inductor --disable-cudagraphs --device cpu --total-partitions 3 --partition-id 0 --output /var/lib/jenkins/workspace/test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv 2025-09-07T08:18:48.2716194Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:18:48.2717063Z import pynvml # type: ignore[import] 2025-09-07T08:18:50.9563503Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:18:50.9564430Z from pkg_resources import resource_filename 2025-09-07T08:18:52.4277165Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:18:52.4278013Z import pynvml # type: ignore[import] 2025-09-07T08:18:55.1060062Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:18:55.1061004Z from pkg_resources import resource_filename 2025-09-07T08:18:55.7365130Z 2025-09-07T08:18:57.9767525Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:18:57.9767795Z loading model: 0it [00:02, ?it/s] 2025-09-07T08:18:57.9906901Z cpu eval AlbertForMaskedLM 2025-09-07T08:19:01.1711514Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:19:02.0169714Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:19:02.8734292Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:19:22.7213924Z pass 2025-09-07T08:19:22.7214311Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:19:25.4193709Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:19:25.4194690Z import pynvml # type: ignore[import] 2025-09-07T08:19:28.0974737Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:19:28.0975660Z from pkg_resources import resource_filename 2025-09-07T08:19:28.7479587Z 2025-09-07T08:19:30.9354666Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:19:30.9355141Z loading model: 0it [00:02, ?it/s] 2025-09-07T08:19:30.9489625Z cpu eval AlbertForQuestionAnswering 2025-09-07T08:19:34.1675627Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:19:35.0282397Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:19:35.8854358Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:19:50.7241860Z pass 2025-09-07T08:19:50.7242642Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:19:53.5048673Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:19:53.5049524Z import pynvml # type: ignore[import] 2025-09-07T08:19:56.1847921Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:19:56.1848834Z from pkg_resources import resource_filename 2025-09-07T08:19:56.8206359Z 2025-09-07T08:20:00.1411234Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:20:00.1411599Z loading model: 0it [00:03, ?it/s] 2025-09-07T08:20:00.1807808Z cpu eval BartForCausalLM 2025-09-07T08:20:01.2857711Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:20:01.6140197Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:20:01.9138736Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:20:17.6509794Z pass 2025-09-07T08:20:17.6510196Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:20:20.4864348Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:20:20.4865188Z import pynvml # type: ignore[import] 2025-09-07T08:20:23.1695189Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:20:23.1696564Z from pkg_resources import resource_filename 2025-09-07T08:20:23.8131301Z 2025-09-07T08:20:29.7428042Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:20:29.7428368Z loading model: 0it [00:05, ?it/s] 2025-09-07T08:20:29.7913321Z cpu eval BartForConditionalGeneration 2025-09-07T08:20:32.2711970Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:20:33.0540320Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:20:33.7899782Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:20:59.9526733Z pass 2025-09-07T08:20:59.9528432Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:03.4939348Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:21:03.4942723Z import pynvml # type: ignore[import] 2025-09-07T08:21:06.1618735Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:21:06.1619684Z from pkg_resources import resource_filename 2025-09-07T08:21:06.7960465Z 2025-09-07T08:21:08.3047315Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:21:08.3047614Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:21:08.3254991Z cpu eval BertForMaskedLM 2025-09-07T08:21:08.8138021Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:08.9667258Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:09.1155448Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:22.0584190Z pass 2025-09-07T08:21:22.0584597Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:24.6593140Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:21:24.6593986Z import pynvml # type: ignore[import] 2025-09-07T08:21:27.3296100Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:21:27.3297018Z from pkg_resources import resource_filename 2025-09-07T08:21:27.9599358Z 2025-09-07T08:21:29.2603114Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:21:29.2603425Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:21:29.2812926Z cpu eval BertForQuestionAnswering 2025-09-07T08:21:29.7026587Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:29.8446750Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:29.9849271Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:42.7751969Z pass 2025-09-07T08:21:42.7752381Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:21:45.3746661Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:21:45.3747828Z import pynvml # type: ignore[import] 2025-09-07T08:21:48.0438936Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:21:48.0439886Z from pkg_resources import resource_filename 2025-09-07T08:21:48.6875814Z 2025-09-07T08:22:13.2551467Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:22:13.2551750Z loading model: 0it [00:24, ?it/s] 2025-09-07T08:22:13.3989195Z cpu eval BlenderbotForCausalLM 2025-09-07T08:22:13.8828647Z pass_due_to_skip 2025-09-07T08:22:13.8831454Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:16.8686478Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:22:16.8687318Z import pynvml # type: ignore[import] 2025-09-07T08:22:19.5457435Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:22:19.5458435Z from pkg_resources import resource_filename 2025-09-07T08:22:20.1974949Z 2025-09-07T08:22:21.1230210Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:22:21.1230681Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:22:21.1394867Z cpu eval BlenderbotSmallForCausalLM 2025-09-07T08:22:21.3371366Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:21.4077938Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:21.4768057Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:32.6479005Z pass 2025-09-07T08:22:32.6479425Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:35.0862110Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:22:35.0862963Z import pynvml # type: ignore[import] 2025-09-07T08:22:37.7619935Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:22:37.7620874Z from pkg_resources import resource_filename 2025-09-07T08:22:38.4149883Z 2025-09-07T08:22:39.7022238Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:22:39.7022528Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:22:39.7268830Z cpu eval BlenderbotSmallForConditionalGeneration 2025-09-07T08:22:40.1459329Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:40.3148839Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:40.4562894Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:56.5354519Z pass 2025-09-07T08:22:56.5354949Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:22:59.3660476Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:22:59.3661305Z import pynvml # type: ignore[import] 2025-09-07T08:23:02.0456370Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:23:02.0457286Z from pkg_resources import resource_filename 2025-09-07T08:23:02.6816477Z 2025-09-07T08:23:04.2798128Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:23:04.2798802Z loading model: 0it [00:01, ?it/s] 2025-09-07T08:23:04.2999789Z cpu eval CamemBert 2025-09-07T08:23:04.8535938Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:23:05.0132940Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:23:05.1620489Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:23:18.0888419Z pass 2025-09-07T08:23:20.7350675Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:23:20.7351946Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:23:20.7352767Z import pynvml # type: ignore[import] 2025-09-07T08:23:23.4199168Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:23:23.4200079Z from pkg_resources import resource_filename 2025-09-07T08:23:24.0640368Z 2025-09-07T08:23:34.9986964Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:23:34.9987580Z loading model: 0it [00:10, ?it/s] 2025-09-07T08:23:35.0773011Z cpu eval DebertaV2ForMaskedLM 2025-09-07T08:23:35.3155973Z pass_due_to_skip 2025-09-07T08:23:35.3158926Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:23:37.5429017Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:23:37.5429895Z import pynvml # type: ignore[import] 2025-09-07T08:23:40.2221619Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:23:40.2222641Z from pkg_resources import resource_filename 2025-09-07T08:23:40.8603041Z 2025-09-07T08:23:50.4456295Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:23:50.4456914Z loading model: 0it [00:09, ?it/s] 2025-09-07T08:23:50.5183722Z cpu eval DebertaV2ForQuestionAnswering 2025-09-07T08:23:52.8081283Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:23:53.4390057Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:23:54.0721641Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:24:26.9059590Z pass 2025-09-07T08:24:26.9059993Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:24:30.9629720Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:24:30.9630548Z import pynvml # type: ignore[import] 2025-09-07T08:24:33.6442770Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:24:33.6444073Z from pkg_resources import resource_filename 2025-09-07T08:24:34.2676900Z 2025-09-07T08:24:35.2361733Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:24:35.2362105Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:24:35.2478620Z cpu eval DistilBertForMaskedLM 2025-09-07T08:24:35.3888957Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:24:35.4465812Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:24:35.5016132Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:24:45.7104974Z pass 2025-09-07T08:24:45.7105366Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:24:48.1340228Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:24:48.1341169Z import pynvml # type: ignore[import] 2025-09-07T08:24:50.8268662Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:24:50.8269599Z from pkg_resources import resource_filename 2025-09-07T08:24:51.4612990Z 2025-09-07T08:24:52.2237531Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:24:52.2237935Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:24:52.2367198Z cpu eval DistilBertForQuestionAnswering 2025-09-07T08:24:52.3647188Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:24:52.4196676Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:24:52.4734287Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:25:02.6007881Z pass 2025-09-07T08:25:02.6008271Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu] 2025-09-07T08:25:04.2090179Z accuracy pass_rate=85.71% 2025-09-07T08:25:04.2094838Z calls_captured gmean=0.00x mean=0.000x 2025-09-07T08:25:04.2097013Z unique_graphs gmean=0.00x mean=0.000x 2025-09-07T08:25:04.2099027Z graph_breaks gmean=0.00x mean=0.000x 2025-09-07T08:25:04.2101245Z unique_graph_breaks gmean=0.00x mean=0.000x 2025-09-07T08:25:04.2103287Z autograd_captures gmean=0.00x mean=0.000x 2025-09-07T08:25:04.2105171Z autograd_compiles gmean=0.00x mean=0.000x 2025-09-07T08:25:04.2107275Z cudagraph_skips gmean=0.00x mean=0.000x 2025-09-07T08:25:04.2107954Z compilation_latency mean=0.000 seconds 2025-09-07T08:25:05.0304058Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *maxautotune-true* ]] 2025-09-07T08:25:05.0304860Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *cudagraphs_low_precision-true* ]] 2025-09-07T08:25:05.0305346Z + for target in "${targets[@]}" 2025-09-07T08:25:05.0305563Z + target_flag=('--performance') 2025-09-07T08:25:05.0305777Z + local target_flag 2025-09-07T08:25:05.0305955Z + [[ performance == \p\e\r\f\o\r\m\a\n\c\e ]] 2025-09-07T08:25:05.0306173Z + target_flag+=(--cold-start-latency) 2025-09-07T08:25:05.0306629Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *freezing-true* ]] 2025-09-07T08:25:05.0307304Z + [[ training-false-inference-true-default-true-dynamic-true-cppwrapper-true-aotinductor-true == *default-true* ]] 2025-09-07T08:25:05.0308786Z + taskset -c 0-94 python benchmarks/dynamo/huggingface.py --performance --cold-start-latency --inference --bfloat16 --backend inductor --disable-cudagraphs --device cpu --total-partitions 3 --partition-id 0 --output /var/lib/jenkins/workspace/test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance.csv 2025-09-07T08:25:05.8056618Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:25:05.8057475Z import pynvml # type: ignore[import] 2025-09-07T08:25:08.5009424Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:25:08.5010524Z from pkg_resources import resource_filename 2025-09-07T08:25:09.9634524Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. 2025-09-07T08:25:09.9635390Z import pynvml # type: ignore[import] 2025-09-07T08:25:12.6282793Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/librosa/util/files.py:10: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:25:12.6283707Z from pkg_resources import resource_filename 2025-09-07T08:25:13.2732869Z 2025-09-07T08:25:16.7523970Z loading model: 0it [00:00, ?it/s] 2025-09-07T08:25:16.7524239Z loading model: 0it [00:03, ?it/s] 2025-09-07T08:25:16.7651352Z cpu eval AlbertForMaskedLM 2025-09-07T08:25:53.6090605Z 2025-09-07T08:25:56.5884571Z running benchmark: 0% 0/30 [00:00bcxy", (query, key)) # multiply 2025-09-07T08:50:06.1903373Z 2025-09-07T08:50:06.1903472Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1903979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1904468Z layer_outputs = layer_module( 2025-09-07T08:50:06.1904805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1905152Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1905557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1906079Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1906493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1906900Z self_outputs = self.self( 2025-09-07T08:50:06.1907288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.1907706Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.1907879Z 2025-09-07T08:50:06.1907981Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1908521Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1909035Z layer_outputs = layer_module( 2025-09-07T08:50:06.1909371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1909934Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1910348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1910758Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1911162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1911565Z self_outputs = self.self( 2025-09-07T08:50:06.1911951Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.1912391Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.1912888Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.1913435Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.1913928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.1914338Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.1914462Z 2025-09-07T08:50:06.1914567Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1915075Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1915549Z layer_outputs = layer_module( 2025-09-07T08:50:06.1915879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1916231Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1916726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1917140Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1917536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1917940Z self_outputs = self.self( 2025-09-07T08:50:06.1918327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.1918764Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.1919260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.1919847Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.1920094Z 2025-09-07T08:50:06.1920188Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1920755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1921240Z layer_outputs = layer_module( 2025-09-07T08:50:06.1921568Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1921909Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1922382Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1922800Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1923261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1923676Z self_outputs = self.self( 2025-09-07T08:50:06.1924069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.1924514Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.1925010Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.1925598Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.1925836Z 2025-09-07T08:50:06.1925942Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1926447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1926928Z layer_outputs = layer_module( 2025-09-07T08:50:06.1927267Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1927624Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1928031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1928442Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1928876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1929281Z self_outputs = self.self( 2025-09-07T08:50:06.1929675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.1930099Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.1930595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.1931214Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.1931454Z 2025-09-07T08:50:06.1931537Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.1931738Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.1931934Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.1932122Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.1932313Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.1932503Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.1932716Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1933231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1933707Z layer_outputs = layer_module( 2025-09-07T08:50:06.1934046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1934397Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1934847Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1935266Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1935672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1936078Z self_outputs = self.self( 2025-09-07T08:50:06.1936499Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.1936902Z attn_scores += diagonal_mask 2025-09-07T08:50:06.1937025Z 2025-09-07T08:50:06.1937117Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1937665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1950477Z layer_outputs = layer_module( 2025-09-07T08:50:06.1951024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1951450Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1951901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1952332Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1952752Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1953186Z self_outputs = self.self( 2025-09-07T08:50:06.1953633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.1954062Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.1954196Z 2025-09-07T08:50:06.1954318Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1954936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1955471Z layer_outputs = layer_module( 2025-09-07T08:50:06.1955864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1956228Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1956650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1957062Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1957472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1957961Z self_outputs = self.self( 2025-09-07T08:50:06.1958365Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.1958795Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.1958934Z 2025-09-07T08:50:06.1959042Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1959561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1960047Z layer_outputs = layer_module( 2025-09-07T08:50:06.1960392Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1960758Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1961184Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1961599Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1962063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1962479Z self_outputs = self.self( 2025-09-07T08:50:06.1962871Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.1963333Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.1963907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.1964506Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.1964978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.1965335Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.1965496Z 2025-09-07T08:50:06.1965595Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1966126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1966616Z layer_outputs = layer_module( 2025-09-07T08:50:06.1966966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1967327Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1967751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1968167Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1968578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1968989Z self_outputs = self.self( 2025-09-07T08:50:06.1969380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.1969834Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.1970358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.1970910Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.1971420Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.1971881Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.1972210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.1972590Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.1972737Z 2025-09-07T08:50:06.1972844Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1973351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1973831Z layer_outputs = layer_module( 2025-09-07T08:50:06.1974172Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1974528Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1974944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1975354Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1975757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1976204Z self_outputs = self.self( 2025-09-07T08:50:06.1976596Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.1977042Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.1977557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.1978154Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.1978366Z 2025-09-07T08:50:06.1978459Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1979000Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1979486Z layer_outputs = layer_module( 2025-09-07T08:50:06.1979820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1980167Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1980567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1980977Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1981378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.1981790Z self_outputs = self.self( 2025-09-07T08:50:06.1982204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.1982661Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.1983195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.1983756Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.1983957Z 2025-09-07T08:50:06.1984060Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1984573Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1985057Z layer_outputs = layer_module( 2025-09-07T08:50:06.1985408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1985841Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1986256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1986718Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1987124Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.1987567Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.1988015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.1988434Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.1988575Z 2025-09-07T08:50:06.1988670Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1989173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1989652Z layer_outputs = layer_module( 2025-09-07T08:50:06.1989986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1990375Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1990781Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.1991189Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.1991590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.1992061Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.1992491Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.1992908Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.1993045Z 2025-09-07T08:50:06.1993170Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1993680Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1994164Z layer_outputs = layer_module( 2025-09-07T08:50:06.1994486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.1994834Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.1995238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.1995657Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.1996050Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.1996441Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.1996853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.1997312Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.1997750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.1998158Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.1998301Z 2025-09-07T08:50:06.1998397Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.1998899Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.1999380Z layer_outputs = layer_module( 2025-09-07T08:50:06.1999711Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2000058Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2000505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2000926Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2001314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2001700Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2002099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2002542Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2002982Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2003435Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2003813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2004157Z return self.act(input) 2025-09-07T08:50:06.2004313Z 2025-09-07T08:50:06.2004409Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2004911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2005391Z layer_outputs = layer_module( 2025-09-07T08:50:06.2005718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2006128Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2006547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2007006Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2007402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2007785Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2008189Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2008651Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2009109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2009526Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2009866Z 2025-09-07T08:50:06.2009959Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2010462Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2010935Z layer_outputs = layer_module( 2025-09-07T08:50:06.2011261Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2011606Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2012006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2012410Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2012807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2013204Z self_outputs = self.self( 2025-09-07T08:50:06.2013590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2013999Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2014128Z 2025-09-07T08:50:06.2014222Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2014828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2015300Z layer_outputs = layer_module( 2025-09-07T08:50:06.2015629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2015979Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2016384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2016795Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2017215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2017634Z self_outputs = self.self( 2025-09-07T08:50:06.2018035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2018541Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2019047Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2019640Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2019891Z 2025-09-07T08:50:06.2019993Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2020558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2021054Z layer_outputs = layer_module( 2025-09-07T08:50:06.2021454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2021815Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2022237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2022683Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2023099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2023509Z self_outputs = self.self( 2025-09-07T08:50:06.2023902Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2024319Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2024458Z 2025-09-07T08:50:06.2024559Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2025078Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2025566Z layer_outputs = layer_module( 2025-09-07T08:50:06.2025961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2026326Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2026743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2027154Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2027556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2027961Z self_outputs = self.self( 2025-09-07T08:50:06.2028355Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2028791Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2029334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2029896Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2030391Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2030802Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2030929Z 2025-09-07T08:50:06.2031038Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2031547Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2032023Z layer_outputs = layer_module( 2025-09-07T08:50:06.2032366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2032727Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2033178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2033588Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2033984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2034389Z self_outputs = self.self( 2025-09-07T08:50:06.2035414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2035887Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2036421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2037010Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2037260Z 2025-09-07T08:50:06.2037357Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2037872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2038356Z layer_outputs = layer_module( 2025-09-07T08:50:06.2038696Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2039050Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2039466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2039881Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2040289Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2040699Z self_outputs = self.self( 2025-09-07T08:50:06.2041093Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2041530Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2042026Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2042607Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2042850Z 2025-09-07T08:50:06.2042971Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2043475Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2044003Z layer_outputs = layer_module( 2025-09-07T08:50:06.2044333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2044694Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2045096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2045512Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2045918Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2046335Z self_outputs = self.self( 2025-09-07T08:50:06.2046722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2047148Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2047637Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2048254Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2048492Z 2025-09-07T08:50:06.2048577Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2048780Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2048972Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2049164Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2049393Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2049593Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2049806Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2050348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2050833Z layer_outputs = layer_module( 2025-09-07T08:50:06.2051169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2051524Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2051924Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2052337Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2052746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2053151Z self_outputs = self.self( 2025-09-07T08:50:06.2053536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2053946Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2054067Z 2025-09-07T08:50:06.2054160Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2054665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2055144Z layer_outputs = layer_module( 2025-09-07T08:50:06.2055468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2055818Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2056228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2056638Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2057038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2057438Z self_outputs = self.self( 2025-09-07T08:50:06.2057817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2058276Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2058403Z 2025-09-07T08:50:06.2058506Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2059007Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2059477Z layer_outputs = layer_module( 2025-09-07T08:50:06.2059812Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2060164Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2060571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2060978Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2061375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2061837Z self_outputs = self.self( 2025-09-07T08:50:06.2062231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2062652Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2062784Z 2025-09-07T08:50:06.2062878Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2063427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2063912Z layer_outputs = layer_module( 2025-09-07T08:50:06.2064279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2064634Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2065035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2065451Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2065891Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2066302Z self_outputs = self.self( 2025-09-07T08:50:06.2066686Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2067135Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2067667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2068255Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2068679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2069025Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2069174Z 2025-09-07T08:50:06.2069269Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2069779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2070256Z layer_outputs = layer_module( 2025-09-07T08:50:06.2070588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2070939Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2071347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2071809Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2072215Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2072624Z self_outputs = self.self( 2025-09-07T08:50:06.2073013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2073460Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2073983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2074526Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2075037Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2075505Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2075825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2076213Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2076367Z 2025-09-07T08:50:06.2076463Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2076978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2077457Z layer_outputs = layer_module( 2025-09-07T08:50:06.2077821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2078178Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2078622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2079041Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2079442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2079850Z self_outputs = self.self( 2025-09-07T08:50:06.2080234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2080681Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2081199Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2081750Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2081961Z 2025-09-07T08:50:06.2082055Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2082562Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2083045Z layer_outputs = layer_module( 2025-09-07T08:50:06.2083376Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2083722Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2084132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2084541Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2084946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2085349Z self_outputs = self.self( 2025-09-07T08:50:06.2085733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2086269Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2086823Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2087378Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2087576Z 2025-09-07T08:50:06.2087672Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2088172Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2088663Z layer_outputs = layer_module( 2025-09-07T08:50:06.2088997Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2089351Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2089753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2090194Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2090599Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2091044Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2091513Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2091945Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2092079Z 2025-09-07T08:50:06.2092190Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2092726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2093224Z layer_outputs = layer_module( 2025-09-07T08:50:06.2093548Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2093895Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2094313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2094734Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2095137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2095583Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2096008Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2096419Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2096558Z 2025-09-07T08:50:06.2096648Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2097145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2097629Z layer_outputs = layer_module( 2025-09-07T08:50:06.2097946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2098303Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2098723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2099132Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2099532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2099961Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2100384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2100840Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2101281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2101692Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2101822Z 2025-09-07T08:50:06.2101919Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2102419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2102904Z layer_outputs = layer_module( 2025-09-07T08:50:06.2103228Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2103581Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2104016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2104427Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2104820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2105207Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2105640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2106164Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2106636Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2107125Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2107515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2107844Z return self.act(input) 2025-09-07T08:50:06.2107966Z 2025-09-07T08:50:06.2108068Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2108582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2109063Z layer_outputs = layer_module( 2025-09-07T08:50:06.2109418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2109920Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2110342Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2110763Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2111154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2111544Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2111949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2112421Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2112882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2113293Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2113427Z 2025-09-07T08:50:06.2113545Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2114064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2114648Z layer_outputs = layer_module( 2025-09-07T08:50:06.2115002Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2115359Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2115775Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2116191Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2116611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2117024Z self_outputs = self.self( 2025-09-07T08:50:06.2117427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2117839Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2117985Z 2025-09-07T08:50:06.2118081Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2118639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2119122Z layer_outputs = layer_module( 2025-09-07T08:50:06.2119461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2119808Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2120260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2120691Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2121147Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2121574Z self_outputs = self.self( 2025-09-07T08:50:06.2121965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2122424Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2122936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2123529Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2123770Z 2025-09-07T08:50:06.2123876Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2124374Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2124860Z layer_outputs = layer_module( 2025-09-07T08:50:06.2125200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2125554Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2125957Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2126364Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2126769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2127171Z self_outputs = self.self( 2025-09-07T08:50:06.2127571Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2127979Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2128114Z 2025-09-07T08:50:06.2128209Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2128753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2129231Z layer_outputs = layer_module( 2025-09-07T08:50:06.2129563Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2129909Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2130322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2130740Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2131140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2131539Z self_outputs = self.self( 2025-09-07T08:50:06.2131919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2132353Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2132931Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2133482Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2133973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2134408Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2134537Z 2025-09-07T08:50:06.2134635Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2135172Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2135659Z layer_outputs = layer_module( 2025-09-07T08:50:06.2135986Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2136331Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2136739Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2137144Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2137542Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2137960Z self_outputs = self.self( 2025-09-07T08:50:06.2138343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2138777Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2139269Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2139853Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2140093Z 2025-09-07T08:50:06.2140187Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2140687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2141162Z layer_outputs = layer_module( 2025-09-07T08:50:06.2141493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2141836Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2142250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2142701Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2143104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2143506Z self_outputs = self.self( 2025-09-07T08:50:06.2143892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2144314Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2144806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2145388Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2145622Z 2025-09-07T08:50:06.2145791Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2146294Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2146814Z layer_outputs = layer_module( 2025-09-07T08:50:06.2147142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2147494Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2147895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2148301Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2148729Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2149148Z self_outputs = self.self( 2025-09-07T08:50:06.2149559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2149995Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2150496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2151063Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2151303Z 2025-09-07T08:50:06.2151378Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2151577Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2151772Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2151964Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2152151Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2152343Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2152559Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2153060Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2153537Z layer_outputs = layer_module( 2025-09-07T08:50:06.2153866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2154215Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2154623Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2155027Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2155423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2155822Z self_outputs = self.self( 2025-09-07T08:50:06.2156207Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2156648Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2156764Z 2025-09-07T08:50:06.2156859Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2157362Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2157836Z layer_outputs = layer_module( 2025-09-07T08:50:06.2158160Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2158507Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2158906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2159314Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2159718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2160122Z self_outputs = self.self( 2025-09-07T08:50:06.2160544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2160956Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2161089Z 2025-09-07T08:50:06.2161181Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2161686Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2162200Z layer_outputs = layer_module( 2025-09-07T08:50:06.2162534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2162879Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2163335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2163752Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2164158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2164565Z self_outputs = self.self( 2025-09-07T08:50:06.2164950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2165374Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2165514Z 2025-09-07T08:50:06.2165612Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2166123Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2166600Z layer_outputs = layer_module( 2025-09-07T08:50:06.2166927Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2167286Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2167692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2168103Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2168500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2168902Z self_outputs = self.self( 2025-09-07T08:50:06.2169291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2169748Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2170275Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2170899Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2171324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2171670Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2171820Z 2025-09-07T08:50:06.2171924Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2172436Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2172913Z layer_outputs = layer_module( 2025-09-07T08:50:06.2173247Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2173600Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2174011Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2174462Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2174865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2175271Z self_outputs = self.self( 2025-09-07T08:50:06.2175661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2176142Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2176670Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2177250Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2177763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2178234Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2178564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2178901Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2179052Z 2025-09-07T08:50:06.2179150Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2179665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2180152Z layer_outputs = layer_module( 2025-09-07T08:50:06.2180486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2180840Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2181258Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2181668Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2182072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2182478Z self_outputs = self.self( 2025-09-07T08:50:06.2182855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2183309Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2183830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2184395Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2184636Z 2025-09-07T08:50:06.2184735Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2185234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2185766Z layer_outputs = layer_module( 2025-09-07T08:50:06.2186103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2186450Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2186859Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2187261Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2187662Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2188068Z self_outputs = self.self( 2025-09-07T08:50:06.2188452Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2188952Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2189466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2190018Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2190224Z 2025-09-07T08:50:06.2190352Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2190861Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2191406Z layer_outputs = layer_module( 2025-09-07T08:50:06.2191766Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2192149Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2192583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2193017Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2193431Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2193874Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2194315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2194730Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2194865Z 2025-09-07T08:50:06.2194963Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2195469Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2195953Z layer_outputs = layer_module( 2025-09-07T08:50:06.2196299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2196648Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2197051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2197451Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2197854Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2198289Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2198725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2199180Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2199313Z 2025-09-07T08:50:06.2199406Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2199909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2200384Z layer_outputs = layer_module( 2025-09-07T08:50:06.2200715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2201062Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2201463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2201882Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2202283Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2202728Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2203140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2203587Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2204023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2204471Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2204604Z 2025-09-07T08:50:06.2204705Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2205246Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2205725Z layer_outputs = layer_module( 2025-09-07T08:50:06.2206057Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2206409Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2206813Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2207225Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2207616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2208006Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2208413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2208860Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2209291Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2209883Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2210262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2210597Z return self.act(input) 2025-09-07T08:50:06.2210705Z 2025-09-07T08:50:06.2210807Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2211314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2211798Z layer_outputs = layer_module( 2025-09-07T08:50:06.2212140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2212497Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2212900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2213387Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2213779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2214164Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2214567Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2215026Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2215475Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2215888Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2216025Z 2025-09-07T08:50:06.2216122Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2216624Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2217176Z layer_outputs = layer_module( 2025-09-07T08:50:06.2217508Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2217861Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2218332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2218753Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2219158Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2219616Z self_outputs = self.self( 2025-09-07T08:50:06.2220013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2220459Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2220595Z 2025-09-07T08:50:06.2220697Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2221195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2221677Z layer_outputs = layer_module( 2025-09-07T08:50:06.2222012Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2222364Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2222786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2223195Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2223604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2224011Z self_outputs = self.self( 2025-09-07T08:50:06.2224403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2224841Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2225332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2225979Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2226225Z 2025-09-07T08:50:06.2226321Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2226829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2227356Z layer_outputs = layer_module( 2025-09-07T08:50:06.2227691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2228040Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2228443Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2228853Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2229259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2229659Z self_outputs = self.self( 2025-09-07T08:50:06.2230052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2230470Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2230600Z 2025-09-07T08:50:06.2230699Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2231231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2231713Z layer_outputs = layer_module( 2025-09-07T08:50:06.2232044Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2232393Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2232843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2233255Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2233697Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2234109Z self_outputs = self.self( 2025-09-07T08:50:06.2234500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2234931Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2235417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2235970Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2236468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2236885Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2237012Z 2025-09-07T08:50:06.2237114Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2237612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2238097Z layer_outputs = layer_module( 2025-09-07T08:50:06.2238430Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2238787Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2239196Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2239603Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2240009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2240417Z self_outputs = self.self( 2025-09-07T08:50:06.2240807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2241286Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2241776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2242365Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2242612Z 2025-09-07T08:50:06.2242706Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2243213Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2243694Z layer_outputs = layer_module( 2025-09-07T08:50:06.2244018Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2244372Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2244779Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2245237Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2245651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2246054Z self_outputs = self.self( 2025-09-07T08:50:06.2246447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2246918Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2247418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2248033Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2248279Z 2025-09-07T08:50:06.2248381Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2248892Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2249378Z layer_outputs = layer_module( 2025-09-07T08:50:06.2249717Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2258269Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2258792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2259243Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2259695Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2260141Z self_outputs = self.self( 2025-09-07T08:50:06.2260561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2261015Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2261525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2262118Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2262362Z 2025-09-07T08:50:06.2262450Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2262655Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2262851Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2263043Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2263243Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2263431Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2263735Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2264257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2264753Z layer_outputs = layer_module( 2025-09-07T08:50:06.2265104Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2265463Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2265942Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2266366Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2266778Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2267185Z self_outputs = self.self( 2025-09-07T08:50:06.2267575Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2268040Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2268163Z 2025-09-07T08:50:06.2268269Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2268803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2269293Z layer_outputs = layer_module( 2025-09-07T08:50:06.2269673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2270040Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2270490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2270914Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2271322Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2271733Z self_outputs = self.self( 2025-09-07T08:50:06.2272121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2272534Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2272657Z 2025-09-07T08:50:06.2272758Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2273259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2273743Z layer_outputs = layer_module( 2025-09-07T08:50:06.2274082Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2274433Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2274843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2275248Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2275646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2276049Z self_outputs = self.self( 2025-09-07T08:50:06.2276432Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2276849Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2276984Z 2025-09-07T08:50:06.2277080Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2277595Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2278138Z layer_outputs = layer_module( 2025-09-07T08:50:06.2278488Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2278850Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2279262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2279672Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2280079Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2280482Z self_outputs = self.self( 2025-09-07T08:50:06.2280866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2281322Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2281853Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2282504Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2282920Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2283259Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2283413Z 2025-09-07T08:50:06.2283513Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2284056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2284546Z layer_outputs = layer_module( 2025-09-07T08:50:06.2284938Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2285295Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2285711Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2286125Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2286527Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2286927Z self_outputs = self.self( 2025-09-07T08:50:06.2287313Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2287762Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2288281Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2288823Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2289325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2289789Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2290111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2290449Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2290593Z 2025-09-07T08:50:06.2290696Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2291214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2291692Z layer_outputs = layer_module( 2025-09-07T08:50:06.2292029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2292428Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2292845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2293261Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2293665Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2294063Z self_outputs = self.self( 2025-09-07T08:50:06.2294447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2294890Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2295409Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2295974Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2296239Z 2025-09-07T08:50:06.2296344Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2296856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2297336Z layer_outputs = layer_module( 2025-09-07T08:50:06.2297669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2298063Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2298486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2298901Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2299348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2299760Z self_outputs = self.self( 2025-09-07T08:50:06.2300154Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2300606Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2301128Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2301684Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2301883Z 2025-09-07T08:50:06.2301979Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2302489Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2302968Z layer_outputs = layer_module( 2025-09-07T08:50:06.2303298Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2303648Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2304051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2304460Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2304869Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2305309Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2305800Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2306221Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2306402Z 2025-09-07T08:50:06.2306502Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2307014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2307495Z layer_outputs = layer_module( 2025-09-07T08:50:06.2307828Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2308180Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2308603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2309012Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2309419Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2310042Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2310481Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2310984Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2311124Z 2025-09-07T08:50:06.2311222Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2311721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2312194Z layer_outputs = layer_module( 2025-09-07T08:50:06.2312569Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2312931Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2313413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2313841Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2314234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2314626Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2315048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2315503Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2315944Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2316354Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2316492Z 2025-09-07T08:50:06.2316592Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2317103Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2317589Z layer_outputs = layer_module( 2025-09-07T08:50:06.2317925Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2318275Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2318679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2319089Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2319486Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2319873Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2320279Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2320793Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2321221Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2321661Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2322035Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2322366Z return self.act(input) 2025-09-07T08:50:06.2322474Z 2025-09-07T08:50:06.2322572Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2323077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2323555Z layer_outputs = layer_module( 2025-09-07T08:50:06.2323890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2324241Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2324684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2325096Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2325487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2325874Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2326311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2326774Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2327253Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2327668Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2327803Z 2025-09-07T08:50:06.2327899Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2328401Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2328872Z layer_outputs = layer_module( 2025-09-07T08:50:06.2329195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2329542Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2329946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2330354Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2330756Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2331155Z self_outputs = self.self( 2025-09-07T08:50:06.2331541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2331952Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2332082Z 2025-09-07T08:50:06.2332178Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2332679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2333164Z layer_outputs = layer_module( 2025-09-07T08:50:06.2333503Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2333856Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2334265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2334737Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2335145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2335560Z self_outputs = self.self( 2025-09-07T08:50:06.2335955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2336403Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2336896Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2337495Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2337747Z 2025-09-07T08:50:06.2337847Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2338357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2338884Z layer_outputs = layer_module( 2025-09-07T08:50:06.2339216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2339572Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2339983Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2340428Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2340842Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2341241Z self_outputs = self.self( 2025-09-07T08:50:06.2341667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2342093Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2342229Z 2025-09-07T08:50:06.2342335Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2342841Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2343321Z layer_outputs = layer_module( 2025-09-07T08:50:06.2343659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2344014Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2344422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2344837Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2345233Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2345640Z self_outputs = self.self( 2025-09-07T08:50:06.2346070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2346510Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2347005Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2347557Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2348051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2348459Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2348585Z 2025-09-07T08:50:06.2348687Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2349237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2349717Z layer_outputs = layer_module( 2025-09-07T08:50:06.2350052Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2350404Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2350820Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2351226Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2351638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2352048Z self_outputs = self.self( 2025-09-07T08:50:06.2352442Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2352921Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2353413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2354001Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2354247Z 2025-09-07T08:50:06.2354345Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2354890Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2355385Z layer_outputs = layer_module( 2025-09-07T08:50:06.2355753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2356117Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2356531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2356946Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2357351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2357751Z self_outputs = self.self( 2025-09-07T08:50:06.2358146Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2358583Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2359077Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2359658Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2359898Z 2025-09-07T08:50:06.2359995Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2360502Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2360981Z layer_outputs = layer_module( 2025-09-07T08:50:06.2361317Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2361671Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2362076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2362489Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2362900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2363351Z self_outputs = self.self( 2025-09-07T08:50:06.2363743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2364172Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2364667Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2365247Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2365484Z 2025-09-07T08:50:06.2365569Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2365778Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2365967Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2366166Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2366363Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2366560Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2366817Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2367325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2367803Z layer_outputs = layer_module( 2025-09-07T08:50:06.2368137Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2368519Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2368931Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2369344Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2369782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2370203Z self_outputs = self.self( 2025-09-07T08:50:06.2370588Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2370999Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2371126Z 2025-09-07T08:50:06.2371224Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2371733Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2372214Z layer_outputs = layer_module( 2025-09-07T08:50:06.2372537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2372890Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2373299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2373713Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2374121Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2374527Z self_outputs = self.self( 2025-09-07T08:50:06.2374911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2375325Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2375452Z 2025-09-07T08:50:06.2375558Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2376067Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2376541Z layer_outputs = layer_module( 2025-09-07T08:50:06.2376881Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2377277Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2377683Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2378090Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2378501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2378908Z self_outputs = self.self( 2025-09-07T08:50:06.2379301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2379714Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2379852Z 2025-09-07T08:50:06.2379950Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2380463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2380990Z layer_outputs = layer_module( 2025-09-07T08:50:06.2381332Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2381687Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2382087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2382495Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2382930Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2382999Z self_outputs = self.self( 2025-09-07T08:50:06.2383334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2383453Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2383817Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2383989Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2384178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2384282Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2384287Z 2025-09-07T08:50:06.2384387Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2384751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2384820Z layer_outputs = layer_module( 2025-09-07T08:50:06.2385043Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2385117Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2385397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2385474Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2385838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2385915Z self_outputs = self.self( 2025-09-07T08:50:06.2386194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2386301Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2386668Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2386839Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2387166Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2387250Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2387440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2387527Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2387531Z 2025-09-07T08:50:06.2387627Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2387987Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2388056Z layer_outputs = layer_module( 2025-09-07T08:50:06.2388282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2388390Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2388676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2388747Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2389024Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2389132Z self_outputs = self.self( 2025-09-07T08:50:06.2389414Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2389558Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2389913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2390067Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2390078Z 2025-09-07T08:50:06.2390174Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2390537Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2390610Z layer_outputs = layer_module( 2025-09-07T08:50:06.2390843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2390922Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2391201Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2391273Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2391556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2391622Z self_outputs = self.self( 2025-09-07T08:50:06.2391905Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2392008Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2392364Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2392502Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2392506Z 2025-09-07T08:50:06.2392600Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2392959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2393366Z layer_outputs = layer_module( 2025-09-07T08:50:06.2393590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2393661Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2393950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2394018Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2394297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2394407Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2394681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2394766Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2394803Z 2025-09-07T08:50:06.2394896Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2395250Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2395315Z layer_outputs = layer_module( 2025-09-07T08:50:06.2395531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2395641Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2395922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2395993Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2396307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2396410Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2396691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2396765Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2396769Z 2025-09-07T08:50:06.2396864Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2397210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2397280Z layer_outputs = layer_module( 2025-09-07T08:50:06.2397494Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2397573Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2397857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2397932Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2398198Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2398269Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2398553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2398664Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2398941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2399021Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2399026Z 2025-09-07T08:50:06.2399117Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2399519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2399586Z layer_outputs = layer_module( 2025-09-07T08:50:06.2399804Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2399877Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2400153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2400232Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2400489Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2400558Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2400844Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2400980Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2401264Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2401369Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2401582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2401647Z return self.act(input) 2025-09-07T08:50:06.2401682Z 2025-09-07T08:50:06.2401779Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2402167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2402233Z layer_outputs = layer_module( 2025-09-07T08:50:06.2402453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2402524Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2402803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2402878Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2403132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2403206Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2403485Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2403604Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2403886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2403964Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2403968Z 2025-09-07T08:50:06.2404064Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2404410Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2404478Z layer_outputs = layer_module( 2025-09-07T08:50:06.2404691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2404764Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2405042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2405113Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2405437Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2405504Z self_outputs = self.self( 2025-09-07T08:50:06.2405787Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2405859Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2405863Z 2025-09-07T08:50:06.2405952Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2406304Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2406367Z layer_outputs = layer_module( 2025-09-07T08:50:06.2406589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2406660Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2406941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2407046Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2407324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2407390Z self_outputs = self.self( 2025-09-07T08:50:06.2407663Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2407808Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2408157Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2408377Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2408386Z 2025-09-07T08:50:06.2408480Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2408829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2408903Z layer_outputs = layer_module( 2025-09-07T08:50:06.2409115Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2409188Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2409463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2409532Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2409973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2410042Z self_outputs = self.self( 2025-09-07T08:50:06.2410328Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2410406Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2410410Z 2025-09-07T08:50:06.2410505Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2410856Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2410921Z layer_outputs = layer_module( 2025-09-07T08:50:06.2411149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2411216Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2411504Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2411656Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2411939Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2412011Z self_outputs = self.self( 2025-09-07T08:50:06.2412293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2412392Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2412738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2412891Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2413169Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2413238Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2413242Z 2025-09-07T08:50:06.2413594Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2413970Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2414045Z layer_outputs = layer_module( 2025-09-07T08:50:06.2414272Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2414353Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2414690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2414763Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2415094Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2415161Z self_outputs = self.self( 2025-09-07T08:50:06.2415447Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2415540Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2415882Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2416069Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2416075Z 2025-09-07T08:50:06.2416172Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2416535Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2416599Z layer_outputs = layer_module( 2025-09-07T08:50:06.2416830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2416904Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2417183Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2417254Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2417532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2417600Z self_outputs = self.self( 2025-09-07T08:50:06.2417876Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2417969Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2418307Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2418519Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2418523Z 2025-09-07T08:50:06.2418616Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2418966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2419036Z layer_outputs = layer_module( 2025-09-07T08:50:06.2419252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2419324Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2419607Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2419674Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2419958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2420057Z self_outputs = self.self( 2025-09-07T08:50:06.2420338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2420426Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2420798Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2420976Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2420980Z 2025-09-07T08:50:06.2421054Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2421170Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2421244Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2421320Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2421391Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2421463Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2421562Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2421912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2421980Z layer_outputs = layer_module( 2025-09-07T08:50:06.2422195Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2422265Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2422550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2422619Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2422901Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2422964Z self_outputs = self.self( 2025-09-07T08:50:06.2423238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2423308Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2423311Z 2025-09-07T08:50:06.2423402Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2423755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2423818Z layer_outputs = layer_module( 2025-09-07T08:50:06.2424037Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2424106Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2424421Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2424497Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2424776Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2424840Z self_outputs = self.self( 2025-09-07T08:50:06.2425113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2425187Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2425194Z 2025-09-07T08:50:06.2425288Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2425638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2425770Z layer_outputs = layer_module( 2025-09-07T08:50:06.2425984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2426093Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2426371Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2426437Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2426748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2426815Z self_outputs = self.self( 2025-09-07T08:50:06.2427096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2427208Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2427212Z 2025-09-07T08:50:06.2427310Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2427661Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2427728Z layer_outputs = layer_module( 2025-09-07T08:50:06.2427948Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2428020Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2428302Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2428372Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2428651Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2428716Z self_outputs = self.self( 2025-09-07T08:50:06.2428992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2429109Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2429464Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2429639Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2429829Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2429921Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2429925Z 2025-09-07T08:50:06.2430023Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2430380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2430505Z layer_outputs = layer_module( 2025-09-07T08:50:06.2430723Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2430797Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2431087Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2431157Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2431440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2431505Z self_outputs = self.self( 2025-09-07T08:50:06.2431788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2431897Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2432252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2432441Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2432759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2432845Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2433064Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2433159Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2433162Z 2025-09-07T08:50:06.2433258Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2433644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2433715Z layer_outputs = layer_module( 2025-09-07T08:50:06.2433932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2434006Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2434282Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2434350Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2434630Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2434693Z self_outputs = self.self( 2025-09-07T08:50:06.2434972Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2435074Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2435426Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2435573Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2435577Z 2025-09-07T08:50:06.2435669Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2436028Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2436094Z layer_outputs = layer_module( 2025-09-07T08:50:06.2436311Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2436381Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2436660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2436768Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2437047Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2437113Z self_outputs = self.self( 2025-09-07T08:50:06.2437388Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2437496Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2437843Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2437980Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2437990Z 2025-09-07T08:50:06.2438083Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2438434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2438537Z layer_outputs = layer_module( 2025-09-07T08:50:06.2438750Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2438820Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2439133Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2439203Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2439484Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2439629Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2439916Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2439994Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2439998Z 2025-09-07T08:50:06.2440115Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2440472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2440535Z layer_outputs = layer_module( 2025-09-07T08:50:06.2440754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2440825Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2441107Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2441179Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2441455Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2441560Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2441835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2441914Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2441918Z 2025-09-07T08:50:06.2442009Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2442358Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2442420Z layer_outputs = layer_module( 2025-09-07T08:50:06.2442634Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2442761Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2443039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2443117Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2443379Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2443449Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2443740Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2443843Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2444126Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2444202Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2444205Z 2025-09-07T08:50:06.2444336Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2444684Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2444750Z layer_outputs = layer_module( 2025-09-07T08:50:06.2444966Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2445035Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2445345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2445421Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2445713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2445786Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2446068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2446168Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2446444Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2446553Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2446764Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2446829Z return self.act(input) 2025-09-07T08:50:06.2446833Z 2025-09-07T08:50:06.2446930Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2447280Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2447347Z layer_outputs = layer_module( 2025-09-07T08:50:06.2447559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2447630Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2447906Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2447979Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2448237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2448304Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2448589Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2448704Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2449017Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2449095Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2449098Z 2025-09-07T08:50:06.2449191Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2449539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2449606Z layer_outputs = layer_module( 2025-09-07T08:50:06.2449821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2449892Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2450167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2450238Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2450552Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2450620Z self_outputs = self.self( 2025-09-07T08:50:06.2450895Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2450968Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2450977Z 2025-09-07T08:50:06.2451126Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2451478Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2451545Z layer_outputs = layer_module( 2025-09-07T08:50:06.2451795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2451870Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2452150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2452222Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2452514Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2452577Z self_outputs = self.self( 2025-09-07T08:50:06.2452855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2452947Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2453296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2453479Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2453484Z 2025-09-07T08:50:06.2453576Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2453926Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2453990Z layer_outputs = layer_module( 2025-09-07T08:50:06.2454210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2454278Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2454553Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2454628Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2454904Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2455025Z self_outputs = self.self( 2025-09-07T08:50:06.2455300Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2455376Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2455379Z 2025-09-07T08:50:06.2455468Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2455815Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2455886Z layer_outputs = layer_module( 2025-09-07T08:50:06.2456100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2456174Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2456450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2456555Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2456838Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2456899Z self_outputs = self.self( 2025-09-07T08:50:06.2457177Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2457298Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2457646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2457827Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2458110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2458187Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2458190Z 2025-09-07T08:50:06.2458288Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2458650Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2458714Z layer_outputs = layer_module( 2025-09-07T08:50:06.2458936Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2459006Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2459287Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2459358Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2459638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2459709Z self_outputs = self.self( 2025-09-07T08:50:06.2459984Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2460075Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2460423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2460600Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2460603Z 2025-09-07T08:50:06.2460702Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2461049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2461155Z layer_outputs = layer_module( 2025-09-07T08:50:06.2461370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2461441Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2461721Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2461790Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2462070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2462133Z self_outputs = self.self( 2025-09-07T08:50:06.2462415Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2462504Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2462845Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2463056Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2463060Z 2025-09-07T08:50:06.2463151Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2463538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2463602Z layer_outputs = layer_module( 2025-09-07T08:50:06.2463821Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2463926Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2464208Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2464288Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2464564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2464632Z self_outputs = self.self( 2025-09-07T08:50:06.2464914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2465006Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2465346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2465515Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2465519Z 2025-09-07T08:50:06.2465602Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2465674Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2465791Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2465864Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2465936Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2466012Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2466106Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2466463Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2466530Z layer_outputs = layer_module( 2025-09-07T08:50:06.2466744Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2466821Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2467099Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2467213Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2467493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2467556Z self_outputs = self.self( 2025-09-07T08:50:06.2467833Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2467900Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2467903Z 2025-09-07T08:50:06.2468002Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2468348Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2468419Z layer_outputs = layer_module( 2025-09-07T08:50:06.2468631Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2468737Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2469020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2469089Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2469373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2469438Z self_outputs = self.self( 2025-09-07T08:50:06.2469745Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2469826Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2469829Z 2025-09-07T08:50:06.2469956Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2470314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2470381Z layer_outputs = layer_module( 2025-09-07T08:50:06.2470601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2470669Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2470943Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2471013Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2471288Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2471354Z self_outputs = self.self( 2025-09-07T08:50:06.2471628Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2471708Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2471718Z 2025-09-07T08:50:06.2471809Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2472156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2472224Z layer_outputs = layer_module( 2025-09-07T08:50:06.2472434Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2472509Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2472782Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2472850Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2473134Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2473230Z self_outputs = self.self( 2025-09-07T08:50:06.2473516Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2473625Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2473979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2474151Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2474340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2474438Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2474442Z 2025-09-07T08:50:06.2474535Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2474889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2474990Z layer_outputs = layer_module( 2025-09-07T08:50:06.2475205Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2475282Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2475559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2475666Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2475945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2476015Z self_outputs = self.self( 2025-09-07T08:50:06.2476338Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2476449Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2476808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2476937Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2477260Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2477344Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2477530Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2477623Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2477628Z 2025-09-07T08:50:06.2477722Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2478081Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2478148Z layer_outputs = layer_module( 2025-09-07T08:50:06.2478366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2478435Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2478714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2478788Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2479067Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2479136Z self_outputs = self.self( 2025-09-07T08:50:06.2479412Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2479553Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2479907Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2480050Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2480054Z 2025-09-07T08:50:06.2480151Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2480498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2480567Z layer_outputs = layer_module( 2025-09-07T08:50:06.2480780Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2480853Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2481131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2481232Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2481515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2481579Z self_outputs = self.self( 2025-09-07T08:50:06.2481884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2481988Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2482383Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2482529Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2482532Z 2025-09-07T08:50:06.2482625Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2482978Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2483041Z layer_outputs = layer_module( 2025-09-07T08:50:06.2483257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2483325Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2483602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2483675Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2483950Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2484060Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2484335Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2484410Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2484418Z 2025-09-07T08:50:06.2484513Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2484864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2484934Z layer_outputs = layer_module( 2025-09-07T08:50:06.2485150Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2485224Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2485501Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2485607Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2485889Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2485985Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2486265Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2486339Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2486343Z 2025-09-07T08:50:06.2486439Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2486786Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2486853Z layer_outputs = layer_module( 2025-09-07T08:50:06.2487072Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2487174Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2487457Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2487531Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2487793Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2487903Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2488190Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2488327Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2488609Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2488691Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2488694Z 2025-09-07T08:50:06.2488787Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2489132Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2489197Z layer_outputs = layer_module( 2025-09-07T08:50:06.2489408Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2489482Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2489757Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2489838Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2490096Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2490166Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2490454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2490547Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2490840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2490945Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2491152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2491220Z return self.act(input) 2025-09-07T08:50:06.2491225Z 2025-09-07T08:50:06.2491318Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2491706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2491774Z layer_outputs = layer_module( 2025-09-07T08:50:06.2491991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2492060Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2492340Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2492425Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2492681Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2492755Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2493033Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2493187Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2493470Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2493543Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2493547Z 2025-09-07T08:50:06.2493642Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2494023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2494096Z layer_outputs = layer_module( 2025-09-07T08:50:06.2494343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2494416Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2494700Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2494774Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2495054Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2495119Z self_outputs = self.self( 2025-09-07T08:50:06.2495396Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2495476Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2495480Z 2025-09-07T08:50:06.2495573Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2495932Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2495998Z layer_outputs = layer_module( 2025-09-07T08:50:06.2496216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2496287Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2496564Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2496641Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2496919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2496988Z self_outputs = self.self( 2025-09-07T08:50:06.2497262Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2497355Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2497706Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2497920Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2497923Z 2025-09-07T08:50:06.2498023Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2498369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2498440Z layer_outputs = layer_module( 2025-09-07T08:50:06.2498653Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2498722Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2499016Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2499085Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2499377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2499475Z self_outputs = self.self( 2025-09-07T08:50:06.2499760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2499831Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2499834Z 2025-09-07T08:50:06.2499924Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2500324Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2500390Z layer_outputs = layer_module( 2025-09-07T08:50:06.2500644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2500716Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2500996Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2501071Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2501349Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2501419Z self_outputs = self.self( 2025-09-07T08:50:06.2501698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2501796Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2502136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2502282Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2502565Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2502634Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2502637Z 2025-09-07T08:50:06.2502734Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2503080Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2503150Z layer_outputs = layer_module( 2025-09-07T08:50:06.2503363Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2503429Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2503709Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2503810Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2504092Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2504159Z self_outputs = self.self( 2025-09-07T08:50:06.2504433Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2504527Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2504867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2505048Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2505053Z 2025-09-07T08:50:06.2505145Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2505498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2505595Z layer_outputs = layer_module( 2025-09-07T08:50:06.2505855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2505928Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2506204Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2506312Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2506590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2506693Z self_outputs = self.self( 2025-09-07T08:50:06.2506973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2507066Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2507406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2507575Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2507578Z 2025-09-07T08:50:06.2507672Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2508019Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2508089Z layer_outputs = layer_module( 2025-09-07T08:50:06.2508306Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2508376Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2508659Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2508728Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2509010Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2509071Z self_outputs = self.self( 2025-09-07T08:50:06.2509346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2509438Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2509928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2510115Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2510202Z 2025-09-07T08:50:06.2510281Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2510359Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2510430Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2510502Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2510578Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2510646Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2510751Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2511113Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2511180Z layer_outputs = layer_module( 2025-09-07T08:50:06.2511405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2511475Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2511763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2511885Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2512167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2512234Z self_outputs = self.self( 2025-09-07T08:50:06.2512561Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2512633Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2512636Z 2025-09-07T08:50:06.2512730Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2513131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2513199Z layer_outputs = layer_module( 2025-09-07T08:50:06.2513413Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2513488Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2513767Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2513838Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2514116Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2514179Z self_outputs = self.self( 2025-09-07T08:50:06.2514458Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2514532Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2514536Z 2025-09-07T08:50:06.2514634Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2514979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2515048Z layer_outputs = layer_module( 2025-09-07T08:50:06.2515259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2515326Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2515612Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2515684Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2515974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2516037Z self_outputs = self.self( 2025-09-07T08:50:06.2516354Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2516442Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2516446Z 2025-09-07T08:50:06.2516542Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2516900Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2516965Z layer_outputs = layer_module( 2025-09-07T08:50:06.2517188Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2517260Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2517541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2517616Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2517894Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2517999Z self_outputs = self.self( 2025-09-07T08:50:06.2518276Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2518392Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2518790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2518961Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2519187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2519288Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2519293Z 2025-09-07T08:50:06.2519402Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2519759Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2519828Z layer_outputs = layer_module( 2025-09-07T08:50:06.2520058Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2520135Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2520429Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2520501Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2520788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2520856Z self_outputs = self.self( 2025-09-07T08:50:06.2521136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2521257Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2521616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2521751Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2522070Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2522157Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2522347Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2522474Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2522477Z 2025-09-07T08:50:06.2522607Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2522963Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2523033Z layer_outputs = layer_module( 2025-09-07T08:50:06.2523252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2523327Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2523616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2523686Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2523971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2524037Z self_outputs = self.self( 2025-09-07T08:50:06.2524315Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2524481Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2524833Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2524988Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2525024Z 2025-09-07T08:50:06.2525123Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2525516Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2525585Z layer_outputs = layer_module( 2025-09-07T08:50:06.2525803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2525884Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2526163Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2526237Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2526517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2526588Z self_outputs = self.self( 2025-09-07T08:50:06.2526865Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2526973Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2527333Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2527476Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2527479Z 2025-09-07T08:50:06.2527580Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2527929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2528000Z layer_outputs = layer_module( 2025-09-07T08:50:06.2528216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2528286Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2528570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2528641Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2528961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2529070Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2529346Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2529435Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2529438Z 2025-09-07T08:50:06.2529538Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2529903Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2529972Z layer_outputs = layer_module( 2025-09-07T08:50:06.2530200Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2530275Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2530559Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2530674Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2530954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2531067Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2531375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2531462Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2531465Z 2025-09-07T08:50:06.2531563Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2531953Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2532028Z layer_outputs = layer_module( 2025-09-07T08:50:06.2532245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2532321Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2532601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2532679Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2532949Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2533020Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2533316Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2533420Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2533707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2533791Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2533794Z 2025-09-07T08:50:06.2533889Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2534245Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2534310Z layer_outputs = layer_module( 2025-09-07T08:50:06.2541139Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2541247Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2541583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2541743Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2542031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2542109Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2542406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2542521Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2547314Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2547461Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2547714Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2547789Z return self.act(input) 2025-09-07T08:50:06.2547796Z 2025-09-07T08:50:06.2547909Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2548345Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2548418Z layer_outputs = layer_module( 2025-09-07T08:50:06.2548646Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2548725Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2549036Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2549118Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2549425Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2549502Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2549788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2549914Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2550193Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2550275Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2550279Z 2025-09-07T08:50:06.2550382Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2550743Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2550819Z layer_outputs = layer_module( 2025-09-07T08:50:06.2551042Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2551119Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2551397Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2551470Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2551746Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2551814Z self_outputs = self.self( 2025-09-07T08:50:06.2552098Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2552175Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2552179Z 2025-09-07T08:50:06.2552279Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2552633Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2552743Z layer_outputs = layer_module( 2025-09-07T08:50:06.2552959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2553029Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2553321Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2553396Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2553765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2553830Z self_outputs = self.self( 2025-09-07T08:50:06.2554114Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2554218Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2554604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2554794Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2554799Z 2025-09-07T08:50:06.2554900Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2555259Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2555326Z layer_outputs = layer_module( 2025-09-07T08:50:06.2555544Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2555657Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2555940Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2556017Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2556293Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2556360Z self_outputs = self.self( 2025-09-07T08:50:06.2556647Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2556721Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2556724Z 2025-09-07T08:50:06.2556831Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2557185Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2557256Z layer_outputs = layer_module( 2025-09-07T08:50:06.2557478Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2557554Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2557840Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2557910Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2558192Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2558257Z self_outputs = self.self( 2025-09-07T08:50:06.2558534Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2558634Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2558976Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2559189Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2559474Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2559555Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2559558Z 2025-09-07T08:50:06.2559657Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2560014Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2560158Z layer_outputs = layer_module( 2025-09-07T08:50:06.2560378Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2560456Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2560735Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2560851Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2561131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2561196Z self_outputs = self.self( 2025-09-07T08:50:06.2561477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2561571Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2561921Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2562135Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2562140Z 2025-09-07T08:50:06.2562242Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2562597Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2562664Z layer_outputs = layer_module( 2025-09-07T08:50:06.2562883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2562954Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2563239Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2563307Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2563585Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2563653Z self_outputs = self.self( 2025-09-07T08:50:06.2563929Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2564028Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2564366Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2564541Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2564544Z 2025-09-07T08:50:06.2564640Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2564990Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2565059Z layer_outputs = layer_module( 2025-09-07T08:50:06.2565318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2565397Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2565673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2565745Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2566021Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2566082Z self_outputs = self.self( 2025-09-07T08:50:06.2566398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2566489Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2566835Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2567006Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2567041Z 2025-09-07T08:50:06.2567119Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2567194Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2567262Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2567332Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2567403Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2567473Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2567571Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2567919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2568016Z layer_outputs = layer_module( 2025-09-07T08:50:06.2568234Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2568311Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2568590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2568657Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2568935Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2568996Z self_outputs = self.self( 2025-09-07T08:50:06.2569274Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2569340Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2569344Z 2025-09-07T08:50:06.2569437Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2569789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2569856Z layer_outputs = layer_module( 2025-09-07T08:50:06.2570071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2570137Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2570417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2570486Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2570763Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2570834Z self_outputs = self.self( 2025-09-07T08:50:06.2571109Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2571220Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2571225Z 2025-09-07T08:50:06.2571314Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2571660Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2571728Z layer_outputs = layer_module( 2025-09-07T08:50:06.2571940Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2572014Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2572325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2572395Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2572676Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2572740Z self_outputs = self.self( 2025-09-07T08:50:06.2573049Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2573125Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2573129Z 2025-09-07T08:50:06.2573223Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2573570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2573637Z layer_outputs = layer_module( 2025-09-07T08:50:06.2573850Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2573952Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2574238Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2574308Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2574583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2574643Z self_outputs = self.self( 2025-09-07T08:50:06.2574913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2575032Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2575387Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2575562Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2575760Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2575861Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2575867Z 2025-09-07T08:50:06.2575962Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2576320Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2576388Z layer_outputs = layer_module( 2025-09-07T08:50:06.2576602Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2576677Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2576958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2577029Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2577310Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2577409Z self_outputs = self.self( 2025-09-07T08:50:06.2577691Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2577803Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2578167Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2578301Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2578654Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2578749Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2578937Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2579066Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2579069Z 2025-09-07T08:50:06.2579167Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2579525Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2579591Z layer_outputs = layer_module( 2025-09-07T08:50:06.2579811Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2579891Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2580172Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2580294Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2580576Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2580644Z self_outputs = self.self( 2025-09-07T08:50:06.2580922Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2581036Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2581403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2581553Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2581559Z 2025-09-07T08:50:06.2581659Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2582009Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2582077Z layer_outputs = layer_module( 2025-09-07T08:50:06.2582299Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2582370Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2582648Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2582717Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2582992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2583059Z self_outputs = self.self( 2025-09-07T08:50:06.2583337Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2583444Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2583832Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2583980Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2583984Z 2025-09-07T08:50:06.2584074Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2584428Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2584498Z layer_outputs = layer_module( 2025-09-07T08:50:06.2584751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2584826Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2585111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2585186Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2585497Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2585599Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2585919Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2586000Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2586004Z 2025-09-07T08:50:06.2586106Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2586496Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2586566Z layer_outputs = layer_module( 2025-09-07T08:50:06.2586790Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2586864Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2587153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2587223Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2587500Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2587604Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2587880Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2587957Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2587963Z 2025-09-07T08:50:06.2588056Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2588417Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2588484Z layer_outputs = layer_module( 2025-09-07T08:50:06.2588707Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2588784Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2589066Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2589150Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2589412Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2589487Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2589769Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2589912Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2590194Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2590267Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2590270Z 2025-09-07T08:50:06.2590374Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2590724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2590829Z layer_outputs = layer_module( 2025-09-07T08:50:06.2591048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2591121Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2591402Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2591521Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2591789Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2591857Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2592140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2592242Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2592522Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2592670Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2592886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2592960Z return self.act(input) 2025-09-07T08:50:06.2592964Z 2025-09-07T08:50:06.2593058Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2593407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2593477Z layer_outputs = layer_module( 2025-09-07T08:50:06.2593692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2593768Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2594046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2594129Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2594385Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2594457Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2594738Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2594856Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2595134Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2595207Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2595211Z 2025-09-07T08:50:06.2595305Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2595656Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2595754Z layer_outputs = layer_module( 2025-09-07T08:50:06.2595973Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2596045Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2596327Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2596399Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2596673Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2596744Z self_outputs = self.self( 2025-09-07T08:50:06.2597057Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2597136Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2597140Z 2025-09-07T08:50:06.2597231Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2597581Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2597684Z layer_outputs = layer_module( 2025-09-07T08:50:06.2597898Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2597975Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2598252Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2598324Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2598605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2598702Z self_outputs = self.self( 2025-09-07T08:50:06.2598989Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2599097Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2599440Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2599625Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2599630Z 2025-09-07T08:50:06.2599727Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2600083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2600150Z layer_outputs = layer_module( 2025-09-07T08:50:06.2600370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2600443Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2600724Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2600794Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2601068Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2601133Z self_outputs = self.self( 2025-09-07T08:50:06.2601407Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2601479Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2601485Z 2025-09-07T08:50:06.2601577Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2601923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2602031Z layer_outputs = layer_module( 2025-09-07T08:50:06.2602243Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2602315Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2602590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2602656Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2602933Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2603033Z self_outputs = self.self( 2025-09-07T08:50:06.2603318Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2603413Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2603755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2603954Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2604231Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2604303Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2604306Z 2025-09-07T08:50:06.2604401Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2604753Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2604850Z layer_outputs = layer_module( 2025-09-07T08:50:06.2605069Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2605146Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2605424Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2605496Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2605773Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2605837Z self_outputs = self.self( 2025-09-07T08:50:06.2606111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2606202Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2606550Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2606726Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2606731Z 2025-09-07T08:50:06.2606825Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2607173Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2607238Z layer_outputs = layer_module( 2025-09-07T08:50:06.2607450Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2607521Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2607803Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2607870Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2608148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2608260Z self_outputs = self.self( 2025-09-07T08:50:06.2608532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2608623Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2608958Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2609130Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2609173Z 2025-09-07T08:50:06.2609265Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2609836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2609901Z layer_outputs = layer_module( 2025-09-07T08:50:06.2610187Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2610259Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2610538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2610608Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2610886Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2610951Z self_outputs = self.self( 2025-09-07T08:50:06.2611286Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2611379Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2611731Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2611909Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2611913Z 2025-09-07T08:50:06.2611997Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2612067Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2612136Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2612209Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2612280Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2612359Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2612455Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2612808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2612881Z layer_outputs = layer_module( 2025-09-07T08:50:06.2613097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2613177Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2613453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2613530Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2613808Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2613871Z self_outputs = self.self( 2025-09-07T08:50:06.2614156Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2614227Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2614231Z 2025-09-07T08:50:06.2614388Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2614736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2614803Z layer_outputs = layer_module( 2025-09-07T08:50:06.2615023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2615092Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2615375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2615497Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2615788Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2615854Z self_outputs = self.self( 2025-09-07T08:50:06.2616131Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2616246Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2616249Z 2025-09-07T08:50:06.2616341Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2616695Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2616760Z layer_outputs = layer_module( 2025-09-07T08:50:06.2616974Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2617051Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2617360Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2617437Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2617718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2617789Z self_outputs = self.self( 2025-09-07T08:50:06.2618063Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2618141Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2618145Z 2025-09-07T08:50:06.2618241Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2618590Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2618662Z layer_outputs = layer_module( 2025-09-07T08:50:06.2618877Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2618949Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2619232Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2619301Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2619584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2619648Z self_outputs = self.self( 2025-09-07T08:50:06.2619928Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2620042Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2620395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2620572Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2620802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2620904Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2620907Z 2025-09-07T08:50:06.2621000Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2621357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2621422Z layer_outputs = layer_module( 2025-09-07T08:50:06.2621675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2621751Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2622030Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2622107Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2622422Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2622485Z self_outputs = self.self( 2025-09-07T08:50:06.2622765Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2622874Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2623230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2623365Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2623718Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2623804Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2623991Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2624082Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2624086Z 2025-09-07T08:50:06.2624179Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2624536Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2624602Z layer_outputs = layer_module( 2025-09-07T08:50:06.2624825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2624897Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2625179Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2625259Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2625541Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2625609Z self_outputs = self.self( 2025-09-07T08:50:06.2625952Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2626065Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2626427Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2626575Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2626579Z 2025-09-07T08:50:06.2626685Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2627076Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2627152Z layer_outputs = layer_module( 2025-09-07T08:50:06.2627373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2627449Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2627737Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2627807Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2628145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2628210Z self_outputs = self.self( 2025-09-07T08:50:06.2628492Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2628608Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2628998Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2629149Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2629153Z 2025-09-07T08:50:06.2629249Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2629603Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2629667Z layer_outputs = layer_module( 2025-09-07T08:50:06.2629914Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2629991Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2630267Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2630343Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2630619Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2630729Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2631006Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2631084Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2631088Z 2025-09-07T08:50:06.2631189Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2631538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2631611Z layer_outputs = layer_module( 2025-09-07T08:50:06.2631826Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2631898Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2632178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2632247Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2632531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2632629Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2632913Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2633022Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2633025Z 2025-09-07T08:50:06.2633117Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2633468Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2633533Z layer_outputs = layer_module( 2025-09-07T08:50:06.2633751Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2633820Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2634142Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2634220Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2634483Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2634565Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2634883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2634995Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2635270Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2635342Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2635350Z 2025-09-07T08:50:06.2635444Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2635791Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2635894Z layer_outputs = layer_module( 2025-09-07T08:50:06.2636111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2636187Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2636466Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2636539Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2636802Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2636873Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2637163Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2637261Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2637539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2637655Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2637867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2637940Z return self.act(input) 2025-09-07T08:50:06.2637943Z 2025-09-07T08:50:06.2638036Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2638389Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2638454Z layer_outputs = layer_module( 2025-09-07T08:50:06.2638669Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2638748Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2639027Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2639140Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2639395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2639461Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2639748Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2639866Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2640149Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2640262Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2640266Z 2025-09-07T08:50:06.2640363Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2640713Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2640812Z layer_outputs = layer_module( 2025-09-07T08:50:06.2641031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2641101Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2641384Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2641452Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2641736Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2641801Z self_outputs = self.self( 2025-09-07T08:50:06.2642110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2642190Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2642193Z 2025-09-07T08:50:06.2642287Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2642638Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2642704Z layer_outputs = layer_module( 2025-09-07T08:50:06.2642915Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2642990Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2643266Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2643342Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2643622Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2643691Z self_outputs = self.self( 2025-09-07T08:50:06.2643971Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2644067Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2644416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2644596Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2644600Z 2025-09-07T08:50:06.2644702Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2645048Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2645120Z layer_outputs = layer_module( 2025-09-07T08:50:06.2645369Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2645441Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2645728Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2645798Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2646080Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2646145Z self_outputs = self.self( 2025-09-07T08:50:06.2646454Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2646536Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2646540Z 2025-09-07T08:50:06.2646630Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2646985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2647084Z layer_outputs = layer_module( 2025-09-07T08:50:06.2647301Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2647368Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2647644Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2647717Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2647995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2648094Z self_outputs = self.self( 2025-09-07T08:50:06.2648372Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2648467Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2648814Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2648964Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2649249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2649320Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2649324Z 2025-09-07T08:50:06.2649422Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2649770Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2649836Z layer_outputs = layer_module( 2025-09-07T08:50:06.2650053Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2650123Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2650406Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2650474Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2650755Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2650820Z self_outputs = self.self( 2025-09-07T08:50:06.2651097Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2651193Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2651583Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2651766Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2651769Z 2025-09-07T08:50:06.2651861Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2652212Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2652276Z layer_outputs = layer_module( 2025-09-07T08:50:06.2652531Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2652609Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2652887Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2652961Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2653271Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2653334Z self_outputs = self.self( 2025-09-07T08:50:06.2653613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2653701Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2654045Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2654216Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2654220Z 2025-09-07T08:50:06.2654348Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2654698Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2654765Z layer_outputs = layer_module( 2025-09-07T08:50:06.2654985Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2655053Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2655334Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2655403Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2655682Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2655752Z self_outputs = self.self( 2025-09-07T08:50:06.2656038Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2656135Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2656472Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2656647Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2656650Z 2025-09-07T08:50:06.2656729Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2656798Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2656875Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2656944Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2657024Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2657094Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2657186Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2657539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2657667Z layer_outputs = layer_module( 2025-09-07T08:50:06.2657883Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2657951Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2658230Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2658307Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2658616Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2658688Z self_outputs = self.self( 2025-09-07T08:50:06.2658965Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2659039Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2659074Z 2025-09-07T08:50:06.2659167Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2659515Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2659584Z layer_outputs = layer_module( 2025-09-07T08:50:06.2659795Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2659869Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2660148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2660223Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2660532Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2660595Z self_outputs = self.self( 2025-09-07T08:50:06.2660875Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2660946Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2660949Z 2025-09-07T08:50:06.2661047Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2661390Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2661455Z layer_outputs = layer_module( 2025-09-07T08:50:06.2661677Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2661748Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2662029Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2662099Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2662377Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2662440Z self_outputs = self.self( 2025-09-07T08:50:06.2662712Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2662797Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2662800Z 2025-09-07T08:50:06.2662890Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2663244Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2663307Z layer_outputs = layer_module( 2025-09-07T08:50:06.2663556Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2663634Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2663909Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2663978Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2664254Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2664321Z self_outputs = self.self( 2025-09-07T08:50:06.2664629Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2664753Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2665111Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2665318Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2665512Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2665602Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2665606Z 2025-09-07T08:50:06.2665787Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2666136Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2666200Z layer_outputs = layer_module( 2025-09-07T08:50:06.2666418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2666523Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2666806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2666874Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2667148Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2667216Z self_outputs = self.self( 2025-09-07T08:50:06.2667490Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2667598Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2667945Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2668077Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2668400Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2668485Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2668672Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2668757Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2668761Z 2025-09-07T08:50:06.2668856Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2669202Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2669270Z layer_outputs = layer_module( 2025-09-07T08:50:06.2669482Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2669550Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2669874Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2669944Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2670224Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2670286Z self_outputs = self.self( 2025-09-07T08:50:06.2670558Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2670664Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2671046Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2671198Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2671203Z 2025-09-07T08:50:06.2671292Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2671675Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2671739Z layer_outputs = layer_module( 2025-09-07T08:50:06.2671955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2672026Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2672305Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2672379Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2672710Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2672774Z self_outputs = self.self( 2025-09-07T08:50:06.2673051Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2673155Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2673505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2673641Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2673644Z 2025-09-07T08:50:06.2673740Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2674091Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2674155Z layer_outputs = layer_module( 2025-09-07T08:50:06.2674373Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2674444Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2674722Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2674790Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2675071Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2675177Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2675453Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2675533Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2675537Z 2025-09-07T08:50:06.2675628Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2676020Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2676083Z layer_outputs = layer_module( 2025-09-07T08:50:06.2676297Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2676367Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2676643Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2676715Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2677023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2677127Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2677403Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2677513Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2677516Z 2025-09-07T08:50:06.2677612Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2677955Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2678025Z layer_outputs = layer_module( 2025-09-07T08:50:06.2678236Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2678307Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2678579Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2678685Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2678954Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2679024Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2679309Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2679412Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2679687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2679762Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2679765Z 2025-09-07T08:50:06.2679856Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2680210Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2680274Z layer_outputs = layer_module( 2025-09-07T08:50:06.2680487Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2680557Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2680830Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2680904Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2681162Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2681232Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2681517Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2681623Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2681946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2682054Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2682268Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2682335Z return self.act(input) 2025-09-07T08:50:06.2682338Z 2025-09-07T08:50:06.2682440Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2682792Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2682891Z layer_outputs = layer_module( 2025-09-07T08:50:06.2683117Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2683190Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2683477Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2683601Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2683866Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2683935Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2684216Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2684335Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2684613Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2684726Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2684729Z 2025-09-07T08:50:06.2684826Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2685175Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2685245Z layer_outputs = layer_module( 2025-09-07T08:50:06.2685461Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2685536Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2685818Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2685894Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2686171Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2686236Z self_outputs = self.self( 2025-09-07T08:50:06.2686519Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 509, in forward 2025-09-07T08:50:06.2686594Z query_vectors = self.query(hidden_states) 2025-09-07T08:50:06.2686597Z 2025-09-07T08:50:06.2686693Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2687040Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2687108Z layer_outputs = layer_module( 2025-09-07T08:50:06.2687319Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2687392Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2687671Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2687740Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2688056Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2688120Z self_outputs = self.self( 2025-09-07T08:50:06.2688395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2688493Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2688836Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2689055Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2689058Z 2025-09-07T08:50:06.2689148Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2689498Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2689593Z layer_outputs = layer_module( 2025-09-07T08:50:06.2689805Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2689879Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2690155Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2690227Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2690505Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2690568Z self_outputs = self.self( 2025-09-07T08:50:06.2690879Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 510, in forward 2025-09-07T08:50:06.2690955Z key_vectors = self.key(hidden_states) 2025-09-07T08:50:06.2690958Z 2025-09-07T08:50:06.2691048Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2691395Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2691463Z layer_outputs = layer_module( 2025-09-07T08:50:06.2691674Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2691743Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2692023Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2692092Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2692380Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2692443Z self_outputs = self.self( 2025-09-07T08:50:06.2692716Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2692814Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2693152Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 790, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2693305Z key = self._chunk(key, window_overlap, getattr(self.config, "onnx_export", False)) 2025-09-07T08:50:06.2693584Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 719, in _chunk 2025-09-07T08:50:06.2693657Z hidden_states = hidden_states.view( 2025-09-07T08:50:06.2693660Z 2025-09-07T08:50:06.2693750Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2694100Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2694205Z layer_outputs = layer_module( 2025-09-07T08:50:06.2694416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2694485Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2694761Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2694832Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2695140Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2695204Z self_outputs = self.self( 2025-09-07T08:50:06.2695483Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2695570Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2695961Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2696133Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2696136Z 2025-09-07T08:50:06.2696233Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2696578Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2696643Z layer_outputs = layer_module( 2025-09-07T08:50:06.2696855Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2696953Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2697237Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2697306Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2697582Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2697650Z self_outputs = self.self( 2025-09-07T08:50:06.2697923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2698019Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2698357Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2698533Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2698538Z 2025-09-07T08:50:06.2698628Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2698979Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2699047Z layer_outputs = layer_module( 2025-09-07T08:50:06.2699256Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2699326Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2699601Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2699673Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2699946Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2700009Z self_outputs = self.self( 2025-09-07T08:50:06.2700325Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 524, in forward 2025-09-07T08:50:06.2700414Z attn_scores = self._sliding_chunks_query_key_matmul( 2025-09-07T08:50:06.2700754Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 796, in _sliding_chunks_query_key_matmul 2025-09-07T08:50:06.2700921Z diagonal_chunked_attention_scores = torch.einsum("bcxd,bcyd->bcxy", (query, key)) # multiply 2025-09-07T08:50:06.2700927Z 2025-09-07T08:50:06.2701000Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2701071Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2701169Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2701242Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2701312Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2701383Z cudagraph partition due to non gpu ops 2025-09-07T08:50:06.2701484Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2701867Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2701934Z layer_outputs = layer_module( 2025-09-07T08:50:06.2702145Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2702219Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2702493Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2702563Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2702872Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2702934Z self_outputs = self.self( 2025-09-07T08:50:06.2703214Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 541, in forward 2025-09-07T08:50:06.2703283Z attn_scores += diagonal_mask 2025-09-07T08:50:06.2703286Z 2025-09-07T08:50:06.2703376Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2703725Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2703786Z layer_outputs = layer_module( 2025-09-07T08:50:06.2704001Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2704068Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2704349Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2704417Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2704692Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2704757Z self_outputs = self.self( 2025-09-07T08:50:06.2705028Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 579, in forward 2025-09-07T08:50:06.2705101Z attn_probs = nn.functional.softmax( 2025-09-07T08:50:06.2705104Z 2025-09-07T08:50:06.2705192Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2705538Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2705608Z layer_outputs = layer_module( 2025-09-07T08:50:06.2705884Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2705990Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2706263Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2706332Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2706604Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2706666Z self_outputs = self.self( 2025-09-07T08:50:06.2706941Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 511, in forward 2025-09-07T08:50:06.2707014Z value_vectors = self.value(hidden_states) 2025-09-07T08:50:06.2707051Z 2025-09-07T08:50:06.2707150Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2707495Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2707558Z layer_outputs = layer_module( 2025-09-07T08:50:06.2707807Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2707874Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2708153Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2708219Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2708497Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2708559Z self_outputs = self.self( 2025-09-07T08:50:06.2708864Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2708984Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2709339Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 863, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2709509Z padded_value = nn.functional.pad(value, (0, 0, window_overlap, window_overlap), value=-1) 2025-09-07T08:50:06.2709857Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2709949Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2709954Z 2025-09-07T08:50:06.2710048Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2710398Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2710466Z layer_outputs = layer_module( 2025-09-07T08:50:06.2710679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2710752Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2711031Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2711098Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2711375Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2711438Z self_outputs = self.self( 2025-09-07T08:50:06.2711715Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2711819Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2712178Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 876, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2712372Z chunked_attn_probs = self._pad_and_diagonalize(chunked_attn_probs) 2025-09-07T08:50:06.2712690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 699, in _pad_and_diagonalize 2025-09-07T08:50:06.2712777Z chunked_hidden_states = nn.functional.pad( 2025-09-07T08:50:06.2712959Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/nn/functional.py", line 5294, in pad 2025-09-07T08:50:06.2713047Z return torch._C._nn.pad(input, pad, mode, value) 2025-09-07T08:50:06.2713051Z 2025-09-07T08:50:06.2713142Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2713539Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2713608Z layer_outputs = layer_module( 2025-09-07T08:50:06.2713819Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2713892Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2714220Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2714294Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2714570Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2714631Z self_outputs = self.self( 2025-09-07T08:50:06.2714911Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2715018Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2715423Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2715569Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2715574Z 2025-09-07T08:50:06.2715668Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2716015Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2716080Z layer_outputs = layer_module( 2025-09-07T08:50:06.2716296Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2716364Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2716645Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2716712Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2716987Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1135, in forward 2025-09-07T08:50:06.2717057Z self_outputs = self.self( 2025-09-07T08:50:06.2717331Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 613, in forward 2025-09-07T08:50:06.2717436Z attn_output = self._sliding_chunks_matmul_attn_probs_value( 2025-09-07T08:50:06.2717785Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 878, in _sliding_chunks_matmul_attn_probs_value 2025-09-07T08:50:06.2717924Z context = torch.einsum("bcwd,bcdh->bcwh", (chunked_attn_probs, chunked_value)) 2025-09-07T08:50:06.2717930Z 2025-09-07T08:50:06.2718020Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2718370Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2718475Z layer_outputs = layer_module( 2025-09-07T08:50:06.2718687Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2718759Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2719034Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2719105Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2719381Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2719533Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2719825Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2719902Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2719907Z 2025-09-07T08:50:06.2720007Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2720391Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2720463Z layer_outputs = layer_module( 2025-09-07T08:50:06.2720679Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2720750Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2721039Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1199, in forward 2025-09-07T08:50:06.2721107Z self_attn_outputs = self.attention( 2025-09-07T08:50:06.2721418Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1144, in forward 2025-09-07T08:50:06.2721524Z attn_output = self.output(self_outputs[0], hidden_states) 2025-09-07T08:50:06.2721806Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1094, in forward 2025-09-07T08:50:06.2721892Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2721895Z 2025-09-07T08:50:06.2721990Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2722351Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2722418Z layer_outputs = layer_module( 2025-09-07T08:50:06.2722640Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2722714Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2722995Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2723081Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2723343Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2723417Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2723699Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2723801Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2724083Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1160, in forward 2025-09-07T08:50:06.2724157Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2724160Z 2025-09-07T08:50:06.2724255Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2724605Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2724708Z layer_outputs = layer_module( 2025-09-07T08:50:06.2724923Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2724993Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2725273Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2725345Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2725639Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2725709Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2725992Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1218, in ff_chunk 2025-09-07T08:50:06.2726093Z intermediate_output = self.intermediate(attn_output) 2025-09-07T08:50:06.2726405Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1161, in forward 2025-09-07T08:50:06.2726516Z hidden_states = self.intermediate_act_fn(hidden_states) 2025-09-07T08:50:06.2726726Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/activations.py", line 69, in forward 2025-09-07T08:50:06.2726798Z return self.act(input) 2025-09-07T08:50:06.2726801Z 2025-09-07T08:50:06.2726891Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:50:06.2727242Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1259, in torch_dynamo_resume_in_forward_at_1244 2025-09-07T08:50:06.2727309Z layer_outputs = layer_module( 2025-09-07T08:50:06.2727557Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/modeling_layers.py", line 94, in __call__ 2025-09-07T08:50:06.2727635Z return super().__call__(*args, **kwargs) 2025-09-07T08:50:06.2727912Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1211, in forward 2025-09-07T08:50:06.2727996Z layer_output = apply_chunking_to_forward( 2025-09-07T08:50:06.2728257Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/pytorch_utils.py", line 251, in apply_chunking_to_forward 2025-09-07T08:50:06.2728327Z return forward_fn(*input_tensors) 2025-09-07T08:50:06.2728611Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1219, in ff_chunk 2025-09-07T08:50:06.2728728Z layer_output = self.output(intermediate_output, attn_output) 2025-09-07T08:50:06.2729013Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1174, in forward 2025-09-07T08:50:06.2729086Z hidden_states = self.dense(hidden_states) 2025-09-07T08:50:06.2729090Z 2025-09-07T08:51:52.0601780Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:51:52.0602416Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1716, in torch_dynamo_resume_in_forward_at_1703 2025-09-07T08:51:52.0602964Z prediction_scores = self.lm_head(sequence_output) 2025-09-07T08:51:52.0603426Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1333, in forward 2025-09-07T08:51:52.0603874Z x = self.dense(features) 2025-09-07T08:51:52.0603996Z 2025-09-07T08:51:52.0604137Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:51:52.0604690Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1716, in torch_dynamo_resume_in_forward_at_1703 2025-09-07T08:51:52.0605664Z prediction_scores = self.lm_head(sequence_output) 2025-09-07T08:51:52.0606110Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1338, in forward 2025-09-07T08:51:52.0606533Z x = self.decoder(x) 2025-09-07T08:51:52.0606633Z 2025-09-07T08:51:52.0606739Z cudagraph partition due to non gpu ops. Found from : 2025-09-07T08:51:52.0607249Z File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1723, in torch_dynamo_resume_in_forward_at_1703 2025-09-07T08:51:52.0607854Z masked_lm_loss = loss_fct(prediction_scores.view(-1, self.config.vocab_size), labels.view(-1)) 2025-09-07T08:51:52.0608102Z 2025-09-07T08:51:57.2743429Z 2025-09-07T08:51:58.5475898Z running benchmark: 0% 0/30 [00:00> $GITHUB_ENV 2025-09-07T09:42:58.0679071Z echo "DEVICE_TYPE=$DEVICE_TYPE" >> $GITHUB_ENV 2025-09-07T09:42:58.0690111Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:42:58.0690357Z env: 2025-09-07T09:42:58.0690505Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:42:58.0690805Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:42:58.0691117Z ##[endgroup] 2025-09-07T09:42:58.0725098Z + [[ -n '' ]] 2025-09-07T09:42:58.0725382Z + python3 -mpip install boto3==1.35.33 psutil==7.0.0 pynvml==12.0.0 2025-09-07T09:42:58.2492292Z Defaulting to user installation because normal site-packages is not writeable 2025-09-07T09:42:59.0195907Z Collecting boto3==1.35.33 2025-09-07T09:42:59.0315580Z Downloading boto3-1.35.33-py3-none-any.whl (139 kB) 2025-09-07T09:42:59.2494993Z Collecting psutil==7.0.0 2025-09-07T09:42:59.2522686Z Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB) 2025-09-07T09:42:59.2803867Z Collecting pynvml==12.0.0 2025-09-07T09:42:59.2828091Z Downloading pynvml-12.0.0-py3-none-any.whl (26 kB) 2025-09-07T09:43:00.0725717Z Collecting botocore<1.36.0,>=1.35.33 2025-09-07T09:43:00.0755713Z Downloading botocore-1.35.99-py3-none-any.whl (13.3 MB) 2025-09-07T09:43:00.1771664Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0) 2025-09-07T09:43:00.2090030Z Collecting s3transfer<0.11.0,>=0.10.0 2025-09-07T09:43:00.2115734Z Downloading s3transfer-0.10.4-py3-none-any.whl (83 kB) 2025-09-07T09:43:00.2497623Z Collecting nvidia-ml-py<13.0.0a0,>=12.0.0 2025-09-07T09:43:00.2522251Z Downloading nvidia_ml_py-12.575.51-py3-none-any.whl (47 kB) 2025-09-07T09:43:00.2581789Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.1) 2025-09-07T09:43:00.2592543Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10) 2025-09-07T09:43:00.3656079Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0) 2025-09-07T09:43:00.4599349Z Installing collected packages: botocore, s3transfer, nvidia-ml-py, pynvml, psutil, boto3 2025-09-07T09:43:00.8700549Z Attempting uninstall: nvidia-ml-py 2025-09-07T09:43:00.8701542Z Found existing installation: nvidia-ml-py 11.525.84 2025-09-07T09:43:00.8712853Z Uninstalling nvidia-ml-py-11.525.84: 2025-09-07T09:43:00.8898918Z Successfully uninstalled nvidia-ml-py-11.525.84 2025-09-07T09:43:00.9331089Z Attempting uninstall: psutil 2025-09-07T09:43:00.9331746Z Found existing installation: psutil 5.9.8 2025-09-07T09:43:00.9393587Z Uninstalling psutil-5.9.8: 2025-09-07T09:43:00.9399064Z Successfully uninstalled psutil-5.9.8 2025-09-07T09:43:01.0668331Z Successfully installed boto3-1.35.33 botocore-1.35.99 nvidia-ml-py-12.575.51 psutil-7.0.0 pynvml-12.0.0 s3transfer-0.10.4 2025-09-07T09:43:01.1567479Z + DEVICE_NAME= 2025-09-07T09:43:01.1567689Z + DEVICE_TYPE= 2025-09-07T09:43:01.1567846Z + command -v nvidia-smi 2025-09-07T09:43:01.1568023Z + command -v rocminfo 2025-09-07T09:43:01.1568191Z + echo DEVICE_NAME= 2025-09-07T09:43:01.1568864Z + echo DEVICE_TYPE= 2025-09-07T09:43:01.1590381Z ##[group]Run set -eux 2025-09-07T09:43:01.1590565Z set -eux 2025-09-07T09:43:01.1590739Z  2025-09-07T09:43:01.1590905Z if [[ -z "${GITHUB_TOKEN}" ]]; then 2025-09-07T09:43:01.1591128Z  echo "Missing github-token input" 2025-09-07T09:43:01.1591326Z  exit 1 2025-09-07T09:43:01.1591464Z fi 2025-09-07T09:43:01.1599688Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:01.1599928Z env: 2025-09-07T09:43:01.1600077Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:01.1600389Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:01.1600699Z DEVICE_NAME: 2025-09-07T09:43:01.1600853Z DEVICE_TYPE: 2025-09-07T09:43:01.1601210Z GITHUB_TOKEN: *** 2025-09-07T09:43:01.1601383Z ##[endgroup] 2025-09-07T09:43:01.1629580Z + [[ -z *** ]] 2025-09-07T09:43:01.1663617Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main 2025-09-07T09:43:01.1663913Z with: 2025-09-07T09:43:01.1664164Z github-token: *** 2025-09-07T09:43:01.1664327Z env: 2025-09-07T09:43:01.1664485Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:01.1664783Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:01.1665104Z DEVICE_NAME: 2025-09-07T09:43:01.1665262Z DEVICE_TYPE: 2025-09-07T09:43:01.1665411Z ##[endgroup] 2025-09-07T09:43:01.1675926Z ##[group]Run set -eux 2025-09-07T09:43:01.1676111Z set -eux 2025-09-07T09:43:01.1676255Z  2025-09-07T09:43:01.1676549Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2025-09-07T09:43:01.1686634Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:01.1686983Z env: 2025-09-07T09:43:01.1687142Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:01.1687447Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:01.1687841Z DEVICE_NAME: 2025-09-07T09:43:01.1687995Z DEVICE_TYPE: 2025-09-07T09:43:01.1688261Z GITHUB_TOKEN: *** 2025-09-07T09:43:01.1688576Z ##[endgroup] 2025-09-07T09:43:01.1729120Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 17525294857 i-06b59a500443ed91d 2025-09-07T09:43:01.6094708Z setting job-id=49775530521 2025-09-07T09:43:01.6095158Z setting job-name=inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T09:43:01.6188971Z ##[group]Run set -eux 2025-09-07T09:43:01.6189176Z set -eux 2025-09-07T09:43:01.6189318Z  2025-09-07T09:43:01.6189467Z if [[ -n "" ]]; then 2025-09-07T09:43:01.6189641Z  source "" 2025-09-07T09:43:01.6189811Z fi 2025-09-07T09:43:01.6189946Z  2025-09-07T09:43:01.6190188Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \ 2025-09-07T09:43:01.6190508Z  --schema-version "${SCHEMA_VERSION}" \ 2025-09-07T09:43:01.6190723Z  --repo "${REPO}" \ 2025-09-07T09:43:01.6190916Z  --head-branch "${HEAD_BRANCH}" \ 2025-09-07T09:43:01.6191122Z  --head-sha "${HEAD_SHA}" \ 2025-09-07T09:43:01.6191337Z  --workflow-id "${WORKFLOW_RUN_ID}" \ 2025-09-07T09:43:01.6191558Z  --run-attempt "${RUN_ATTEMPT}" \ 2025-09-07T09:43:01.6191752Z  --job-id "${JOB_ID}" \ 2025-09-07T09:43:01.6191941Z  --job-name "${JOB_NAME}" 2025-09-07T09:43:01.6199170Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:01.6199406Z env: 2025-09-07T09:43:01.6199546Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:01.6199845Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:01.6200159Z DEVICE_NAME: 2025-09-07T09:43:01.6200304Z DEVICE_TYPE: 2025-09-07T09:43:01.6200455Z SCHEMA_VERSION: v3 2025-09-07T09:43:01.6200609Z REPO: pytorch/pytorch 2025-09-07T09:43:01.6200778Z HEAD_BRANCH: refs/heads/main 2025-09-07T09:43:01.6200984Z HEAD_SHA: 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T09:43:01.6201201Z WORKFLOW_RUN_ID: 17525294857 2025-09-07T09:43:01.6201358Z RUN_ATTEMPT: 1 2025-09-07T09:43:01.6201506Z JOB_ID: 49775530521 2025-09-07T09:43:01.6201816Z JOB_NAME: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T09:43:01.6202146Z ##[endgroup] 2025-09-07T09:43:01.6233038Z + [[ -n '' ]] 2025-09-07T09:43:01.6234232Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/main --head-sha 93fb23d6fae7c4e82c4239a1033e522088742634 --workflow-id 17525294857 --run-attempt 1 --job-id 49775530521 --job-name 'inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd)' 2025-09-07T09:43:01.6501703Z ##[group]Run set -eux 2025-09-07T09:43:01.6501889Z set -eux 2025-09-07T09:43:01.6502045Z  2025-09-07T09:43:01.6502188Z if [[ -n "" ]]; then 2025-09-07T09:43:01.6502365Z  source "" 2025-09-07T09:43:01.6502523Z fi 2025-09-07T09:43:01.6502656Z  2025-09-07T09:43:01.6502904Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_runners_info.py" 2025-09-07T09:43:01.6510148Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:01.6510384Z env: 2025-09-07T09:43:01.6510525Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:01.6510824Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:01.6511144Z DEVICE_NAME: 2025-09-07T09:43:01.6511424Z DEVICE_TYPE: 2025-09-07T09:43:01.6511565Z ##[endgroup] 2025-09-07T09:43:01.6536290Z + [[ -n '' ]] 2025-09-07T09:43:01.6536865Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_runners_info.py 2025-09-07T09:43:01.6866482Z INFO:root:Fail to import torch to get the device name 2025-09-07T09:43:01.6985196Z ##[group]Run set -eux 2025-09-07T09:43:01.6985390Z set -eux 2025-09-07T09:43:01.6985538Z  2025-09-07T09:43:01.6985780Z # TODO (huydhn): Implement this part 2025-09-07T09:43:01.6986027Z echo "dependencies={}" >> "${GITHUB_OUTPUT}" 2025-09-07T09:43:01.6993670Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:01.6993909Z env: 2025-09-07T09:43:01.6994051Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:01.6994347Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:01.6994681Z DEVICE_NAME: 2025-09-07T09:43:01.6994835Z DEVICE_TYPE: 2025-09-07T09:43:01.6994979Z ##[endgroup] 2025-09-07T09:43:01.7023464Z + echo 'dependencies={}' 2025-09-07T09:43:01.7042767Z ##[group]Run set -eux 2025-09-07T09:43:01.7042959Z set -eux 2025-09-07T09:43:01.7043102Z  2025-09-07T09:43:01.7043258Z if [[ -n "" ]]; then 2025-09-07T09:43:01.7043427Z  source "" 2025-09-07T09:43:01.7043579Z fi 2025-09-07T09:43:01.7043722Z  2025-09-07T09:43:01.7043909Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then 2025-09-07T09:43:01.7044177Z  echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping" 2025-09-07T09:43:01.7044468Z  # We don't want the job to fail if the directory doesn't exist 2025-09-07T09:43:01.7044702Z  exit 0 2025-09-07T09:43:01.7044845Z fi 2025-09-07T09:43:01.7044973Z  2025-09-07T09:43:01.7045126Z if [[ "${DRY_RUN}" == "true" ]]; then 2025-09-07T09:43:01.7045429Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2025-09-07T09:43:01.7045765Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2025-09-07T09:43:01.7046031Z  --metadata "${BENCHMARK_METADATA}" \ 2025-09-07T09:43:01.7046244Z  --runners "${RUNNER_INFO}" \ 2025-09-07T09:43:01.7046464Z  --dependencies "${DEPENDENCIES}" \ 2025-09-07T09:43:01.7046674Z  --dry-run 2025-09-07T09:43:01.7046836Z else 2025-09-07T09:43:01.7047063Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2025-09-07T09:43:01.7047386Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2025-09-07T09:43:01.7047635Z  --metadata "${BENCHMARK_METADATA}" \ 2025-09-07T09:43:01.7047846Z  --runners "${RUNNER_INFO}" \ 2025-09-07T09:43:01.7048052Z  --dependencies "${DEPENDENCIES}" 2025-09-07T09:43:01.7048248Z fi 2025-09-07T09:43:01.7055364Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:01.7055604Z env: 2025-09-07T09:43:01.7055748Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:01.7056052Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:01.7056370Z DEVICE_NAME: 2025-09-07T09:43:01.7056528Z DEVICE_TYPE: 2025-09-07T09:43:01.7056691Z BENCHMARK_RESULTS_DIR: test/test-reports 2025-09-07T09:43:01.7056884Z DRY_RUN: false 2025-09-07T09:43:01.7057694Z BENCHMARK_METADATA: {"timestamp": 1757238181, "schema_version": "v3", "name": "inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/main", "head_sha": "93fb23d6fae7c4e82c4239a1033e522088742634", "workflow_id": 17525294857, "run_attempt": 1, "job_id": 49775530521} 2025-09-07T09:43:01.7058694Z RUNNER_INFO: [{"cpu_info": "x86_64", "cpu_count": 96, "avail_mem_in_gb": 369, "extra_info": {"hostname": "ip-10-0-59-69.ec2.internal"}, "name": "", "type": ""}] 2025-09-07T09:43:01.7059180Z DEPENDENCIES: {} 2025-09-07T09:43:01.7059337Z ##[endgroup] 2025-09-07T09:43:01.7086354Z + [[ -n '' ]] 2025-09-07T09:43:01.7086533Z + [[ ! -d test/test-reports ]] 2025-09-07T09:43:01.7086719Z + [[ false == \t\r\u\e ]] 2025-09-07T09:43:01.7088510Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/upload_benchmark_results.py --benchmark-results-dir test/test-reports --metadata '{"timestamp": 1757238181, "schema_version": "v3", "name": "inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/main", "head_sha": "93fb23d6fae7c4e82c4239a1033e522088742634", "workflow_id": 17525294857, "run_attempt": 1, "job_id": 49775530521}' --runners '[{"cpu_info": "x86_64", "cpu_count": 96, "avail_mem_in_gb": 369, "extra_info": {"hostname": "ip-10-0-59-69.ec2.internal"}, "name": "", "type": ""}]' --dependencies '{}' 2025-09-07T09:43:01.8168271Z INFO:root:Upload test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json 2025-09-07T09:43:01.8422599Z INFO:botocore.credentials:Found credentials from IAM Role: gh-ci-github-action-runners-runner-role 2025-09-07T09:43:01.9971119Z INFO:root:Upload test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json 2025-09-07T09:43:02.0690926Z INFO:root:Upload test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json 2025-09-07T09:43:02.1538528Z INFO:root:Upload test/test-reports/inductor_export_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_export_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json 2025-09-07T09:43:02.2468935Z INFO:root:Upload test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json 2025-09-07T09:43:02.3360440Z INFO:root:Upload test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance.json 2025-09-07T09:43:02.4492662Z INFO:root:Upload test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json 2025-09-07T09:43:02.5471296Z INFO:root:Upload test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_performance.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_performance.json 2025-09-07T09:43:02.6451612Z INFO:root:Upload test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json 2025-09-07T09:43:02.7457878Z INFO:root:Upload test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_performance.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_performance.json 2025-09-07T09:43:02.8350629Z INFO:root:Upload test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json 2025-09-07T09:43:02.9544236Z INFO:root:Upload test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_performance.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_performance.json 2025-09-07T09:43:03.0600250Z INFO:root:Upload test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json to s3://ossci-benchmarks/v3/pytorch/pytorch/17525294857/49775530521/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json 2025-09-07T09:43:03.1986485Z ##[group]Run cat test/**/*_toprint.log || true 2025-09-07T09:43:03.1986765Z cat test/**/*_toprint.log || true 2025-09-07T09:43:03.1993809Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:03.1994045Z env: 2025-09-07T09:43:03.1994193Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:03.1994498Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:03.1994803Z DEVICE_NAME: 2025-09-07T09:43:03.1994961Z DEVICE_TYPE: 2025-09-07T09:43:03.1995103Z ##[endgroup] 2025-09-07T09:43:03.2079701Z cat: 'test/**/*_toprint.log': No such file or directory 2025-09-07T09:43:03.2104744Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2025-09-07T09:43:03.2105007Z kill "$MONITOR_SCRIPT_PID" 2025-09-07T09:43:03.2112303Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:03.2112543Z env: 2025-09-07T09:43:03.2112691Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:03.2113011Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:03.2113317Z DEVICE_NAME: 2025-09-07T09:43:03.2113478Z DEVICE_TYPE: 2025-09-07T09:43:03.2113624Z MONITOR_SCRIPT_PID: 57263 2025-09-07T09:43:03.2113798Z ##[endgroup] 2025-09-07T09:43:03.2213863Z Prepare all required actions 2025-09-07T09:43:03.2214210Z Getting action download info 2025-09-07T09:43:03.3610603Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2025-09-07T09:43:03.6355997Z Download action repository 'actions/upload-artifact@v4' (SHA:ea165f8d65b6e75b540449e92b4886f43607fa02) 2025-09-07T09:43:04.0087681Z ##[group]Run ./.github/actions/upload-test-artifacts 2025-09-07T09:43:04.0087915Z with: 2025-09-07T09:43:04.0088192Z file-suffix: test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521 2025-09-07T09:43:04.0088512Z s3-bucket: gha-artifacts 2025-09-07T09:43:04.0088678Z env: 2025-09-07T09:43:04.0088829Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:04.0089124Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:04.0089441Z DEVICE_NAME: 2025-09-07T09:43:04.0089582Z DEVICE_TYPE: 2025-09-07T09:43:04.0089723Z ##[endgroup] 2025-09-07T09:43:04.0106214Z ##[group]Run # Remove any previous test jsons if they exist 2025-09-07T09:43:04.0106502Z # Remove any previous test jsons if they exist 2025-09-07T09:43:04.0106733Z rm -f test-jsons-*.zip 2025-09-07T09:43:04.0107003Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json' 2025-09-07T09:43:04.0114136Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:04.0114370Z env: 2025-09-07T09:43:04.0114511Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:04.0114817Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:04.0115126Z DEVICE_NAME: 2025-09-07T09:43:04.0115275Z DEVICE_TYPE: 2025-09-07T09:43:04.0115635Z FILE_SUFFIX: test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521 2025-09-07T09:43:04.0115940Z ##[endgroup] 2025-09-07T09:43:04.0259499Z adding: test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json (deflated 99%) 2025-09-07T09:43:04.0277768Z adding: test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json (deflated 99%) 2025-09-07T09:43:04.0296178Z adding: test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json (deflated 99%) 2025-09-07T09:43:04.0314785Z adding: test/test-reports/inductor_export_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json (deflated 99%) 2025-09-07T09:43:04.0331580Z adding: test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.json (deflated 99%) 2025-09-07T09:43:04.0359284Z adding: test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance.json (deflated 99%) 2025-09-07T09:43:04.0420956Z adding: test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json (deflated 99%) 2025-09-07T09:43:04.0449381Z adding: test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_performance.json (deflated 99%) 2025-09-07T09:43:04.0510694Z adding: test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json (deflated 99%) 2025-09-07T09:43:04.0537873Z adding: test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_performance.json (deflated 99%) 2025-09-07T09:43:04.0598739Z adding: test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json (deflated 99%) 2025-09-07T09:43:04.0624047Z adding: test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_performance.json (deflated 99%) 2025-09-07T09:43:04.0660876Z adding: test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.json (deflated 99%) 2025-09-07T09:43:04.0684872Z ##[group]Run # Remove any previous test reports if they exist 2025-09-07T09:43:04.0685397Z # Remove any previous test reports if they exist 2025-09-07T09:43:04.0685651Z rm -f test-reports-*.zip 2025-09-07T09:43:04.0685949Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv' 2025-09-07T09:43:04.0693054Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:04.0693294Z env: 2025-09-07T09:43:04.0693437Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:04.0693738Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:04.0694040Z DEVICE_NAME: 2025-09-07T09:43:04.0694193Z DEVICE_TYPE: 2025-09-07T09:43:04.0694461Z FILE_SUFFIX: test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521 2025-09-07T09:43:04.0694784Z ##[endgroup] 2025-09-07T09:43:04.0760820Z adding: test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv (deflated 63%) 2025-09-07T09:43:04.0761416Z adding: test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv (deflated 62%) 2025-09-07T09:43:04.0761967Z adding: test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv (deflated 62%) 2025-09-07T09:43:04.0762518Z adding: test/test-reports/inductor_export_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv (deflated 63%) 2025-09-07T09:43:04.0763061Z adding: test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_accuracy.csv (deflated 73%) 2025-09-07T09:43:04.0763631Z adding: test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance.csv (deflated 53%) 2025-09-07T09:43:04.0764482Z adding: test/test-reports/inductor_no_cudagraphs_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.csv (deflated 51%) 2025-09-07T09:43:04.0765278Z adding: test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_performance.csv (deflated 53%) 2025-09-07T09:43:04.0766758Z adding: test/test-reports/inductor_dynamic_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.csv (deflated 50%) 2025-09-07T09:43:04.0767359Z adding: test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_performance.csv (deflated 53%) 2025-09-07T09:43:04.0768938Z adding: test/test-reports/inductor_cpp_wrapper_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.csv (deflated 51%) 2025-09-07T09:43:04.0769548Z adding: test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_performance.csv (deflated 54%) 2025-09-07T09:43:04.0770516Z adding: test/test-reports/inductor_aot_inductor_huggingface_bfloat16_inference_cpu_x86_zen_performance_compilation_metrics.csv (deflated 51%) 2025-09-07T09:43:04.0806738Z ##[group]Run # Remove any previous usage logs if they exist 2025-09-07T09:43:04.0807050Z # Remove any previous usage logs if they exist 2025-09-07T09:43:04.0807301Z rm -f logs-*.zip 2025-09-07T09:43:04.0807535Z zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' || true 2025-09-07T09:43:04.0807835Z zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log' || true 2025-09-07T09:43:04.0815062Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:04.0815303Z env: 2025-09-07T09:43:04.0815453Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:04.0815743Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:04.0816053Z DEVICE_NAME: 2025-09-07T09:43:04.0816206Z DEVICE_TYPE: 2025-09-07T09:43:04.0816475Z FILE_SUFFIX: test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521 2025-09-07T09:43:04.0816780Z ##[endgroup] 2025-09-07T09:43:04.0903777Z adding: usage_log.txt (deflated 96%) 2025-09-07T09:43:04.0919544Z 2025-09-07T09:43:04.0919818Z zip error: Nothing to do! (logs-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip) 2025-09-07T09:43:04.0961311Z ##[group]Run # Remove any previous debugging artifacts if they exist 2025-09-07T09:43:04.0961664Z # Remove any previous debugging artifacts if they exist 2025-09-07T09:43:04.0961909Z rm -f debug-*.zip 2025-09-07T09:43:04.0962099Z if [ -d 'test/debug' ]; then 2025-09-07T09:43:04.0962329Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2025-09-07T09:43:04.0962536Z fi 2025-09-07T09:43:04.0969754Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:04.0969985Z env: 2025-09-07T09:43:04.0970132Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:04.0970434Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:04.0970743Z DEVICE_NAME: 2025-09-07T09:43:04.0970905Z DEVICE_TYPE: 2025-09-07T09:43:04.0971178Z FILE_SUFFIX: test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521 2025-09-07T09:43:04.0971492Z ##[endgroup] 2025-09-07T09:43:04.1064555Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-09-07T09:43:04.1064785Z with: 2025-09-07T09:43:04.1064943Z s3-bucket: gha-artifacts 2025-09-07T09:43:04.1065157Z s3-prefix: pytorch/pytorch/17525294857/1/artifact 2025-09-07T09:43:04.1065378Z retention-days: 14 2025-09-07T09:43:04.1065534Z if-no-files-found: warn 2025-09-07T09:43:04.1065774Z path: test-jsons-*.zip 2025-09-07T09:43:04.1065941Z name: artifact 2025-09-07T09:43:04.1066089Z region: us-east-1 2025-09-07T09:43:04.1066229Z env: 2025-09-07T09:43:04.1066365Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:04.1066659Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:04.1066971Z DEVICE_NAME: 2025-09-07T09:43:04.1067111Z DEVICE_TYPE: 2025-09-07T09:43:04.1067364Z ##[endgroup] 2025-09-07T09:43:04.4015626Z NOTE: s3-prefix specified, ignoring name parameter 2025-09-07T09:43:04.4015942Z With the provided path, there will be 1 file uploaded 2025-09-07T09:43:04.4016602Z Uploading to s3 prefix: pytorch/pytorch/17525294857/1/artifact 2025-09-07T09:43:04.4073431Z Starting upload of test-jsons-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip 2025-09-07T09:43:04.5123853Z Finished upload of test-jsons-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip 2025-09-07T09:43:04.5330733Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-09-07T09:43:04.5330965Z with: 2025-09-07T09:43:04.5331117Z s3-bucket: gha-artifacts 2025-09-07T09:43:04.5331337Z s3-prefix: pytorch/pytorch/17525294857/1/artifact 2025-09-07T09:43:04.5331566Z retention-days: 14 2025-09-07T09:43:04.5331730Z if-no-files-found: error 2025-09-07T09:43:04.5331903Z path: test-reports-*.zip 2025-09-07T09:43:04.5332068Z name: artifact 2025-09-07T09:43:04.5332243Z region: us-east-1 2025-09-07T09:43:04.5332395Z env: 2025-09-07T09:43:04.5332545Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:04.5332859Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:04.5333199Z DEVICE_NAME: 2025-09-07T09:43:04.5333354Z DEVICE_TYPE: 2025-09-07T09:43:04.5333499Z ##[endgroup] 2025-09-07T09:43:04.7993135Z NOTE: s3-prefix specified, ignoring name parameter 2025-09-07T09:43:04.7993460Z With the provided path, there will be 1 file uploaded 2025-09-07T09:43:04.7993743Z Uploading to s3 prefix: pytorch/pytorch/17525294857/1/artifact 2025-09-07T09:43:04.8049884Z Starting upload of test-reports-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip 2025-09-07T09:43:04.9155018Z Finished upload of test-reports-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip 2025-09-07T09:43:04.9362322Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-09-07T09:43:04.9362563Z with: 2025-09-07T09:43:04.9362715Z s3-bucket: gha-artifacts 2025-09-07T09:43:04.9362932Z s3-prefix: pytorch/pytorch/17525294857/1/artifact 2025-09-07T09:43:04.9363158Z retention-days: 14 2025-09-07T09:43:04.9363315Z if-no-files-found: ignore 2025-09-07T09:43:04.9363686Z path: logs-*.zip 2025-09-07T09:43:04.9363843Z name: artifact 2025-09-07T09:43:04.9363989Z region: us-east-1 2025-09-07T09:43:04.9364131Z env: 2025-09-07T09:43:04.9364268Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:04.9364576Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:04.9364895Z DEVICE_NAME: 2025-09-07T09:43:04.9365039Z DEVICE_TYPE: 2025-09-07T09:43:04.9365184Z ##[endgroup] 2025-09-07T09:43:05.2016880Z NOTE: s3-prefix specified, ignoring name parameter 2025-09-07T09:43:05.2017188Z With the provided path, there will be 1 file uploaded 2025-09-07T09:43:05.2017465Z Uploading to s3 prefix: pytorch/pytorch/17525294857/1/artifact 2025-09-07T09:43:05.2073373Z Starting upload of logs-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip 2025-09-07T09:43:05.3075283Z Finished upload of logs-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip 2025-09-07T09:43:05.3285090Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-09-07T09:43:05.3285317Z with: 2025-09-07T09:43:05.3285474Z s3-bucket: gha-artifacts 2025-09-07T09:43:05.3285695Z s3-prefix: pytorch/pytorch/17525294857/1/artifact 2025-09-07T09:43:05.3285916Z retention-days: 14 2025-09-07T09:43:05.3286076Z if-no-files-found: ignore 2025-09-07T09:43:05.3286252Z path: debug-*.zip 2025-09-07T09:43:05.3286403Z name: artifact 2025-09-07T09:43:05.3286556Z region: us-east-1 2025-09-07T09:43:05.3286693Z env: 2025-09-07T09:43:05.3286830Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:05.3287124Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:05.3287438Z DEVICE_NAME: 2025-09-07T09:43:05.3287581Z DEVICE_TYPE: 2025-09-07T09:43:05.3287831Z ##[endgroup] 2025-09-07T09:43:05.5888454Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2025-09-07T09:43:05.6108609Z ##[group]Run # shellcheck disable=SC2156 2025-09-07T09:43:05.6108877Z # shellcheck disable=SC2156 2025-09-07T09:43:05.6109246Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2025-09-07T09:43:05.6116813Z shell: /usr/bin/bash -e {0} 2025-09-07T09:43:05.6117001Z env: 2025-09-07T09:43:05.6117150Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:05.6117449Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:05.6117764Z DEVICE_NAME: 2025-09-07T09:43:05.6117915Z DEVICE_TYPE: 2025-09-07T09:43:05.6118064Z ##[endgroup] 2025-09-07T09:43:05.9208649Z Prepare all required actions 2025-09-07T09:43:05.9208942Z Getting action download info 2025-09-07T09:43:06.0330223Z ##[group]Run ./.github/actions/upload-utilization-stats 2025-09-07T09:43:06.0330475Z with: 2025-09-07T09:43:06.0330620Z job_id: 49775530521 2025-09-07T09:43:06.0330935Z job_name: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T09:43:06.0331311Z workflow_name: inductor-perf-nightly-x86-zen 2025-09-07T09:43:06.0331525Z workflow_run_id: 17525294857 2025-09-07T09:43:06.0331702Z workflow_attempt: 1 2025-09-07T09:43:06.0331859Z env: 2025-09-07T09:43:06.0331997Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:06.0332290Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:06.0332596Z DEVICE_NAME: 2025-09-07T09:43:06.0332739Z DEVICE_TYPE: 2025-09-07T09:43:06.0332888Z ##[endgroup] 2025-09-07T09:43:06.0346221Z ##[group]Run echo "workflow_id: 17525294857" 2025-09-07T09:43:06.0346491Z echo "workflow_id: 17525294857" 2025-09-07T09:43:06.0346704Z echo "workflow_attempt: 1" 2025-09-07T09:43:06.0346954Z echo "workflow_Name: inductor-perf-nightly-x86-zen" 2025-09-07T09:43:06.0347207Z echo "job_id: 49775530521" 2025-09-07T09:43:06.0347577Z echo "job_name: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd)" 2025-09-07T09:43:06.0347952Z echo "artifact_prefix: " 2025-09-07T09:43:06.0348148Z python3 --version 2025-09-07T09:43:06.0355238Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:06.0355472Z env: 2025-09-07T09:43:06.0355619Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:06.0355921Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:06.0356225Z DEVICE_NAME: 2025-09-07T09:43:06.0356376Z DEVICE_TYPE: 2025-09-07T09:43:06.0356519Z ##[endgroup] 2025-09-07T09:43:06.0382547Z workflow_id: 17525294857 2025-09-07T09:43:06.0382729Z workflow_attempt: 1 2025-09-07T09:43:06.0382925Z workflow_Name: inductor-perf-nightly-x86-zen 2025-09-07T09:43:06.0383144Z job_id: 49775530521 2025-09-07T09:43:06.0383450Z job_name: inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd) 2025-09-07T09:43:06.0383787Z artifact_prefix: 2025-09-07T09:43:06.0398299Z Python 3.9.23 2025-09-07T09:43:06.0442230Z ##[group]Run nick-fields/retry@v3.0.0 2025-09-07T09:43:06.0442443Z with: 2025-09-07T09:43:06.0442581Z shell: bash 2025-09-07T09:43:06.0442721Z timeout_minutes: 5 2025-09-07T09:43:06.0442878Z max_attempts: 5 2025-09-07T09:43:06.0443036Z retry_wait_seconds: 30 2025-09-07T09:43:06.0443379Z command: set -eu python3 -m pip install python-dateutil==2.8.2 boto3==1.35.42 pandas==2.1.3 dataclasses_json==0.6.7 2025-09-07T09:43:06.0443730Z polling_interval_seconds: 1 2025-09-07T09:43:06.0443910Z warning_on_retry: true 2025-09-07T09:43:06.0444088Z continue_on_error: false 2025-09-07T09:43:06.0444257Z env: 2025-09-07T09:43:06.0444383Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:06.0444675Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:06.0445114Z DEVICE_NAME: 2025-09-07T09:43:06.0445261Z DEVICE_TYPE: 2025-09-07T09:43:06.0445471Z ##[endgroup] 2025-09-07T09:43:06.3056598Z Defaulting to user installation because normal site-packages is not writeable 2025-09-07T09:43:06.3636383Z Collecting python-dateutil==2.8.2 2025-09-07T09:43:06.3756443Z Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2025-09-07T09:43:07.0102950Z Collecting boto3==1.35.42 2025-09-07T09:43:07.0131198Z Downloading boto3-1.35.42-py3-none-any.whl (139 kB) 2025-09-07T09:43:07.3575643Z Collecting pandas==2.1.3 2025-09-07T09:43:07.3605299Z Downloading pandas-2.1.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.3 MB) 2025-09-07T09:43:07.4574933Z Requirement already satisfied: dataclasses_json==0.6.7 in /home/ec2-user/.local/lib/python3.9/site-packages (0.6.7) 2025-09-07T09:43:07.4586037Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil==2.8.2) (1.15.0) 2025-09-07T09:43:07.4616914Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.0) 2025-09-07T09:43:07.4620663Z Requirement already satisfied: botocore<1.36.0,>=1.35.42 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (1.35.99) 2025-09-07T09:43:07.4623092Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.4) 2025-09-07T09:43:07.5241736Z Collecting tzdata>=2022.1 2025-09-07T09:43:07.5267453Z Downloading tzdata-2025.2-py2.py3-none-any.whl (347 kB) 2025-09-07T09:43:07.5343362Z Requirement already satisfied: pytz>=2020.1 in /usr/lib/python3.9/site-packages (from pandas==2.1.3) (2022.7.1) 2025-09-07T09:43:08.0773721Z Collecting numpy<2,>=1.22.4 2025-09-07T09:43:08.0805209Z Downloading numpy-1.26.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB) 2025-09-07T09:43:08.2397064Z Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from dataclasses_json==0.6.7) (3.26.1) 2025-09-07T09:43:08.2398996Z Requirement already satisfied: typing-inspect<1,>=0.4.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from dataclasses_json==0.6.7) (0.9.0) 2025-09-07T09:43:08.2439439Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.25.10) 2025-09-07T09:43:08.2514234Z Requirement already satisfied: packaging>=17.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses_json==0.6.7) (25.0) 2025-09-07T09:43:08.2582215Z Requirement already satisfied: typing-extensions>=3.7.4 in /home/ec2-user/.local/lib/python3.9/site-packages (from typing-inspect<1,>=0.4.0->dataclasses_json==0.6.7) (4.15.0) 2025-09-07T09:43:08.2585912Z Requirement already satisfied: mypy-extensions>=0.3.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from typing-inspect<1,>=0.4.0->dataclasses_json==0.6.7) (1.1.0) 2025-09-07T09:43:08.3947106Z Installing collected packages: python-dateutil, tzdata, numpy, pandas, boto3 2025-09-07T09:43:12.1518313Z Attempting uninstall: boto3 2025-09-07T09:43:12.1518928Z Found existing installation: boto3 1.35.33 2025-09-07T09:43:12.1611771Z Uninstalling boto3-1.35.33: 2025-09-07T09:43:12.1624294Z Successfully uninstalled boto3-1.35.33 2025-09-07T09:43:12.2072838Z Successfully installed boto3-1.35.42 numpy-1.26.4 pandas-2.1.3 python-dateutil-2.8.2 tzdata-2025.2 2025-09-07T09:43:13.1099152Z Command completed after 1 attempt(s). 2025-09-07T09:43:13.1155335Z ##[group]Run python3 -m tools.stats.upload_utilization_stats.upload_utilization_stats \ 2025-09-07T09:43:13.1155789Z python3 -m tools.stats.upload_utilization_stats.upload_utilization_stats \ 2025-09-07T09:43:13.1156105Z  --workflow-run-id "17525294857" \ 2025-09-07T09:43:13.1156375Z  --workflow-name "inductor-perf-nightly-x86-zen" \ 2025-09-07T09:43:13.1156757Z  --workflow-run-attempt "1" \ 2025-09-07T09:43:13.1156968Z  --job-id "49775530521" \ 2025-09-07T09:43:13.1157418Z  --job-name "inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd)" \ 2025-09-07T09:43:13.1157787Z  --local-path "" \ 2025-09-07T09:43:13.1157974Z  --artifact-prefix "" 2025-09-07T09:43:13.1165680Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:13.1165920Z env: 2025-09-07T09:43:13.1166073Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:13.1166371Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:13.1166688Z DEVICE_NAME: 2025-09-07T09:43:13.1166842Z DEVICE_TYPE: 2025-09-07T09:43:13.1167176Z ##[endgroup] 2025-09-07T09:43:14.0212513Z repo: pytorch/pytorch 2025-09-07T09:43:14.0212798Z Search for test log in s3 bucket: ossci-utilization 2025-09-07T09:43:14.0213222Z Downloading logs-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip 2025-09-07T09:43:14.0213777Z extracting usage_log.txt from zip file logs-test-inductor_huggingface_perf_cpu_x86_zen-1-3-linux.24xlarge.amd_49775530521.zip 2025-09-07T09:43:14.0214182Z Converted Log Model: UtilizationMetadata: 2025-09-07T09:43:14.0215085Z UtilizationMetadata(level='metadata', workflow_id='17525294857', job_id='49775530521', workflow_name='inductor-perf-nightly-x86-zen', job_name='inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd)', usage_collect_interval=4.0, data_model_version=1.5, start_at=1757231041, gpu_count=0, cpu_count=96, gpu_type=None, error=None) 2025-09-07T09:43:14.0216040Z [Db Segments] detected pytest cmd: 13, generated segments: 13 2025-09-07T09:43:14.0216299Z [db model] Peek db timeseries 2025-09-07T09:43:14.0216475Z :{ 2025-09-07T09:43:14.0216619Z "created_at": 1757238193, 2025-09-07T09:43:14.0216793Z "type": "utilization", 2025-09-07T09:43:14.0216961Z "tags": [ 2025-09-07T09:43:14.0217100Z "record" 2025-09-07T09:43:14.0217239Z ], 2025-09-07T09:43:14.0217372Z "time_stamp": 1757231041, 2025-09-07T09:43:14.0217551Z "repo": "pytorch/pytorch", 2025-09-07T09:43:14.0217728Z "workflow_id": 17525294857, 2025-09-07T09:43:14.0217902Z "run_attempt": 1, 2025-09-07T09:43:14.0218058Z "job_id": 49775530521, 2025-09-07T09:43:14.0218265Z "workflow_name": "inductor-perf-nightly-x86-zen", 2025-09-07T09:43:14.0218649Z "job_name": "inductor-test-nightly / test (inductor_huggingface_perf_cpu_x86_zen, 1, 3, linux.24xlarge.amd)", 2025-09-07T09:43:14.0218981Z "json_data": "{}" 2025-09-07T09:43:14.0219124Z } 2025-09-07T09:43:14.0219438Z Writing 1 documents to S3 ossci-utilization/util_metadata/v_1.5/pytorch/pytorch/17525294857/1/49775530521/metadata 2025-09-07T09:43:14.0219986Z Done! Finish writing document to S3 ossci-utilization/util_metadata/v_1.5/pytorch/pytorch/17525294857/1/49775530521/metadata 2025-09-07T09:43:14.0220546Z Writing 475 documents to S3 ossci-utilization/util_timeseries/v_1.5/pytorch/pytorch/17525294857/1/49775530521/time_series 2025-09-07T09:43:14.0221113Z Done! Finish writing document to S3 ossci-utilization/util_timeseries/v_1.5/pytorch/pytorch/17525294857/1/49775530521/time_series 2025-09-07T09:43:14.1117684Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2025-09-07T09:43:14.1117975Z with: 2025-09-07T09:43:14.1118110Z env: 2025-09-07T09:43:14.1118248Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:14.1118548Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:14.1118859Z DEVICE_NAME: 2025-09-07T09:43:14.1119007Z DEVICE_TYPE: 2025-09-07T09:43:14.1119142Z ##[endgroup] 2025-09-07T09:43:14.1131152Z ##[group]Run set -eou pipefail 2025-09-07T09:43:14.1131387Z set -eou pipefail 2025-09-07T09:43:14.1131556Z  2025-09-07T09:43:14.1131790Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2025-09-07T09:43:14.1132185Z for _ in $(seq 1440); do 2025-09-07T09:43:14.1132401Z  # Break if no ssh session exists anymore 2025-09-07T09:43:14.1132706Z  if [ "$(who)" = "" ]; then 2025-09-07T09:43:14.1132898Z  break 2025-09-07T09:43:14.1133072Z  fi 2025-09-07T09:43:14.1133226Z  echo "." 2025-09-07T09:43:14.1133383Z  sleep 5 2025-09-07T09:43:14.1133536Z done 2025-09-07T09:43:14.1140483Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:14.1140717Z env: 2025-09-07T09:43:14.1140856Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:14.1141158Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:14.1141471Z DEVICE_NAME: 2025-09-07T09:43:14.1141618Z DEVICE_TYPE: 2025-09-07T09:43:14.1141754Z ##[endgroup] 2025-09-07T09:43:14.1168697Z Holding runner for 2 hours until all ssh sessions have logged out 2025-09-07T09:43:14.1248270Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-09-07T09:43:14.1248637Z # ignore expansion of "docker ps -q" since it could be empty 2025-09-07T09:43:14.1248920Z # shellcheck disable=SC2046 2025-09-07T09:43:14.1249159Z docker stop $(docker ps -q) || true 2025-09-07T09:43:14.1249380Z # Prune all of the docker images 2025-09-07T09:43:14.1249592Z docker system prune -af 2025-09-07T09:43:14.1256593Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:14.1256830Z env: 2025-09-07T09:43:14.1256969Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:43:14.1257275Z DOCKER_CONTAINER_ID: edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:14.1257588Z DEVICE_NAME: 2025-09-07T09:43:14.1257744Z DEVICE_TYPE: 2025-09-07T09:43:14.1257880Z ##[endgroup] 2025-09-07T09:43:25.1266312Z edcf7e58c22e 2025-09-07T09:43:26.6386902Z Deleted Containers: 2025-09-07T09:43:26.6387229Z edcf7e58c22ecb4df04e245f74bd63e43bbb886d2bd4ed179b79ad4e0a2e0499 2025-09-07T09:43:26.6387484Z 2025-09-07T09:43:42.2939276Z Deleted Images: 2025-09-07T09:43:42.2939909Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-jammy-py3-gcc11-inductor-benchmarks-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T09:43:42.2940713Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image@sha256:383efb45082f20b8c808cb0ba4df693a01359592233f641f1f486911ac320a9a 2025-09-07T09:43:42.2941245Z deleted: sha256:662d8c9dfc7db2f5d004293de4f2b7647941dee4c916479ef082d17fcdfd9c47 2025-09-07T09:43:42.2941636Z deleted: sha256:ea5ad443c754124b3a5a209c2663376b4c156947edef1b982a336148bbf9114d 2025-09-07T09:43:42.2942013Z deleted: sha256:284be7504f072e0c04da4e2190e8d0e1de73835ed67be81f3ddd7eafd5d06a3a 2025-09-07T09:43:42.2942387Z deleted: sha256:2f49ff4be65f7ca55de8d7028fb3df7d08232a9f043aa7ba27d9393724286281 2025-09-07T09:43:42.2942767Z deleted: sha256:f63b503fdd1cca198aecefb9eef7ffbeb5fbc723f2a8462f50316e56cd403cbc 2025-09-07T09:43:42.2943158Z deleted: sha256:f9d46e08457013f0e71d608ac3dd95b79c41120060a80baefa684048cc15574e 2025-09-07T09:43:42.2943538Z deleted: sha256:cab76e28615751b6d6a703103b1da790a67cb3a4ee2e8814de51de18ff8b595d 2025-09-07T09:43:42.2944292Z deleted: sha256:0b2d09aa482371591a32563a5db71472822abd096a347967a9bd2a177737109f 2025-09-07T09:43:42.2944666Z deleted: sha256:d306d346d5da05e9fd04284304b1637a0bf01ee97397c688d19d783d5e133de9 2025-09-07T09:43:42.2945030Z deleted: sha256:bb3381a916d410a6e304540bb0796099dc780cd11f5829e734b337e0e79acfe4 2025-09-07T09:43:42.2945384Z deleted: sha256:bcf487c27e826c092985285163fb896e3324460b1774f3eb2a66623cd31e7d87 2025-09-07T09:43:42.2945794Z deleted: sha256:7d13485a9bdc5c0e64ac5085b25f4dded75c60f74090369c1b6f3f546ee37e94 2025-09-07T09:43:42.2946153Z deleted: sha256:55351d98a4197542fa7c78089671f447a6ef88cc554b7fad4fc522e8d4d187b6 2025-09-07T09:43:42.2946514Z deleted: sha256:f884bc0c4f9a994f3b3f1d82205f3a7014b05c84ad0c1c2fa3254d15a44f31e1 2025-09-07T09:43:42.2947004Z deleted: sha256:cdd16785a15239e518604ea9ea31405d5225fa6411d1c6d74d6523bcebf759ab 2025-09-07T09:43:42.2947376Z deleted: sha256:2c5bc1dc49446d7df5784578ae7c99460a93b502aa0c3b9deffbb95ec5216860 2025-09-07T09:43:42.2947842Z deleted: sha256:bae1e956be98416ce7d1a6c2c6ef0917f467238e19291786f8e1fed36fa81956 2025-09-07T09:43:42.2948206Z deleted: sha256:2cb1f002ab1126b0606999a9557b3f7f5da1e453d5376d29d95d60a979a215c4 2025-09-07T09:43:42.2948590Z deleted: sha256:25055a5f67b9bce8fac50ee1508dcb0f862ed154de5ded734e55f60edaca385f 2025-09-07T09:43:42.2948962Z deleted: sha256:98024e2dd34a5899240e41ae14f59c657cdc005040773e6ad7cfe3d67cdac7a8 2025-09-07T09:43:42.2949344Z deleted: sha256:8d2e75659096b4af8a20c3e9a6cce899b6e720f638eacdfd7d41ec8a736efdde 2025-09-07T09:43:42.2949708Z deleted: sha256:7741a6bf043548509c51c32e44734f30dfe07f91ca56c64422b004c3c0444e68 2025-09-07T09:43:42.2950076Z deleted: sha256:e2e63edbd2512e413c388888eabade05a2a7876adf20e7f0e0c3660ac3acbd3d 2025-09-07T09:43:42.2950450Z deleted: sha256:7fdea0f7711ee22084f87dc6d651598b5e5c5237de828105f698cb6a937d4c9c 2025-09-07T09:43:42.2950819Z deleted: sha256:486a2cf42f9492f291d59d48f3cec5a0a72449d8b6ad7d7a02596da237cdd154 2025-09-07T09:43:42.2951203Z deleted: sha256:a17da64c93a4939fad81a3ff6b6cb30f988176a6e0062fcf9c65e06cd9b9c3fb 2025-09-07T09:43:42.2951578Z deleted: sha256:70b4a3a917b8f95b19ae5dab6f404af8fa1c886022e4a1d785654013d5d876af 2025-09-07T09:43:42.2951955Z deleted: sha256:bd1b9d6a8aa636a67023800dcd85e4a3a7a7a21d65c6e6491d169fa65b4404a9 2025-09-07T09:43:42.2952330Z deleted: sha256:e3befcf3d3693c1d7bf0535e6e6722f0aabb0123805443ef5915dd5441ed0b00 2025-09-07T09:43:42.2952707Z deleted: sha256:4b4f846f1c4266b015f5fdf8dac5346c083c3aee2375e337172c112677c5a8c0 2025-09-07T09:43:42.2953074Z deleted: sha256:f05dc4d1350267b90e07af241a64f86a928fb3d8de75717ac04ec5a0433d042f 2025-09-07T09:43:42.2953441Z deleted: sha256:b6b4de696915fa2db09844ec9ac44dbb2940b655cd356404cf1ff03eec644dad 2025-09-07T09:43:42.2953816Z deleted: sha256:da008bbe1fc29cb35b3949040e97eb801f3264a56c4dd1b9d43a3cb54f2a39b2 2025-09-07T09:43:42.2954195Z deleted: sha256:261da5d14cad99ee11dcdaeb6055726f38fc12b7c559ee9c6d2ddc3f288f4828 2025-09-07T09:43:42.2954568Z deleted: sha256:16f900c60e70d685a85ca571ee0dada993a02217bdd6bb8b1d49169e7e28cf41 2025-09-07T09:43:42.2954937Z deleted: sha256:f57b18c5cde1d1dc553a15e1e98141d4afc0b4d0bb1182cc85b2c21bd18bb783 2025-09-07T09:43:42.2955305Z deleted: sha256:3c79105088ac60b231e4553752ee42cb6a87f9d32736b32f0c2123dddec724e7 2025-09-07T09:43:42.2955673Z deleted: sha256:df1ffff478908236efb6ceb8e05e6e078f12b864f4d24ce598cba7b961fad65c 2025-09-07T09:43:42.2956090Z deleted: sha256:8170255b562b59b76768f18a5b84b1ba887db93d3fe43b87a74bdc6be4f82014 2025-09-07T09:43:42.2956464Z deleted: sha256:c863cfe6bed704be5a54617331e27158b6f5a492dd6b9ed9c99d23db017cf5e1 2025-09-07T09:43:42.2956842Z deleted: sha256:e9e5a98c073f72c3abf9cc98724a31a3791535574ac78aeda7eb5df4580b21d0 2025-09-07T09:43:42.2957209Z deleted: sha256:0a42ac98735ca6578911218be7a7918001fe8aee1eb33d98f0d0a153d0e1102d 2025-09-07T09:43:42.2957586Z deleted: sha256:77d5a8aaa4d0fe1210dda9ac1f0fa3cf6141fea925b6240b9839d7505d021d3f 2025-09-07T09:43:42.2957960Z deleted: sha256:fa6ec46c43532dc01449df1cc403de8bb5872f859076e90658534c51c1487ef9 2025-09-07T09:43:42.2958442Z deleted: sha256:424a12dd5083283e19af48d31b7f2e33911ca8f459796f17280eaf5777a9aa25 2025-09-07T09:43:42.2958820Z deleted: sha256:8f0499601e14f1073e20ce889b45d12ab33264f9cf30359ac29dddbf58a311aa 2025-09-07T09:43:42.2959194Z deleted: sha256:5a5fae32dfb81abcd7bf374018b11e8e42a5aa39841d4b94e822d306c9af015b 2025-09-07T09:43:42.2959573Z deleted: sha256:d1bda89f22d383d38dfb7f7590b3bb202ccb91814034e7c7e2493306a10151ef 2025-09-07T09:43:42.2959959Z deleted: sha256:dbf16c1fcae146528685a8f745f9c505b24ba9ef009c42b1bd711ff7bf51b936 2025-09-07T09:43:42.2960325Z deleted: sha256:f9ec0065788f638325536a37427e2635b760a32457f20ca0acbcef6946b1041b 2025-09-07T09:43:42.2960679Z deleted: sha256:9d9911dac8fb2ff7db87329f38625d73f452dfef8822830048bbc00541c7df14 2025-09-07T09:43:42.2961043Z deleted: sha256:de4c1937129850e357b0de484d230569f628ac0bc883b12eff42932cd1e193ce 2025-09-07T09:43:42.2961459Z deleted: sha256:7b3c9e5b56a1d74226a5c1a54e5cb5e749012aa9b1d2376c6e7503757e29c35b 2025-09-07T09:43:42.2961875Z deleted: sha256:8062a6f28fc5fe2a199e1c1c40b6c43b7e29eb0c452492b47ec6900413b19cb6 2025-09-07T09:43:42.2962248Z deleted: sha256:f879aeffe6886f8da80462b571f9307aa63bb961645bec55ff579187a81cfd0b 2025-09-07T09:43:42.2962611Z deleted: sha256:5c6ef06b3536a430194aee509a784ee889c4a9d6248cb20fd9290e87e4ee2245 2025-09-07T09:43:42.2962983Z deleted: sha256:461aea034a25a2d72be6adfe9213c457c4cbf48724e9cb1c57987afb87668f21 2025-09-07T09:43:42.2963359Z deleted: sha256:e342cd1c71b7d0b024ea16b4a11f3f7fbbc2e3d11ef754c9d242aa50c4f8b0a3 2025-09-07T09:43:42.2963746Z deleted: sha256:bffd35a7fa1ddcfe05f79b7d3cae4180928eeea00eaab7ed7f484bc31adfc1d5 2025-09-07T09:43:42.2964117Z deleted: sha256:b34e33e7b04b5cbb5d5852199430593bfa18ddfe9081df42284230a14ebb739e 2025-09-07T09:43:42.2964487Z deleted: sha256:21d9b55338774d9ddc66d0bfcc92af9c8d2ecd94d1710b7049f5a811e411af7b 2025-09-07T09:43:42.2964859Z deleted: sha256:6cc2b33909585d17bf269fb8297ff881249e136137254734f7d23b9583208718 2025-09-07T09:43:42.2965227Z deleted: sha256:ca7f55b7c6d6cb11ddd8e187da34c2695fc2ce7655d652b9c9dc140a01ed056f 2025-09-07T09:43:42.2965606Z deleted: sha256:a3ece3d0ab6e99ef783c4f8d27d0e38504ab4477590ef556c16d22d92ba63a43 2025-09-07T09:43:42.2965972Z deleted: sha256:c137b0d41177c753aa1b69b11d0dd1f82420bf8520371866c845b53dca10b2d0 2025-09-07T09:43:42.2966348Z deleted: sha256:1e0d92b07bce12e511af59f608edd1932b10704d700f5e7538e406b90ecbb615 2025-09-07T09:43:42.2966721Z deleted: sha256:2ec3d01b3031e9da124d67410f54866ec5c679a0d6e4aee6b31608c45ce7fd77 2025-09-07T09:43:42.2967088Z deleted: sha256:308cffbd71363688c672b2043c6b9bf647cfb84593c42c3d88e3f36ee8f7f1b4 2025-09-07T09:43:42.2967445Z deleted: sha256:d965d9873fa450daba50a85d961f0835b14374167d84cfafa6060d16229f4229 2025-09-07T09:43:42.2967820Z deleted: sha256:effd997e222f62a34133bb2ecf9c0ffee151e5797f72e734d86a270d2e722374 2025-09-07T09:43:42.2968210Z deleted: sha256:0bbc1c78c10ee09c2697cfcce347dc9edbf82a7ccc25a6db6ee0a8dda398f7f2 2025-09-07T09:43:42.2968595Z deleted: sha256:214858e773d1ad73c2965c19b29cbfd3e2a974daa879163e1c1eb96567a7ee06 2025-09-07T09:43:42.2968977Z deleted: sha256:a9c7a2cd7ae229b26e84c093de657d0f4334d6cc9301991c6c3245ff62a9a71d 2025-09-07T09:43:42.2969344Z deleted: sha256:749a80551ef3f272e2517cb065bc7a5250da47d0b36bf74ed453caa9a5fee265 2025-09-07T09:43:42.2969706Z deleted: sha256:39b014c4e62d21c11df6c6d775d3f345675014292198981f455bacc4515a0f7b 2025-09-07T09:43:42.2970070Z deleted: sha256:0f087c9a894566644f825f5f87308d92e4cf149c51f7cd4769cbfaeefd3df791 2025-09-07T09:43:42.2970442Z deleted: sha256:dc6eb6dad5f9e332f00af553440e857b1467db1be43dd910cdb6830ba0898d50 2025-09-07T09:43:42.2970659Z 2025-09-07T09:43:42.2970751Z Total reclaimed space: 63.43GB 2025-09-07T09:43:42.3050458Z Post job cleanup. 2025-09-07T09:43:42.3079264Z Post job cleanup. 2025-09-07T09:43:42.3820009Z [command]/usr/bin/git version 2025-09-07T09:43:42.3861685Z git version 2.47.1 2025-09-07T09:43:42.3892252Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/5fa89506-1bed-4b99-9270-cfe10856f46a/.gitconfig' 2025-09-07T09:43:42.3900548Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/5fa89506-1bed-4b99-9270-cfe10856f46a' before making global git config changes 2025-09-07T09:43:42.3901211Z Adding repository directory to the temporary git global config as a safe directory 2025-09-07T09:43:42.3904917Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-09-07T09:43:42.3955974Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-09-07T09:43:42.3997647Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-09-07T09:43:42.4359427Z Entering 'android/libs/fbjni' 2025-09-07T09:43:42.4427225Z Entering 'third_party/FP16' 2025-09-07T09:43:42.4493698Z Entering 'third_party/FXdiv' 2025-09-07T09:43:42.4559238Z Entering 'third_party/NNPACK' 2025-09-07T09:43:42.4626424Z Entering 'third_party/NVTX' 2025-09-07T09:43:42.4690872Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T09:43:42.4755984Z Entering 'third_party/XNNPACK' 2025-09-07T09:43:42.4838766Z Entering 'third_party/aiter' 2025-09-07T09:43:42.4903154Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T09:43:42.4976289Z Entering 'third_party/benchmark' 2025-09-07T09:43:42.5041839Z Entering 'third_party/composable_kernel' 2025-09-07T09:43:42.5114354Z Entering 'third_party/cpp-httplib' 2025-09-07T09:43:42.5176413Z Entering 'third_party/cpuinfo' 2025-09-07T09:43:42.5241064Z Entering 'third_party/cudnn_frontend' 2025-09-07T09:43:42.5305727Z Entering 'third_party/cutlass' 2025-09-07T09:43:42.5379882Z Entering 'third_party/fbgemm' 2025-09-07T09:43:42.5446444Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T09:43:42.5510622Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T09:43:42.5579218Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T09:43:42.5641683Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T09:43:42.5715012Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T09:43:42.5777495Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T09:43:42.5841391Z Entering 'third_party/fbgemm/external/json' 2025-09-07T09:43:42.5908246Z Entering 'third_party/flash-attention' 2025-09-07T09:43:42.5974533Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T09:43:42.6042891Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T09:43:42.6117505Z Entering 'third_party/flatbuffers' 2025-09-07T09:43:42.6183860Z Entering 'third_party/fmt' 2025-09-07T09:43:42.6249395Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T09:43:42.6316528Z Entering 'third_party/gloo' 2025-09-07T09:43:42.6381806Z Entering 'third_party/googletest' 2025-09-07T09:43:42.6447724Z Entering 'third_party/ideep' 2025-09-07T09:43:42.6511607Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T09:43:42.6580949Z Entering 'third_party/ittapi' 2025-09-07T09:43:42.6648980Z Entering 'third_party/kineto' 2025-09-07T09:43:42.6714955Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T09:43:42.6775489Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T09:43:42.6840616Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T09:43:42.6907957Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T09:43:42.6976112Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T09:43:42.7043561Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T09:43:42.7110758Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T09:43:42.7173153Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T09:43:42.7238147Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T09:43:42.7303320Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T09:43:42.7371824Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T09:43:42.7435078Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T09:43:42.7505075Z Entering 'third_party/kleidiai' 2025-09-07T09:43:42.7570373Z Entering 'third_party/mimalloc' 2025-09-07T09:43:42.7635884Z Entering 'third_party/nlohmann' 2025-09-07T09:43:42.7703761Z Entering 'third_party/onnx' 2025-09-07T09:43:42.7782865Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T09:43:42.7853342Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T09:43:42.7921398Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T09:43:42.7982986Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T09:43:42.8047921Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T09:43:42.8114268Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T09:43:42.8177278Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T09:43:42.8240280Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T09:43:42.8302026Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T09:43:42.8368972Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T09:43:42.8433129Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T09:43:42.8498687Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T09:43:42.8580796Z Entering 'third_party/pocketfft' 2025-09-07T09:43:42.8647435Z Entering 'third_party/protobuf' 2025-09-07T09:43:42.8714887Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T09:43:42.8778828Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T09:43:42.8847813Z Entering 'third_party/psimd' 2025-09-07T09:43:42.8912179Z Entering 'third_party/pthreadpool' 2025-09-07T09:43:42.8979703Z Entering 'third_party/pybind11' 2025-09-07T09:43:42.9043609Z Entering 'third_party/python-peachpy' 2025-09-07T09:43:42.9109489Z Entering 'third_party/sleef' 2025-09-07T09:43:42.9174327Z Entering 'third_party/tensorpipe' 2025-09-07T09:43:42.9241661Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T09:43:42.9303153Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T09:43:42.9368448Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T09:43:42.9431627Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T09:43:42.9495454Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T09:43:42.9584304Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-09-07T09:43:42.9608952Z http.https://github.com/.extraheader 2025-09-07T09:43:42.9619647Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-09-07T09:43:42.9653322Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-09-07T09:43:43.0000324Z Entering 'android/libs/fbjni' 2025-09-07T09:43:43.0045063Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0086974Z Entering 'third_party/FP16' 2025-09-07T09:43:43.0134190Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0174409Z Entering 'third_party/FXdiv' 2025-09-07T09:43:43.0220312Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0259748Z Entering 'third_party/NNPACK' 2025-09-07T09:43:43.0305549Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0347066Z Entering 'third_party/NVTX' 2025-09-07T09:43:43.0391755Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0434769Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T09:43:43.0479988Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0523233Z Entering 'third_party/XNNPACK' 2025-09-07T09:43:43.0567925Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0620362Z Entering 'third_party/aiter' 2025-09-07T09:43:43.0664951Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0705638Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T09:43:43.0750346Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0799084Z Entering 'third_party/benchmark' 2025-09-07T09:43:43.0842745Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0884449Z Entering 'third_party/composable_kernel' 2025-09-07T09:43:43.0928642Z http.https://github.com/.extraheader 2025-09-07T09:43:43.0976948Z Entering 'third_party/cpp-httplib' 2025-09-07T09:43:43.1020856Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1063654Z Entering 'third_party/cpuinfo' 2025-09-07T09:43:43.1107698Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1149548Z Entering 'third_party/cudnn_frontend' 2025-09-07T09:43:43.1192450Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1235221Z Entering 'third_party/cutlass' 2025-09-07T09:43:43.1278410Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1331411Z Entering 'third_party/fbgemm' 2025-09-07T09:43:43.1374961Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1419156Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T09:43:43.1462479Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1502173Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T09:43:43.1545945Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1592360Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T09:43:43.1634963Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1675470Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T09:43:43.1719307Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1765736Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T09:43:43.1807379Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1848458Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T09:43:43.1890481Z http.https://github.com/.extraheader 2025-09-07T09:43:43.1930722Z Entering 'third_party/fbgemm/external/json' 2025-09-07T09:43:43.1974539Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2021249Z Entering 'third_party/flash-attention' 2025-09-07T09:43:43.2065643Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2106698Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T09:43:43.2152497Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2198984Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T09:43:43.2241346Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2291675Z Entering 'third_party/flatbuffers' 2025-09-07T09:43:43.2336985Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2378339Z Entering 'third_party/fmt' 2025-09-07T09:43:43.2422607Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2460610Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T09:43:43.2505048Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2545774Z Entering 'third_party/gloo' 2025-09-07T09:43:43.2588158Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2632496Z Entering 'third_party/googletest' 2025-09-07T09:43:43.2675531Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2716186Z Entering 'third_party/ideep' 2025-09-07T09:43:43.2759212Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2799551Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T09:43:43.2844127Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2892892Z Entering 'third_party/ittapi' 2025-09-07T09:43:43.2937184Z http.https://github.com/.extraheader 2025-09-07T09:43:43.2976739Z Entering 'third_party/kineto' 2025-09-07T09:43:43.3020820Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3060842Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T09:43:43.3104309Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3145756Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T09:43:43.3188161Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3232741Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T09:43:43.3275232Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3316539Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T09:43:43.3359387Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3402277Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T09:43:43.3445668Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3487410Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T09:43:43.3529403Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3573767Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T09:43:43.3621384Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3661972Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T09:43:43.3705727Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3750498Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T09:43:43.3793758Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3837174Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T09:43:43.3881196Z http.https://github.com/.extraheader 2025-09-07T09:43:43.3927278Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T09:43:43.3969721Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4008741Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T09:43:43.4051454Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4094604Z Entering 'third_party/kleidiai' 2025-09-07T09:43:43.4138866Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4179969Z Entering 'third_party/mimalloc' 2025-09-07T09:43:43.4226155Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4267020Z Entering 'third_party/nlohmann' 2025-09-07T09:43:43.4312431Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4353369Z Entering 'third_party/onnx' 2025-09-07T09:43:43.4396828Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4452272Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T09:43:43.4494961Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4539672Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T09:43:43.4584708Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4628974Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T09:43:43.4670682Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4711229Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T09:43:43.4754497Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4793574Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T09:43:43.4837017Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4876327Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T09:43:43.4924123Z http.https://github.com/.extraheader 2025-09-07T09:43:43.4965431Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T09:43:43.5007533Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5048683Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T09:43:43.5091190Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5130877Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T09:43:43.5171467Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5212037Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T09:43:43.5253882Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5295595Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T09:43:43.5339479Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5383951Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T09:43:43.5426102Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5485581Z Entering 'third_party/pocketfft' 2025-09-07T09:43:43.5531116Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5571738Z Entering 'third_party/protobuf' 2025-09-07T09:43:43.5617137Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5661191Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T09:43:43.5705816Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5745522Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T09:43:43.5788168Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5831027Z Entering 'third_party/psimd' 2025-09-07T09:43:43.5874917Z http.https://github.com/.extraheader 2025-09-07T09:43:43.5917952Z Entering 'third_party/pthreadpool' 2025-09-07T09:43:43.5962788Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6002833Z Entering 'third_party/pybind11' 2025-09-07T09:43:43.6047806Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6088274Z Entering 'third_party/python-peachpy' 2025-09-07T09:43:43.6132593Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6173748Z Entering 'third_party/sleef' 2025-09-07T09:43:43.6219510Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6259663Z Entering 'third_party/tensorpipe' 2025-09-07T09:43:43.6304594Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6346284Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T09:43:43.6388213Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6429153Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T09:43:43.6471750Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6510267Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T09:43:43.6551684Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6591471Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T09:43:43.6637068Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6676226Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T09:43:43.6720487Z http.https://github.com/.extraheader 2025-09-07T09:43:43.6861700Z A job completed hook has been configured by the self-hosted runner administrator 2025-09-07T09:43:43.6878187Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2025-09-07T09:43:43.6883994Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:43:43.6884242Z ##[endgroup] 2025-09-07T09:43:43.6993663Z [!ALERT!] Swap in detected! [!ALERT!] 2025-09-07T09:43:52.4003137Z [!ALERT!] Swap out detected [!ALERT!] 2025-09-07T09:44:07.6168384Z Cleaning up orphan processes