2026-02-21T08:27:43.5829899Z Current runner version: '2.331.0'
2026-02-21T08:27:43.5836848Z Runner name: 'i-07a4a42cd83fff41a'
2026-02-21T08:27:43.5837807Z Runner group name: 'default'
2026-02-21T08:27:43.5838766Z Machine name: 'ip-10-0-31-116'
2026-02-21T08:27:43.5841681Z ##[group]GITHUB_TOKEN Permissions
2026-02-21T08:27:43.5844289Z Contents: read
2026-02-21T08:27:43.5844876Z Metadata: read
2026-02-21T08:27:43.5845461Z ##[endgroup]
2026-02-21T08:27:43.5847836Z Secret source: Actions
2026-02-21T08:27:43.5848620Z Prepare workflow directory
2026-02-21T08:27:43.6205784Z Prepare all required actions
2026-02-21T08:27:43.6247750Z Getting action download info
2026-02-21T08:27:43.8083881Z Download action repository 'actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683' (SHA:11bd71901bbe5b1630ceea73d27597364c9af683)
2026-02-21T08:27:44.1210477Z Download action repository 'actions/download-artifact@65a9edc5881444af0b9093a5e628f2fe47ea3b2e' (SHA:65a9edc5881444af0b9093a5e628f2fe47ea3b2e)
2026-02-21T08:27:44.5974416Z Uses: pytorch/test-infra/.github/workflows/upload_benchmark_results.yml@refs/heads/main (bb8f04ff3961233c844fde6533c7c6c5f0857909)
2026-02-21T08:27:44.5979564Z ##[group] Inputs
2026-02-21T08:27:44.5980259Z   benchmark-artifact: benchmark-results-h100-jsd
2026-02-21T08:27:44.5982681Z   benchmark-metadata: {"timestamp": 1771662207, "schema_version": "v3", "name": "run-h100 (jsd) / benchmark-cu128-jsd-py3.12-h100", "repo": "pytorch/helion", "head_branch": "refs/heads/main", "head_sha": "874a7d0cadab18218a84ad3579d329dc95c51820", "workflow_id": 22253280836, "run_attempt": 1, "job_id": 64380330168}
2026-02-21T08:27:44.5985898Z   runners-info: [{"cpu_info": "x86_64", "cpu_count": 192, "avail_mem_in_gb": 1999, "extra_info": {"hostname": "25d4327f1089"}, "name": "cuda", "type": "NVIDIA H100 80GB HBM3", "gpu_count": 1, "avail_gpu_mem_in_gb": 79}]
2026-02-21T08:27:44.5987445Z   dependencies: {}
2026-02-21T08:27:44.5987943Z   schema-version: v3
2026-02-21T08:27:44.5988962Z   dry-run: false
2026-02-21T08:27:44.5989513Z   if-no-files-found: ignore
2026-02-21T08:27:44.5990065Z   run_h100: true
2026-02-21T08:27:44.5990545Z   run_b200: true
2026-02-21T08:27:44.5991002Z   run_mi325x: true
2026-02-21T08:27:44.5992171Z   kernels: softmax,jsd,welford,kl_div,int4_gemm,layer_norm,layer_norm-bwd,rms_norm,rms_norm-bwd,cross_entropy,flash_attention,gemm,grouped_gemm
2026-02-21T08:27:44.5993454Z ##[endgroup]
2026-02-21T08:27:44.5994328Z Complete job name: run-h100 (jsd) / upload-benchmark-results / Uploading benchmark-results-h100-jsd
2026-02-21T08:27:44.6515690Z A job started hook has been configured by the self-hosted runner administrator
2026-02-21T08:27:44.6634887Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh'
2026-02-21T08:27:44.6645325Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2026-02-21T08:27:44.6646349Z ##[endgroup]
2026-02-21T08:27:45.9837085Z Runner Type: linux.2xlarge
2026-02-21T08:27:45.9837655Z Instance Type: c5.2xlarge
2026-02-21T08:27:45.9837974Z AMI Name: unknown
2026-02-21T08:27:45.9869847Z AMI ID: ami-068c0051b15cdb816
2026-02-21T08:27:51.7702892Z ##[group]Run actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
2026-02-21T08:27:51.7703476Z with:
2026-02-21T08:27:51.7703773Z   repository: pytorch/test-infra
2026-02-21T08:27:51.7704104Z   ref: main
2026-02-21T08:27:51.7704379Z   path: test-infra
2026-02-21T08:27:51.7704890Z   token: ***
2026-02-21T08:27:51.7705192Z   ssh-strict: true
2026-02-21T08:27:51.7705486Z   ssh-user: git
2026-02-21T08:27:51.7705768Z   persist-credentials: true
2026-02-21T08:27:51.7706094Z   clean: true
2026-02-21T08:27:51.7706395Z   sparse-checkout-cone-mode: true
2026-02-21T08:27:51.7706771Z   fetch-depth: 1
2026-02-21T08:27:51.7707039Z   fetch-tags: false
2026-02-21T08:27:51.7707338Z   show-progress: true
2026-02-21T08:27:51.7707615Z   lfs: false
2026-02-21T08:27:51.7707891Z   submodules: false
2026-02-21T08:27:51.7708178Z   set-safe-directory: true
2026-02-21T08:27:51.7708630Z ##[endgroup]
2026-02-21T08:27:51.9254047Z Syncing repository: pytorch/test-infra
2026-02-21T08:27:51.9255735Z ##[group]Getting Git version info
2026-02-21T08:27:51.9256681Z Working directory is '/home/ec2-user/actions-runner/_work/helion/helion/test-infra'
2026-02-21T08:27:51.9257556Z [command]/usr/bin/git version
2026-02-21T08:27:51.9257906Z git version 2.50.1
2026-02-21T08:27:51.9281410Z ##[endgroup]
2026-02-21T08:27:51.9293388Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/3c866a66-dff6-486e-aac6-56590cc203fb' before making global git config changes
2026-02-21T08:27:51.9294538Z Adding repository directory to the temporary git global config as a safe directory
2026-02-21T08:27:51.9298495Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/helion/helion/test-infra
2026-02-21T08:27:51.9328802Z ##[group]Initializing the repository
2026-02-21T08:27:51.9333308Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/helion/helion/test-infra
2026-02-21T08:27:51.9376792Z hint: Using 'master' as the name for the initial branch. This default branch name
2026-02-21T08:27:51.9378231Z hint: is subject to change. To configure the initial branch name to use in all
2026-02-21T08:27:51.9379514Z hint: of your new repositories, which will suppress this warning, call:
2026-02-21T08:27:51.9380433Z hint:
2026-02-21T08:27:51.9381122Z hint: 	git config --global init.defaultBranch <name>
2026-02-21T08:27:51.9381897Z hint:
2026-02-21T08:27:51.9382635Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2026-02-21T08:27:51.9383901Z hint: 'development'. The just-created branch can be renamed via this command:
2026-02-21T08:27:51.9384856Z hint:
2026-02-21T08:27:51.9385349Z hint: 	git branch -m <name>
2026-02-21T08:27:51.9385920Z hint:
2026-02-21T08:27:51.9386732Z hint: Disable this message with "git config set advice.defaultBranchName false"
2026-02-21T08:27:51.9388441Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/helion/helion/test-infra/.git/
2026-02-21T08:27:51.9390976Z [command]/usr/bin/git remote add origin https://github.com/pytorch/test-infra
2026-02-21T08:27:51.9414751Z ##[endgroup]
2026-02-21T08:27:51.9415746Z ##[group]Disabling automatic garbage collection
2026-02-21T08:27:51.9418026Z [command]/usr/bin/git config --local gc.auto 0
2026-02-21T08:27:51.9445425Z ##[endgroup]
2026-02-21T08:27:51.9445920Z ##[group]Setting up auth
2026-02-21T08:27:51.9450949Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2026-02-21T08:27:51.9477258Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2026-02-21T08:27:51.9857683Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2026-02-21T08:27:51.9895763Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2026-02-21T08:27:52.0217174Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2026-02-21T08:27:52.0258007Z ##[endgroup]
2026-02-21T08:27:52.0258976Z ##[group]Fetching the repository
2026-02-21T08:27:52.0267547Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --no-recurse-submodules --depth=1 origin +refs/heads/main*:refs/remotes/origin/main* +refs/tags/main*:refs/tags/main*
2026-02-21T08:27:52.3838485Z From https://github.com/pytorch/test-infra
2026-02-21T08:27:52.3839397Z  * [new branch]      main       -> origin/main
2026-02-21T08:27:52.3863396Z ##[endgroup]
2026-02-21T08:27:52.3863855Z ##[group]Determining the checkout info
2026-02-21T08:27:52.3870997Z [command]/usr/bin/git branch --list --remote origin/main
2026-02-21T08:27:52.3906608Z   origin/main
2026-02-21T08:27:52.3911410Z ##[endgroup]
2026-02-21T08:27:52.3914806Z [command]/usr/bin/git sparse-checkout disable
2026-02-21T08:27:52.3948581Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig
2026-02-21T08:27:52.3972405Z ##[group]Checking out the ref
2026-02-21T08:27:52.3975494Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main
2026-02-21T08:27:52.5606951Z Switched to a new branch 'main'
2026-02-21T08:27:52.5619147Z branch 'main' set up to track 'origin/main'.
2026-02-21T08:27:52.5628656Z ##[endgroup]
2026-02-21T08:27:52.5674638Z [command]/usr/bin/git log -1 --format=%H
2026-02-21T08:27:52.5700471Z bb8f04ff3961233c844fde6533c7c6c5f0857909
2026-02-21T08:27:52.5881146Z ##[group]Run actions/download-artifact@65a9edc5881444af0b9093a5e628f2fe47ea3b2e
2026-02-21T08:27:52.5881674Z with:
2026-02-21T08:27:52.5881926Z   name: benchmark-results-h100-jsd
2026-02-21T08:27:52.5882356Z   path: /home/ec2-user/actions-runner/_work/_temp/benchmark-artifact
2026-02-21T08:27:52.5882815Z   merge-multiple: false
2026-02-21T08:27:52.5883083Z   repository: pytorch/helion
2026-02-21T08:27:52.5883371Z   run-id: 22253280836
2026-02-21T08:27:52.5883620Z ##[endgroup]
2026-02-21T08:27:52.8462176Z Downloading single artifact
2026-02-21T08:27:52.9567156Z Preparing to download the following artifacts:
2026-02-21T08:27:52.9567688Z - benchmark-results-h100-jsd (ID: 5600410538, Size: 150)
2026-02-21T08:27:53.0165567Z Redirecting to blob download url: https://productionresultssa0.blob.core.windows.net/actions-results/cff08df3-00e7-4767-8b8d-229a961df982/workflow-job-run-a279f11e-687d-5386-b695-ef5f02acaba0/artifacts/546b9647532299323da587e4f24f521c73b18fccbcda3f1c12d0ca26a24abc53.zip
2026-02-21T08:27:53.0167362Z Starting download of artifact to: /home/ec2-user/actions-runner/_work/_temp/benchmark-artifact
2026-02-21T08:27:53.0455817Z (node:41258) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
2026-02-21T08:27:53.0457035Z (Use `node --trace-deprecation ...` to show where the warning was created)
2026-02-21T08:27:53.0493044Z Artifact download completed successfully.
2026-02-21T08:27:53.0493704Z Total of 1 artifact(s) downloaded
2026-02-21T08:27:53.0499581Z Download artifact has finished successfully
2026-02-21T08:27:53.0619249Z ##[group]Run set -eux
2026-02-21T08:27:53.0619633Z set -eux
2026-02-21T08:27:53.0619870Z 
2026-02-21T08:27:53.0620175Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then
2026-02-21T08:27:53.0620662Z   echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping"
2026-02-21T08:27:53.0621186Z   # We don't want the job to fail if the directory doesn't exist
2026-02-21T08:27:53.0621650Z   exit 0
2026-02-21T08:27:53.0621896Z fi
2026-02-21T08:27:53.0622115Z 
2026-02-21T08:27:53.0622372Z python3 -mpip install boto3==1.35.33
2026-02-21T08:27:53.0622697Z 
2026-02-21T08:27:53.0622944Z if [[ "${DRY_RUN}" == "true" ]]; then
2026-02-21T08:27:53.0623384Z   python3 ".github/scripts/upload_benchmark_results.py" \
2026-02-21T08:27:53.0623937Z     --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \
2026-02-21T08:27:53.0624894Z     --metadata "${BENCHMARK_METADATA}" \
2026-02-21T08:27:53.0625269Z     --runners "${RUNNERS_INFO}" \
2026-02-21T08:27:53.0625641Z     --dependencies "${DEPENDENCIES}" \
2026-02-21T08:27:53.0625980Z     --dry-run
2026-02-21T08:27:53.0626244Z else
2026-02-21T08:27:53.0626583Z   python3 ".github/scripts/upload_benchmark_results.py" \
2026-02-21T08:27:53.0627099Z     --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \
2026-02-21T08:27:53.0627555Z     --metadata "${BENCHMARK_METADATA}" \
2026-02-21T08:27:53.0627920Z     --runners "${RUNNERS_INFO}" \
2026-02-21T08:27:53.0628377Z     --dependencies "${DEPENDENCIES}"
2026-02-21T08:27:53.0628700Z fi
2026-02-21T08:27:53.0639512Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2026-02-21T08:27:53.0639906Z env:
2026-02-21T08:27:53.0640495Z   BENCHMARK_RESULTS_DIR: /home/ec2-user/actions-runner/_work/_temp/benchmark-artifact
2026-02-21T08:27:53.0641002Z   DRY_RUN: false
2026-02-21T08:27:53.0641260Z   IF_NO_FILES_FOUND: ignore
2026-02-21T08:27:53.0642678Z   BENCHMARK_METADATA: {"timestamp": 1771662207, "schema_version": "v3", "name": "run-h100 (jsd) / benchmark-cu128-jsd-py3.12-h100", "repo": "pytorch/helion", "head_branch": "refs/heads/main", "head_sha": "874a7d0cadab18218a84ad3579d329dc95c51820", "workflow_id": 22253280836, "run_attempt": 1, "job_id": 64380330168}
2026-02-21T08:27:53.0645093Z   RUNNERS_INFO: [{"cpu_info": "x86_64", "cpu_count": 192, "avail_mem_in_gb": 1999, "extra_info": {"hostname": "25d4327f1089"}, "name": "cuda", "type": "NVIDIA H100 80GB HBM3", "gpu_count": 1, "avail_gpu_mem_in_gb": 79}]
2026-02-21T08:27:53.0646128Z   DEPENDENCIES: {}
2026-02-21T08:27:53.0646374Z ##[endgroup]
2026-02-21T08:27:53.0681549Z + [[ ! -d /home/ec2-user/actions-runner/_work/_temp/benchmark-artifact ]]
2026-02-21T08:27:53.0682041Z + python3 -mpip install boto3==1.35.33
2026-02-21T08:27:53.3712559Z Defaulting to user installation because normal site-packages is not writeable
2026-02-21T08:27:54.5305338Z Collecting boto3==1.35.33
2026-02-21T08:27:54.5501551Z   Downloading boto3-1.35.33-py3-none-any.whl (139 kB)
2026-02-21T08:27:54.6348020Z Collecting s3transfer<0.11.0,>=0.10.0
2026-02-21T08:27:54.6385938Z   Downloading s3transfer-0.10.4-py3-none-any.whl (83 kB)
2026-02-21T08:27:54.6453286Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0)
2026-02-21T08:27:55.9097950Z Collecting botocore<1.36.0,>=1.35.33
2026-02-21T08:27:55.9142951Z   Downloading botocore-1.35.99-py3-none-any.whl (13.3 MB)
2026-02-21T08:27:56.1029410Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10)
2026-02-21T08:27:56.1034816Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.1)
2026-02-21T08:27:56.2806879Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0)
2026-02-21T08:27:56.3669706Z Installing collected packages: botocore, s3transfer, boto3
2026-02-21T08:27:56.9380208Z Successfully installed boto3-1.35.33 botocore-1.35.99 s3transfer-0.10.4
2026-02-21T08:27:57.1533736Z + [[ false == \t\r\u\e ]]
2026-02-21T08:27:57.1536731Z + python3 .github/scripts/upload_benchmark_results.py --benchmark-results-dir /home/ec2-user/actions-runner/_work/_temp/benchmark-artifact --metadata '{"timestamp": 1771662207, "schema_version": "v3", "name": "run-h100 (jsd) / benchmark-cu128-jsd-py3.12-h100", "repo": "pytorch/helion", "head_branch": "refs/heads/main", "head_sha": "874a7d0cadab18218a84ad3579d329dc95c51820", "workflow_id": 22253280836, "run_attempt": 1, "job_id": 64380330168}' --runners '[{"cpu_info": "x86_64", "cpu_count": 192, "avail_mem_in_gb": 1999, "extra_info": {"hostname": "25d4327f1089"}, "name": "cuda", "type": "NVIDIA H100 80GB HBM3", "gpu_count": 1, "avail_gpu_mem_in_gb": 79}]' --dependencies '{}'
2026-02-21T08:27:57.3270881Z Post job cleanup.
2026-02-21T08:27:57.4574312Z [command]/usr/bin/git version
2026-02-21T08:27:57.4613433Z git version 2.50.1
2026-02-21T08:27:57.4682925Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/8ed10825-1738-424b-ad3d-3d11e3262291' before making global git config changes
2026-02-21T08:27:57.4684789Z Adding repository directory to the temporary git global config as a safe directory
2026-02-21T08:27:57.4689556Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/helion/helion/test-infra
2026-02-21T08:27:57.4726065Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2026-02-21T08:27:57.4759102Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2026-02-21T08:27:57.5062216Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2026-02-21T08:27:57.5086822Z http.https://github.com/.extraheader
2026-02-21T08:27:57.5096448Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2026-02-21T08:27:57.5124363Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2026-02-21T08:27:57.5501328Z A job completed hook has been configured by the self-hosted runner administrator
2026-02-21T08:27:57.5526810Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh'
2026-02-21T08:27:57.5533254Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2026-02-21T08:27:57.5533665Z ##[endgroup]
2026-02-21T08:27:57.5695239Z [!ALERT!] Swap in detected! [!ALERT!]
2026-02-21T08:28:09.1465698Z [!ALERT!] Swap out detected [!ALERT!]
2026-02-21T08:28:27.8978570Z Cleaning up orphan processes