2024-12-18T00:03:07.2222793Z Current runner version: '2.321.0' 2024-12-18T00:03:07.2230200Z Runner name: 'i-07b82df1ecbdd12be' 2024-12-18T00:03:07.2231262Z Runner group name: 'Default' 2024-12-18T00:03:07.2232394Z Machine name: 'ip-10-0-78-168' 2024-12-18T00:03:07.2237729Z ##[group]GITHUB_TOKEN Permissions 2024-12-18T00:03:07.2240671Z Actions: read 2024-12-18T00:03:07.2241460Z Attestations: read 2024-12-18T00:03:07.2242291Z Checks: read 2024-12-18T00:03:07.2242984Z Contents: read 2024-12-18T00:03:07.2243722Z Deployments: read 2024-12-18T00:03:07.2244514Z Discussions: read 2024-12-18T00:03:07.2245260Z Issues: read 2024-12-18T00:03:07.2245960Z Metadata: read 2024-12-18T00:03:07.2246703Z Packages: read 2024-12-18T00:03:07.2247437Z Pages: read 2024-12-18T00:03:07.2248144Z PullRequests: read 2024-12-18T00:03:07.2249045Z RepositoryProjects: read 2024-12-18T00:03:07.2249860Z SecurityEvents: read 2024-12-18T00:03:07.2250572Z Statuses: read 2024-12-18T00:03:07.2251349Z ##[endgroup] 2024-12-18T00:03:07.2255055Z Secret source: Actions 2024-12-18T00:03:07.2256249Z Prepare workflow directory 2024-12-18T00:03:07.5985362Z Prepare all required actions 2024-12-18T00:03:07.6032621Z Getting action download info 2024-12-18T00:03:07.8242792Z Download action repository 'pytorch/test-infra@release/2.6' (SHA:eb0adf5a84668865394af69e26428b32c8105c1c) 2024-12-18T00:03:09.7351359Z Download action repository 'pytorch/pytorch@release/2.6' (SHA:0cdf8b1d09254cfda66191d1bd01e3041c3c76f7) 2024-12-18T00:03:23.1006857Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-12-18T00:03:23.3879294Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-12-18T00:03:23.6966652Z Getting action download info 2024-12-18T00:03:23.8422069Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-12-18T00:03:24.1708405Z Getting action download info 2024-12-18T00:03:24.3310590Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2024-12-18T00:03:24.5021471Z Getting action download info 2024-12-18T00:03:24.6210205Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-12-18T00:03:24.7928120Z Getting action download info 2024-12-18T00:03:24.9637077Z Download action repository 'pytorch/test-infra@main' (SHA:a07505a74641a4ff5123d635defac481ef28ef1e) 2024-12-18T00:03:26.1199293Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/release/2.6 (0cdf8b1d09254cfda66191d1bd01e3041c3c76f7) 2024-12-18T00:03:26.1201868Z ##[group] Inputs 2024-12-18T00:03:26.1202572Z build-environment: linux-focal-cuda12.4-py3.10-gcc9-sm75 2024-12-18T00:03:26.1203439Z test-matrix: {"include": [{"config": "pr_time_benchmarks", "shard": 1, "num_shards": 1, "runner": "linux.g4dn.metal.nvidia.gpu"}]} 2024-12-18T00:03:26.1204923Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:03:26.1206023Z sync-tag: 2024-12-18T00:03:26.1207002Z timeout-minutes: 240 2024-12-18T00:03:26.1207336Z use-gha: 2024-12-18T00:03:26.1207658Z dashboard-tag: 2024-12-18T00:03:26.1207990Z s3-bucket: gha-artifacts 2024-12-18T00:03:26.1208358Z aws-role-to-assume: 2024-12-18T00:03:26.1209029Z disable-monitor: false 2024-12-18T00:03:26.1209402Z ##[endgroup] 2024-12-18T00:03:26.1210019Z Complete job name: cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:03:26.2129726Z A job started hook has been configured by the self-hosted runner administrator 2024-12-18T00:03:26.2232773Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-12-18T00:03:26.2240781Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:03:26.2241444Z ##[endgroup] 2024-12-18T00:03:27.5713809Z Runner Type: linux.g4dn.metal.nvidia.gpu 2024-12-18T00:03:27.5714813Z Instance Type: g4dn.metal 2024-12-18T00:03:27.5715147Z AMI Name: unknown 2024-12-18T00:03:27.5742403Z AMI ID: ami-0fff1b9a61dec8a5f 2024-12-18T00:03:33.0289099Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@release/2.6 2024-12-18T00:03:33.0289610Z with: 2024-12-18T00:03:33.0290346Z github-secret: *** 2024-12-18T00:03:33.0291113Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-12-18T00:03:33.0291929Z activate-with-label: false 2024-12-18T00:03:33.0292234Z label: with-ssh 2024-12-18T00:03:33.0292489Z remove-existing-keys: true 2024-12-18T00:03:33.0292797Z fail-silently: true 2024-12-18T00:03:33.0293061Z env: 2024-12-18T00:03:33.0293293Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:03:33.0293586Z ##[endgroup] 2024-12-18T00:03:33.1461042Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-12-18T00:03:33.1462130Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys 2024-12-18T00:03:33.1587630Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@release/2.6 2024-12-18T00:03:33.1588157Z with: 2024-12-18T00:03:33.1588393Z no-sudo: true 2024-12-18T00:03:33.1588683Z submodules: recursive 2024-12-18T00:03:33.1588981Z fetch-depth: 0 2024-12-18T00:03:33.1589251Z env: 2024-12-18T00:03:33.1589482Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:03:33.1589785Z ##[endgroup] 2024-12-18T00:03:33.1672068Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:03:33.1673093Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:03:33.1679847Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:03:33.1680263Z env: 2024-12-18T00:03:33.1680515Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:03:33.1680851Z ##[endgroup] 2024-12-18T00:03:33.1772442Z ##[group]Run retry () { 2024-12-18T00:03:33.1772758Z retry () { 2024-12-18T00:03:33.1773113Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-12-18T00:03:33.1773530Z } 2024-12-18T00:03:33.1773788Z echo "${GITHUB_WORKSPACE}" 2024-12-18T00:03:33.1774133Z if [ -z "${NO_SUDO}" ]; then 2024-12-18T00:03:33.1774507Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-12-18T00:03:33.1774852Z else 2024-12-18T00:03:33.1775132Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-12-18T00:03:33.1775479Z fi 2024-12-18T00:03:33.1775739Z mkdir "${GITHUB_WORKSPACE}" 2024-12-18T00:03:33.1780270Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:03:33.1780679Z env: 2024-12-18T00:03:33.1780906Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:03:33.1781216Z NO_SUDO: true 2024-12-18T00:03:33.1781470Z ##[endgroup] 2024-12-18T00:03:33.1801231Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:03:35.3338211Z ##[group]Run malfet/checkout@silent-checkout 2024-12-18T00:03:35.3338592Z with: 2024-12-18T00:03:35.3338863Z ref: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:03:35.3339229Z fetch-depth: 0 2024-12-18T00:03:35.3339526Z submodules: recursive 2024-12-18T00:03:35.3339799Z quiet-checkout: true 2024-12-18T00:03:35.3340099Z repository: pytorch/pytorch 2024-12-18T00:03:35.3340536Z token: *** 2024-12-18T00:03:35.3340809Z ssh-strict: true 2024-12-18T00:03:35.3341111Z persist-credentials: true 2024-12-18T00:03:35.3341419Z clean: true 2024-12-18T00:03:35.3341670Z sparse-checkout-cone-mode: true 2024-12-18T00:03:35.3341991Z lfs: false 2024-12-18T00:03:35.3342243Z set-safe-directory: true 2024-12-18T00:03:35.3342526Z env: 2024-12-18T00:03:35.3342743Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:03:35.3343032Z ##[endgroup] 2024-12-18T00:03:35.4206933Z Syncing repository: pytorch/pytorch 2024-12-18T00:03:35.4208779Z ##[group]Getting Git version info 2024-12-18T00:03:35.4209403Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-12-18T00:03:35.4210210Z [command]/usr/bin/git version 2024-12-18T00:03:35.4210579Z git version 2.40.1 2024-12-18T00:03:35.4215296Z ##[endgroup] 2024-12-18T00:03:35.4234961Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/5e418577-a50b-4a6d-b16a-272f5cc28dbd' before making global git config changes 2024-12-18T00:03:35.4236121Z Adding repository directory to the temporary git global config as a safe directory 2024-12-18T00:03:35.4237200Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:03:35.4261492Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-12-18T00:03:35.4264712Z ##[group]Initializing the repository 2024-12-18T00:03:35.4267005Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:03:35.4289714Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-12-18T00:03:35.4290495Z hint: is subject to change. To configure the initial branch name to use in all 2024-12-18T00:03:35.4291160Z hint: of your new repositories, which will suppress this warning, call: 2024-12-18T00:03:35.4291674Z hint: 2024-12-18T00:03:35.4292037Z hint: git config --global init.defaultBranch 2024-12-18T00:03:35.4292463Z hint: 2024-12-18T00:03:35.4292864Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-12-18T00:03:35.4293509Z hint: 'development'. The just-created branch can be renamed via this command: 2024-12-18T00:03:35.4294028Z hint: 2024-12-18T00:03:35.4294314Z hint: git branch -m 2024-12-18T00:03:35.4294944Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-12-18T00:03:35.4299864Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-12-18T00:03:35.4321664Z ##[endgroup] 2024-12-18T00:03:35.4322205Z ##[group]Disabling automatic garbage collection 2024-12-18T00:03:35.4322725Z [command]/usr/bin/git config --local gc.auto 0 2024-12-18T00:03:35.4344188Z ##[endgroup] 2024-12-18T00:03:35.4344683Z ##[group]Setting up auth 2024-12-18T00:03:35.4347442Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-12-18T00:03:35.4368350Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-12-18T00:03:35.4631366Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-12-18T00:03:35.4650795Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-12-18T00:03:35.4892118Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-12-18T00:03:35.4932728Z ##[endgroup] 2024-12-18T00:03:35.4933286Z ##[group]Fetching the repository 2024-12-18T00:03:35.4937654Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-12-18T00:03:38.1091171Z remote: Enumerating objects: 1056385 2024-12-18T00:03:38.1091728Z remote: Enumerating objects: 1057261, done. 2024-12-18T00:03:38.1092314Z remote: Counting objects: 0% (1/876) 2024-12-18T00:03:38.1092768Z remote: Counting objects: 1% (9/876) 2024-12-18T00:03:38.1093226Z remote: Counting objects: 2% (18/876) 2024-12-18T00:03:38.1093682Z remote: Counting objects: 3% (27/876) 2024-12-18T00:03:38.1094108Z remote: Counting objects: 4% (36/876) 2024-12-18T00:03:38.1094558Z remote: Counting objects: 5% (44/876) 2024-12-18T00:03:38.1095372Z remote: Counting objects: 6% (53/876) 2024-12-18T00:03:38.1095838Z remote: Counting objects: 7% (62/876) 2024-12-18T00:03:38.1096286Z remote: Counting objects: 8% (71/876) 2024-12-18T00:03:38.1096712Z remote: Counting objects: 9% (79/876) 2024-12-18T00:03:38.1097155Z remote: Counting objects: 10% (88/876) 2024-12-18T00:03:38.1097609Z remote: Counting objects: 11% (97/876) 2024-12-18T00:03:38.1098108Z remote: Counting objects: 12% (106/876) 2024-12-18T00:03:38.1098568Z remote: Counting objects: 13% (114/876) 2024-12-18T00:03:38.1099017Z remote: Counting objects: 14% (123/876) 2024-12-18T00:03:38.1099445Z remote: Counting objects: 15% (132/876) 2024-12-18T00:03:38.1099896Z remote: Counting objects: 16% (141/876) 2024-12-18T00:03:38.1100329Z remote: Counting objects: 17% (149/876) 2024-12-18T00:03:38.1100781Z remote: Counting objects: 18% (158/876) 2024-12-18T00:03:38.1101234Z remote: Counting objects: 19% (167/876) 2024-12-18T00:03:38.1101944Z remote: Counting objects: 20% (176/876) 2024-12-18T00:03:38.1102365Z remote: Counting objects: 21% (184/876) 2024-12-18T00:03:38.1102859Z remote: Counting objects: 22% (193/876) 2024-12-18T00:03:38.1103305Z remote: Counting objects: 23% (202/876) 2024-12-18T00:03:38.1103755Z remote: Counting objects: 24% (211/876) 2024-12-18T00:03:38.1104204Z remote: Counting objects: 25% (219/876) 2024-12-18T00:03:38.1104631Z remote: Counting objects: 26% (228/876) 2024-12-18T00:03:38.1105160Z remote: Counting objects: 27% (237/876) 2024-12-18T00:03:38.1105614Z remote: Counting objects: 28% (246/876) 2024-12-18T00:03:38.1106059Z remote: Counting objects: 29% (255/876) 2024-12-18T00:03:38.1106508Z remote: Counting objects: 30% (263/876) 2024-12-18T00:03:38.1106935Z remote: Counting objects: 31% (272/876) 2024-12-18T00:03:38.1107395Z remote: Counting objects: 32% (281/876) 2024-12-18T00:03:38.1107845Z remote: Counting objects: 33% (290/876) 2024-12-18T00:03:38.1108303Z remote: Counting objects: 34% (298/876) 2024-12-18T00:03:38.1108755Z remote: Counting objects: 35% (307/876) 2024-12-18T00:03:38.1109181Z remote: Counting objects: 36% (316/876) 2024-12-18T00:03:38.1109631Z remote: Counting objects: 37% (325/876) 2024-12-18T00:03:38.1110075Z remote: Counting objects: 38% (333/876) 2024-12-18T00:03:38.1110523Z remote: Counting objects: 39% (342/876) 2024-12-18T00:03:38.1110972Z remote: Counting objects: 40% (351/876) 2024-12-18T00:03:38.1111420Z remote: Counting objects: 41% (360/876) 2024-12-18T00:03:38.1111847Z remote: Counting objects: 42% (368/876) 2024-12-18T00:03:38.1112291Z remote: Counting objects: 43% (377/876) 2024-12-18T00:03:38.1112741Z remote: Counting objects: 44% (386/876) 2024-12-18T00:03:38.1113199Z remote: Counting objects: 45% (395/876) 2024-12-18T00:03:38.1113654Z remote: Counting objects: 46% (403/876) 2024-12-18T00:03:38.1114085Z remote: Counting objects: 47% (412/876) 2024-12-18T00:03:38.1114536Z remote: Counting objects: 48% (421/876) 2024-12-18T00:03:38.1115007Z remote: Counting objects: 49% (430/876) 2024-12-18T00:03:38.1115461Z remote: Counting objects: 50% (438/876) 2024-12-18T00:03:38.1115912Z remote: Counting objects: 51% (447/876) 2024-12-18T00:03:38.1116342Z remote: Counting objects: 52% (456/876) 2024-12-18T00:03:38.1116792Z remote: Counting objects: 53% (465/876) 2024-12-18T00:03:38.1117244Z remote: Counting objects: 54% (474/876) 2024-12-18T00:03:38.1117692Z remote: Counting objects: 55% (482/876) 2024-12-18T00:03:38.1118142Z remote: Counting objects: 56% (491/876) 2024-12-18T00:03:38.1118570Z remote: Counting objects: 57% (500/876) 2024-12-18T00:03:38.1119018Z remote: Counting objects: 58% (509/876) 2024-12-18T00:03:38.1119582Z remote: Counting objects: 59% (517/876) 2024-12-18T00:03:38.1120033Z remote: Counting objects: 60% (526/876) 2024-12-18T00:03:38.1120488Z remote: Counting objects: 61% (535/876) 2024-12-18T00:03:38.1120933Z remote: Counting objects: 62% (544/876) 2024-12-18T00:03:38.1121417Z remote: Counting objects: 63% (552/876) 2024-12-18T00:03:38.1121913Z remote: Counting objects: 64% (561/876) 2024-12-18T00:03:38.1122361Z remote: Counting objects: 65% (570/876) 2024-12-18T00:03:38.1122845Z remote: Counting objects: 66% (579/876) 2024-12-18T00:03:38.1123291Z remote: Counting objects: 67% (587/876) 2024-12-18T00:03:38.1123737Z remote: Counting objects: 68% (596/876) 2024-12-18T00:03:38.1124186Z remote: Counting objects: 69% (605/876) 2024-12-18T00:03:38.1124610Z remote: Counting objects: 70% (614/876) 2024-12-18T00:03:38.1125062Z remote: Counting objects: 71% (622/876) 2024-12-18T00:03:38.1125511Z remote: Counting objects: 72% (631/876) 2024-12-18T00:03:38.1126039Z remote: Counting objects: 73% (640/876) 2024-12-18T00:03:38.1126491Z remote: Counting objects: 74% (649/876) 2024-12-18T00:03:38.1126941Z remote: Counting objects: 75% (657/876) 2024-12-18T00:03:38.1127371Z remote: Counting objects: 76% (666/876) 2024-12-18T00:03:38.1127819Z remote: Counting objects: 77% (675/876) 2024-12-18T00:03:38.1128284Z remote: Counting objects: 78% (684/876) 2024-12-18T00:03:38.1128744Z remote: Counting objects: 79% (693/876) 2024-12-18T00:03:38.1129192Z remote: Counting objects: 80% (701/876) 2024-12-18T00:03:38.1129622Z remote: Counting objects: 81% (710/876) 2024-12-18T00:03:38.1130077Z remote: Counting objects: 82% (719/876) 2024-12-18T00:03:38.1130535Z remote: Counting objects: 83% (728/876) 2024-12-18T00:03:38.1130991Z remote: Counting objects: 84% (736/876) 2024-12-18T00:03:38.1131452Z remote: Counting objects: 85% (745/876) 2024-12-18T00:03:38.1131886Z remote: Counting objects: 86% (754/876) 2024-12-18T00:03:38.1132338Z remote: Counting objects: 87% (763/876) 2024-12-18T00:03:38.1132789Z remote: Counting objects: 88% (771/876) 2024-12-18T00:03:38.1133247Z remote: Counting objects: 89% (780/876) 2024-12-18T00:03:38.1133698Z remote: Counting objects: 90% (789/876) 2024-12-18T00:03:38.1134149Z remote: Counting objects: 91% (798/876) 2024-12-18T00:03:38.1134576Z remote: Counting objects: 92% (806/876) 2024-12-18T00:03:38.1135027Z remote: Counting objects: 93% (815/876) 2024-12-18T00:03:38.1135480Z remote: Counting objects: 94% (824/876) 2024-12-18T00:03:38.1135928Z remote: Counting objects: 95% (833/876) 2024-12-18T00:03:38.1136377Z remote: Counting objects: 96% (841/876) 2024-12-18T00:03:38.1136807Z remote: Counting objects: 97% (850/876) 2024-12-18T00:03:38.1137263Z remote: Counting objects: 98% (859/876) 2024-12-18T00:03:38.1137717Z remote: Counting objects: 99% (868/876) 2024-12-18T00:03:38.1138170Z remote: Counting objects: 100% (876/876) 2024-12-18T00:03:38.1138652Z remote: Counting objects: 100% (876/876), done. 2024-12-18T00:03:38.1150518Z remote: Compressing objects: 0% (1/352) 2024-12-18T00:03:38.1268950Z remote: Compressing objects: 1% (4/352) 2024-12-18T00:03:38.1335867Z remote: Compressing objects: 2% (8/352) 2024-12-18T00:03:38.1464393Z remote: Compressing objects: 3% (11/352) 2024-12-18T00:03:38.1548046Z remote: Compressing objects: 4% (15/352) 2024-12-18T00:03:38.1617898Z remote: Compressing objects: 5% (18/352) 2024-12-18T00:03:38.1749874Z remote: Compressing objects: 6% (22/352) 2024-12-18T00:03:38.2179558Z remote: Compressing objects: 7% (25/352) 2024-12-18T00:03:38.2430133Z remote: Compressing objects: 8% (29/352) 2024-12-18T00:03:38.3396371Z remote: Compressing objects: 9% (32/352) 2024-12-18T00:03:38.3806365Z remote: Compressing objects: 10% (36/352) 2024-12-18T00:03:38.4262966Z remote: Compressing objects: 11% (39/352) 2024-12-18T00:03:38.4367670Z remote: Compressing objects: 12% (43/352) 2024-12-18T00:03:38.4515845Z remote: Compressing objects: 13% (46/352) 2024-12-18T00:03:38.4579907Z remote: Compressing objects: 14% (50/352) 2024-12-18T00:03:38.4580498Z remote: Compressing objects: 15% (53/352) 2024-12-18T00:03:38.4581688Z remote: Compressing objects: 16% (57/352) 2024-12-18T00:03:38.4583601Z remote: Compressing objects: 17% (60/352) 2024-12-18T00:03:38.4588999Z remote: Compressing objects: 18% (64/352) 2024-12-18T00:03:38.4590325Z remote: Compressing objects: 19% (67/352) 2024-12-18T00:03:38.4591538Z remote: Compressing objects: 20% (71/352) 2024-12-18T00:03:38.4592819Z remote: Compressing objects: 21% (74/352) 2024-12-18T00:03:38.4594305Z remote: Compressing objects: 22% (78/352) 2024-12-18T00:03:38.4601305Z remote: Compressing objects: 23% (81/352) 2024-12-18T00:03:38.4604697Z remote: Compressing objects: 24% (85/352) 2024-12-18T00:03:38.4611216Z remote: Compressing objects: 25% (88/352) 2024-12-18T00:03:38.4612448Z remote: Compressing objects: 26% (92/352) 2024-12-18T00:03:38.4613632Z remote: Compressing objects: 27% (96/352) 2024-12-18T00:03:38.4616874Z remote: Compressing objects: 28% (99/352) 2024-12-18T00:03:38.4624303Z remote: Compressing objects: 29% (103/352) 2024-12-18T00:03:38.4632975Z remote: Compressing objects: 30% (106/352) 2024-12-18T00:03:38.4633489Z remote: Compressing objects: 31% (110/352) 2024-12-18T00:03:38.4634927Z remote: Compressing objects: 32% (113/352) 2024-12-18T00:03:38.4637286Z remote: Compressing objects: 33% (117/352) 2024-12-18T00:03:38.4646040Z remote: Compressing objects: 34% (120/352) 2024-12-18T00:03:38.4646561Z remote: Compressing objects: 35% (124/352) 2024-12-18T00:03:38.4653317Z remote: Compressing objects: 36% (127/352) 2024-12-18T00:03:38.4658699Z remote: Compressing objects: 37% (131/352) 2024-12-18T00:03:38.4665839Z remote: Compressing objects: 38% (134/352) 2024-12-18T00:03:38.4666934Z remote: Compressing objects: 39% (138/352) 2024-12-18T00:03:38.4669812Z remote: Compressing objects: 40% (141/352) 2024-12-18T00:03:38.4673367Z remote: Compressing objects: 41% (145/352) 2024-12-18T00:03:38.4681678Z remote: Compressing objects: 42% (148/352) 2024-12-18T00:03:38.4682172Z remote: Compressing objects: 43% (152/352) 2024-12-18T00:03:38.4683685Z remote: Compressing objects: 44% (155/352) 2024-12-18T00:03:38.4688003Z remote: Compressing objects: 45% (159/352) 2024-12-18T00:03:38.4691855Z remote: Compressing objects: 46% (162/352) 2024-12-18T00:03:38.4695159Z remote: Compressing objects: 47% (166/352) 2024-12-18T00:03:38.4697172Z remote: Compressing objects: 48% (169/352) 2024-12-18T00:03:38.4698826Z remote: Compressing objects: 49% (173/352) 2024-12-18T00:03:38.4700628Z remote: Compressing objects: 50% (176/352) 2024-12-18T00:03:38.4703152Z remote: Compressing objects: 51% (180/352) 2024-12-18T00:03:38.4704488Z remote: Compressing objects: 52% (184/352) 2024-12-18T00:03:38.4706605Z remote: Compressing objects: 53% (187/352) 2024-12-18T00:03:38.4708511Z remote: Compressing objects: 54% (191/352) 2024-12-18T00:03:38.4710186Z remote: Compressing objects: 55% (194/352) 2024-12-18T00:03:38.4714255Z remote: Compressing objects: 56% (198/352) 2024-12-18T00:03:38.4715646Z remote: Compressing objects: 57% (201/352) 2024-12-18T00:03:38.4717128Z remote: Compressing objects: 58% (205/352) 2024-12-18T00:03:38.4720333Z remote: Compressing objects: 59% (208/352) 2024-12-18T00:03:38.4723133Z remote: Compressing objects: 60% (212/352) 2024-12-18T00:03:38.4724464Z remote: Compressing objects: 61% (215/352) 2024-12-18T00:03:38.4725871Z remote: Compressing objects: 62% (219/352) 2024-12-18T00:03:38.4730197Z remote: Compressing objects: 63% (222/352) 2024-12-18T00:03:38.4733969Z remote: Compressing objects: 64% (226/352) 2024-12-18T00:03:38.4737551Z remote: Compressing objects: 65% (229/352) 2024-12-18T00:03:38.4739816Z remote: Compressing objects: 66% (233/352) 2024-12-18T00:03:38.4742483Z remote: Compressing objects: 67% (236/352) 2024-12-18T00:03:38.4743830Z remote: Compressing objects: 68% (240/352) 2024-12-18T00:03:38.4747953Z remote: Compressing objects: 69% (243/352) 2024-12-18T00:03:38.4749552Z remote: Compressing objects: 70% (247/352) 2024-12-18T00:03:38.4752677Z remote: Compressing objects: 71% (250/352) 2024-12-18T00:03:38.4753995Z remote: Compressing objects: 72% (254/352) 2024-12-18T00:03:38.4755438Z remote: Compressing objects: 73% (257/352) 2024-12-18T00:03:38.4756551Z remote: Compressing objects: 74% (261/352) 2024-12-18T00:03:38.4757866Z remote: Compressing objects: 75% (264/352) 2024-12-18T00:03:38.4759157Z remote: Compressing objects: 76% (268/352) 2024-12-18T00:03:38.4760613Z remote: Compressing objects: 77% (272/352) 2024-12-18T00:03:38.4761079Z remote: Compressing objects: 78% (275/352) 2024-12-18T00:03:38.4761720Z remote: Compressing objects: 79% (279/352) 2024-12-18T00:03:38.4763120Z remote: Compressing objects: 80% (282/352) 2024-12-18T00:03:38.4765666Z remote: Compressing objects: 81% (286/352) 2024-12-18T00:03:38.4767361Z remote: Compressing objects: 82% (289/352) 2024-12-18T00:03:38.4769564Z remote: Compressing objects: 83% (293/352) 2024-12-18T00:03:38.4771819Z remote: Compressing objects: 84% (296/352) 2024-12-18T00:03:38.4773659Z remote: Compressing objects: 85% (300/352) 2024-12-18T00:03:38.4775331Z remote: Compressing objects: 86% (303/352) 2024-12-18T00:03:38.4777418Z remote: Compressing objects: 87% (307/352) 2024-12-18T00:03:38.4778648Z remote: Compressing objects: 88% (310/352) 2024-12-18T00:03:38.4779955Z remote: Compressing objects: 89% (314/352) 2024-12-18T00:03:38.4781191Z remote: Compressing objects: 90% (317/352) 2024-12-18T00:03:38.4781649Z remote: Compressing objects: 91% (321/352) 2024-12-18T00:03:38.4782324Z remote: Compressing objects: 92% (324/352) 2024-12-18T00:03:38.4782785Z remote: Compressing objects: 93% (328/352) 2024-12-18T00:03:38.4783633Z remote: Compressing objects: 94% (331/352) 2024-12-18T00:03:38.4784883Z remote: Compressing objects: 95% (335/352) 2024-12-18T00:03:38.4786246Z remote: Compressing objects: 96% (338/352) 2024-12-18T00:03:38.4786703Z remote: Compressing objects: 97% (342/352) 2024-12-18T00:03:38.4787176Z remote: Compressing objects: 98% (345/352) 2024-12-18T00:03:38.4787638Z remote: Compressing objects: 99% (349/352) 2024-12-18T00:03:38.4788111Z remote: Compressing objects: 100% (352/352) 2024-12-18T00:03:38.4788605Z remote: Compressing objects: 100% (352/352), done. 2024-12-18T00:04:00.6279936Z remote: Total 1057261 (delta 697), reused 548 (delta 524), pack-reused 1056385 (from 3) 2024-12-18T00:04:21.6738432Z [command]/usr/bin/git rev-parse --verify --quiet 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7^{object} 2024-12-18T00:04:21.6759473Z 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:04:21.6761815Z ##[endgroup] 2024-12-18T00:04:21.6762301Z ##[group]Determining the checkout info 2024-12-18T00:04:21.6762847Z ##[endgroup] 2024-12-18T00:04:21.6763298Z ##[group]Checking out the ref 2024-12-18T00:04:21.6765603Z [command]/usr/bin/git checkout --quiet --force 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:04:23.0756474Z ##[endgroup] 2024-12-18T00:04:23.0757057Z ##[group]Setting up auth for fetching submodules 2024-12-18T00:04:23.0759375Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-12-18T00:04:23.0800541Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-12-18T00:04:23.0819980Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-12-18T00:04:23.0842017Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-12-18T00:04:23.0865363Z ##[endgroup] 2024-12-18T00:04:23.0865856Z ##[group]Fetching submodules 2024-12-18T00:04:23.0866260Z [command]/usr/bin/git submodule sync --recursive 2024-12-18T00:04:23.1141225Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-12-18T00:04:23.1407897Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-12-18T00:04:23.1409394Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-12-18T00:04:23.1410589Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-12-18T00:04:23.1411745Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-12-18T00:04:23.1415713Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX' 2024-12-18T00:04:23.1418490Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-12-18T00:04:23.1420379Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-12-18T00:04:23.1422761Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-12-18T00:04:23.1425273Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel' 2024-12-18T00:04:23.1427637Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-12-18T00:04:23.1430067Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-12-18T00:04:23.1432838Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-12-18T00:04:23.1435466Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-12-18T00:04:23.1438224Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-12-18T00:04:23.1441041Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-12-18T00:04:23.1443980Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-12-18T00:04:23.1448311Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-12-18T00:04:23.1451737Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:04:23.1454749Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-12-18T00:04:23.1458223Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-12-18T00:04:23.1461412Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-12-18T00:04:23.1464894Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-12-18T00:04:23.1468212Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-12-18T00:04:23.1471692Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-12-18T00:04:23.1475206Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-12-18T00:04:23.1478785Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-12-18T00:04:23.1482746Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-12-18T00:04:23.1486859Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-12-18T00:04:23.1490610Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-12-18T00:04:23.1494483Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-12-18T00:04:23.1498461Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-12-18T00:04:23.1502834Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-12-18T00:04:23.1506957Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-12-18T00:04:23.1512678Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-12-18T00:04:23.1517105Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-12-18T00:04:23.1521588Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-12-18T00:04:23.1548621Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-12-18T00:04:23.4567662Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-12-18T00:04:23.6488668Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-12-18T00:04:23.9195715Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-12-18T00:04:24.1666739Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'... 2024-12-18T00:04:24.5235867Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-12-18T00:04:26.3058935Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-12-18T00:04:35.6212876Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-12-18T00:04:36.0623505Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/composable_kernel'... 2024-12-18T00:04:38.1766553Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-12-18T00:04:38.6336271Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-12-18T00:04:39.2458219Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-12-18T00:04:40.3868713Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-12-18T00:04:42.4177444Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-12-18T00:04:48.2929324Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-12-18T00:04:49.7277283Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-12-18T00:04:50.8187886Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-12-18T00:04:51.9003065Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-12-18T00:04:52.3757269Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-12-18T00:04:52.7741081Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-12-18T00:04:53.7773572Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-12-18T00:04:54.1586154Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-12-18T00:04:54.4820567Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-12-18T00:04:56.0161967Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-12-18T00:04:56.8556104Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-12-18T00:04:57.2180857Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-12-18T00:05:03.4346174Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-12-18T00:05:05.3099576Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-12-18T00:05:08.8737979Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-12-18T00:05:09.1821692Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-12-18T00:05:17.5518283Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-12-18T00:05:17.7555223Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-12-18T00:05:17.9871623Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-12-18T00:05:18.9901184Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-12-18T00:05:19.3432629Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-12-18T00:05:19.9460172Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-12-18T00:05:20.3705377Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-12-18T00:05:20.3831892Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-12-18T00:05:20.3920930Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-12-18T00:05:20.4142808Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-12-18T00:05:20.4456379Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1' 2024-12-18T00:05:20.4807042Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-12-18T00:05:21.1537540Z Submodule path 'third_party/XNNPACK': checked out '4ea82e595b36106653175dcb04b2aa532660d0d8' 2024-12-18T00:05:21.1758625Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-12-18T00:05:21.3944652Z Submodule path 'third_party/composable_kernel': checked out '50ee4267e27b875d149e642f4cebd47be1dc3b57' 2024-12-18T00:05:21.4411330Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-12-18T00:05:21.5364017Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99' 2024-12-18T00:05:21.5676303Z Submodule path 'third_party/cudnn_frontend': checked out '936021bfed8c91dc416af1588b2c4eca631a9e45' 2024-12-18T00:05:22.0489848Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-12-18T00:05:22.2937767Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-12-18T00:05:22.3853771Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-12-18T00:05:22.3868890Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:05:22.3872495Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:05:22.3873737Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:05:22.3874982Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:05:22.3876569Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:05:22.3909761Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-12-18T00:05:23.2391932Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-12-18T00:05:23.8590243Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-12-18T00:05:25.8844020Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-12-18T00:05:26.8308711Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-12-18T00:05:27.1951038Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-12-18T00:05:27.2901283Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-12-18T00:05:27.6766353Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-12-18T00:05:27.7357649Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-12-18T00:05:27.7466945Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-12-18T00:05:27.8685390Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-12-18T00:05:27.9054251Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-12-18T00:05:27.9414972Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-12-18T00:05:27.9663893Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-12-18T00:05:28.0071701Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59' 2024-12-18T00:05:28.0206692Z Submodule path 'third_party/ideep': checked out 'c7ccd5bdbe5434ba156f4e856dcef0601637334b' 2024-12-18T00:05:28.0221165Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-12-18T00:05:28.0243549Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-12-18T00:05:40.7630674Z Submodule path 'third_party/ideep/mkl-dnn': checked out '66f0cb9eb66affd2da3bf5f8d897376f04aae6af' 2024-12-18T00:05:40.7798138Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-12-18T00:05:40.8644238Z Submodule path 'third_party/kineto': checked out '338140f58a28d599da3434ced4fd2d75dd1a213d' 2024-12-18T00:05:40.8663853Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:05:40.8665325Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:05:40.8667034Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:05:40.8689245Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-12-18T00:05:41.7423881Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-12-18T00:05:42.7600083Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-12-18T00:05:43.7511653Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-12-18T00:05:43.7525307Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:05:43.7527486Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:05:43.7529107Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:05:43.7530775Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:05:43.7532178Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:05:43.7533909Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:05:43.7535654Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:05:43.7537579Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:05:43.7564701Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-12-18T00:05:44.6818350Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-12-18T00:05:45.0601877Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-12-18T00:05:46.0990100Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-12-18T00:05:46.4760165Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-12-18T00:05:46.9229404Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-12-18T00:05:47.9021095Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-12-18T00:05:54.7252507Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-12-18T00:05:55.1188933Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-12-18T00:05:55.1361455Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-12-18T00:05:55.1700690Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-12-18T00:05:55.1820550Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-12-18T00:05:55.1840249Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:05:55.1861364Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-12-18T00:05:55.4906730Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-12-18T00:05:55.5074247Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-12-18T00:05:55.5450993Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-12-18T00:05:55.6458013Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-12-18T00:05:55.6601429Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-12-18T00:05:55.6973065Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-12-18T00:05:55.7509739Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-12-18T00:05:55.7852413Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-12-18T00:05:55.8131523Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-12-18T00:05:55.9158732Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-12-18T00:05:56.2463295Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c' 2024-12-18T00:05:56.2496357Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-12-18T00:05:56.2518341Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-12-18T00:05:57.3788508Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-12-18T00:05:57.4449764Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-12-18T00:05:57.4469883Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:05:57.4472519Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:05:57.4473880Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:05:57.4475199Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:05:57.4476802Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:05:57.4478531Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:05:57.4480123Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:05:57.4481712Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:05:57.4509754Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-12-18T00:05:57.8576081Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-12-18T00:05:58.7908221Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-12-18T00:05:59.1067859Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-12-18T00:06:05.2952047Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-12-18T00:06:05.5962989Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-12-18T00:06:05.8146077Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-12-18T00:06:06.1596733Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-12-18T00:06:14.6832212Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-12-18T00:06:14.7215024Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-12-18T00:06:14.7357320Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-12-18T00:06:14.8310945Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-12-18T00:06:14.8426541Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-12-18T00:06:14.8558587Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-12-18T00:06:14.8694824Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-12-18T00:06:14.8706339Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:06:14.8709932Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:06:14.8731466Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-12-18T00:06:16.4467359Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-12-18T00:06:17.6287733Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-12-18T00:06:17.6727958Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-12-18T00:06:18.0960894Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-12-18T00:06:18.1071892Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-12-18T00:06:18.3741645Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-12-18T00:06:18.3766376Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:06:18.3768570Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-12-18T00:06:18.3789878Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-12-18T00:06:18.8522012Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-12-18T00:06:19.7972633Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-12-18T00:06:19.8649150Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-12-18T00:06:19.8732704Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-12-18T00:06:19.8843283Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-12-18T00:06:19.9182804Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2024-12-18T00:06:19.9458728Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-12-18T00:06:19.9852077Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-12-18T00:06:20.0097588Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-12-18T00:06:20.0112675Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:06:20.0114019Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:06:20.0115235Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:06:20.0117328Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:06:20.0142076Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-12-18T00:06:20.9077203Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-12-18T00:06:21.1583528Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-12-18T00:06:23.2795795Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-12-18T00:06:24.4729361Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-12-18T00:06:24.4882878Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-12-18T00:06:24.5449749Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-12-18T00:06:24.5725693Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-12-18T00:06:24.5743275Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:06:24.5764996Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-12-18T00:06:24.8388067Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-12-18T00:06:24.8422365Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-12-18T00:06:24.8689024Z Entering 'android/libs/fbjni' 2024-12-18T00:06:24.8740838Z Entering 'third_party/FP16' 2024-12-18T00:06:24.8782602Z Entering 'third_party/FXdiv' 2024-12-18T00:06:24.8818650Z Entering 'third_party/NNPACK' 2024-12-18T00:06:24.8865117Z Entering 'third_party/NVTX' 2024-12-18T00:06:24.8904677Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:06:24.8941744Z Entering 'third_party/XNNPACK' 2024-12-18T00:06:24.8995717Z Entering 'third_party/benchmark' 2024-12-18T00:06:24.9044082Z Entering 'third_party/composable_kernel' 2024-12-18T00:06:24.9093154Z Entering 'third_party/cpp-httplib' 2024-12-18T00:06:24.9140685Z Entering 'third_party/cpuinfo' 2024-12-18T00:06:24.9184741Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:06:24.9224434Z Entering 'third_party/cutlass' 2024-12-18T00:06:24.9274520Z Entering 'third_party/eigen' 2024-12-18T00:06:24.9325424Z Entering 'third_party/fbgemm' 2024-12-18T00:06:24.9369937Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:06:24.9411734Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:06:24.9448755Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:06:24.9489223Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:06:24.9526699Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:06:24.9563135Z Entering 'third_party/flatbuffers' 2024-12-18T00:06:24.9604648Z Entering 'third_party/fmt' 2024-12-18T00:06:24.9641822Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:06:24.9682949Z Entering 'third_party/gloo' 2024-12-18T00:06:24.9722110Z Entering 'third_party/googletest' 2024-12-18T00:06:24.9765029Z Entering 'third_party/ideep' 2024-12-18T00:06:24.9800021Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:06:24.9851447Z Entering 'third_party/ittapi' 2024-12-18T00:06:24.9892147Z Entering 'third_party/kineto' 2024-12-18T00:06:24.9932940Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:06:24.9969440Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:06:25.0014494Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:06:25.0052190Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:06:25.0093230Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:06:25.0140323Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:06:25.0186306Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:06:25.0221919Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:06:25.0256685Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:06:25.0301095Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:06:25.0344924Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:06:25.0380428Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:06:25.0421015Z Entering 'third_party/mimalloc' 2024-12-18T00:06:25.0462974Z Entering 'third_party/nccl/nccl' 2024-12-18T00:06:25.0504665Z Entering 'third_party/nlohmann' 2024-12-18T00:06:25.0545529Z Entering 'third_party/onnx' 2024-12-18T00:06:25.0600022Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:06:25.0644404Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:06:25.0687159Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:06:25.0721218Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:06:25.0762770Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:06:25.0803577Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:06:25.0839892Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:06:25.0880560Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:06:25.0915664Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:06:25.0959376Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:06:25.1003767Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:06:25.1046419Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:06:25.1100599Z Entering 'third_party/pocketfft' 2024-12-18T00:06:25.1144244Z Entering 'third_party/protobuf' 2024-12-18T00:06:25.1183674Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:06:25.1220552Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:06:25.1266434Z Entering 'third_party/psimd' 2024-12-18T00:06:25.1302445Z Entering 'third_party/pthreadpool' 2024-12-18T00:06:25.1345355Z Entering 'third_party/pybind11' 2024-12-18T00:06:25.1391077Z Entering 'third_party/python-peachpy' 2024-12-18T00:06:25.1435581Z Entering 'third_party/sleef' 2024-12-18T00:06:25.1481003Z Entering 'third_party/tensorpipe' 2024-12-18T00:06:25.1521192Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:06:25.1557285Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:06:25.1602050Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:06:25.1644627Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:06:25.1683871Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:06:25.1740156Z ##[endgroup] 2024-12-18T00:06:25.1742362Z ##[group]Persisting credentials for submodules 2024-12-18T00:06:25.1744394Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-12-18T00:06:25.2002277Z Entering 'android/libs/fbjni' 2024-12-18T00:06:25.2060429Z Entering 'third_party/FP16' 2024-12-18T00:06:25.2110291Z Entering 'third_party/FXdiv' 2024-12-18T00:06:25.2164198Z Entering 'third_party/NNPACK' 2024-12-18T00:06:25.2216496Z Entering 'third_party/NVTX' 2024-12-18T00:06:25.2270360Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:06:25.2324448Z Entering 'third_party/XNNPACK' 2024-12-18T00:06:25.2390537Z Entering 'third_party/benchmark' 2024-12-18T00:06:25.2438591Z Entering 'third_party/composable_kernel' 2024-12-18T00:06:25.2494980Z Entering 'third_party/cpp-httplib' 2024-12-18T00:06:25.2546783Z Entering 'third_party/cpuinfo' 2024-12-18T00:06:25.2594028Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:06:25.2646840Z Entering 'third_party/cutlass' 2024-12-18T00:06:25.2706346Z Entering 'third_party/eigen' 2024-12-18T00:06:25.2757350Z Entering 'third_party/fbgemm' 2024-12-18T00:06:25.2809226Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:06:25.2862944Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:06:25.2916375Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:06:25.2966456Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:06:25.3020788Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:06:25.3075763Z Entering 'third_party/flatbuffers' 2024-12-18T00:06:25.3129816Z Entering 'third_party/fmt' 2024-12-18T00:06:25.3183997Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:06:25.3236746Z Entering 'third_party/gloo' 2024-12-18T00:06:25.3290613Z Entering 'third_party/googletest' 2024-12-18T00:06:25.3343613Z Entering 'third_party/ideep' 2024-12-18T00:06:25.3389269Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:06:25.3451706Z Entering 'third_party/ittapi' 2024-12-18T00:06:25.3512153Z Entering 'third_party/kineto' 2024-12-18T00:06:25.3559355Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:06:25.3610325Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:06:25.3671584Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:06:25.3723918Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:06:25.3772814Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:06:25.3824276Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:06:25.3881554Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:06:25.3927102Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:06:25.3973468Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:06:25.4029583Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:06:25.4076915Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:06:25.4121094Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:06:25.4170207Z Entering 'third_party/mimalloc' 2024-12-18T00:06:25.4226174Z Entering 'third_party/nccl/nccl' 2024-12-18T00:06:25.4281521Z Entering 'third_party/nlohmann' 2024-12-18T00:06:25.4329109Z Entering 'third_party/onnx' 2024-12-18T00:06:25.4396285Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:06:25.4452635Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:06:25.4502109Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:06:25.4562416Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:06:25.4611167Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:06:25.4662979Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:06:25.4717765Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:06:25.4762651Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:06:25.4806509Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:06:25.4859375Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:06:25.4910412Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:06:25.4966797Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:06:25.5035260Z Entering 'third_party/pocketfft' 2024-12-18T00:06:25.5081460Z Entering 'third_party/protobuf' 2024-12-18T00:06:25.5136113Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:06:25.5189302Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:06:25.5243992Z Entering 'third_party/psimd' 2024-12-18T00:06:25.5295256Z Entering 'third_party/pthreadpool' 2024-12-18T00:06:25.5343666Z Entering 'third_party/pybind11' 2024-12-18T00:06:25.5395303Z Entering 'third_party/python-peachpy' 2024-12-18T00:06:25.5446918Z Entering 'third_party/sleef' 2024-12-18T00:06:25.5506096Z Entering 'third_party/tensorpipe' 2024-12-18T00:06:25.5551509Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:06:25.5600818Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:06:25.5646208Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:06:25.5700022Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:06:25.5751044Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:06:25.5821458Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-12-18T00:06:25.6109917Z Entering 'android/libs/fbjni' 2024-12-18T00:06:25.6157771Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-12-18T00:06:25.6171741Z Entering 'third_party/FP16' 2024-12-18T00:06:25.6214995Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-12-18T00:06:25.6227628Z Entering 'third_party/FXdiv' 2024-12-18T00:06:25.6269610Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-12-18T00:06:25.6283765Z Entering 'third_party/NNPACK' 2024-12-18T00:06:25.6329544Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-12-18T00:06:25.6343433Z Entering 'third_party/NVTX' 2024-12-18T00:06:25.6385563Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2024-12-18T00:06:25.6399751Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:06:25.6441740Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-12-18T00:06:25.6459212Z Entering 'third_party/XNNPACK' 2024-12-18T00:06:25.6499729Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-12-18T00:06:25.6530050Z Entering 'third_party/benchmark' 2024-12-18T00:06:25.6569320Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:06:25.6584912Z Entering 'third_party/composable_kernel' 2024-12-18T00:06:25.6627293Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2024-12-18T00:06:25.6647123Z Entering 'third_party/cpp-httplib' 2024-12-18T00:06:25.6688650Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-12-18T00:06:25.6701007Z Entering 'third_party/cpuinfo' 2024-12-18T00:06:25.6747770Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-12-18T00:06:25.6762488Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:06:25.6803727Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-12-18T00:06:25.6818184Z Entering 'third_party/cutlass' 2024-12-18T00:06:25.6862147Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-12-18T00:06:25.6883952Z Entering 'third_party/eigen' 2024-12-18T00:06:25.6924785Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-12-18T00:06:25.6941539Z Entering 'third_party/fbgemm' 2024-12-18T00:06:25.6982793Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-12-18T00:06:25.6997052Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:06:25.7039895Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-12-18T00:06:25.7057002Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:06:25.7099944Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-12-18T00:06:25.7112833Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:06:25.7155816Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-12-18T00:06:25.7176410Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:06:25.7220059Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:06:25.7233395Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:06:25.7273311Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-12-18T00:06:25.7289645Z Entering 'third_party/flatbuffers' 2024-12-18T00:06:25.7331597Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-12-18T00:06:25.7351315Z Entering 'third_party/fmt' 2024-12-18T00:06:25.7393400Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-12-18T00:06:25.7411303Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:06:25.7451741Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-12-18T00:06:25.7466622Z Entering 'third_party/gloo' 2024-12-18T00:06:25.7504846Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-12-18T00:06:25.7520744Z Entering 'third_party/googletest' 2024-12-18T00:06:25.7561278Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:06:25.7574904Z Entering 'third_party/ideep' 2024-12-18T00:06:25.7618212Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-12-18T00:06:25.7632288Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:06:25.7672471Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-12-18T00:06:25.7694170Z Entering 'third_party/ittapi' 2024-12-18T00:06:25.7735451Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-12-18T00:06:25.7749530Z Entering 'third_party/kineto' 2024-12-18T00:06:25.7795818Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-12-18T00:06:25.7808387Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:06:25.7851343Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-12-18T00:06:25.7864323Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:06:25.7905993Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-12-18T00:06:25.7919308Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:06:25.7976103Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-12-18T00:06:25.7977674Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:06:25.8023100Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-12-18T00:06:25.8035027Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:06:25.8080017Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-12-18T00:06:25.8096299Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:06:25.8138822Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-12-18T00:06:25.8152688Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:06:25.8195834Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-12-18T00:06:25.8207738Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:06:25.8250213Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:06:25.8265408Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:06:25.8305470Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-12-18T00:06:25.8320107Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:06:25.8362232Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-12-18T00:06:25.8377187Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:06:25.8419269Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-12-18T00:06:25.8433512Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:06:25.8475237Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-12-18T00:06:25.8489994Z Entering 'third_party/mimalloc' 2024-12-18T00:06:25.8532605Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-12-18T00:06:25.8546438Z Entering 'third_party/nccl/nccl' 2024-12-18T00:06:25.8587895Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-12-18T00:06:25.8600383Z Entering 'third_party/nlohmann' 2024-12-18T00:06:25.8644122Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-12-18T00:06:25.8659208Z Entering 'third_party/onnx' 2024-12-18T00:06:25.8698671Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-12-18T00:06:25.8729152Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:06:25.8767256Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:06:25.8785179Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:06:25.8831597Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-12-18T00:06:25.8846394Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:06:25.8889371Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:06:25.8900948Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:06:25.8944580Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:06:25.8957800Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:06:25.8996847Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-12-18T00:06:25.9011422Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:06:25.9057441Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-12-18T00:06:25.9070291Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:06:25.9114179Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-12-18T00:06:25.9129754Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:06:25.9169568Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-12-18T00:06:25.9188164Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:06:25.9229751Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-12-18T00:06:25.9243029Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:06:25.9284829Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-12-18T00:06:25.9298936Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:06:25.9340987Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-12-18T00:06:25.9357350Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:06:25.9398985Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-12-18T00:06:25.9432173Z Entering 'third_party/pocketfft' 2024-12-18T00:06:25.9472961Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-12-18T00:06:25.9486798Z Entering 'third_party/protobuf' 2024-12-18T00:06:25.9528131Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-12-18T00:06:25.9545305Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:06:25.9589746Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:06:25.9606983Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:06:25.9647307Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:06:25.9670120Z Entering 'third_party/psimd' 2024-12-18T00:06:25.9716978Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-12-18T00:06:25.9729640Z Entering 'third_party/pthreadpool' 2024-12-18T00:06:25.9771283Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-12-18T00:06:25.9784956Z Entering 'third_party/pybind11' 2024-12-18T00:06:25.9827208Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:06:25.9841212Z Entering 'third_party/python-peachpy' 2024-12-18T00:06:25.9881729Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-12-18T00:06:25.9895537Z Entering 'third_party/sleef' 2024-12-18T00:06:25.9939794Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-12-18T00:06:25.9953070Z Entering 'third_party/tensorpipe' 2024-12-18T00:06:25.9998017Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-12-18T00:06:26.0010090Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:06:26.0052340Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:06:26.0064165Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:06:26.0104944Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-12-18T00:06:26.0118589Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:06:26.0159423Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-12-18T00:06:26.0172796Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:06:26.0216125Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:06:26.0226348Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:06:26.0268780Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-12-18T00:06:26.0832709Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-12-18T00:06:26.1099720Z Entering 'android/libs/fbjni' 2024-12-18T00:06:26.1136570Z Entering 'third_party/FP16' 2024-12-18T00:06:26.1179218Z Entering 'third_party/FXdiv' 2024-12-18T00:06:26.1224411Z Entering 'third_party/NNPACK' 2024-12-18T00:06:26.1265607Z Entering 'third_party/NVTX' 2024-12-18T00:06:26.1302768Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:06:26.1345125Z Entering 'third_party/XNNPACK' 2024-12-18T00:06:26.1403945Z Entering 'third_party/benchmark' 2024-12-18T00:06:26.1445744Z Entering 'third_party/composable_kernel' 2024-12-18T00:06:26.1490015Z Entering 'third_party/cpp-httplib' 2024-12-18T00:06:26.1533275Z Entering 'third_party/cpuinfo' 2024-12-18T00:06:26.1577796Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:06:26.1614065Z Entering 'third_party/cutlass' 2024-12-18T00:06:26.1659976Z Entering 'third_party/eigen' 2024-12-18T00:06:26.1697527Z Entering 'third_party/fbgemm' 2024-12-18T00:06:26.1742562Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:06:26.1783932Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:06:26.1822873Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:06:26.1870974Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:06:26.1911926Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:06:26.1956396Z Entering 'third_party/flatbuffers' 2024-12-18T00:06:26.1996019Z Entering 'third_party/fmt' 2024-12-18T00:06:26.2039929Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:06:26.2083950Z Entering 'third_party/gloo' 2024-12-18T00:06:26.2124740Z Entering 'third_party/googletest' 2024-12-18T00:06:26.2170843Z Entering 'third_party/ideep' 2024-12-18T00:06:26.2211618Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:06:26.2263251Z Entering 'third_party/ittapi' 2024-12-18T00:06:26.2303982Z Entering 'third_party/kineto' 2024-12-18T00:06:26.2341695Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:06:26.2381967Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:06:26.2421692Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:06:26.2457318Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:06:26.2501697Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:06:26.2543129Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:06:26.2580952Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:06:26.2615718Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:06:26.2654317Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:06:26.2694874Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:06:26.2734837Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:06:26.2773603Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:06:26.2816059Z Entering 'third_party/mimalloc' 2024-12-18T00:06:26.2857655Z Entering 'third_party/nccl/nccl' 2024-12-18T00:06:26.2904554Z Entering 'third_party/nlohmann' 2024-12-18T00:06:26.2944589Z Entering 'third_party/onnx' 2024-12-18T00:06:26.2998440Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:06:26.3040617Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:06:26.3085833Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:06:26.3133365Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:06:26.3174222Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:06:26.3213226Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:06:26.3253527Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:06:26.3288966Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:06:26.3322945Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:06:26.3357298Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:06:26.3402470Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:06:26.3444218Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:06:26.3503193Z Entering 'third_party/pocketfft' 2024-12-18T00:06:26.3538679Z Entering 'third_party/protobuf' 2024-12-18T00:06:26.3586435Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:06:26.3620945Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:06:26.3666279Z Entering 'third_party/psimd' 2024-12-18T00:06:26.3703329Z Entering 'third_party/pthreadpool' 2024-12-18T00:06:26.3744723Z Entering 'third_party/pybind11' 2024-12-18T00:06:26.3784275Z Entering 'third_party/python-peachpy' 2024-12-18T00:06:26.3823767Z Entering 'third_party/sleef' 2024-12-18T00:06:26.3864227Z Entering 'third_party/tensorpipe' 2024-12-18T00:06:26.3907582Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:06:26.3949003Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:06:26.3991789Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:06:26.4034504Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:06:26.4071665Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:06:26.4130095Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-12-18T00:06:26.4396486Z Entering 'android/libs/fbjni' 2024-12-18T00:06:26.4433647Z Entering 'third_party/FP16' 2024-12-18T00:06:26.4475741Z Entering 'third_party/FXdiv' 2024-12-18T00:06:26.4512149Z Entering 'third_party/NNPACK' 2024-12-18T00:06:26.4549817Z Entering 'third_party/NVTX' 2024-12-18T00:06:26.4595078Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:06:26.4640586Z Entering 'third_party/XNNPACK' 2024-12-18T00:06:26.4695907Z Entering 'third_party/benchmark' 2024-12-18T00:06:26.4736202Z Entering 'third_party/composable_kernel' 2024-12-18T00:06:26.4786486Z Entering 'third_party/cpp-httplib' 2024-12-18T00:06:26.4834877Z Entering 'third_party/cpuinfo' 2024-12-18T00:06:26.4876113Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:06:26.4921234Z Entering 'third_party/cutlass' 2024-12-18T00:06:26.4970474Z Entering 'third_party/eigen' 2024-12-18T00:06:26.5007018Z Entering 'third_party/fbgemm' 2024-12-18T00:06:26.5044679Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:06:26.5087272Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:06:26.5125470Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:06:26.5171531Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:06:26.5212433Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:06:26.5255643Z Entering 'third_party/flatbuffers' 2024-12-18T00:06:26.5297155Z Entering 'third_party/fmt' 2024-12-18T00:06:26.5341011Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:06:26.5381783Z Entering 'third_party/gloo' 2024-12-18T00:06:26.5418021Z Entering 'third_party/googletest' 2024-12-18T00:06:26.5463811Z Entering 'third_party/ideep' 2024-12-18T00:06:26.5500086Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:06:26.5552017Z Entering 'third_party/ittapi' 2024-12-18T00:06:26.5590050Z Entering 'third_party/kineto' 2024-12-18T00:06:26.5631923Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:06:26.5668277Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:06:26.5704691Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:06:26.5744445Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:06:26.5786251Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:06:26.5823832Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:06:26.5866640Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:06:26.5904469Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:06:26.5940589Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:06:26.5984739Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:06:26.6022333Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:06:26.6057384Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:06:26.6094825Z Entering 'third_party/mimalloc' 2024-12-18T00:06:26.6140310Z Entering 'third_party/nccl/nccl' 2024-12-18T00:06:26.6183864Z Entering 'third_party/nlohmann' 2024-12-18T00:06:26.6222046Z Entering 'third_party/onnx' 2024-12-18T00:06:26.6271169Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:06:26.6312431Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:06:26.6353896Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:06:26.6393317Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:06:26.6433767Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:06:26.6480106Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:06:26.6525262Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:06:26.6564204Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:06:26.6603234Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:06:26.6638388Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:06:26.6675430Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:06:26.6722472Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:06:26.6780202Z Entering 'third_party/pocketfft' 2024-12-18T00:06:26.6816417Z Entering 'third_party/protobuf' 2024-12-18T00:06:26.6862555Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:06:26.6902775Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:06:26.6945092Z Entering 'third_party/psimd' 2024-12-18T00:06:26.6983378Z Entering 'third_party/pthreadpool' 2024-12-18T00:06:26.7030859Z Entering 'third_party/pybind11' 2024-12-18T00:06:26.7073006Z Entering 'third_party/python-peachpy' 2024-12-18T00:06:26.7112615Z Entering 'third_party/sleef' 2024-12-18T00:06:26.7154067Z Entering 'third_party/tensorpipe' 2024-12-18T00:06:26.7194798Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:06:26.7241380Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:06:26.7283496Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:06:26.7322404Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:06:26.7360149Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:06:26.7416097Z ##[endgroup] 2024-12-18T00:06:26.7448093Z [command]/usr/bin/git log -1 --format='%H' 2024-12-18T00:06:26.7466714Z '0cdf8b1d09254cfda66191d1bd01e3041c3c76f7' 2024-12-18T00:06:26.7633291Z Prepare all required actions 2024-12-18T00:06:26.7634015Z Getting action download info 2024-12-18T00:06:26.9142779Z ##[group]Run ./.github/actions/setup-linux 2024-12-18T00:06:26.9143139Z env: 2024-12-18T00:06:26.9143368Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:26.9143671Z ##[endgroup] 2024-12-18T00:06:26.9191644Z ##[group]Run set -euo pipefail 2024-12-18T00:06:26.9192044Z set -euo pipefail 2024-12-18T00:06:26.9192356Z function get_ec2_metadata() { 2024-12-18T00:06:26.9192769Z  # Pulled from instance metadata endpoint for EC2 2024-12-18T00:06:26.9193436Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-12-18T00:06:26.9194031Z  category=$1 2024-12-18T00:06:26.9194425Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-12-18T00:06:26.9194900Z  runner_name_str=i-07b82df1ecbdd12be 2024-12-18T00:06:26.9195311Z  if [[ -f /.inarc ]]; then 2024-12-18T00:06:26.9195690Z  echo "ARC Runner, no info on ec2 metadata" 2024-12-18T00:06:26.9196108Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-12-18T00:06:26.9196615Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-12-18T00:06:26.9197079Z  else 2024-12-18T00:06:26.9197995Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-12-18T00:06:26.9198957Z  fi 2024-12-18T00:06:26.9199206Z } 2024-12-18T00:06:26.9199484Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-12-18T00:06:26.9199948Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-12-18T00:06:26.9200462Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-12-18T00:06:26.9200917Z echo "system info $(uname -a)" 2024-12-18T00:06:26.9208913Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:26.9209377Z env: 2024-12-18T00:06:26.9209624Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:26.9209937Z ##[endgroup] 2024-12-18T00:06:26.9344086Z ami-id: ami-0fff1b9a61dec8a5f 2024-12-18T00:06:26.9447124Z instance-id: i-07b82df1ecbdd12be 2024-12-18T00:06:26.9551447Z instance-type: g4dn.metal 2024-12-18T00:06:26.9561472Z system info Linux ip-10-0-78-168.ec2.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-12-18T00:06:26.9592303Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:06:26.9593440Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:06:26.9598455Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:26.9598871Z env: 2024-12-18T00:06:26.9599113Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:26.9599401Z ##[endgroup] 2024-12-18T00:06:26.9658576Z ##[group]Run if systemctl is-active --quiet docker; then 2024-12-18T00:06:26.9659052Z if systemctl is-active --quiet docker; then 2024-12-18T00:06:26.9659467Z  echo "Docker daemon is running..."; 2024-12-18T00:06:26.9659808Z else 2024-12-18T00:06:26.9660188Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-12-18T00:06:26.9660640Z fi 2024-12-18T00:06:26.9665014Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:26.9665421Z env: 2024-12-18T00:06:26.9665658Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:26.9665931Z ##[endgroup] 2024-12-18T00:06:26.9738843Z Docker daemon is running... 2024-12-18T00:06:26.9788608Z ##[group]Run nick-fields/retry@v3.0.0 2024-12-18T00:06:26.9788950Z with: 2024-12-18T00:06:26.9789209Z shell: bash 2024-12-18T00:06:26.9789645Z timeout_minutes: 5 2024-12-18T00:06:26.9789954Z max_attempts: 3 2024-12-18T00:06:26.9790316Z retry_wait_seconds: 30 2024-12-18T00:06:26.9792725Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-12-18T00:06:26.9795140Z polling_interval_seconds: 1 2024-12-18T00:06:26.9795485Z warning_on_retry: true 2024-12-18T00:06:26.9795801Z continue_on_error: false 2024-12-18T00:06:26.9796066Z env: 2024-12-18T00:06:26.9796321Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:26.9796643Z AWS_RETRY_MODE: standard 2024-12-18T00:06:26.9796954Z AWS_MAX_ATTEMPTS: 5 2024-12-18T00:06:26.9797226Z AWS_DEFAULT_REGION: us-east-1 2024-12-18T00:06:26.9797535Z ##[endgroup] 2024-12-18T00:06:28.1701058Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:06:28.1702979Z Configure a credential helper to remove this warning. See 2024-12-18T00:06:28.1704694Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:06:28.1705880Z 2024-12-18T00:06:28.1706148Z Login Succeeded 2024-12-18T00:06:29.1085293Z Command completed after 1 attempt(s). 2024-12-18T00:06:29.1155506Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:06:29.1156153Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:06:29.1156705Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:06:29.1162770Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:29.1163232Z env: 2024-12-18T00:06:29.1163510Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:29.1163835Z ##[endgroup] 2024-12-18T00:06:29.1252645Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T00:06:29.1253394Z # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T00:06:29.1254003Z # shellcheck disable=SC2046 2024-12-18T00:06:29.1254480Z docker stop $(docker ps -q) || true 2024-12-18T00:06:29.1254956Z # Prune all of the docker images 2024-12-18T00:06:29.1255460Z docker system prune -af 2024-12-18T00:06:29.1260790Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:29.1261291Z env: 2024-12-18T00:06:29.1261641Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:29.1262040Z ##[endgroup] 2024-12-18T00:06:29.1552149Z "docker stop" requires at least 1 argument. 2024-12-18T00:06:29.1552812Z See 'docker stop --help'. 2024-12-18T00:06:29.1553060Z 2024-12-18T00:06:29.1553362Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-12-18T00:06:29.1553724Z 2024-12-18T00:06:29.1553923Z Stop one or more running containers 2024-12-18T00:06:29.1723876Z Total reclaimed space: 0B 2024-12-18T00:06:29.1773345Z ##[group]Run set +e 2024-12-18T00:06:29.1773698Z set +e 2024-12-18T00:06:29.1773992Z set -x 2024-12-18T00:06:29.1774273Z  2024-12-18T00:06:29.1774573Z PT_DOMAIN=download.pytorch.org 2024-12-18T00:06:29.1775191Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-12-18T00:06:29.1776026Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-12-18T00:06:29.1776619Z # one is returned at random 2024-12-18T00:06:29.1777080Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-12-18T00:06:29.1777520Z  2024-12-18T00:06:29.1777974Z if [ -z "${RESOLVED_IP}" ]; then 2024-12-18T00:06:29.1778444Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-12-18T00:06:29.1779193Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-12-18T00:06:29.1779655Z  2024-12-18T00:06:29.1779947Z  if [ -z "${RESOLVED_IP}" ]; then 2024-12-18T00:06:29.1780390Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-12-18T00:06:29.1780781Z  exit 1 2024-12-18T00:06:29.1781062Z  fi 2024-12-18T00:06:29.1781320Z fi 2024-12-18T00:06:29.1781577Z  2024-12-18T00:06:29.1781882Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-12-18T00:06:29.1782274Z  # Clean up any old records first 2024-12-18T00:06:29.1782686Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-12-18T00:06:29.1783064Z fi 2024-12-18T00:06:29.1783323Z  2024-12-18T00:06:29.1783689Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-12-18T00:06:29.1784117Z cat /etc/hosts 2024-12-18T00:06:29.1789527Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:29.1789962Z env: 2024-12-18T00:06:29.1790223Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:29.1790534Z ##[endgroup] 2024-12-18T00:06:29.1813498Z + PT_DOMAIN=download.pytorch.org 2024-12-18T00:06:29.1818013Z ++ dig -4 +short download.pytorch.org 2024-12-18T00:06:29.1819246Z ++ tail -n1 2024-12-18T00:06:29.2377918Z + RESOLVED_IP=108.138.64.97 2024-12-18T00:06:29.2378448Z + '[' -z 108.138.64.97 ']' 2024-12-18T00:06:29.2378834Z + grep -r download.pytorch.org /etc/hosts 2024-12-18T00:06:29.2388708Z 3.167.99.89 download.pytorch.org 2024-12-18T00:06:29.2390306Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-12-18T00:06:29.3867879Z + echo '108.138.64.97 download.pytorch.org' 2024-12-18T00:06:29.3868349Z + sudo tee -a /etc/hosts 2024-12-18T00:06:29.4074216Z 108.138.64.97 download.pytorch.org 2024-12-18T00:06:29.4087080Z + cat /etc/hosts 2024-12-18T00:06:29.4095451Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-12-18T00:06:29.4100897Z ::1 localhost6 localhost6.localdomain6 2024-12-18T00:06:29.4101353Z 108.138.64.97 download.pytorch.org 2024-12-18T00:06:29.4272608Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@release/2.6 2024-12-18T00:06:29.4273208Z with: 2024-12-18T00:06:29.4274160Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:29.4275223Z docker-build-dir: .ci/docker 2024-12-18T00:06:29.4275556Z working-directory: . 2024-12-18T00:06:29.4275979Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:29.4276461Z force-push: false 2024-12-18T00:06:29.4276753Z env: 2024-12-18T00:06:29.4277029Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:29.4277325Z ##[endgroup] 2024-12-18T00:06:29.4308983Z ##[group]Run set -ex 2024-12-18T00:06:29.4309357Z set -ex 2024-12-18T00:06:29.4309674Z  2024-12-18T00:06:29.4310168Z # If the docker build directory or the build script doesn't exist, the action will 2024-12-18T00:06:29.4311036Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-12-18T00:06:29.4311705Z # job could then download the pre-built image as usual 2024-12-18T00:06:29.4312330Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-12-18T00:06:29.4312911Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4313459Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4313962Z  2024-12-18T00:06:29.4314503Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-12-18T00:06:29.4315090Z  exit 0 2024-12-18T00:06:29.4315371Z else 2024-12-18T00:06:29.4315685Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4316214Z fi 2024-12-18T00:06:29.4316482Z  2024-12-18T00:06:29.4316864Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-12-18T00:06:29.4317534Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-12-18T00:06:29.4318139Z  # use it as it is, but first let's extract the tag 2024-12-18T00:06:29.4318695Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-12-18T00:06:29.4319272Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4319824Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4320287Z else 2024-12-18T00:06:29.4320632Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-12-18T00:06:29.4321160Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4321867Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4322496Z fi 2024-12-18T00:06:29.4328365Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:29.4328808Z env: 2024-12-18T00:06:29.4329075Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:29.4329398Z REPO_NAME: pytorch 2024-12-18T00:06:29.4330333Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:29.4331326Z DOCKER_BUILD_DIR: .ci/docker 2024-12-18T00:06:29.4331730Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:29.4332175Z ##[endgroup] 2024-12-18T00:06:29.4352378Z + [[ ! -d .ci/docker ]] 2024-12-18T00:06:29.4352911Z + [[ ! -f .ci/docker/build.sh ]] 2024-12-18T00:06:29.4353250Z + echo skip=false 2024-12-18T00:06:29.4354756Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-12-18T00:06:29.4359772Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:29.4360791Z ++ awk -F '[:,]' '{print $2}' 2024-12-18T00:06:29.4379941Z + DOCKER_TAG=45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:29.4380932Z + echo docker-tag=45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:29.4382196Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:29.4422485Z ##[group]Run set +e 2024-12-18T00:06:29.4422863Z set +e 2024-12-18T00:06:29.4423129Z set -x 2024-12-18T00:06:29.4423388Z  2024-12-18T00:06:29.4423649Z login() { 2024-12-18T00:06:29.4424195Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-12-18T00:06:29.4424750Z } 2024-12-18T00:06:29.4425019Z  2024-12-18T00:06:29.4425260Z retry () { 2024-12-18T00:06:29.4425562Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-12-18T00:06:29.4425912Z } 2024-12-18T00:06:29.4426152Z  2024-12-18T00:06:29.4426427Z retry login "${DOCKER_REGISTRY}" 2024-12-18T00:06:29.4426763Z  2024-12-18T00:06:29.4427003Z START_TIME=$(date +%s) 2024-12-18T00:06:29.4427326Z # Wait up to 90 minutes 2024-12-18T00:06:29.4427726Z while [[ $(( $(date +%s) - 5400 )) -lt $START_TIME ]]; do 2024-12-18T00:06:29.4428278Z  # Check if image already exists, if it does then skip building it 2024-12-18T00:06:29.4428804Z  if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-12-18T00:06:29.4429358Z  exit 0 2024-12-18T00:06:29.4429641Z  fi 2024-12-18T00:06:29.4429873Z  2024-12-18T00:06:29.4430286Z  # NB: This flag is used by Docker build workflow to push the image to ECR, so we can 2024-12-18T00:06:29.4431002Z  # use this to differentiate between the Docker build and regular build jobs. For the 2024-12-18T00:06:29.4431723Z  # latter, it will wait for the Docker images to become available before continuing 2024-12-18T00:06:29.4432293Z  if [ "${DOCKER_PUSH:-false}" == "true" ]; then 2024-12-18T00:06:29.4432730Z  # It's a Docker build job, let's build the image 2024-12-18T00:06:29.4433123Z  break 2024-12-18T00:06:29.4433381Z  else 2024-12-18T00:06:29.4433776Z  # It's a regular build job, wait for the image to become available 2024-12-18T00:06:29.4434249Z  sleep 300 2024-12-18T00:06:29.4434543Z  fi 2024-12-18T00:06:29.4434783Z done 2024-12-18T00:06:29.4435002Z  2024-12-18T00:06:29.4435386Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-12-18T00:06:29.4435995Z # be empty. The default action would be to continue rebuild the image 2024-12-18T00:06:29.4436546Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-12-18T00:06:29.4437044Z  # if we're on the base branch then use the parent commit 2024-12-18T00:06:29.4437502Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-12-18T00:06:29.4437840Z else 2024-12-18T00:06:29.4438206Z  # otherwise we're on a PR, so use the most recent base commit 2024-12-18T00:06:29.4438734Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-12-18T00:06:29.4439152Z fi 2024-12-18T00:06:29.4439414Z  2024-12-18T00:06:29.4439673Z if [[ -z "${MERGE_BASE}" ]]; then 2024-12-18T00:06:29.4440089Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4440476Z  2024-12-18T00:06:29.4441642Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-12-18T00:06:29.4442275Z  exit 0 2024-12-18T00:06:29.4442561Z fi 2024-12-18T00:06:29.4442801Z  2024-12-18T00:06:29.4443166Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-12-18T00:06:29.4443914Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-12-18T00:06:29.4444563Z  exit 1 2024-12-18T00:06:29.4444834Z fi 2024-12-18T00:06:29.4445070Z  2024-12-18T00:06:29.4445472Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-12-18T00:06:29.4446162Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-12-18T00:06:29.4446784Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-12-18T00:06:29.4447516Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-12-18T00:06:29.4448339Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-12-18T00:06:29.4448838Z fi 2024-12-18T00:06:29.4449073Z  2024-12-18T00:06:29.4449363Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:06:29.4453931Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:29.4454336Z env: 2024-12-18T00:06:29.4454590Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:29.4454879Z DOCKER_BUILD_DIR: .ci/docker 2024-12-18T00:06:29.4455318Z BASE_REVISION: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:06:29.4456317Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:29.4457395Z DOCKER_TAG: 45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:29.4457867Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:29.4458322Z DOCKER_PUSH: 2024-12-18T00:06:29.4458599Z ##[endgroup] 2024-12-18T00:06:29.4478231Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:29.4478761Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:29.4482611Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:29.4483232Z + aws ecr get-login-password --region us-east-1 2024-12-18T00:06:29.9818212Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:06:29.9819631Z Configure a credential helper to remove this warning. See 2024-12-18T00:06:29.9820286Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:06:29.9820726Z 2024-12-18T00:06:29.9820880Z Login Succeeded 2024-12-18T00:06:29.9837914Z ++ date +%s 2024-12-18T00:06:29.9843558Z + START_TIME=1734480389 2024-12-18T00:06:29.9846380Z ++ date +%s 2024-12-18T00:06:29.9853395Z + [[ 1734474989 -lt 1734480389 ]] 2024-12-18T00:06:29.9854491Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:30.2156702Z { 2024-12-18T00:06:30.2157135Z "schemaVersion": 2, 2024-12-18T00:06:30.2157654Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-12-18T00:06:30.2158170Z "config": { 2024-12-18T00:06:30.2158580Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-12-18T00:06:30.2159063Z "size": 52680, 2024-12-18T00:06:30.2159554Z "digest": "sha256:67e93a8badaf799ceb664d7c453077c6c6785d56dc10c720be9358edeb91759b" 2024-12-18T00:06:30.2161202Z }, 2024-12-18T00:06:30.2161442Z "layers": [ 2024-12-18T00:06:30.2161708Z { 2024-12-18T00:06:30.2162129Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2162619Z "size": 28584506, 2024-12-18T00:06:30.2163346Z "digest": "sha256:80888bc6716fcbb8874e75ac88898d3e38e6f1bc55678f0e97ca9d706b7f3733" 2024-12-18T00:06:30.2163884Z }, 2024-12-18T00:06:30.2164127Z { 2024-12-18T00:06:30.2164616Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2165094Z "size": 7944698, 2024-12-18T00:06:30.2165593Z "digest": "sha256:fbcd35dc5bc3a7bda41926aadd083020f942b001ebac6f1d30480f0f065394c0" 2024-12-18T00:06:30.2166157Z }, 2024-12-18T00:06:30.2166398Z { 2024-12-18T00:06:30.2166784Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2167262Z "size": 57593527, 2024-12-18T00:06:30.2167777Z "digest": "sha256:c7232af9ae05f7de83f8d6171bd0c35a4dd0a85ebafb15b950dbc08f89ea5fb5" 2024-12-18T00:06:30.2168340Z }, 2024-12-18T00:06:30.2168583Z { 2024-12-18T00:06:30.2168971Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2169454Z "size": 185, 2024-12-18T00:06:30.2169955Z "digest": "sha256:db6cdef1932a0d9ca6ef9a539e08d491f66d1b1ed81926ae1525375bdd8100cc" 2024-12-18T00:06:30.2170567Z }, 2024-12-18T00:06:30.2170806Z { 2024-12-18T00:06:30.2171196Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2171670Z "size": 6886, 2024-12-18T00:06:30.2172181Z "digest": "sha256:56dc8550293751a1604e97ac949cfae82ba20cb2a28e034737bafd7382559609" 2024-12-18T00:06:30.2172757Z }, 2024-12-18T00:06:30.2173037Z { 2024-12-18T00:06:30.2173466Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2173968Z "size": 1374287670, 2024-12-18T00:06:30.2174509Z "digest": "sha256:30c0ea6140d07e2a8deb70d780f277c63cf61836ff33d66eef944728a4bef6bd" 2024-12-18T00:06:30.2175100Z }, 2024-12-18T00:06:30.2175385Z { 2024-12-18T00:06:30.2175816Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2176459Z "size": 62641, 2024-12-18T00:06:30.2176999Z "digest": "sha256:71bdb1a72c2d6dc97bbdbca82383f0260c4ee87556701e8e606c08a6bb0f0da5" 2024-12-18T00:06:30.2177603Z }, 2024-12-18T00:06:30.2177889Z { 2024-12-18T00:06:30.2178323Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2178822Z "size": 1685, 2024-12-18T00:06:30.2179353Z "digest": "sha256:4829486be7c30f19f4136fa56adbb3de206ed0bbf0705b59fb2147406778ce38" 2024-12-18T00:06:30.2179949Z }, 2024-12-18T00:06:30.2180233Z { 2024-12-18T00:06:30.2180667Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2181173Z "size": 1523, 2024-12-18T00:06:30.2181702Z "digest": "sha256:1f4e68d7b5e4224ba1da78ef461ff7f01e8d59c09d39281277521384105a9441" 2024-12-18T00:06:30.2182296Z }, 2024-12-18T00:06:30.2182574Z { 2024-12-18T00:06:30.2183001Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2183500Z "size": 2626741021, 2024-12-18T00:06:30.2184134Z "digest": "sha256:7c373e2d9b7e82a6878d4a31293dd857915a0fe47d07dce541cea03b043d57fc" 2024-12-18T00:06:30.2184709Z }, 2024-12-18T00:06:30.2184979Z { 2024-12-18T00:06:30.2185391Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2185869Z "size": 86545, 2024-12-18T00:06:30.2186363Z "digest": "sha256:6223811417458a3c93b84ee3b65f8b08d9e2828b926f0aed863041610d7d95d4" 2024-12-18T00:06:30.2186931Z }, 2024-12-18T00:06:30.2187190Z { 2024-12-18T00:06:30.2187595Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2188074Z "size": 1824, 2024-12-18T00:06:30.2188578Z "digest": "sha256:f003d065e31e5e8c0cea490c88a912dd331bddcbd2f5ff22ccc692a5343bcbeb" 2024-12-18T00:06:30.2189153Z }, 2024-12-18T00:06:30.2189418Z { 2024-12-18T00:06:30.2189830Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2190314Z "size": 246420139, 2024-12-18T00:06:30.2190837Z "digest": "sha256:cd6ce71168153e485b99493ce07032bbd9fd5cefceb68ef33ce088244306a653" 2024-12-18T00:06:30.2191407Z }, 2024-12-18T00:06:30.2191680Z { 2024-12-18T00:06:30.2192163Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2192647Z "size": 703, 2024-12-18T00:06:30.2193149Z "digest": "sha256:e843066a8f68042266cfe814f1729975619fb8f733f371be115e8b2fe81cbc9d" 2024-12-18T00:06:30.2193718Z }, 2024-12-18T00:06:30.2193996Z { 2024-12-18T00:06:30.2194419Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2194906Z "size": 1256, 2024-12-18T00:06:30.2195422Z "digest": "sha256:bac50ca2930bc4b1afa8a2f1b4b0d1d499d63b7922b784af690c3b31ec0c2f70" 2024-12-18T00:06:30.2195998Z }, 2024-12-18T00:06:30.2196257Z { 2024-12-18T00:06:30.2196663Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2197143Z "size": 484, 2024-12-18T00:06:30.2197642Z "digest": "sha256:57e52c6751f4d865ada4cae919859fe563fe5dcbb93ca82cb4746f98caccbd3a" 2024-12-18T00:06:30.2198220Z }, 2024-12-18T00:06:30.2198482Z { 2024-12-18T00:06:30.2198892Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2199377Z "size": 91715265, 2024-12-18T00:06:30.2199887Z "digest": "sha256:a9c5c14d77c035c7501566b1247024dfd241bd6bc12fbe2bca28ec7d90b26069" 2024-12-18T00:06:30.2200455Z }, 2024-12-18T00:06:30.2200723Z { 2024-12-18T00:06:30.2201130Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2201704Z "size": 3706, 2024-12-18T00:06:30.2202393Z "digest": "sha256:b86099b8619ad88e8fe6c8e693180d52e0f2fbeac5927f0b403c8a9ef76d7f6b" 2024-12-18T00:06:30.2203058Z }, 2024-12-18T00:06:30.2203329Z { 2024-12-18T00:06:30.2203745Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2204237Z "size": 1860, 2024-12-18T00:06:30.2204758Z "digest": "sha256:3c8ea8a600fff6cce4c1b36acc5f3949ecd664e55b5eaf4a50fe5499351574a6" 2024-12-18T00:06:30.2205476Z }, 2024-12-18T00:06:30.2205762Z { 2024-12-18T00:06:30.2206188Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2206690Z "size": 701, 2024-12-18T00:06:30.2207222Z "digest": "sha256:bebd539a1d598fe86afc0da77bf16ae4c7ebfb9f031f21ed7634150fbe23f996" 2024-12-18T00:06:30.2207817Z }, 2024-12-18T00:06:30.2208195Z { 2024-12-18T00:06:30.2208602Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2209173Z "size": 478, 2024-12-18T00:06:30.2209637Z "digest": "sha256:292b18ec2dab9bd60d00192387c1269d39b0b4886b782585d2c879808218fc66" 2024-12-18T00:06:30.2210173Z }, 2024-12-18T00:06:30.2210435Z { 2024-12-18T00:06:30.2210826Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2211285Z "size": 2941869535, 2024-12-18T00:06:30.2211768Z "digest": "sha256:76e3817b4b4cec0a5b005161867dc257681b792271ba9d23c9b79b3a6801dcd9" 2024-12-18T00:06:30.2231108Z }, 2024-12-18T00:06:30.2231360Z { 2024-12-18T00:06:30.2231729Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2232223Z "size": 380, 2024-12-18T00:06:30.2232679Z "digest": "sha256:50b1f245e9f5be8670d8ba5790e3b96450eee3428dcac7060367db48ae00234e" 2024-12-18T00:06:30.2233193Z }, 2024-12-18T00:06:30.2233418Z { 2024-12-18T00:06:30.2233766Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2234230Z "size": 12901, 2024-12-18T00:06:30.2234684Z "digest": "sha256:ad93cf5205f24ada86b5f7eab5b63ed97ae7858368f6fdbce373343d2568d66e" 2024-12-18T00:06:30.2235211Z }, 2024-12-18T00:06:30.2235464Z { 2024-12-18T00:06:30.2235807Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2236261Z "size": 863, 2024-12-18T00:06:30.2236722Z "digest": "sha256:8d17c59eaf7d84d49e3660380debcc70734b2a178e6cab86f0d4fd3e7a8100d1" 2024-12-18T00:06:30.2237258Z }, 2024-12-18T00:06:30.2237510Z { 2024-12-18T00:06:30.2237901Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2238349Z "size": 106, 2024-12-18T00:06:30.2238995Z "digest": "sha256:b36a8ccf5c8c8ef0bf3e168ec9f568a0ada36c49103c9cacfef6dd072ddd681a" 2024-12-18T00:06:30.2239523Z }, 2024-12-18T00:06:30.2239723Z { 2024-12-18T00:06:30.2240093Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2240564Z "size": 504, 2024-12-18T00:06:30.2241039Z "digest": "sha256:aa0a3b87e9e34ab15903206018bfd9fb1eb54fd21f05a61ef254557703890732" 2024-12-18T00:06:30.2241561Z }, 2024-12-18T00:06:30.2241768Z { 2024-12-18T00:06:30.2242120Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2242585Z "size": 121477314, 2024-12-18T00:06:30.2243063Z "digest": "sha256:72a632052c5be4900c60ce09e32f8a0fd3b637ab0b7685dc5b07bda4776ddd15" 2024-12-18T00:06:30.2243584Z }, 2024-12-18T00:06:30.2243813Z { 2024-12-18T00:06:30.2244187Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2244660Z "size": 109, 2024-12-18T00:06:30.2245146Z "digest": "sha256:ceed6316bc249ffffee9563cb7505023b3e70fba306f187bd612fece63508263" 2024-12-18T00:06:30.2245693Z }, 2024-12-18T00:06:30.2245918Z { 2024-12-18T00:06:30.2246300Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2246771Z "size": 489, 2024-12-18T00:06:30.2247224Z "digest": "sha256:d0ca0f491f809a9f1dedd391f5b25cc3f59d8e95e7f76299f18ec3c931e56ed1" 2024-12-18T00:06:30.2247742Z }, 2024-12-18T00:06:30.2247966Z { 2024-12-18T00:06:30.2248339Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2248822Z "size": 296, 2024-12-18T00:06:30.2249262Z "digest": "sha256:cf02c706cd567c781eeb567c90960801dc1ef78872b73fbc047df898951ecbb8" 2024-12-18T00:06:30.2249790Z }, 2024-12-18T00:06:30.2249993Z { 2024-12-18T00:06:30.2250348Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2250926Z "size": 103, 2024-12-18T00:06:30.2251371Z "digest": "sha256:16073d3f107dab837d7edb5e6044449660fec7e2ded263ca81d5dcfea5beb486" 2024-12-18T00:06:30.2251886Z }, 2024-12-18T00:06:30.2252096Z { 2024-12-18T00:06:30.2252454Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2252910Z "size": 1473, 2024-12-18T00:06:30.2253357Z "digest": "sha256:d234faf2f1bfb6cb9d4ba14103226d20d540e568b47690b67c2a2b2c5a49645f" 2024-12-18T00:06:30.2253865Z }, 2024-12-18T00:06:30.2254073Z { 2024-12-18T00:06:30.2254427Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2254876Z "size": 430258758, 2024-12-18T00:06:30.2255342Z "digest": "sha256:3f0ade86af1a5bc72c9088735bb1a7ab9819fa20fdd96437fc080b2c711dfd3d" 2024-12-18T00:06:30.2255848Z }, 2024-12-18T00:06:30.2256051Z { 2024-12-18T00:06:30.2256424Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2256890Z "size": 164, 2024-12-18T00:06:30.2257360Z "digest": "sha256:034b6a03f5f751ed12f7505175ce3443eb3ed7b34d02d1bb25de0ee52d93a44b" 2024-12-18T00:06:30.2257899Z }, 2024-12-18T00:06:30.2258131Z { 2024-12-18T00:06:30.2258516Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2258994Z "size": 564, 2024-12-18T00:06:30.2259465Z "digest": "sha256:21f8f066852dd484ccbf79470452fe8005cde08773dd4fedc07fed783a0b9bf8" 2024-12-18T00:06:30.2260007Z }, 2024-12-18T00:06:30.2260233Z { 2024-12-18T00:06:30.2260621Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2261106Z "size": 35865656, 2024-12-18T00:06:30.2261595Z "digest": "sha256:9dc1f315a979ec860a882d7df33584e02c1d18f86293521839ce42e21082e639" 2024-12-18T00:06:30.2262130Z }, 2024-12-18T00:06:30.2262358Z { 2024-12-18T00:06:30.2262755Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2263239Z "size": 104, 2024-12-18T00:06:30.2263714Z "digest": "sha256:cd6a6063178b945c150fe21a31df6e33203295dd814802e0658835e810fb2bf9" 2024-12-18T00:06:30.2264244Z }, 2024-12-18T00:06:30.2264473Z { 2024-12-18T00:06:30.2264940Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2265432Z "size": 425, 2024-12-18T00:06:30.2265911Z "digest": "sha256:2116738f4ea9299766a55629d39b881c4d33fc4fc0ce915965be1a850fcd7aaa" 2024-12-18T00:06:30.2266452Z }, 2024-12-18T00:06:30.2266686Z { 2024-12-18T00:06:30.2267086Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2267662Z "size": 20262160, 2024-12-18T00:06:30.2268162Z "digest": "sha256:d7fa134316d91d2ec39bceb121619d44cdfdf1c7ac30c72768a9fd48f9763bd1" 2024-12-18T00:06:30.2268718Z }, 2024-12-18T00:06:30.2268952Z { 2024-12-18T00:06:30.2269354Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2269848Z "size": 643, 2024-12-18T00:06:30.2270326Z "digest": "sha256:af03dc3fd15ea8f5f1fa41d514400f6a1d963985cf046b09d789f7f0359b2aba" 2024-12-18T00:06:30.2270872Z }, 2024-12-18T00:06:30.2271105Z { 2024-12-18T00:06:30.2271495Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2271984Z "size": 701, 2024-12-18T00:06:30.2272465Z "digest": "sha256:bebd539a1d598fe86afc0da77bf16ae4c7ebfb9f031f21ed7634150fbe23f996" 2024-12-18T00:06:30.2273020Z }, 2024-12-18T00:06:30.2273251Z { 2024-12-18T00:06:30.2273644Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2274134Z "size": 142, 2024-12-18T00:06:30.2274613Z "digest": "sha256:fd9de3dc425828e7b8984d4ced05f4102762137b81a5dc67104fc6b0805c570d" 2024-12-18T00:06:30.2275152Z }, 2024-12-18T00:06:30.2275381Z { 2024-12-18T00:06:30.2275735Z + exit 0 2024-12-18T00:06:30.2276100Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2276595Z "size": 135, 2024-12-18T00:06:30.2277081Z "digest": "sha256:b85093661f7768ac691f4b3ee5f553b9ab14cb2a6877c8edc6133d74caa88f69" 2024-12-18T00:06:30.2277702Z }, 2024-12-18T00:06:30.2277956Z { 2024-12-18T00:06:30.2278321Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2278809Z "size": 4995482131, 2024-12-18T00:06:30.2279305Z "digest": "sha256:ab6ef6c2ac4d23af7a3249cee1d4761f63a89513796ba720da7cc425c8afa6d2" 2024-12-18T00:06:30.2279845Z }, 2024-12-18T00:06:30.2280098Z { 2024-12-18T00:06:30.2280458Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2280946Z "size": 196, 2024-12-18T00:06:30.2281414Z "digest": "sha256:56c896077120aaa4cbcc2203662d13b4ea14cf998e9657e91b252535ceae5348" 2024-12-18T00:06:30.2281945Z }, 2024-12-18T00:06:30.2282199Z { 2024-12-18T00:06:30.2282563Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2283202Z "size": 564, 2024-12-18T00:06:30.2283682Z "digest": "sha256:d88e9c5e7c70fe36bd1bd2e94d43d4192d94a1f28e323234a73a75a2d1da48f1" 2024-12-18T00:06:30.2284225Z }, 2024-12-18T00:06:30.2284480Z { 2024-12-18T00:06:30.2284843Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2285335Z "size": 43164612, 2024-12-18T00:06:30.2285860Z "digest": "sha256:53617ee83302d7f97eb56f6756d78d18f8dc41bf252bf2d04cb643198f400f6f" 2024-12-18T00:06:30.2286362Z }, 2024-12-18T00:06:30.2286581Z { 2024-12-18T00:06:30.2286920Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2287370Z "size": 106, 2024-12-18T00:06:30.2287819Z "digest": "sha256:3edbde10d4043bf2ebf32fddfa55c8d0923435465637df7dc8f4addcc03a0b84" 2024-12-18T00:06:30.2288435Z }, 2024-12-18T00:06:30.2288657Z { 2024-12-18T00:06:30.2288995Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2289441Z "size": 1402, 2024-12-18T00:06:30.2289880Z "digest": "sha256:f4038f7524c3ed705e7560db6dd6efe76f548363f16bc7a93cfe360d5bc6dcaa" 2024-12-18T00:06:30.2290386Z }, 2024-12-18T00:06:30.2290603Z { 2024-12-18T00:06:30.2290942Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2291385Z "size": 701, 2024-12-18T00:06:30.2291908Z "digest": "sha256:bebd539a1d598fe86afc0da77bf16ae4c7ebfb9f031f21ed7634150fbe23f996" 2024-12-18T00:06:30.2292429Z }, 2024-12-18T00:06:30.2292645Z { 2024-12-18T00:06:30.2292983Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2293430Z "size": 137, 2024-12-18T00:06:30.2293870Z "digest": "sha256:4a51173f77576ab68fba2f862dd4d12b9ff1f250145c090520b05f88f5c81391" 2024-12-18T00:06:30.2294366Z }, 2024-12-18T00:06:30.2294612Z { 2024-12-18T00:06:30.2294950Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2295396Z "size": 120, 2024-12-18T00:06:30.2295831Z "digest": "sha256:ed6a71d41274e5b1eea4025d24a4851d6880b902b08f7d4dd0618ea81154f575" 2024-12-18T00:06:30.2296327Z }, 2024-12-18T00:06:30.2296541Z { 2024-12-18T00:06:30.2296885Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2297329Z "size": 4886226234, 2024-12-18T00:06:30.2297793Z "digest": "sha256:389dc939e2a414ef26b642b1e8657a710358afa6a6be3ebc4380b01ffacbbacc" 2024-12-18T00:06:30.2298292Z }, 2024-12-18T00:06:30.2298486Z { 2024-12-18T00:06:30.2298838Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2299272Z "size": 174, 2024-12-18T00:06:30.2299713Z "digest": "sha256:0341eaeed33df462f8bd28003bb9b09739b0786abba58ccc17ba4cec535ee4ef" 2024-12-18T00:06:30.2300212Z }, 2024-12-18T00:06:30.2300407Z { 2024-12-18T00:06:30.2300756Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2301183Z "size": 908, 2024-12-18T00:06:30.2301676Z "digest": "sha256:537cdb2d31685c0dbaf612d24633539a141cfcb69d90c5ce932923a6e4ab4474" 2024-12-18T00:06:30.2302450Z }, 2024-12-18T00:06:30.2302656Z { 2024-12-18T00:06:30.2303027Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2303613Z "size": 701, 2024-12-18T00:06:30.2304096Z "digest": "sha256:bebd539a1d598fe86afc0da77bf16ae4c7ebfb9f031f21ed7634150fbe23f996" 2024-12-18T00:06:30.2304657Z }, 2024-12-18T00:06:30.2304873Z { 2024-12-18T00:06:30.2305248Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2305719Z "size": 135, 2024-12-18T00:06:30.2306183Z "digest": "sha256:76d4a07024975dd727ff7b1c8873c513043bc9a5d310b469e51c3b110fdb6084" 2024-12-18T00:06:30.2306720Z }, 2024-12-18T00:06:30.2306946Z { 2024-12-18T00:06:30.2307318Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2307803Z "size": 32, 2024-12-18T00:06:30.2308271Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:06:30.2308822Z }, 2024-12-18T00:06:30.2309036Z { 2024-12-18T00:06:30.2309413Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2309900Z "size": 159, 2024-12-18T00:06:30.2310363Z "digest": "sha256:3287a539d61e3913b93941ecd49e55887b5122d63403e0fe9e7a3a63b6ed03c6" 2024-12-18T00:06:30.2310909Z }, 2024-12-18T00:06:30.2311124Z { 2024-12-18T00:06:30.2311507Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2311990Z "size": 1932, 2024-12-18T00:06:30.2312452Z "digest": "sha256:9b763e24a7d42c731eb337815675c9478832146e73305559d0db1c88a0731492" 2024-12-18T00:06:30.2312987Z }, 2024-12-18T00:06:30.2313201Z { 2024-12-18T00:06:30.2313579Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2314282Z "size": 196810750, 2024-12-18T00:06:30.2314729Z "digest": "sha256:f6ef3d4c814e330a230273579dc978970563774df75f73fba78181ddcf6ab98e" 2024-12-18T00:06:30.2315224Z }, 2024-12-18T00:06:30.2315422Z { 2024-12-18T00:06:30.2315767Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2316192Z "size": 165, 2024-12-18T00:06:30.2316610Z "digest": "sha256:06914b00eb49b8005245cba4a631c34d0a2aaf8bf6291bc6477705206de11a06" 2024-12-18T00:06:30.2317089Z }, 2024-12-18T00:06:30.2317359Z { 2024-12-18T00:06:30.2317711Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2318144Z "size": 7943, 2024-12-18T00:06:30.2318587Z "digest": "sha256:724553524224508e03de9422ca47b1a1c047e53cd305c2a1344147bb0d82d1d0" 2024-12-18T00:06:30.2319083Z }, 2024-12-18T00:06:30.2319289Z { 2024-12-18T00:06:30.2319648Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2320098Z "size": 8070, 2024-12-18T00:06:30.2320545Z "digest": "sha256:47d9fb6dae26902b0fdb744916689adbd42add22a476d1c5ec89ae4e30b91e39" 2024-12-18T00:06:30.2321044Z }, 2024-12-18T00:06:30.2321247Z { 2024-12-18T00:06:30.2321598Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2322045Z "size": 303, 2024-12-18T00:06:30.2322492Z "digest": "sha256:acce7b690dcb2fde77ba3ce65df70452fc7c98de73a42fe72652e477f86fc62d" 2024-12-18T00:06:30.2323014Z }, 2024-12-18T00:06:30.2323223Z { 2024-12-18T00:06:30.2323579Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2324012Z "size": 7633763, 2024-12-18T00:06:30.2324441Z "digest": "sha256:58dc9f64def75bcb2abecdf39b798c3800e837d37da971e766a05731ea5537c2" 2024-12-18T00:06:30.2324939Z }, 2024-12-18T00:06:30.2325147Z { 2024-12-18T00:06:30.2325488Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2325932Z "size": 108, 2024-12-18T00:06:30.2326355Z "digest": "sha256:94dfe5ef1b7e91ebd6a1a5acc1d7732e051334d5102d8a69c509c1d2f6e95598" 2024-12-18T00:06:30.2326839Z }, 2024-12-18T00:06:30.2327027Z { 2024-12-18T00:06:30.2327353Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2327778Z "size": 54145665, 2024-12-18T00:06:30.2328216Z "digest": "sha256:40a2c9135b0683a7e2432748a9a6ff19926f6a2a49722d844c07e307320f7362" 2024-12-18T00:06:30.2328746Z }, 2024-12-18T00:06:30.2328943Z { 2024-12-18T00:06:30.2329287Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2329727Z "size": 484, 2024-12-18T00:06:30.2330150Z "digest": "sha256:8839d6b0c8218eccb426367e5bfe066b172b8c6059bae8473e915e11c4e582a9" 2024-12-18T00:06:30.2330642Z }, 2024-12-18T00:06:30.2330836Z { 2024-12-18T00:06:30.2331174Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2331605Z "size": 1374859271, 2024-12-18T00:06:30.2332056Z "digest": "sha256:1c588f0a9e97f3e192252a179d987d1ba1e5201ba4b6e74c429074e9e34df1b2" 2024-12-18T00:06:30.2332590Z }, 2024-12-18T00:06:30.2332813Z { 2024-12-18T00:06:30.2333203Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2333678Z "size": 106, 2024-12-18T00:06:30.2334148Z "digest": "sha256:6727e7e279360b8b66f0137a15b357efede06e69bfd0800ebad6ed7c8ed71df4" 2024-12-18T00:06:30.2334685Z }, 2024-12-18T00:06:30.2334917Z { 2024-12-18T00:06:30.2335317Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2335813Z "size": 568, 2024-12-18T00:06:30.2336284Z "digest": "sha256:3a55100d1957b103c43e314deb55697c459aa6fa225f91e7b1c69bc4c01dca4e" 2024-12-18T00:06:30.2336799Z }, 2024-12-18T00:06:30.2337062Z { 2024-12-18T00:06:30.2337465Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2337961Z "size": 303706071, 2024-12-18T00:06:30.2338453Z "digest": "sha256:3d6f160d335161c5321e13ce2823ec68379a6a3401b07bd7378602a69c85b80c" 2024-12-18T00:06:30.2338961Z }, 2024-12-18T00:06:30.2339229Z { 2024-12-18T00:06:30.2339630Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2340121Z "size": 111, 2024-12-18T00:06:30.2340608Z "digest": "sha256:b2a8bb947a87562144fe67a39c280d4dee50cbe9d8ff349140f5db6c377517e6" 2024-12-18T00:06:30.2341126Z }, 2024-12-18T00:06:30.2341399Z { 2024-12-18T00:06:30.2341813Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2342305Z "size": 529, 2024-12-18T00:06:30.2345543Z "digest": "sha256:69a74b2360f4ede95654274ce7ef6cc1597a7234cc17e86d5cdf4c98286d97c3" 2024-12-18T00:06:30.2346102Z }, 2024-12-18T00:06:30.2346372Z { 2024-12-18T00:06:30.2346780Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2347268Z "size": 48289052, 2024-12-18T00:06:30.2347767Z "digest": "sha256:f9e12a253d89c16863b9d4d90138ffa673447c9b7f27afcba54a2a679e58b5ab" 2024-12-18T00:06:30.2348273Z }, 2024-12-18T00:06:30.2348522Z { 2024-12-18T00:06:30.2348907Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2349386Z "size": 106, 2024-12-18T00:06:30.2349855Z "digest": "sha256:8fdb06d51b96d538045b9566a381de3dc25e59d1adb9d0a4e567afcb3213f676" 2024-12-18T00:06:30.2350368Z }, 2024-12-18T00:06:30.2350617Z { 2024-12-18T00:06:30.2350992Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2351461Z "size": 32, 2024-12-18T00:06:30.2351913Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:06:30.2352419Z }, 2024-12-18T00:06:30.2352645Z { 2024-12-18T00:06:30.2353010Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2353459Z "size": 32, 2024-12-18T00:06:30.2353907Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:06:30.2354421Z }, 2024-12-18T00:06:30.2354652Z { 2024-12-18T00:06:30.2355029Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2355513Z "size": 32, 2024-12-18T00:06:30.2355954Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:06:30.2356463Z }, 2024-12-18T00:06:30.2356698Z { 2024-12-18T00:06:30.2357058Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:06:30.2357595Z "size": 32, 2024-12-18T00:06:30.2358067Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:06:30.2358571Z } 2024-12-18T00:06:30.2358811Z ] 2024-12-18T00:06:30.2359061Z } 2024-12-18T00:06:30.2401151Z ##[group]Run set -eux 2024-12-18T00:06:30.2401533Z set -eux 2024-12-18T00:06:30.2402710Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin 2024-12-18T00:06:30.2409116Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:30.2409582Z env: 2024-12-18T00:06:30.2409838Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:30.2410181Z ##[endgroup] 2024-12-18T00:06:30.2434896Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token 2024-12-18T00:06:30.2436296Z + jq --raw-output .SecretString 2024-12-18T00:06:30.2436845Z + jq -r .docker_hub_readonly_token 2024-12-18T00:06:30.2439305Z + docker login --username pytorchbot --password-stdin 2024-12-18T00:06:30.8420918Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:06:30.8421708Z Configure a credential helper to remove this warning. See 2024-12-18T00:06:30.8422415Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:06:30.8422892Z 2024-12-18T00:06:30.8423284Z Login Succeeded 2024-12-18T00:06:30.8525996Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-12-18T00:06:30.8526442Z tag=${ECR_DOCKER_IMAGE##*/} 2024-12-18T00:06:30.8527043Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-12-18T00:06:30.8532616Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:30.8533048Z env: 2024-12-18T00:06:30.8533312Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:30.8534262Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:30.8535227Z ##[endgroup] 2024-12-18T00:06:30.8567856Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks-45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:30.8627914Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@release/2.6 2024-12-18T00:06:30.8628446Z with: 2024-12-18T00:06:30.8629332Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:30.8630384Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:30.8630830Z env: 2024-12-18T00:06:30.8631089Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:30.8631405Z ##[endgroup] 2024-12-18T00:06:30.8662988Z ##[group]Run set -x 2024-12-18T00:06:30.8663326Z set -x 2024-12-18T00:06:30.8663634Z set +e 2024-12-18T00:06:30.8663887Z  2024-12-18T00:06:30.8664159Z login() { 2024-12-18T00:06:30.8664698Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-12-18T00:06:30.8665290Z } 2024-12-18T00:06:30.8665559Z  2024-12-18T00:06:30.8665874Z retry () { 2024-12-18T00:06:30.8666203Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-12-18T00:06:30.8666554Z } 2024-12-18T00:06:30.8666817Z  2024-12-18T00:06:30.8667113Z retry login "${DOCKER_REGISTRY}" 2024-12-18T00:06:30.8667479Z  2024-12-18T00:06:30.8667740Z set -e 2024-12-18T00:06:30.8668113Z # ignore output since only exit code is used for conditional 2024-12-18T00:06:30.8668666Z # only pull docker image if it's not available locally 2024-12-18T00:06:30.8669271Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-12-18T00:06:30.8669980Z  retry docker pull "${DOCKER_IMAGE}" 2024-12-18T00:06:30.8670358Z fi 2024-12-18T00:06:30.8675745Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:06:30.8676157Z env: 2024-12-18T00:06:30.8676426Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:06:30.8677371Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:30.8678429Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:30.8678873Z ##[endgroup] 2024-12-18T00:06:30.8702132Z + set +e 2024-12-18T00:06:30.8702761Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:30.8703299Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:30.8704772Z + aws ecr get-login-password --region us-east-1 2024-12-18T00:06:30.8706729Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:06:31.4043631Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:06:31.4044340Z Configure a credential helper to remove this warning. See 2024-12-18T00:06:31.4046602Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:06:31.4047916Z 2024-12-18T00:06:31.4048266Z Login Succeeded 2024-12-18T00:06:31.4063661Z + set -e 2024-12-18T00:06:31.4064746Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:31.4206077Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:31.4207868Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:06:31.6973093Z 45e1356b47a284893081276eff3000b7b534f3b1: Pulling from pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks 2024-12-18T00:06:31.6974282Z 80888bc6716f: Pulling fs layer 2024-12-18T00:06:31.6974698Z fbcd35dc5bc3: Pulling fs layer 2024-12-18T00:06:31.6975492Z c7232af9ae05: Pulling fs layer 2024-12-18T00:06:31.6975905Z db6cdef1932a: Pulling fs layer 2024-12-18T00:06:31.6976328Z 56dc85502937: Pulling fs layer 2024-12-18T00:06:31.6976662Z 30c0ea6140d0: Pulling fs layer 2024-12-18T00:06:31.6976985Z 71bdb1a72c2d: Pulling fs layer 2024-12-18T00:06:31.6977319Z 4829486be7c3: Pulling fs layer 2024-12-18T00:06:31.6977822Z 1f4e68d7b5e4: Pulling fs layer 2024-12-18T00:06:31.6978335Z 7c373e2d9b7e: Pulling fs layer 2024-12-18T00:06:31.6978812Z 622381141745: Pulling fs layer 2024-12-18T00:06:31.6979333Z f003d065e31e: Pulling fs layer 2024-12-18T00:06:31.6979875Z cd6ce7116815: Pulling fs layer 2024-12-18T00:06:31.6980349Z e843066a8f68: Pulling fs layer 2024-12-18T00:06:31.6980705Z bac50ca2930b: Pulling fs layer 2024-12-18T00:06:31.6981037Z 57e52c6751f4: Pulling fs layer 2024-12-18T00:06:31.6981355Z a9c5c14d77c0: Pulling fs layer 2024-12-18T00:06:31.6981807Z b86099b8619a: Pulling fs layer 2024-12-18T00:06:31.6982216Z 3c8ea8a600ff: Pulling fs layer 2024-12-18T00:06:31.6982568Z bebd539a1d59: Pulling fs layer 2024-12-18T00:06:31.6982915Z 292b18ec2dab: Pulling fs layer 2024-12-18T00:06:31.6983255Z 76e3817b4b4c: Pulling fs layer 2024-12-18T00:06:31.6983575Z 50b1f245e9f5: Pulling fs layer 2024-12-18T00:06:31.6983907Z ad93cf5205f2: Pulling fs layer 2024-12-18T00:06:31.6984242Z 8d17c59eaf7d: Pulling fs layer 2024-12-18T00:06:31.6984577Z b36a8ccf5c8c: Pulling fs layer 2024-12-18T00:06:31.6984899Z 56dc85502937: Waiting 2024-12-18T00:06:31.6985186Z aa0a3b87e9e3: Pulling fs layer 2024-12-18T00:06:31.6985518Z 72a632052c5b: Pulling fs layer 2024-12-18T00:06:31.6985839Z 71bdb1a72c2d: Waiting 2024-12-18T00:06:31.6986126Z 30c0ea6140d0: Waiting 2024-12-18T00:06:31.6986616Z ceed6316bc24: Pulling fs layer 2024-12-18T00:06:31.6986939Z d0ca0f491f80: Pulling fs layer 2024-12-18T00:06:31.6987272Z cf02c706cd56: Pulling fs layer 2024-12-18T00:06:31.6987600Z cd6ce7116815: Waiting 2024-12-18T00:06:31.6987899Z 16073d3f107d: Pulling fs layer 2024-12-18T00:06:31.6988219Z 4829486be7c3: Waiting 2024-12-18T00:06:31.6988514Z d234faf2f1bf: Pulling fs layer 2024-12-18T00:06:31.6988856Z 3f0ade86af1a: Pulling fs layer 2024-12-18T00:06:31.6989176Z e843066a8f68: Waiting 2024-12-18T00:06:31.6989465Z bac50ca2930b: Waiting 2024-12-18T00:06:31.6989760Z 034b6a03f5f7: Pulling fs layer 2024-12-18T00:06:31.6990074Z 21f8f066852d: Pulling fs layer 2024-12-18T00:06:31.6990394Z db6cdef1932a: Waiting 2024-12-18T00:06:31.6990691Z 9dc1f315a979: Pulling fs layer 2024-12-18T00:06:31.6991006Z 622381141745: Waiting 2024-12-18T00:06:31.6991292Z 1f4e68d7b5e4: Waiting 2024-12-18T00:06:31.6991559Z f003d065e31e: Waiting 2024-12-18T00:06:31.6991856Z cd6a6063178b: Pulling fs layer 2024-12-18T00:06:31.6992189Z 7c373e2d9b7e: Waiting 2024-12-18T00:06:31.6992483Z 2116738f4ea9: Pulling fs layer 2024-12-18T00:06:31.6992797Z d7fa134316d9: Pulling fs layer 2024-12-18T00:06:31.6993131Z af03dc3fd15e: Pulling fs layer 2024-12-18T00:06:31.6993457Z a9c5c14d77c0: Waiting 2024-12-18T00:06:31.6993754Z 57e52c6751f4: Waiting 2024-12-18T00:06:31.6994048Z 50b1f245e9f5: Waiting 2024-12-18T00:06:31.6994328Z fd9de3dc4258: Pulling fs layer 2024-12-18T00:06:31.6994659Z b85093661f77: Pulling fs layer 2024-12-18T00:06:31.6994978Z ad93cf5205f2: Waiting 2024-12-18T00:06:31.6995265Z d0ca0f491f80: Waiting 2024-12-18T00:06:31.6995566Z ab6ef6c2ac4d: Pulling fs layer 2024-12-18T00:06:31.6995886Z 56c896077120: Pulling fs layer 2024-12-18T00:06:31.6996215Z d88e9c5e7c70: Pulling fs layer 2024-12-18T00:06:31.6996549Z 53617ee83302: Pulling fs layer 2024-12-18T00:06:31.6996869Z 8d17c59eaf7d: Waiting 2024-12-18T00:06:31.6997156Z 76e3817b4b4c: Waiting 2024-12-18T00:06:31.6997424Z 034b6a03f5f7: Waiting 2024-12-18T00:06:31.6997713Z b36a8ccf5c8c: Waiting 2024-12-18T00:06:31.6998008Z 292b18ec2dab: Waiting 2024-12-18T00:06:31.6998294Z cf02c706cd56: Waiting 2024-12-18T00:06:31.6998578Z 3edbde10d404: Pulling fs layer 2024-12-18T00:06:31.6998908Z bebd539a1d59: Waiting 2024-12-18T00:06:31.6999206Z f4038f7524c3: Pulling fs layer 2024-12-18T00:06:31.6999530Z aa0a3b87e9e3: Waiting 2024-12-18T00:06:31.6999933Z 4a51173f7757: Pulling fs layer 2024-12-18T00:06:31.7000240Z 72a632052c5b: Waiting 2024-12-18T00:06:31.7000541Z ed6a71d41274: Pulling fs layer 2024-12-18T00:06:31.7017102Z 389dc939e2a4: Pulling fs layer 2024-12-18T00:06:31.7017461Z b86099b8619a: Waiting 2024-12-18T00:06:31.7017776Z 0341eaeed33d: Pulling fs layer 2024-12-18T00:06:31.7018089Z 3f0ade86af1a: Waiting 2024-12-18T00:06:31.7018382Z 16073d3f107d: Waiting 2024-12-18T00:06:31.7018668Z 2116738f4ea9: Waiting 2024-12-18T00:06:31.7018967Z 537cdb2d3168: Pulling fs layer 2024-12-18T00:06:31.7019295Z ceed6316bc24: Waiting 2024-12-18T00:06:31.7019571Z 9dc1f315a979: Waiting 2024-12-18T00:06:31.7019874Z 76d4a0702497: Pulling fs layer 2024-12-18T00:06:31.7020225Z ab6ef6c2ac4d: Waiting 2024-12-18T00:06:31.7020529Z 4f4fb700ef54: Pulling fs layer 2024-12-18T00:06:31.7020863Z d234faf2f1bf: Waiting 2024-12-18T00:06:31.7021136Z 53617ee83302: Waiting 2024-12-18T00:06:31.7021422Z d88e9c5e7c70: Waiting 2024-12-18T00:06:31.7021739Z 3287a539d61e: Pulling fs layer 2024-12-18T00:06:31.7022079Z 9b763e24a7d4: Pulling fs layer 2024-12-18T00:06:31.7022401Z f6ef3d4c814e: Pulling fs layer 2024-12-18T00:06:31.7022730Z fd9de3dc4258: Waiting 2024-12-18T00:06:31.7023029Z 06914b00eb49: Pulling fs layer 2024-12-18T00:06:31.7023348Z 4a51173f7757: Waiting 2024-12-18T00:06:31.7023640Z 724553524224: Pulling fs layer 2024-12-18T00:06:31.7023944Z f4038f7524c3: Waiting 2024-12-18T00:06:31.7024229Z 3c8ea8a600ff: Waiting 2024-12-18T00:06:31.7024531Z 47d9fb6dae26: Pulling fs layer 2024-12-18T00:06:31.7024867Z acce7b690dcb: Pulling fs layer 2024-12-18T00:06:31.7025204Z 58dc9f64def7: Pulling fs layer 2024-12-18T00:06:31.7025513Z ed6a71d41274: Waiting 2024-12-18T00:06:31.7025995Z 94dfe5ef1b7e: Pulling fs layer 2024-12-18T00:06:31.7026318Z 56c896077120: Waiting 2024-12-18T00:06:31.7026597Z b85093661f77: Waiting 2024-12-18T00:06:31.7027036Z 389dc939e2a4: Waiting 2024-12-18T00:06:31.7027302Z d7fa134316d9: Waiting 2024-12-18T00:06:31.7027597Z 40a2c9135b06: Pulling fs layer 2024-12-18T00:06:31.7027944Z 8839d6b0c821: Pulling fs layer 2024-12-18T00:06:31.7028280Z 1c588f0a9e97: Pulling fs layer 2024-12-18T00:06:31.7028615Z 6727e7e27936: Pulling fs layer 2024-12-18T00:06:31.7028929Z 3a55100d1957: Pulling fs layer 2024-12-18T00:06:31.7029247Z 9b763e24a7d4: Waiting 2024-12-18T00:06:31.7029545Z 3d6f160d3351: Pulling fs layer 2024-12-18T00:06:31.7029865Z 537cdb2d3168: Waiting 2024-12-18T00:06:31.7030150Z b2a8bb947a87: Pulling fs layer 2024-12-18T00:06:31.7030487Z 69a74b2360f4: Pulling fs layer 2024-12-18T00:06:31.7030816Z f9e12a253d89: Pulling fs layer 2024-12-18T00:06:31.7031133Z 0341eaeed33d: Waiting 2024-12-18T00:06:31.7031419Z 06914b00eb49: Waiting 2024-12-18T00:06:31.7031703Z 8fdb06d51b96: Pulling fs layer 2024-12-18T00:06:31.7032023Z 724553524224: Waiting 2024-12-18T00:06:31.7032306Z 1c588f0a9e97: Waiting 2024-12-18T00:06:31.7032591Z 3d6f160d3351: Waiting 2024-12-18T00:06:31.7032876Z 47d9fb6dae26: Waiting 2024-12-18T00:06:31.7033151Z af03dc3fd15e: Waiting 2024-12-18T00:06:31.7033447Z b2a8bb947a87: Waiting 2024-12-18T00:06:31.7033736Z acce7b690dcb: Waiting 2024-12-18T00:06:31.7034026Z 8fdb06d51b96: Waiting 2024-12-18T00:06:31.7034312Z 76d4a0702497: Waiting 2024-12-18T00:06:31.7034577Z f9e12a253d89: Waiting 2024-12-18T00:06:31.7034854Z 3a55100d1957: Waiting 2024-12-18T00:06:31.7035133Z 8839d6b0c821: Waiting 2024-12-18T00:06:31.7035417Z 58dc9f64def7: Waiting 2024-12-18T00:06:31.7035717Z 6727e7e27936: Waiting 2024-12-18T00:06:31.7035984Z 3287a539d61e: Waiting 2024-12-18T00:06:31.7036271Z 94dfe5ef1b7e: Waiting 2024-12-18T00:06:31.7036560Z 69a74b2360f4: Waiting 2024-12-18T00:06:31.8440475Z fbcd35dc5bc3: Verifying Checksum 2024-12-18T00:06:31.8440937Z fbcd35dc5bc3: Download complete 2024-12-18T00:06:31.9324712Z db6cdef1932a: Verifying Checksum 2024-12-18T00:06:31.9325180Z db6cdef1932a: Download complete 2024-12-18T00:06:32.0116848Z 56dc85502937: Verifying Checksum 2024-12-18T00:06:32.0117325Z 56dc85502937: Download complete 2024-12-18T00:06:32.0393577Z 80888bc6716f: Verifying Checksum 2024-12-18T00:06:32.0394664Z 80888bc6716f: Download complete 2024-12-18T00:06:32.1213021Z 71bdb1a72c2d: Download complete 2024-12-18T00:06:32.2052808Z 4829486be7c3: Verifying Checksum 2024-12-18T00:06:32.2053767Z 4829486be7c3: Download complete 2024-12-18T00:06:32.2909316Z 1f4e68d7b5e4: Verifying Checksum 2024-12-18T00:06:32.2910434Z 1f4e68d7b5e4: Download complete 2024-12-18T00:06:32.3426604Z c7232af9ae05: Verifying Checksum 2024-12-18T00:06:32.3427060Z c7232af9ae05: Download complete 2024-12-18T00:06:32.4415794Z 622381141745: Verifying Checksum 2024-12-18T00:06:32.5302457Z f003d065e31e: Download complete 2024-12-18T00:06:32.8141029Z 80888bc6716f: Pull complete 2024-12-18T00:06:33.0166695Z fbcd35dc5bc3: Pull complete 2024-12-18T00:06:33.8126983Z c7232af9ae05: Pull complete 2024-12-18T00:06:33.8252819Z db6cdef1932a: Pull complete 2024-12-18T00:06:33.8382002Z 56dc85502937: Pull complete 2024-12-18T00:06:35.0623477Z cd6ce7116815: Verifying Checksum 2024-12-18T00:06:35.0623990Z cd6ce7116815: Download complete 2024-12-18T00:06:35.1533688Z e843066a8f68: Verifying Checksum 2024-12-18T00:06:35.1534169Z e843066a8f68: Download complete 2024-12-18T00:06:35.2283439Z bac50ca2930b: Download complete 2024-12-18T00:06:35.5582128Z 57e52c6751f4: Download complete 2024-12-18T00:06:36.6310523Z a9c5c14d77c0: Verifying Checksum 2024-12-18T00:06:36.6310979Z a9c5c14d77c0: Download complete 2024-12-18T00:06:36.7982016Z b86099b8619a: Verifying Checksum 2024-12-18T00:06:36.7982602Z b86099b8619a: Download complete 2024-12-18T00:06:36.8854393Z 3c8ea8a600ff: Verifying Checksum 2024-12-18T00:06:36.8854771Z 3c8ea8a600ff: Download complete 2024-12-18T00:06:37.0013912Z bebd539a1d59: Verifying Checksum 2024-12-18T00:06:37.0014460Z bebd539a1d59: Download complete 2024-12-18T00:06:37.0932739Z 292b18ec2dab: Download complete 2024-12-18T00:06:45.9387672Z 30c0ea6140d0: Verifying Checksum 2024-12-18T00:06:45.9388161Z 30c0ea6140d0: Download complete 2024-12-18T00:06:46.0488981Z 50b1f245e9f5: Verifying Checksum 2024-12-18T00:06:46.0489435Z 50b1f245e9f5: Download complete 2024-12-18T00:06:46.1502788Z ad93cf5205f2: Download complete 2024-12-18T00:06:46.2452655Z 8d17c59eaf7d: Verifying Checksum 2024-12-18T00:06:46.2453239Z 8d17c59eaf7d: Download complete 2024-12-18T00:06:46.3298111Z b36a8ccf5c8c: Download complete 2024-12-18T00:06:46.3943839Z aa0a3b87e9e3: Download complete 2024-12-18T00:06:47.6747172Z 72a632052c5b: Verifying Checksum 2024-12-18T00:06:47.6747849Z 72a632052c5b: Download complete 2024-12-18T00:06:47.7655145Z ceed6316bc24: Download complete 2024-12-18T00:06:47.8533746Z d0ca0f491f80: Verifying Checksum 2024-12-18T00:06:47.8534202Z d0ca0f491f80: Download complete 2024-12-18T00:06:48.0075399Z cf02c706cd56: Download complete 2024-12-18T00:06:48.1014000Z 16073d3f107d: Download complete 2024-12-18T00:06:48.1900941Z d234faf2f1bf: Download complete 2024-12-18T00:06:52.5836619Z 3f0ade86af1a: Verifying Checksum 2024-12-18T00:06:52.5837113Z 3f0ade86af1a: Download complete 2024-12-18T00:06:52.6750282Z 034b6a03f5f7: Download complete 2024-12-18T00:06:52.7420842Z 21f8f066852d: Verifying Checksum 2024-12-18T00:06:52.7422026Z 21f8f066852d: Download complete 2024-12-18T00:06:53.1720161Z 9dc1f315a979: Verifying Checksum 2024-12-18T00:06:53.1720638Z 9dc1f315a979: Download complete 2024-12-18T00:06:53.3279104Z cd6a6063178b: Download complete 2024-12-18T00:06:53.4092560Z 2116738f4ea9: Download complete 2024-12-18T00:06:53.6874714Z d7fa134316d9: Verifying Checksum 2024-12-18T00:06:53.6875211Z d7fa134316d9: Download complete 2024-12-18T00:06:53.8031693Z af03dc3fd15e: Verifying Checksum 2024-12-18T00:06:53.8032314Z af03dc3fd15e: Download complete 2024-12-18T00:06:53.9016495Z fd9de3dc4258: Download complete 2024-12-18T00:06:54.0004278Z b85093661f77: Verifying Checksum 2024-12-18T00:06:54.0005432Z b85093661f77: Download complete 2024-12-18T00:06:58.4839198Z 30c0ea6140d0: Pull complete 2024-12-18T00:06:58.6208289Z 7c373e2d9b7e: Verifying Checksum 2024-12-18T00:06:58.7133798Z 7c373e2d9b7e: Download complete 2024-12-18T00:06:58.7134234Z 56c896077120: Verifying Checksum 2024-12-18T00:06:58.7134927Z 56c896077120: Download complete 2024-12-18T00:06:58.7986394Z d88e9c5e7c70: Verifying Checksum 2024-12-18T00:06:58.7987231Z d88e9c5e7c70: Download complete 2024-12-18T00:06:58.9509907Z 71bdb1a72c2d: Pull complete 2024-12-18T00:06:59.3020357Z 53617ee83302: Verifying Checksum 2024-12-18T00:06:59.3020809Z 53617ee83302: Download complete 2024-12-18T00:06:59.3903256Z 4829486be7c3: Pull complete 2024-12-18T00:06:59.4149450Z 3edbde10d404: Download complete 2024-12-18T00:06:59.5253290Z f4038f7524c3: Download complete 2024-12-18T00:06:59.6023466Z 4a51173f7757: Download complete 2024-12-18T00:06:59.6974909Z ed6a71d41274: Verifying Checksum 2024-12-18T00:06:59.6975904Z ed6a71d41274: Download complete 2024-12-18T00:06:59.9000783Z 1f4e68d7b5e4: Pull complete 2024-12-18T00:07:06.5803424Z 76e3817b4b4c: Verifying Checksum 2024-12-18T00:07:06.5803946Z 76e3817b4b4c: Download complete 2024-12-18T00:07:06.6758656Z 0341eaeed33d: Verifying Checksum 2024-12-18T00:07:06.6759137Z 0341eaeed33d: Download complete 2024-12-18T00:07:06.7728303Z 537cdb2d3168: Verifying Checksum 2024-12-18T00:07:06.7728824Z 537cdb2d3168: Download complete 2024-12-18T00:07:06.8560528Z 76d4a0702497: Verifying Checksum 2024-12-18T00:07:06.8560987Z 76d4a0702497: Download complete 2024-12-18T00:07:06.8632431Z 4f4fb700ef54: Verifying Checksum 2024-12-18T00:07:06.8632977Z 4f4fb700ef54: Download complete 2024-12-18T00:07:06.9433169Z 3287a539d61e: Download complete 2024-12-18T00:07:07.0257486Z 9b763e24a7d4: Verifying Checksum 2024-12-18T00:07:07.0258505Z 9b763e24a7d4: Download complete 2024-12-18T00:07:09.0358326Z f6ef3d4c814e: Verifying Checksum 2024-12-18T00:07:09.0358833Z f6ef3d4c814e: Download complete 2024-12-18T00:07:09.1265445Z 06914b00eb49: Verifying Checksum 2024-12-18T00:07:09.1266265Z 06914b00eb49: Download complete 2024-12-18T00:07:09.2255154Z 724553524224: Download complete 2024-12-18T00:07:09.3177111Z 47d9fb6dae26: Download complete 2024-12-18T00:07:09.4362993Z acce7b690dcb: Verifying Checksum 2024-12-18T00:07:09.4363529Z acce7b690dcb: Download complete 2024-12-18T00:07:09.5677957Z 58dc9f64def7: Verifying Checksum 2024-12-18T00:07:09.6553197Z 58dc9f64def7: Download complete 2024-12-18T00:07:09.6553686Z 94dfe5ef1b7e: Verifying Checksum 2024-12-18T00:07:09.6554046Z 94dfe5ef1b7e: Download complete 2024-12-18T00:07:10.2606712Z 40a2c9135b06: Verifying Checksum 2024-12-18T00:07:10.2607201Z 40a2c9135b06: Download complete 2024-12-18T00:07:10.3331476Z 8839d6b0c821: Verifying Checksum 2024-12-18T00:07:25.0771051Z 8839d6b0c821: Download complete 2024-12-18T00:07:25.0771537Z 1c588f0a9e97: Verifying Checksum 2024-12-18T00:07:25.0771927Z 1c588f0a9e97: Download complete 2024-12-18T00:07:25.2074076Z 6727e7e27936: Verifying Checksum 2024-12-18T00:07:25.2074594Z 6727e7e27936: Download complete 2024-12-18T00:07:25.3099381Z 3a55100d1957: Verifying Checksum 2024-12-18T00:07:25.3100393Z 3a55100d1957: Download complete 2024-12-18T00:07:27.4939015Z 7c373e2d9b7e: Pull complete 2024-12-18T00:07:27.9168887Z 622381141745: Pull complete 2024-12-18T00:07:28.3676961Z f003d065e31e: Pull complete 2024-12-18T00:07:30.6742723Z 3d6f160d3351: Verifying Checksum 2024-12-18T00:07:30.6743217Z 3d6f160d3351: Download complete 2024-12-18T00:07:30.7961442Z b2a8bb947a87: Verifying Checksum 2024-12-18T00:07:30.7961923Z b2a8bb947a87: Download complete 2024-12-18T00:07:30.8838248Z 69a74b2360f4: Download complete 2024-12-18T00:07:32.3242028Z f9e12a253d89: Verifying Checksum 2024-12-18T00:07:32.3243124Z f9e12a253d89: Download complete 2024-12-18T00:07:32.4114655Z 8fdb06d51b96: Download complete 2024-12-18T00:07:34.6554888Z cd6ce7116815: Pull complete 2024-12-18T00:07:35.1152524Z e843066a8f68: Pull complete 2024-12-18T00:07:35.5558213Z bac50ca2930b: Pull complete 2024-12-18T00:07:35.9946538Z 57e52c6751f4: Pull complete 2024-12-18T00:07:38.3896436Z a9c5c14d77c0: Pull complete 2024-12-18T00:07:38.8246297Z b86099b8619a: Pull complete 2024-12-18T00:07:39.2855561Z 3c8ea8a600ff: Pull complete 2024-12-18T00:07:39.6883926Z bebd539a1d59: Pull complete 2024-12-18T00:07:40.0187110Z 292b18ec2dab: Pull complete 2024-12-18T00:07:54.7430855Z ab6ef6c2ac4d: Verifying Checksum 2024-12-18T00:07:54.7431346Z ab6ef6c2ac4d: Download complete 2024-12-18T00:07:56.1089794Z 389dc939e2a4: Verifying Checksum 2024-12-18T00:07:56.1090495Z 389dc939e2a4: Download complete 2024-12-18T00:08:26.2714873Z 76e3817b4b4c: Pull complete 2024-12-18T00:08:26.7275594Z 50b1f245e9f5: Pull complete 2024-12-18T00:08:27.2113147Z ad93cf5205f2: Pull complete 2024-12-18T00:08:27.6781657Z 8d17c59eaf7d: Pull complete 2024-12-18T00:08:28.1663650Z b36a8ccf5c8c: Pull complete 2024-12-18T00:08:28.5979479Z aa0a3b87e9e3: Pull complete 2024-12-18T00:08:32.1291422Z 72a632052c5b: Pull complete 2024-12-18T00:08:32.5578965Z ceed6316bc24: Pull complete 2024-12-18T00:08:33.0068659Z d0ca0f491f80: Pull complete 2024-12-18T00:08:33.5278124Z cf02c706cd56: Pull complete 2024-12-18T00:08:34.0074581Z 16073d3f107d: Pull complete 2024-12-18T00:08:34.4855532Z d234faf2f1bf: Pull complete 2024-12-18T00:08:42.4351525Z 3f0ade86af1a: Pull complete 2024-12-18T00:08:42.8721405Z 034b6a03f5f7: Pull complete 2024-12-18T00:08:43.3493431Z 21f8f066852d: Pull complete 2024-12-18T00:08:44.4905245Z 9dc1f315a979: Pull complete 2024-12-18T00:08:44.9263280Z cd6a6063178b: Pull complete 2024-12-18T00:08:45.3521490Z 2116738f4ea9: Pull complete 2024-12-18T00:08:46.0179363Z d7fa134316d9: Pull complete 2024-12-18T00:08:46.4621677Z af03dc3fd15e: Pull complete 2024-12-18T00:08:47.3008628Z fd9de3dc4258: Pull complete 2024-12-18T00:08:47.7407407Z b85093661f77: Pull complete 2024-12-18T00:09:21.9713451Z ab6ef6c2ac4d: Pull complete 2024-12-18T00:09:22.3763363Z 56c896077120: Pull complete 2024-12-18T00:09:22.8355604Z d88e9c5e7c70: Pull complete 2024-12-18T00:09:25.0236147Z 53617ee83302: Pull complete 2024-12-18T00:09:25.3180346Z 3edbde10d404: Pull complete 2024-12-18T00:09:25.7378163Z f4038f7524c3: Pull complete 2024-12-18T00:09:26.5980118Z 4a51173f7757: Pull complete 2024-12-18T00:09:26.9678562Z ed6a71d41274: Pull complete 2024-12-18T00:10:47.1088212Z 389dc939e2a4: Pull complete 2024-12-18T00:10:47.5618092Z 0341eaeed33d: Pull complete 2024-12-18T00:10:48.0154450Z 537cdb2d3168: Pull complete 2024-12-18T00:10:48.9433917Z 76d4a0702497: Pull complete 2024-12-18T00:10:49.4184318Z 4f4fb700ef54: Pull complete 2024-12-18T00:10:49.9451937Z 3287a539d61e: Pull complete 2024-12-18T00:10:50.4300997Z 9b763e24a7d4: Pull complete 2024-12-18T00:10:56.8072377Z f6ef3d4c814e: Pull complete 2024-12-18T00:10:57.2397477Z 06914b00eb49: Pull complete 2024-12-18T00:10:57.6486894Z 724553524224: Pull complete 2024-12-18T00:10:58.0898920Z 47d9fb6dae26: Pull complete 2024-12-18T00:10:58.5531620Z acce7b690dcb: Pull complete 2024-12-18T00:10:59.8616014Z 58dc9f64def7: Pull complete 2024-12-18T00:11:00.2554877Z 94dfe5ef1b7e: Pull complete 2024-12-18T00:11:02.4183693Z 40a2c9135b06: Pull complete 2024-12-18T00:11:02.8708765Z 8839d6b0c821: Pull complete 2024-12-18T00:11:16.2418522Z 1c588f0a9e97: Pull complete 2024-12-18T00:11:16.7320712Z 6727e7e27936: Pull complete 2024-12-18T00:11:17.1690877Z 3a55100d1957: Pull complete 2024-12-18T00:11:20.3253592Z 3d6f160d3351: Pull complete 2024-12-18T00:11:20.7565883Z b2a8bb947a87: Pull complete 2024-12-18T00:11:21.1738939Z 69a74b2360f4: Pull complete 2024-12-18T00:11:21.9963361Z f9e12a253d89: Pull complete 2024-12-18T00:11:22.4529703Z 8fdb06d51b96: Pull complete 2024-12-18T00:11:24.5134799Z Digest: sha256:ff80d4c93d18e8ab7a2501f0e62b7c40cf97aa83fc9702e88b9c2d02cdcbecdb 2024-12-18T00:11:24.6115041Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:11:24.6677803Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:11:24.6739788Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:11:24.6741281Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:11:24.6749764Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:11:24.6750207Z env: 2024-12-18T00:11:24.6750485Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:11:24.6750809Z ##[endgroup] 2024-12-18T00:11:24.7162397Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@release/2.6 2024-12-18T00:11:24.7162954Z with: 2024-12-18T00:11:24.7163220Z driver-version: 550.54.15 2024-12-18T00:11:24.7163522Z env: 2024-12-18T00:11:24.7163776Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:11:24.7164085Z ##[endgroup] 2024-12-18T00:11:24.7485594Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-12-18T00:11:24.7486153Z with: 2024-12-18T00:11:24.7486450Z timeout_minutes: 10 2024-12-18T00:11:24.7486786Z max_attempts: 3 2024-12-18T00:11:24.7516380Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-12-18T00:11:24.7544493Z retry_wait_seconds: 10 2024-12-18T00:11:24.7544991Z polling_interval_seconds: 1 2024-12-18T00:11:24.7545343Z warning_on_retry: true 2024-12-18T00:11:24.7545847Z continue_on_error: false 2024-12-18T00:11:24.7546226Z env: 2024-12-18T00:11:24.7546485Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:11:24.7546837Z DRIVER_VERSION: 550.54.15 2024-12-18T00:11:24.7547182Z ##[endgroup] 2024-12-18T00:11:24.8935405Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-12-18T00:11:24.8936013Z + pre_install_nvidia_driver_amzn2 2024-12-18T00:11:24.8937364Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-12-18T00:11:25.2408246Z No match for argument: nvidia-driver-latest-dkms 2024-12-18T00:11:25.2409496Z No packages marked for removal. 2024-12-18T00:11:25.2469818Z Dependencies resolved. 2024-12-18T00:11:25.2476923Z Nothing to do. 2024-12-18T00:11:25.2477832Z Complete! 2024-12-18T00:11:25.3637341Z + install_nvidia_driver_common 2024-12-18T00:11:25.3641038Z + echo 'Before installing NVIDIA driver' 2024-12-18T00:11:25.3642168Z + lspci 2024-12-18T00:11:25.3643594Z Before installing NVIDIA driver 2024-12-18T00:11:25.3877142Z 00:00.0 Host bridge: Intel Corporation Sky Lake-E DMI3 Registers (rev 07) 2024-12-18T00:11:25.3878121Z 00:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.3878853Z 00:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.3879593Z 00:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.3896338Z 00:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.3897286Z 00:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.3897995Z 00:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.3898933Z 00:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.3899615Z 00:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.3900372Z 00:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 07) 2024-12-18T00:11:25.3901083Z 00:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 07) 2024-12-18T00:11:25.3901724Z 00:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 07) 2024-12-18T00:11:25.3902331Z 00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.3903134Z 00:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.3903843Z 00:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.3904571Z 00:11.0 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 0 (rev 09) 2024-12-18T00:11:25.3905356Z 00:11.1 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 1 (rev 09) 2024-12-18T00:11:25.3906297Z 00:11.5 SATA controller: Intel Corporation C620 Series Chipset Family SSATA Controller [AHCI mode] (rev 09) 2024-12-18T00:11:25.3907193Z 00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09) 2024-12-18T00:11:25.3908100Z 00:14.2 Signal processing controller: Intel Corporation C620 Series Chipset Family Thermal Subsystem (rev 09) 2024-12-18T00:11:25.3909155Z 00:16.0 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #1 (rev 09) 2024-12-18T00:11:25.3910076Z 00:16.4 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #3 (rev 09) 2024-12-18T00:11:25.3910980Z 00:17.0 SATA controller: Intel Corporation C620 Series Chipset Family SATA Controller [AHCI mode] (rev 09) 2024-12-18T00:11:25.3911797Z 00:1f.0 ISA bridge: Intel Corporation C621 Series Chipset LPC/eSPI Controller (rev 09) 2024-12-18T00:11:25.3912627Z 00:1f.2 Memory controller: Intel Corporation C620 Series Chipset Family Power Management Controller (rev 09) 2024-12-18T00:11:25.3913412Z 00:1f.4 SMBus: Intel Corporation C620 Series Chipset Family SMBus (rev 09) 2024-12-18T00:11:25.3914152Z 00:1f.5 Serial bus controller: Intel Corporation C620 Series Chipset Family SPI Controller (rev 09) 2024-12-18T00:11:25.3914930Z 17:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.3915612Z 17:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.3916248Z 17:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.3916929Z 17:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.3917676Z 17:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.3918358Z 17:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3919036Z 17:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3919709Z 17:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3920375Z 17:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3921029Z 17:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3921691Z 17:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3922360Z 17:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3923021Z 17:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3923696Z 17:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3924357Z 17:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3925004Z 17:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3925769Z 17:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3926472Z 17:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3927431Z 17:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3928126Z 17:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3928793Z 17:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3929452Z 17:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3930115Z 17:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3930799Z 17:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3931484Z 17:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3932184Z 17:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3932848Z 17:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3933517Z 17:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3934187Z 17:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3934856Z 17:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3935601Z 17:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3936263Z 17:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3936928Z 17:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3937582Z 17:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3938261Z 17:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3938931Z 17:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3939621Z 17:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3940304Z 17:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3940977Z 17:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3941634Z 17:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3942309Z 17:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3942988Z 17:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3943761Z 17:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3944426Z 17:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3945099Z 17:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3945734Z 17:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3946397Z 17:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3947067Z 17:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3947822Z 17:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3948461Z 17:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3949098Z 17:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3949709Z 17:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3950339Z 17:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3950975Z 17:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3951664Z 17:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3952311Z 17:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3952953Z 17:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3953569Z 17:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3954220Z 17:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3954846Z 17:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3955468Z 17:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3956078Z 17:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3956675Z 17:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3957289Z 17:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3957900Z 17:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.3958514Z 17:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.3959123Z 17:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.3959739Z 17:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.3960406Z 17:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.3961020Z 17:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.3961639Z 17:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.3962261Z 17:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.3962840Z 18:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.3963380Z 19:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.3963944Z 34:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.3964570Z 34:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.3965159Z 34:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.3965801Z 34:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.3966494Z 34:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.3967191Z 34:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3967924Z 34:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3968670Z 34:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3969425Z 34:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3970171Z 34:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3970912Z 34:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3971654Z 34:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3972324Z 34:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-12-18T00:11:25.3972939Z 34:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-12-18T00:11:25.3973562Z 34:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-12-18T00:11:25.3974192Z 34:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-12-18T00:11:25.3974805Z 34:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-12-18T00:11:25.3977082Z 34:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-12-18T00:11:25.3977711Z 34:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-12-18T00:11:25.3978401Z 34:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3979139Z 34:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3979889Z 34:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3980624Z 34:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3981356Z 34:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.3982013Z 34:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-12-18T00:11:25.3982629Z 34:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-12-18T00:11:25.3983243Z 34:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-12-18T00:11:25.3983861Z 34:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-12-18T00:11:25.3984474Z 34:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-12-18T00:11:25.3985077Z 34:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-12-18T00:11:25.3985767Z 34:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-12-18T00:11:25.3986341Z 35:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.3986865Z 36:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.3987439Z 7a:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.3988065Z 7a:01.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port B (rev 07) 2024-12-18T00:11:25.3988687Z 7a:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.3989263Z 7a:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.3989901Z 7a:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.3990588Z 7a:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.3991204Z 7a:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.3991805Z 7a:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.3992401Z 7a:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.3992987Z 7a:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.3993586Z 7a:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.3994184Z 7a:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.3994826Z 7a:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.3995487Z 7a:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.3996136Z 7a:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.3996763Z 7a:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.3997429Z 7a:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.3998074Z 7a:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.3998724Z 7a:15.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.3999372Z 7a:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.4000043Z 7a:16.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.4000754Z 7a:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.4001430Z 7a:16.5 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.4002412Z 7a:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.4003151Z 7a:17.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.4003779Z 7b:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4004245Z 7c:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4004682Z 7c:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4005144Z 7c:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4005604Z 7c:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4006058Z 7c:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4006509Z 7c:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4006944Z 7c:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4007392Z 7c:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4007847Z 7c:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4008299Z 7c:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4008755Z 7c:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4009184Z 7c:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4009751Z 7c:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4010208Z 7c:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4010661Z 7c:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4011123Z 7c:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4011559Z 7c:10.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4012021Z 7c:11.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4012478Z 7c:12.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4012940Z 7c:13.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4013396Z 7c:14.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4013931Z 7c:15.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4014470Z 7c:16.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4014895Z 7c:17.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4015273Z 7c:18.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4015663Z 7c:19.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4016043Z 7c:1a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4016427Z 7c:1b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4016813Z 7c:1c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4017184Z 7c:1d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4017574Z 7c:1e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4017962Z 7c:1f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4018355Z 9d:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4018745Z 9e:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4019118Z 9e:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4019505Z 9e:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4019882Z 9e:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4020268Z 9e:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4020664Z 9e:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4021036Z 9e:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4021420Z 9e:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4021808Z 9e:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4022199Z 9e:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4022588Z 9e:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4022965Z 9e:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4023530Z 9e:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4024035Z 9e:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4024449Z 9e:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4024859Z 9e:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4025275Z 9e:10.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4025673Z 9e:11.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4026094Z 9e:12.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4026505Z 9e:13.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4026919Z 9e:14.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4027332Z 9e:15.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4027726Z 9e:16.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4028138Z 9e:17.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4028550Z 9e:18.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4028963Z 9e:19.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4029378Z 9e:1a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4029781Z 9e:1b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4030187Z 9e:1c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4030597Z 9e:1d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4031010Z 9e:1e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4031474Z 9e:1f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4031907Z 9f:00.0 Serial controller: Amazon.com, Inc. Device 8250 2024-12-18T00:11:25.4032421Z a0:00.0 Non-Volatile memory controller: Amazon.com, Inc. Device 0061 2024-12-18T00:11:25.4032998Z bf:00.0 Non-Volatile memory controller: Amazon.com, Inc. Device cd00 2024-12-18T00:11:25.4033580Z bf:00.1 Non-Volatile memory controller: Amazon.com, Inc. Device cd00 2024-12-18T00:11:25.4034195Z c0:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.4035122Z c0:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.4035783Z c0:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.4036443Z c0:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.4037109Z c0:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.4037770Z c0:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.4038434Z c0:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.4039103Z c0:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.4039821Z c0:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 07) 2024-12-18T00:11:25.4040503Z c0:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 07) 2024-12-18T00:11:25.4041021Z c0:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 07) 2024-12-18T00:11:25.4041588Z c0:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.4042256Z c0:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.4042929Z c0:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.4043573Z c2:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.4044196Z c2:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.4044863Z c2:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.4045584Z c2:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.4046246Z c2:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4046880Z c2:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4047571Z c2:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4048206Z c2:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4048840Z c2:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4049477Z c2:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4050120Z c2:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4050754Z c2:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4051402Z c2:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4052053Z c2:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4052698Z c2:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4053343Z c2:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4053988Z c2:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4054618Z c2:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4055262Z c2:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4055906Z c2:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4056624Z c2:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4057281Z c2:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4057943Z c2:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4058689Z c2:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4059315Z c2:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4059944Z c2:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4060574Z c2:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4061205Z c2:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4061824Z c2:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4062444Z c2:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4063071Z c2:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4063678Z c2:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4064306Z c2:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4064935Z c2:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4065566Z c2:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4066178Z c2:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4066810Z c2:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4067441Z c2:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4068067Z c2:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4068701Z c2:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4069319Z c2:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4069929Z c2:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4070547Z c2:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4071169Z c2:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4071873Z c2:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4072507Z c2:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4073139Z c2:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4073756Z c2:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4074413Z c2:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4075065Z c2:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4075700Z c2:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4076311Z c2:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4076922Z c2:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4077523Z c2:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4078134Z c2:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4078743Z c2:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4079360Z c2:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4079996Z c2:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4080637Z c2:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4081247Z c2:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4081869Z c2:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4082489Z c2:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4083099Z c2:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4083713Z c2:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.4084318Z c2:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.4084958Z c2:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.4085573Z c2:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.4086201Z c2:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.4086831Z c2:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.4087461Z c2:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.4088062Z c2:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.4088571Z c3:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4088967Z c4:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4089373Z c4:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4089782Z c4:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4090192Z c4:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4090590Z c4:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4091005Z c4:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4091419Z c4:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4091842Z c4:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4092248Z c4:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4092644Z c4:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4093042Z c4:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4093436Z c4:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4093853Z c4:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4094283Z c4:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4094759Z c4:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4095158Z c4:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.4095657Z c6:00.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-12-18T00:11:25.4096289Z e6:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.4096939Z e6:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.4097571Z e6:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.4098258Z e6:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.4098955Z e6:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.4099639Z e6:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4100417Z e6:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4101204Z e6:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4102244Z e6:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4103066Z e6:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4103880Z e6:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4104789Z e6:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4105551Z e6:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-12-18T00:11:25.4106221Z e6:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-12-18T00:11:25.4106916Z e6:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-12-18T00:11:25.4107615Z e6:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-12-18T00:11:25.4108286Z e6:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-12-18T00:11:25.4108936Z e6:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-12-18T00:11:25.4109607Z e6:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-12-18T00:11:25.4110368Z e6:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4111186Z e6:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4112004Z e6:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4112805Z e6:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4113598Z e6:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.4114525Z e6:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-12-18T00:11:25.4115149Z e6:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-12-18T00:11:25.4115793Z e6:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-12-18T00:11:25.4116439Z e6:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-12-18T00:11:25.4117075Z e6:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-12-18T00:11:25.4117698Z e6:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-12-18T00:11:25.4118330Z e6:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-12-18T00:11:25.4118898Z e7:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.4119429Z e8:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.4120013Z f3:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.4120710Z f3:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.4121289Z f3:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.4121931Z f3:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.4122622Z f3:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.4123242Z f3:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.4123850Z f3:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.4124455Z f3:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.4125040Z f3:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.4125642Z f3:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.4126234Z f3:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.4126864Z f3:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.4127522Z f3:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.4128171Z f3:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.4128796Z f3:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.4129501Z f3:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.4130152Z f3:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.4130807Z f3:15.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.4131474Z f3:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.4132119Z f3:16.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.4132758Z f3:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.4133409Z f3:16.5 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.4134057Z f3:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.4134710Z f3:17.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.4135314Z f4:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.4135837Z f5:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.4136252Z + lsmod 2024-12-18T00:11:25.4136549Z Module Size Used by 2024-12-18T00:11:25.4136896Z veth 36864 0 2024-12-18T00:11:25.4137202Z nvidia_modeset 1351680 0 2024-12-18T00:11:25.4137550Z video 65536 1 nvidia_modeset 2024-12-18T00:11:25.4137912Z wmi 36864 1 video 2024-12-18T00:11:25.4138217Z nvidia_uvm 4706304 0 2024-12-18T00:11:25.4138563Z nvidia 54071296 35 nvidia_uvm,nvidia_modeset 2024-12-18T00:11:25.4138936Z drm 602112 1 nvidia 2024-12-18T00:11:25.4139300Z drm_panel_orientation_quirks 32768 1 drm 2024-12-18T00:11:25.4139714Z backlight 24576 3 video,drm,nvidia_modeset 2024-12-18T00:11:25.4140097Z i2c_core 106496 2 nvidia,drm 2024-12-18T00:11:25.4140434Z xt_conntrack 16384 1 2024-12-18T00:11:25.4140732Z nft_chain_nat 16384 3 2024-12-18T00:11:25.4141030Z xt_MASQUERADE 20480 1 2024-12-18T00:11:25.4141392Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-12-18T00:11:25.4141776Z nf_conntrack_netlink 57344 0 2024-12-18T00:11:25.4142246Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-12-18T00:11:25.4142763Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-12-18T00:11:25.4143209Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-12-18T00:11:25.4143580Z xfrm_user 57344 1 2024-12-18T00:11:25.4143898Z xfrm_algo 16384 1 xfrm_user 2024-12-18T00:11:25.4144268Z xt_addrtype 16384 2 2024-12-18T00:11:25.4144609Z nft_compat 20480 4 2024-12-18T00:11:25.4144994Z nf_tables 311296 57 nft_compat,nft_chain_nat 2024-12-18T00:11:25.4145507Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-12-18T00:11:25.4145948Z br_netfilter 36864 0 2024-12-18T00:11:25.4146303Z bridge 323584 1 br_netfilter 2024-12-18T00:11:25.4146679Z stp 16384 1 bridge 2024-12-18T00:11:25.4147048Z llc 16384 2 bridge,stp 2024-12-18T00:11:25.4147414Z overlay 167936 0 2024-12-18T00:11:25.4147713Z tls 114688 0 2024-12-18T00:11:25.4148042Z nls_ascii 16384 1 2024-12-18T00:11:25.4148372Z nls_cp437 20480 1 2024-12-18T00:11:25.4148698Z vfat 24576 1 2024-12-18T00:11:25.4149027Z sunrpc 692224 1 2024-12-18T00:11:25.4149333Z fat 86016 1 vfat 2024-12-18T00:11:25.4149679Z skx_edac 20480 0 2024-12-18T00:11:25.4150013Z skx_edac_common 28672 1 skx_edac 2024-12-18T00:11:25.4150384Z x86_pkg_temp_thermal 20480 0 2024-12-18T00:11:25.4150722Z kvm_intel 393216 0 2024-12-18T00:11:25.4151089Z kvm 1155072 1 kvm_intel 2024-12-18T00:11:25.4151456Z ena 167936 0 2024-12-18T00:11:25.4151788Z irqbypass 16384 1 kvm 2024-12-18T00:11:25.4152119Z ghash_clmulni_intel 16384 0 2024-12-18T00:11:25.4152455Z lpc_ich 28672 0 2024-12-18T00:11:25.4152744Z ioatdma 69632 0 2024-12-18T00:11:25.4153061Z mfd_core 20480 1 lpc_ich 2024-12-18T00:11:25.4153402Z dca 16384 1 ioatdma 2024-12-18T00:11:25.4153749Z button 24576 0 2024-12-18T00:11:25.4154077Z sch_fq_codel 20480 33 2024-12-18T00:11:25.4154384Z dm_mod 188416 0 2024-12-18T00:11:25.4154696Z fuse 163840 1 2024-12-18T00:11:25.4155005Z loop 36864 0 2024-12-18T00:11:25.4155319Z configfs 57344 1 2024-12-18T00:11:25.4155926Z dax 45056 1 dm_mod 2024-12-18T00:11:25.4156261Z dmi_sysfs 20480 0 2024-12-18T00:11:25.4156773Z crc32_pclmul 16384 0 2024-12-18T00:11:25.4157126Z crc32c_intel 24576 0 2024-12-18T00:11:25.4157466Z + modinfo nvidia 2024-12-18T00:11:25.4157969Z filename: /lib/modules/6.1.109-118.189.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-12-18T00:11:25.4158542Z alias: char-major-195-* 2024-12-18T00:11:25.4158904Z version: 550.54.15 2024-12-18T00:11:25.4159238Z supported: external 2024-12-18T00:11:25.4159578Z license: NVIDIA 2024-12-18T00:11:25.4159935Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-12-18T00:11:25.4160364Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-12-18T00:11:25.4160784Z srcversion: 833721318DA517F0C2FEC97 2024-12-18T00:11:25.4161192Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-12-18T00:11:25.4161629Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-12-18T00:11:25.4162069Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-12-18T00:11:25.4162450Z depends: i2c-core,drm 2024-12-18T00:11:25.4162795Z retpoline: Y 2024-12-18T00:11:25.4163089Z name: nvidia 2024-12-18T00:11:25.4163527Z vermagic: 6.1.109-118.189.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-12-18T00:11:25.4164127Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-12-18T00:11:25.4164676Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-12-18T00:11:25.4165207Z parm: NVreg_ResmanDebugLevel:int 2024-12-18T00:11:25.4165601Z parm: NVreg_RmLogonRC:int 2024-12-18T00:11:25.4165989Z parm: NVreg_ModifyDeviceFiles:int 2024-12-18T00:11:25.4166482Z parm: NVreg_DeviceFileUID:int 2024-12-18T00:11:25.4166864Z parm: NVreg_DeviceFileGID:int 2024-12-18T00:11:25.4167263Z parm: NVreg_DeviceFileMode:int 2024-12-18T00:11:25.4167836Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-12-18T00:11:25.4168415Z parm: NVreg_UsePageAttributeTable:int 2024-12-18T00:11:25.4168822Z parm: NVreg_EnablePCIeGen3:int 2024-12-18T00:11:25.4169165Z parm: NVreg_EnableMSI:int 2024-12-18T00:11:25.4169516Z parm: NVreg_TCEBypassMode:int 2024-12-18T00:11:25.4169902Z parm: NVreg_EnableStreamMemOPs:int 2024-12-18T00:11:25.4170325Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-12-18T00:11:25.4170796Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-12-18T00:11:25.4171257Z parm: NVreg_EnableS0ixPowerManagement:int 2024-12-18T00:11:25.4171724Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-12-18T00:11:25.4172214Z parm: NVreg_DynamicPowerManagement:int 2024-12-18T00:11:25.4172711Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-12-18T00:11:25.4173205Z parm: NVreg_EnableGpuFirmware:int 2024-12-18T00:11:25.4173618Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-12-18T00:11:25.4174038Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-12-18T00:11:25.4174490Z parm: NVreg_EnableUserNUMAManagement:int 2024-12-18T00:11:25.4174956Z parm: NVreg_MemoryPoolSize:int 2024-12-18T00:11:25.4175350Z parm: NVreg_KMallocHeapMaxSize:int 2024-12-18T00:11:25.4175762Z parm: NVreg_VMallocHeapMaxSize:int 2024-12-18T00:11:25.4176135Z parm: NVreg_IgnoreMMIOCheck:int 2024-12-18T00:11:25.4176522Z parm: NVreg_NvLinkDisable:int 2024-12-18T00:11:25.4176938Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-12-18T00:11:25.4177372Z parm: NVreg_RegisterPCIDriver:int 2024-12-18T00:11:25.4177783Z parm: NVreg_EnableResizableBar:int 2024-12-18T00:11:25.4178261Z parm: NVreg_EnableDbgBreakpoint:int 2024-12-18T00:11:25.4178706Z parm: NVreg_EnableNonblockingOpen:int 2024-12-18T00:11:25.4179121Z parm: NVreg_RegistryDwords:charp 2024-12-18T00:11:25.4179536Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-12-18T00:11:25.4179940Z parm: NVreg_RmMsg:charp 2024-12-18T00:11:25.4180272Z parm: NVreg_GpuBlacklist:charp 2024-12-18T00:11:25.4180648Z parm: NVreg_TemporaryFilePath:charp 2024-12-18T00:11:25.4181024Z parm: NVreg_ExcludedGpus:charp 2024-12-18T00:11:25.4181388Z parm: NVreg_DmaRemapPeerMmio:int 2024-12-18T00:11:25.4181775Z parm: NVreg_RmNvlinkBandwidth:charp 2024-12-18T00:11:25.4182143Z parm: NVreg_ImexChannelCount:int 2024-12-18T00:11:25.4182558Z parm: rm_firmware_active:charp 2024-12-18T00:11:25.4182899Z + HAS_NVIDIA_DRIVER=0 2024-12-18T00:11:25.4183178Z ++ command -v nvidia-smi 2024-12-18T00:11:25.4183484Z + '[' -x /usr/bin/nvidia-smi ']' 2024-12-18T00:11:25.4183774Z + set +e 2024-12-18T00:11:25.4184129Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-12-18T00:11:25.4233142Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-12-18T00:11:25.4234841Z + NVIDIA_SMI_STATUS=0 2024-12-18T00:11:25.4235751Z + '[' 0 -ne 0 ']' 2024-12-18T00:11:25.4236479Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-12-18T00:11:25.4237382Z + HAS_NVIDIA_DRIVER=1 2024-12-18T00:11:25.4238827Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-12-18T00:11:25.4240362Z + set -e 2024-12-18T00:11:25.4240993Z + '[' 1 -eq 0 ']' 2024-12-18T00:11:25.4242239Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-12-18T00:11:25.4243746Z + post_install_nvidia_driver_common 2024-12-18T00:11:25.4244400Z + sudo modprobe nvidia 2024-12-18T00:11:25.5476152Z + echo 'After installing NVIDIA driver' 2024-12-18T00:11:25.5476647Z + lspci 2024-12-18T00:11:25.5478373Z After installing NVIDIA driver 2024-12-18T00:11:25.5710003Z 00:00.0 Host bridge: Intel Corporation Sky Lake-E DMI3 Registers (rev 07) 2024-12-18T00:11:25.5710768Z 00:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5711543Z 00:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5712252Z 00:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5712963Z 00:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5713633Z 00:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5714322Z 00:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5715020Z 00:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5715729Z 00:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5716513Z 00:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 07) 2024-12-18T00:11:25.5717252Z 00:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 07) 2024-12-18T00:11:25.5717791Z 00:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 07) 2024-12-18T00:11:25.5718398Z 00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.5719313Z 00:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.5720021Z 00:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.5720756Z 00:11.0 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 0 (rev 09) 2024-12-18T00:11:25.5721532Z 00:11.1 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 1 (rev 09) 2024-12-18T00:11:25.5722367Z 00:11.5 SATA controller: Intel Corporation C620 Series Chipset Family SSATA Controller [AHCI mode] (rev 09) 2024-12-18T00:11:25.5723266Z 00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09) 2024-12-18T00:11:25.5724177Z 00:14.2 Signal processing controller: Intel Corporation C620 Series Chipset Family Thermal Subsystem (rev 09) 2024-12-18T00:11:25.5725123Z 00:16.0 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #1 (rev 09) 2024-12-18T00:11:25.5726056Z 00:16.4 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #3 (rev 09) 2024-12-18T00:11:25.5726971Z 00:17.0 SATA controller: Intel Corporation C620 Series Chipset Family SATA Controller [AHCI mode] (rev 09) 2024-12-18T00:11:25.5727793Z 00:1f.0 ISA bridge: Intel Corporation C621 Series Chipset LPC/eSPI Controller (rev 09) 2024-12-18T00:11:25.5728616Z 00:1f.2 Memory controller: Intel Corporation C620 Series Chipset Family Power Management Controller (rev 09) 2024-12-18T00:11:25.5729405Z 00:1f.4 SMBus: Intel Corporation C620 Series Chipset Family SMBus (rev 09) 2024-12-18T00:11:25.5730149Z 00:1f.5 Serial bus controller: Intel Corporation C620 Series Chipset Family SPI Controller (rev 09) 2024-12-18T00:11:25.5731043Z 17:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.5731671Z 17:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.5732261Z 17:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.5732891Z 17:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.5733579Z 17:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.5734209Z 17:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5734821Z 17:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5735433Z 17:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5736133Z 17:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5736734Z 17:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5737350Z 17:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5737966Z 17:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5738587Z 17:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5739205Z 17:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5739987Z 17:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5740618Z 17:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5741261Z 17:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5741915Z 17:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5742563Z 17:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5743213Z 17:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5743857Z 17:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5744492Z 17:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5745200Z 17:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5745844Z 17:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5746492Z 17:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5747139Z 17:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5747791Z 17:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5748434Z 17:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5749086Z 17:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5749731Z 17:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5750380Z 17:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5751035Z 17:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5751673Z 17:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5752327Z 17:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5752991Z 17:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5753810Z 17:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5754487Z 17:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5755167Z 17:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5755834Z 17:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5756510Z 17:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5757185Z 17:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5757865Z 17:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5758543Z 17:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5759212Z 17:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5759869Z 17:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5760541Z 17:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5761300Z 17:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5761974Z 17:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5762646Z 17:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5763320Z 17:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5763981Z 17:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5764656Z 17:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5765321Z 17:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5765987Z 17:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5766647Z 17:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5767420Z 17:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5768053Z 17:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5768693Z 17:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5769451Z 17:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5770177Z 17:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5770841Z 17:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5771452Z 17:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5772052Z 17:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5772662Z 17:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5773273Z 17:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5773890Z 17:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5774507Z 17:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5775118Z 17:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5775717Z 17:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5776337Z 17:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5776954Z 17:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5777566Z 17:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5778145Z 18:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.5778674Z 19:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.5779241Z 34:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.5779871Z 34:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.5780456Z 34:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.5781093Z 34:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.5781781Z 34:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.5782480Z 34:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5783209Z 34:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5783946Z 34:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5784686Z 34:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5785496Z 34:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5786235Z 34:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5786973Z 34:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5787638Z 34:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-12-18T00:11:25.5788256Z 34:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-12-18T00:11:25.5788880Z 34:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-12-18T00:11:25.5789650Z 34:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-12-18T00:11:25.5790274Z 34:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-12-18T00:11:25.5790887Z 34:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-12-18T00:11:25.5791490Z 34:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-12-18T00:11:25.5792176Z 34:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5792917Z 34:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5793658Z 34:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5794445Z 34:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5795183Z 34:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5795845Z 34:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-12-18T00:11:25.5796453Z 34:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-12-18T00:11:25.5797068Z 34:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-12-18T00:11:25.5797689Z 34:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-12-18T00:11:25.5798310Z 34:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-12-18T00:11:25.5798919Z 34:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-12-18T00:11:25.5799524Z 34:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-12-18T00:11:25.5800107Z 35:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.5800636Z 36:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.5801212Z 7a:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.5802089Z 7a:01.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port B (rev 07) 2024-12-18T00:11:25.5802776Z 7a:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.5803405Z 7a:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.5804103Z 7a:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.5804858Z 7a:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.5805525Z 7a:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.5806179Z 7a:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.5806837Z 7a:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.5807473Z 7a:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.5808130Z 7a:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.5808781Z 7a:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.5809486Z 7a:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5810297Z 7a:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5811012Z 7a:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5811706Z 7a:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5812433Z 7a:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5813150Z 7a:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.5813954Z 7a:15.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.5814772Z 7a:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.5815422Z 7a:16.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.5816062Z 7a:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.5816718Z 7a:16.5 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.5817371Z 7a:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.5818026Z 7a:17.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.5818571Z 7b:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5818977Z 7c:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5819426Z 7c:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5819830Z 7c:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5820230Z 7c:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5820628Z 7c:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5821028Z 7c:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5821408Z 7c:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5821807Z 7c:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5822212Z 7c:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5822600Z 7c:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5822991Z 7c:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5823371Z 7c:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5823767Z 7c:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5824159Z 7c:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5824556Z 7c:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5824951Z 7c:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5825331Z 7c:10.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5825720Z 7c:11.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5826115Z 7c:12.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5826507Z 7c:13.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5826899Z 7c:14.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5827283Z 7c:15.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5827678Z 7c:16.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5828070Z 7c:17.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5828464Z 7c:18.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5828857Z 7c:19.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5829240Z 7c:1a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5829640Z 7c:1b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5830031Z 7c:1c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5830422Z 7c:1d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5830815Z 7c:1e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5831210Z 7c:1f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5831592Z 9d:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5831984Z 9e:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5832428Z 9e:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5832828Z 9e:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5833230Z 9e:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5833612Z 9e:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5834010Z 9e:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5834407Z 9e:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5834807Z 9e:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5835199Z 9e:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5835579Z 9e:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5835973Z 9e:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5836367Z 9e:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5836763Z 9e:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5837158Z 9e:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5837537Z 9e:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5837936Z 9e:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5838331Z 9e:10.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5838726Z 9e:11.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5839120Z 9e:12.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5839505Z 9e:13.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5839948Z 9e:14.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5840343Z 9e:15.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5840743Z 9e:16.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5841140Z 9e:17.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5841523Z 9e:18.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5841921Z 9e:19.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5842315Z 9e:1a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5842708Z 9e:1b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5843111Z 9e:1c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5843506Z 9e:1d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5843889Z 9e:1e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5844281Z 9e:1f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5844697Z 9f:00.0 Serial controller: Amazon.com, Inc. Device 8250 2024-12-18T00:11:25.5845202Z a0:00.0 Non-Volatile memory controller: Amazon.com, Inc. Device 0061 2024-12-18T00:11:25.5845750Z bf:00.0 Non-Volatile memory controller: Amazon.com, Inc. Device cd00 2024-12-18T00:11:25.5846281Z bf:00.1 Non-Volatile memory controller: Amazon.com, Inc. Device cd00 2024-12-18T00:11:25.5846873Z c0:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5847506Z c0:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5848142Z c0:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5848773Z c0:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5849585Z c0:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5850239Z c0:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5850906Z c0:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5851576Z c0:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-12-18T00:11:25.5852312Z c0:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 07) 2024-12-18T00:11:25.5853003Z c0:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 07) 2024-12-18T00:11:25.5853533Z c0:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 07) 2024-12-18T00:11:25.5854082Z c0:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.5854814Z c0:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.5855504Z c0:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-12-18T00:11:25.5856171Z c2:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.5856799Z c2:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.5857480Z c2:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.5858201Z c2:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.5858872Z c2:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5859529Z c2:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5860185Z c2:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5860844Z c2:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5861483Z c2:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5862242Z c2:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5862862Z c2:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5863481Z c2:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5864189Z c2:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5864807Z c2:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5865408Z c2:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5866027Z c2:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5866650Z c2:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5867268Z c2:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5867878Z c2:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5868487Z c2:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5869085Z c2:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5869705Z c2:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5870317Z c2:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5870928Z c2:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5871539Z c2:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5889715Z c2:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5890363Z c2:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5890984Z c2:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5891599Z c2:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5892198Z c2:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5892799Z c2:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5893423Z c2:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5894016Z c2:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5894622Z c2:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5895224Z c2:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5895823Z c2:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5896533Z c2:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5897135Z c2:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5897740Z c2:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5898337Z c2:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5898955Z c2:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5899743Z c2:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5900385Z c2:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5901019Z c2:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5901734Z c2:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5902616Z c2:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5903285Z c2:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5903949Z c2:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5904610Z c2:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5905258Z c2:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5906027Z c2:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5906690Z c2:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5907354Z c2:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5908006Z c2:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5908669Z c2:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5909323Z c2:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5909985Z c2:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5910648Z c2:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5911309Z c2:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5911971Z c2:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5912632Z c2:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5913285Z c2:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5914046Z c2:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5914687Z c2:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-12-18T00:11:25.5915336Z c2:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5915981Z c2:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5916625Z c2:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5917267Z c2:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5918022Z c2:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5918653Z c2:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5919283Z c2:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-12-18T00:11:25.5919790Z c3:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5920209Z c4:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5920591Z c4:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5920978Z c4:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5923496Z c4:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5923916Z c4:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5924307Z c4:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5924684Z c4:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5925076Z c4:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5925466Z c4:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5925872Z c4:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5926276Z c4:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5926675Z c4:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5927054Z c4:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5927456Z c4:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5927857Z c4:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5928258Z c4:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-12-18T00:11:25.5928779Z c6:00.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-12-18T00:11:25.5929403Z e6:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.5930042Z e6:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.5930644Z e6:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.5931348Z e6:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.5932055Z e6:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.5932766Z e6:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5933509Z e6:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5934266Z e6:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5935020Z e6:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5935775Z e6:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5936524Z e6:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5937280Z e6:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5937955Z e6:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-12-18T00:11:25.5938580Z e6:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-12-18T00:11:25.5939208Z e6:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-12-18T00:11:25.5939842Z e6:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-12-18T00:11:25.5940459Z e6:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-12-18T00:11:25.5941068Z e6:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-12-18T00:11:25.5941671Z e6:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-12-18T00:11:25.5942345Z e6:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5943083Z e6:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5943819Z e6:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5944555Z e6:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5945288Z e6:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-12-18T00:11:25.5945946Z e6:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-12-18T00:11:25.5946549Z e6:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-12-18T00:11:25.5947194Z e6:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-12-18T00:11:25.5947814Z e6:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-12-18T00:11:25.5948422Z e6:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-12-18T00:11:25.5949023Z e6:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-12-18T00:11:25.5949634Z e6:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-12-18T00:11:25.5950206Z e7:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.5950728Z e8:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.5951295Z f3:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-12-18T00:11:25.5951916Z f3:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-12-18T00:11:25.5952704Z f3:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-12-18T00:11:25.5953360Z f3:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-12-18T00:11:25.5954079Z f3:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-12-18T00:11:25.5954723Z f3:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.5955352Z f3:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.5956043Z f3:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.5956673Z f3:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.5957292Z f3:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-12-18T00:11:25.5957919Z f3:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-12-18T00:11:25.5958589Z f3:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5959287Z f3:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5959965Z f3:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5960638Z f3:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5961314Z f3:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-12-18T00:11:25.5961992Z f3:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.5962669Z f3:15.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.5963346Z f3:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.5964134Z f3:16.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.5964776Z f3:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.5965403Z f3:16.5 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.5966041Z f3:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-12-18T00:11:25.5966678Z f3:17.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-12-18T00:11:25.5967271Z f4:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.5967796Z f5:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-12-18T00:11:25.5968199Z + lsmod 2024-12-18T00:11:25.5968430Z Module Size Used by 2024-12-18T00:11:25.5968736Z veth 36864 0 2024-12-18T00:11:25.5969024Z nvidia_modeset 1351680 0 2024-12-18T00:11:25.5969334Z video 65536 1 nvidia_modeset 2024-12-18T00:11:25.5969659Z wmi 36864 1 video 2024-12-18T00:11:25.5969962Z nvidia_uvm 4706304 0 2024-12-18T00:11:25.5970296Z nvidia 54071296 35 nvidia_uvm,nvidia_modeset 2024-12-18T00:11:25.5970702Z drm 602112 1 nvidia 2024-12-18T00:11:25.5971048Z drm_panel_orientation_quirks 32768 1 drm 2024-12-18T00:11:25.5971436Z backlight 24576 3 video,drm,nvidia_modeset 2024-12-18T00:11:25.5971824Z i2c_core 106496 2 nvidia,drm 2024-12-18T00:11:25.5972151Z xt_conntrack 16384 1 2024-12-18T00:11:25.5972445Z nft_chain_nat 16384 3 2024-12-18T00:11:25.5972740Z xt_MASQUERADE 20480 1 2024-12-18T00:11:25.5973061Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-12-18T00:11:25.5973432Z nf_conntrack_netlink 57344 0 2024-12-18T00:11:25.5973878Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-12-18T00:11:25.5974373Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-12-18T00:11:25.5974725Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-12-18T00:11:25.5975054Z xfrm_user 57344 1 2024-12-18T00:11:25.5975341Z xfrm_algo 16384 1 xfrm_user 2024-12-18T00:11:25.5975670Z xt_addrtype 16384 2 2024-12-18T00:11:25.5975962Z nft_compat 20480 4 2024-12-18T00:11:25.5976312Z nf_tables 311296 57 nft_compat,nft_chain_nat 2024-12-18T00:11:25.5976795Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-12-18T00:11:25.5977211Z br_netfilter 36864 0 2024-12-18T00:11:25.5977547Z bridge 323584 1 br_netfilter 2024-12-18T00:11:25.5977933Z stp 16384 1 bridge 2024-12-18T00:11:25.5978281Z llc 16384 2 bridge,stp 2024-12-18T00:11:25.5978618Z overlay 167936 0 2024-12-18T00:11:25.5978896Z tls 114688 0 2024-12-18T00:11:25.5979200Z nls_ascii 16384 1 2024-12-18T00:11:25.5979506Z nls_cp437 20480 1 2024-12-18T00:11:25.5979811Z vfat 24576 1 2024-12-18T00:11:25.5980114Z sunrpc 692224 1 2024-12-18T00:11:25.5980397Z fat 86016 1 vfat 2024-12-18T00:11:25.5980721Z skx_edac 20480 0 2024-12-18T00:11:25.5981035Z skx_edac_common 28672 1 skx_edac 2024-12-18T00:11:25.5981388Z x86_pkg_temp_thermal 20480 0 2024-12-18T00:11:25.5981709Z kvm_intel 393216 0 2024-12-18T00:11:25.5982001Z kvm 1155072 1 kvm_intel 2024-12-18T00:11:25.5982327Z ena 167936 0 2024-12-18T00:11:25.5982627Z irqbypass 16384 1 kvm 2024-12-18T00:11:25.5982964Z ghash_clmulni_intel 16384 0 2024-12-18T00:11:25.5983276Z lpc_ich 28672 0 2024-12-18T00:11:25.5983554Z ioatdma 69632 0 2024-12-18T00:11:25.5983863Z mfd_core 20480 1 lpc_ich 2024-12-18T00:11:25.5984195Z dca 16384 1 ioatdma 2024-12-18T00:11:25.5984522Z button 24576 0 2024-12-18T00:11:25.5984817Z sch_fq_codel 20480 33 2024-12-18T00:11:25.5985129Z dm_mod 188416 0 2024-12-18T00:11:25.5985423Z fuse 163840 1 2024-12-18T00:11:25.5985727Z loop 36864 0 2024-12-18T00:11:25.5986008Z configfs 57344 1 2024-12-18T00:11:25.5986290Z dax 45056 1 dm_mod 2024-12-18T00:11:25.5986590Z dmi_sysfs 20480 0 2024-12-18T00:11:25.5986863Z crc32_pclmul 16384 0 2024-12-18T00:11:25.5987146Z crc32c_intel 24576 0 2024-12-18T00:11:25.5987425Z + modinfo nvidia 2024-12-18T00:11:25.5987856Z filename: /lib/modules/6.1.109-118.189.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-12-18T00:11:25.5988361Z alias: char-major-195-* 2024-12-18T00:11:25.5988649Z version: 550.54.15 2024-12-18T00:11:25.5988918Z supported: external 2024-12-18T00:11:25.5989184Z license: NVIDIA 2024-12-18T00:11:25.5989626Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-12-18T00:11:25.5990001Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-12-18T00:11:25.5990345Z srcversion: 833721318DA517F0C2FEC97 2024-12-18T00:11:25.5990738Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-12-18T00:11:25.5991122Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-12-18T00:11:25.5991497Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-12-18T00:11:25.5991847Z depends: i2c-core,drm 2024-12-18T00:11:25.5992125Z retpoline: Y 2024-12-18T00:11:25.5992372Z name: nvidia 2024-12-18T00:11:25.5992775Z vermagic: 6.1.109-118.189.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-12-18T00:11:25.5993308Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-12-18T00:11:25.5993812Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-12-18T00:11:25.5994272Z parm: NVreg_ResmanDebugLevel:int 2024-12-18T00:11:25.5994615Z parm: NVreg_RmLogonRC:int 2024-12-18T00:11:25.5994950Z parm: NVreg_ModifyDeviceFiles:int 2024-12-18T00:11:25.5995304Z parm: NVreg_DeviceFileUID:int 2024-12-18T00:11:25.5995638Z parm: NVreg_DeviceFileGID:int 2024-12-18T00:11:25.5995977Z parm: NVreg_DeviceFileMode:int 2024-12-18T00:11:25.5996374Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-12-18T00:11:25.5996801Z parm: NVreg_UsePageAttributeTable:int 2024-12-18T00:11:25.5997169Z parm: NVreg_EnablePCIeGen3:int 2024-12-18T00:11:25.5997505Z parm: NVreg_EnableMSI:int 2024-12-18T00:11:25.5997819Z parm: NVreg_TCEBypassMode:int 2024-12-18T00:11:25.5998208Z parm: NVreg_EnableStreamMemOPs:int 2024-12-18T00:11:25.5998612Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-12-18T00:11:25.5999046Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-12-18T00:11:25.5999461Z parm: NVreg_EnableS0ixPowerManagement:int 2024-12-18T00:11:25.5999913Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-12-18T00:11:25.6000353Z parm: NVreg_DynamicPowerManagement:int 2024-12-18T00:11:25.6000806Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-12-18T00:11:25.6001257Z parm: NVreg_EnableGpuFirmware:int 2024-12-18T00:11:25.6001679Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-12-18T00:11:25.6002324Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-12-18T00:11:25.6002765Z parm: NVreg_EnableUserNUMAManagement:int 2024-12-18T00:11:25.6003184Z parm: NVreg_MemoryPoolSize:int 2024-12-18T00:11:25.6003574Z parm: NVreg_KMallocHeapMaxSize:int 2024-12-18T00:11:25.6003719Z parm: NVreg_VMallocHeapMaxSize:int 2024-12-18T00:11:25.6003861Z parm: NVreg_IgnoreMMIOCheck:int 2024-12-18T00:11:25.6003994Z parm: NVreg_NvLinkDisable:int 2024-12-18T00:11:25.6004175Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-12-18T00:11:25.6004311Z parm: NVreg_RegisterPCIDriver:int 2024-12-18T00:11:25.6004458Z parm: NVreg_EnableResizableBar:int 2024-12-18T00:11:25.6004601Z parm: NVreg_EnableDbgBreakpoint:int 2024-12-18T00:11:25.6004755Z parm: NVreg_EnableNonblockingOpen:int 2024-12-18T00:11:25.6004897Z parm: NVreg_RegistryDwords:charp 2024-12-18T00:11:25.6005053Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-12-18T00:11:25.6005177Z parm: NVreg_RmMsg:charp 2024-12-18T00:11:25.6005307Z parm: NVreg_GpuBlacklist:charp 2024-12-18T00:11:25.6005450Z parm: NVreg_TemporaryFilePath:charp 2024-12-18T00:11:25.6005581Z parm: NVreg_ExcludedGpus:charp 2024-12-18T00:11:25.6005721Z parm: NVreg_DmaRemapPeerMmio:int 2024-12-18T00:11:25.6005863Z parm: NVreg_RmNvlinkBandwidth:charp 2024-12-18T00:11:25.6005994Z parm: NVreg_ImexChannelCount:int 2024-12-18T00:11:25.6006125Z parm: rm_firmware_active:charp 2024-12-18T00:11:25.6006219Z + set +e 2024-12-18T00:11:25.6006319Z + nvidia-smi 2024-12-18T00:11:25.6591799Z Wed Dec 18 00:11:25 2024 2024-12-18T00:11:25.6593041Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:11:25.6594089Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-12-18T00:11:25.6594674Z |-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.6595283Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-12-18T00:11:25.6595549Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-12-18T00:11:25.6595689Z | | | MIG M. | 2024-12-18T00:11:25.6595837Z |=========================================+========================+======================| 2024-12-18T00:11:25.6771851Z | 0 Tesla T4 On | 00000000:18:00.0 Off | 0 | 2024-12-18T00:11:25.6772402Z | N/A 23C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:11:25.6772556Z | | | N/A | 2024-12-18T00:11:25.6772771Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.6914247Z | 1 Tesla T4 On | 00000000:19:00.0 Off | 0 | 2024-12-18T00:11:25.6914834Z | N/A 23C P8 10W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:11:25.6915567Z | | | N/A | 2024-12-18T00:11:25.6916127Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.7055505Z | 2 Tesla T4 On | 00000000:35:00.0 Off | 0 | 2024-12-18T00:11:25.7055716Z | N/A 24C P8 8W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:11:25.7056025Z | | | N/A | 2024-12-18T00:11:25.7056415Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.7195692Z | 3 Tesla T4 On | 00000000:36:00.0 Off | 0 | 2024-12-18T00:11:25.7196258Z | N/A 24C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:11:25.7196637Z | | | N/A | 2024-12-18T00:11:25.7197026Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.7340755Z | 4 Tesla T4 On | 00000000:E7:00.0 Off | 0 | 2024-12-18T00:11:25.7341322Z | N/A 22C P8 8W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:11:25.7341722Z | | | N/A | 2024-12-18T00:11:25.7342316Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.7484037Z | 5 Tesla T4 On | 00000000:E8:00.0 Off | 0 | 2024-12-18T00:11:25.7484710Z | N/A 24C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:11:25.7484850Z | | | N/A | 2024-12-18T00:11:25.7628421Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.7628971Z | 6 Tesla T4 On | 00000000:F4:00.0 Off | 0 | 2024-12-18T00:11:25.7629517Z | N/A 24C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:11:25.7629878Z | | | N/A | 2024-12-18T00:11:25.7630451Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.7772504Z | 7 Tesla T4 On | 00000000:F5:00.0 Off | 0 | 2024-12-18T00:11:25.7773035Z | N/A 24C P8 8W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:11:25.7773179Z | | | N/A | 2024-12-18T00:11:25.7773393Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:11:25.7804518Z 2024-12-18T00:11:25.7805781Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:11:25.7806307Z | Processes: | 2024-12-18T00:11:25.7806966Z | GPU GI CI PID Type Process name GPU Memory | 2024-12-18T00:11:25.7807329Z | ID ID Usage | 2024-12-18T00:11:25.7807481Z |=========================================================================================| 2024-12-18T00:11:25.7908658Z | No running processes found | 2024-12-18T00:11:25.7909282Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:11:26.9267743Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-12-18T00:11:26.9471975Z Tesla T4 2024-12-18T00:11:26.9540076Z + NVIDIA_SMI_STATUS=0 2024-12-18T00:11:26.9540917Z + '[' 0 -eq 0 ']' 2024-12-18T00:11:26.9541702Z + echo 'INFO: Ignoring allowed status 0' 2024-12-18T00:11:26.9542634Z + set -e 2024-12-18T00:11:26.9543248Z INFO: Ignoring allowed status 0 2024-12-18T00:11:26.9550708Z == Installing nvidia container toolkit for amzn2023 == 2024-12-18T00:11:26.9553046Z + sudo yum install -y yum-utils 2024-12-18T00:11:27.3605673Z Last metadata expiration check: 0:31:46 ago on Tue Dec 17 23:39:41 2024. 2024-12-18T00:11:27.3844955Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-12-18T00:11:27.4209928Z Dependencies resolved. 2024-12-18T00:11:27.4382172Z Nothing to do. 2024-12-18T00:11:27.4382941Z Complete! 2024-12-18T00:11:27.5553309Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-12-18T00:11:27.5555095Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-12-18T00:11:27.5556978Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-12-18T00:11:27.8104604Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-12-18T00:11:27.8756608Z + sudo yum install -y nvidia-docker2 nvidia-container-toolkit-1.16.2 2024-12-18T00:11:28.4167385Z nvidia-container-toolkit 10 kB/s | 833 B 00:00 2024-12-18T00:11:28.4407482Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-12-18T00:11:28.4411708Z Package nvidia-container-toolkit-1.16.2-1.x86_64 is already installed. 2024-12-18T00:11:28.4781707Z Dependencies resolved. 2024-12-18T00:11:28.4957627Z Nothing to do. 2024-12-18T00:11:28.4958411Z Complete! 2024-12-18T00:11:28.6091739Z + sudo systemctl restart docker 2024-12-18T00:13:17.0763793Z nvidia-persistenced failed to initialize. Check syslog for more details. 2024-12-18T00:13:17.1623845Z Wed Dec 18 00:13:17 2024 2024-12-18T00:13:17.1627699Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:13:17.1629436Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-12-18T00:13:17.1631042Z |-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.1632232Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-12-18T00:13:17.1633149Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-12-18T00:13:17.1633806Z | | | MIG M. | 2024-12-18T00:13:17.1634209Z |=========================================+========================+======================| 2024-12-18T00:13:17.1803761Z | 0 Tesla T4 On | 00000000:18:00.0 Off | 0 | 2024-12-18T00:13:17.1805251Z | N/A 23C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:13:17.1806480Z | | | N/A | 2024-12-18T00:13:17.1807771Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.1982895Z | 1 Tesla T4 On | 00000000:19:00.0 Off | 0 | 2024-12-18T00:13:17.1984358Z | N/A 23C P8 8W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:13:17.1985602Z | | | N/A | 2024-12-18T00:13:17.1986899Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.2127381Z | 2 Tesla T4 On | 00000000:35:00.0 Off | 0 | 2024-12-18T00:13:17.2128845Z | N/A 23C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:13:17.2129855Z | | | N/A | 2024-12-18T00:13:17.2130364Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.2272259Z | 3 Tesla T4 On | 00000000:36:00.0 Off | 0 | 2024-12-18T00:13:17.2273689Z | N/A 23C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:13:17.2274947Z | | | N/A | 2024-12-18T00:13:17.2276244Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.2415903Z | 4 Tesla T4 On | 00000000:E7:00.0 Off | 0 | 2024-12-18T00:13:17.2417374Z | N/A 21C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:13:17.2418642Z | | | N/A | 2024-12-18T00:13:17.2419930Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.2560058Z | 5 Tesla T4 On | 00000000:E8:00.0 Off | 0 | 2024-12-18T00:13:17.2560796Z | N/A 23C P8 8W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:13:17.2561288Z | | | N/A | 2024-12-18T00:13:17.2561792Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.2703952Z | 6 Tesla T4 On | 00000000:F4:00.0 Off | 0 | 2024-12-18T00:13:17.2705403Z | N/A 24C P8 8W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:13:17.2706637Z | | | N/A | 2024-12-18T00:13:17.2707933Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.2847300Z | 7 Tesla T4 On | 00000000:F5:00.0 Off | 0 | 2024-12-18T00:13:17.2848807Z | N/A 23C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-12-18T00:13:17.2849293Z | | | N/A | 2024-12-18T00:13:17.2849970Z +-----------------------------------------+------------------------+----------------------+ 2024-12-18T00:13:17.2893668Z 2024-12-18T00:13:17.2895099Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:13:17.2896518Z | Processes: | 2024-12-18T00:13:17.2898019Z | GPU GI CI PID Type Process name GPU Memory | 2024-12-18T00:13:17.2899395Z | ID ID Usage | 2024-12-18T00:13:17.2900505Z |=========================================================================================| 2024-12-18T00:13:17.3006016Z | No running processes found | 2024-12-18T00:13:17.3007678Z +-----------------------------------------------------------------------------------------+ 2024-12-18T00:13:19.0083412Z Command completed after 1 attempt(s). 2024-12-18T00:13:19.0193531Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-12-18T00:13:19.0194281Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-12-18T00:13:19.0194917Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-12-18T00:13:19.0195697Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:19.0207363Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:19.0207881Z env: 2024-12-18T00:13:19.0208215Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:19.0208666Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:19.0209117Z ##[endgroup] 2024-12-18T00:13:19.2649388Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T00:13:19.2801717Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2024-12-18T00:13:19.2806525Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2024-12-18T00:13:19.4046833Z Prepare all required actions 2024-12-18T00:13:19.4047410Z Getting action download info 2024-12-18T00:13:19.5489030Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-12-18T00:13:19.7580116Z Download action repository 'actions/download-artifact@v4' (SHA:fa0a91b85d4f404e444e00e005971372dc801d16) 2024-12-18T00:13:20.0460135Z ##[group]Run ./.github/actions/download-build-artifacts 2024-12-18T00:13:20.0460573Z with: 2024-12-18T00:13:20.0460906Z name: linux-focal-cuda12.4-py3.10-gcc9-sm75 2024-12-18T00:13:20.0461322Z s3-bucket: gha-artifacts 2024-12-18T00:13:20.0461668Z env: 2024-12-18T00:13:20.0461959Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:20.0462368Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:20.0462842Z ##[endgroup] 2024-12-18T00:13:20.0527070Z ##[group]Run seemethere/download-artifact-s3@v4 2024-12-18T00:13:20.0527456Z with: 2024-12-18T00:13:20.0527806Z name: linux-focal-cuda12.4-py3.10-gcc9-sm75 2024-12-18T00:13:20.0528201Z s3-bucket: gha-artifacts 2024-12-18T00:13:20.0528504Z region: us-east-1 2024-12-18T00:13:20.0528772Z env: 2024-12-18T00:13:20.0529128Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:20.0529504Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:20.0529925Z ##[endgroup] 2024-12-18T00:13:20.5275293Z (node:134581) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-12-18T00:13:20.5276808Z 2024-12-18T00:13:20.5277418Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-12-18T00:13:20.5279020Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-12-18T00:13:20.5280101Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-12-18T00:13:20.6366760Z Found 1 objects with prefix pytorch/pytorch/12383255652/linux-focal-cuda12.4-py3.10-gcc9-sm75/ 2024-12-18T00:13:20.6368763Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-12-18T00:13:38.5128585Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-12-18T00:13:38.5133635Z Artifact download has finished successfully 2024-12-18T00:13:38.5391313Z ##[group]Run unzip -o artifacts.zip 2024-12-18T00:13:38.5391794Z unzip -o artifacts.zip 2024-12-18T00:13:38.5397966Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:38.5398445Z env: 2024-12-18T00:13:38.5398714Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:38.5399142Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:38.5399593Z ##[endgroup] 2024-12-18T00:13:38.5442873Z Archive: artifacts.zip 2024-12-18T00:13:38.5443813Z creating: dist/ 2024-12-18T00:13:40.4550433Z inflating: dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl 2024-12-18T00:13:40.4551969Z creating: build/custom_test_artifacts/ 2024-12-18T00:13:40.4553198Z creating: build/custom_test_artifacts/custom-op-build/ 2024-12-18T00:13:40.4554763Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-12-18T00:13:40.4556515Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:13:40.4558710Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:13:40.4559707Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-12-18T00:13:40.4560444Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:13:40.4561227Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:13:40.4562006Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:13:40.4562872Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:13:40.4563935Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:13:40.4564756Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:13:40.4565533Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:13:40.4566437Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:13:40.4567349Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:13:40.4568225Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:13:40.4569106Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:13:40.4570148Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:13:40.4571078Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:13:40.4571881Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-12-18T00:13:40.4572667Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-12-18T00:13:40.4614116Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-12-18T00:13:40.4654540Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-12-18T00:13:40.4657848Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-12-18T00:13:40.4698498Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-12-18T00:13:40.4699672Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-12-18T00:13:40.4700768Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-12-18T00:13:40.4702094Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-12-18T00:13:40.4703199Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-12-18T00:13:40.4704284Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-12-18T00:13:40.4705398Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-12-18T00:13:40.4706489Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-12-18T00:13:40.4707553Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-12-18T00:13:40.4708579Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-12-18T00:13:40.4709730Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-12-18T00:13:40.4710712Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-12-18T00:13:40.4711691Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-12-18T00:13:40.4712651Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-12-18T00:13:40.4713610Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-12-18T00:13:40.4783998Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-12-18T00:13:40.4859124Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-12-18T00:13:40.4861831Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-12-18T00:13:40.4864026Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:13:40.4865897Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-12-18T00:13:40.4867742Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-12-18T00:13:40.4868448Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-12-18T00:13:40.4869236Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-12-18T00:13:40.4870137Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-12-18T00:13:40.4870979Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-12-18T00:13:40.4871778Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-12-18T00:13:40.4872602Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-12-18T00:13:40.4873442Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-12-18T00:13:40.4874269Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-12-18T00:13:40.4875093Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-12-18T00:13:40.4875906Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-12-18T00:13:40.4884459Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-12-18T00:13:40.5027202Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-12-18T00:13:40.5029463Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-12-18T00:13:40.5031868Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-12-18T00:13:40.5034549Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-12-18T00:13:40.5037116Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-12-18T00:13:40.5038999Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-12-18T00:13:40.5039859Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-12-18T00:13:40.5040737Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-12-18T00:13:40.5041610Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-12-18T00:13:40.5042479Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-12-18T00:13:40.5043517Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-12-18T00:13:40.5050760Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-12-18T00:13:40.5132974Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-12-18T00:13:40.5135714Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:13:40.5138075Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:13:40.5139649Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-12-18T00:13:40.5140352Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-12-18T00:13:40.5141032Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-12-18T00:13:40.5141724Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-12-18T00:13:40.5142370Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-12-18T00:13:40.5142945Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-12-18T00:13:40.5143550Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-12-18T00:13:40.5260840Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-12-18T00:13:40.5324603Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-12-18T00:13:40.5326238Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-12-18T00:13:40.5327370Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-12-18T00:13:40.5328003Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:13:40.5330897Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:13:40.5331617Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-12-18T00:13:40.5332312Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:13:40.5333051Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:13:40.5333777Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:13:40.5334621Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:13:40.5335660Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:13:40.5336424Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:13:40.5337168Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:13:40.5338694Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:13:40.5340340Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:13:40.5341823Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:13:40.5342697Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:13:40.5343709Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:13:40.5344625Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:13:40.5345400Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-12-18T00:13:40.5346159Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-12-18T00:13:40.5388649Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-12-18T00:13:40.5429874Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-12-18T00:13:40.5433105Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-12-18T00:13:40.5475165Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-12-18T00:13:40.5477993Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-12-18T00:13:40.5479286Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-12-18T00:13:40.5480412Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-12-18T00:13:40.5481482Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-12-18T00:13:40.5482538Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-12-18T00:13:40.5483599Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-12-18T00:13:40.5484657Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-12-18T00:13:40.5485695Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-12-18T00:13:40.5486677Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-12-18T00:13:40.5487633Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-12-18T00:13:40.5488559Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-12-18T00:13:40.5489503Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-12-18T00:13:40.5490412Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-12-18T00:13:40.5491335Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-12-18T00:13:40.5559474Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-12-18T00:13:40.5634065Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-12-18T00:13:40.5636847Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-12-18T00:13:40.5637667Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:13:40.5638346Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-12-18T00:13:40.5639067Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-12-18T00:13:40.5639821Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-12-18T00:13:40.5640677Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-12-18T00:13:40.5641649Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-12-18T00:13:40.5642580Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-12-18T00:13:40.5643432Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-12-18T00:13:40.5644326Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-12-18T00:13:40.5645423Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-12-18T00:13:40.5646375Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-12-18T00:13:40.5647314Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-12-18T00:13:40.5648237Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-12-18T00:13:40.5659058Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-12-18T00:13:40.5725270Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-12-18T00:13:40.5727956Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:13:40.5728829Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:13:40.5729613Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-12-18T00:13:40.5730331Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-12-18T00:13:40.5731040Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-12-18T00:13:40.5731751Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-12-18T00:13:40.5732399Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-12-18T00:13:40.5733019Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-12-18T00:13:40.5733653Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-12-18T00:13:40.5780151Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-12-18T00:13:40.5781863Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-12-18T00:13:40.5783518Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-12-18T00:13:40.5784917Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:13:40.5786843Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:13:40.5787644Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-12-18T00:13:40.5788429Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:13:40.5789270Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:13:40.5790097Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:13:40.5791031Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:13:40.5791983Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:13:40.5792803Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:13:40.5793630Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:13:40.5794591Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:13:40.5795827Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:13:40.5797427Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:13:40.5798391Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:13:40.5800076Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:13:40.5801610Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:13:40.5802549Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-12-18T00:13:40.5803441Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-12-18T00:13:40.5844058Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-12-18T00:13:40.5884778Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-12-18T00:13:40.5886330Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-12-18T00:13:40.5932482Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-12-18T00:13:40.5934061Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-12-18T00:13:40.5935348Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-12-18T00:13:40.5936650Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-12-18T00:13:40.5937901Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-12-18T00:13:40.5939158Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-12-18T00:13:40.5940393Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-12-18T00:13:40.5941626Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-12-18T00:13:40.5942845Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-12-18T00:13:40.5943992Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-12-18T00:13:40.5945103Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-12-18T00:13:40.5946199Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-12-18T00:13:40.5947302Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-12-18T00:13:40.5948358Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-12-18T00:13:40.5949450Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-12-18T00:13:40.6019010Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-12-18T00:13:40.6092421Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-12-18T00:13:40.6093532Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-12-18T00:13:40.6094431Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:13:40.6095201Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-12-18T00:13:40.6096006Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-12-18T00:13:40.6096837Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-12-18T00:13:40.6097981Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-12-18T00:13:40.6099061Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-12-18T00:13:40.6100109Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-12-18T00:13:40.6101078Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-12-18T00:13:40.6102151Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-12-18T00:13:40.6103282Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-12-18T00:13:40.6104282Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-12-18T00:13:40.6105294Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-12-18T00:13:40.6106299Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-12-18T00:13:40.6107369Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-12-18T00:13:40.6226120Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-12-18T00:13:40.6227169Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-12-18T00:13:40.6228188Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-12-18T00:13:40.6229310Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-12-18T00:13:40.6230401Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-12-18T00:13:40.6231429Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-12-18T00:13:40.6232485Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-12-18T00:13:40.6233559Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-12-18T00:13:40.6234625Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-12-18T00:13:40.6235693Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-12-18T00:13:40.6236728Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-12-18T00:13:40.6251273Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-12-18T00:13:40.6304336Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-12-18T00:13:40.6305490Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:13:40.6306465Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:13:40.6307345Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-12-18T00:13:40.6308151Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-12-18T00:13:40.6308967Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-12-18T00:13:40.6309756Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-12-18T00:13:40.6310513Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-12-18T00:13:40.6311377Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-12-18T00:13:40.6312090Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-12-18T00:13:40.6410633Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-12-18T00:13:40.6454137Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-12-18T00:13:40.6454972Z creating: build/lib/ 2024-12-18T00:13:40.6463073Z inflating: build/lib/libpthreadpool.a 2024-12-18T00:13:40.6473524Z inflating: build/lib/libcpuinfo_internals.a 2024-12-18T00:13:40.6479934Z inflating: build/lib/libcpuinfo.a 2024-12-18T00:13:40.6569158Z inflating: build/lib/libprotobuf-lite.a 2024-12-18T00:13:40.6570710Z inflating: build/lib/libclog.a 2024-12-18T00:13:40.6571866Z inflating: build/lib/libnnpack_reference_layers.a 2024-12-18T00:13:40.7017958Z inflating: build/lib/libprotobuf.a 2024-12-18T00:13:40.7036532Z inflating: build/lib/libnnpack.a 2024-12-18T00:13:40.7103527Z inflating: build/lib/libgtest.a 2024-12-18T00:13:40.7177855Z inflating: build/lib/libbenchmark.a 2024-12-18T00:13:40.7241791Z inflating: build/lib/libasmjit.a 2024-12-18T00:13:40.7249263Z inflating: build/lib/libittnotify.a 2024-12-18T00:13:40.7277367Z inflating: build/lib/libtensorpipe_uv.a 2024-12-18T00:13:40.7403447Z inflating: build/lib/libgloo.a 2024-12-18T00:13:40.7586057Z inflating: build/lib/libmicrokernels-prod.a 2024-12-18T00:13:40.7606742Z inflating: build/lib/libfmt.a 2024-12-18T00:13:40.7607848Z inflating: build/lib/libcaffe2_nvrtc.so 2024-12-18T00:13:40.7708285Z inflating: build/lib/libc10.so 2024-12-18T00:13:40.7709482Z inflating: build/lib/libtorch_global_deps.so 2024-12-18T00:13:40.7730232Z inflating: build/lib/libpytorch_qnnpack.a 2024-12-18T00:13:40.8224129Z inflating: build/lib/libprotoc.a 2024-12-18T00:13:40.8241975Z inflating: build/lib/libgmock.a 2024-12-18T00:13:40.8243096Z inflating: build/lib/libgtest_main.a 2024-12-18T00:13:40.8244159Z inflating: build/lib/libbenchmark_main.a 2024-12-18T00:13:41.8101918Z inflating: build/lib/libdnnl.a 2024-12-18T00:13:41.8654282Z inflating: build/lib/libtensorpipe.a 2024-12-18T00:13:41.8654725Z inflating: build/lib/libgmock_main.a 2024-12-18T00:13:41.9852622Z inflating: build/lib/libfbgemm.a 2024-12-18T00:13:41.9912249Z inflating: build/lib/libc10_cuda.so 2024-12-18T00:13:42.0413847Z inflating: build/lib/libkineto.a 2024-12-18T00:13:42.0662846Z inflating: build/lib/libtensorpipe_cuda.a 2024-12-18T00:13:42.1028520Z inflating: build/lib/libgloo_cuda.a 2024-12-18T00:13:42.1070431Z inflating: build/lib/libonnx_proto.a 2024-12-18T00:13:42.1158558Z inflating: build/lib/libXNNPACK.a 2024-12-18T00:13:42.1867615Z inflating: build/lib/libonnx.a 2024-12-18T00:13:44.6350871Z inflating: build/lib/libtorch_cpu.so 2024-12-18T00:13:44.7191234Z inflating: build/lib/libmicrokernels-all.a 2024-12-18T00:13:44.7193572Z inflating: build/lib/libshm.so 2024-12-18T00:13:44.7199813Z inflating: build/lib/libunbox_lib.a 2024-12-18T00:13:46.3710947Z inflating: build/lib/libtorch_cuda.so 2024-12-18T00:13:46.3712059Z inflating: build/lib/libtorch.so 2024-12-18T00:13:46.3713175Z inflating: build/lib/libc10d_cuda_test.so 2024-12-18T00:13:47.2356811Z inflating: build/lib/libtorch_cuda_linalg.so 2024-12-18T00:13:47.2377232Z inflating: build/lib/libjitbackend_test.so 2024-12-18T00:13:47.2446509Z inflating: build/lib/libtorchbind_test.so 2024-12-18T00:13:47.2471597Z inflating: build/lib/libbackend_with_compiler.so 2024-12-18T00:13:47.2496493Z inflating: build/lib/libaoti_custom_ops.so 2024-12-18T00:13:47.4524659Z inflating: build/lib/libtorch_python.so 2024-12-18T00:13:47.4559336Z inflating: build/lib/libnnapi_backend.so 2024-12-18T00:13:47.4560443Z creating: build/bin/ 2024-12-18T00:13:47.4612770Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-12-18T00:13:47.4669461Z inflating: build/bin/c10_DeviceGuard_test 2024-12-18T00:13:47.4724685Z inflating: build/bin/c10_Device_test 2024-12-18T00:13:47.4786023Z inflating: build/bin/c10_DispatchKeySet_test 2024-12-18T00:13:47.4843881Z inflating: build/bin/c10_Scalar_test 2024-12-18T00:13:47.4895797Z inflating: build/bin/c10_StreamGuard_test 2024-12-18T00:13:47.4953400Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-12-18T00:13:47.5007508Z inflating: build/bin/c10_SymInt_test 2024-12-18T00:13:47.5066466Z inflating: build/bin/c10_InlineStreamGuard_test 2024-12-18T00:13:47.5126855Z inflating: build/bin/c10_SizesAndStrides_test 2024-12-18T00:13:47.5200721Z inflating: build/bin/c10_cow_test 2024-12-18T00:13:47.5253781Z inflating: build/bin/c10_ArrayRef_test 2024-12-18T00:13:47.5309205Z inflating: build/bin/c10_Bitset_test 2024-12-18T00:13:47.5361690Z inflating: build/bin/c10_ConstexprCrc_test 2024-12-18T00:13:47.5415087Z inflating: build/bin/c10_DeadlockDetection_test 2024-12-18T00:13:47.5468561Z inflating: build/bin/c10_Half_test 2024-12-18T00:13:47.5528930Z inflating: build/bin/c10_LeftRight_test 2024-12-18T00:13:47.5586802Z inflating: build/bin/c10_Metaprogramming_test 2024-12-18T00:13:47.5643888Z inflating: build/bin/c10_NetworkFlow_test 2024-12-18T00:13:47.5696718Z inflating: build/bin/c10_Synchronized_test 2024-12-18T00:13:47.5756608Z inflating: build/bin/c10_ThreadLocal_test 2024-12-18T00:13:47.5811563Z inflating: build/bin/c10_TypeIndex_test 2024-12-18T00:13:47.5866459Z inflating: build/bin/c10_TypeList_test 2024-12-18T00:13:47.5919441Z inflating: build/bin/c10_TypeTraits_test 2024-12-18T00:13:47.5973888Z inflating: build/bin/c10_accumulate_test 2024-12-18T00:13:47.6032663Z inflating: build/bin/c10_bfloat16_test 2024-12-18T00:13:47.6085873Z inflating: build/bin/c10_bit_cast_test 2024-12-18T00:13:47.6146342Z inflating: build/bin/c10_complex_math_test 2024-12-18T00:13:47.6204181Z inflating: build/bin/c10_complex_test 2024-12-18T00:13:47.6257453Z inflating: build/bin/c10_error_test 2024-12-18T00:13:47.6313745Z inflating: build/bin/c10_exception_test 2024-12-18T00:13:47.6366983Z inflating: build/bin/c10_flags_test 2024-12-18T00:13:47.6421300Z inflating: build/bin/c10_generic_math_test 2024-12-18T00:13:47.6586286Z inflating: build/bin/c10_intrusive_ptr_test 2024-12-18T00:13:47.6641234Z inflating: build/bin/c10_irange_test 2024-12-18T00:13:47.6697260Z inflating: build/bin/c10_lazy_test 2024-12-18T00:13:47.6759301Z inflating: build/bin/c10_logging_test 2024-12-18T00:13:47.6837710Z inflating: build/bin/c10_optional_test 2024-12-18T00:13:47.6894801Z inflating: build/bin/c10_registry_test 2024-12-18T00:13:47.6961404Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-12-18T00:13:47.7017157Z inflating: build/bin/c10_ssize_test 2024-12-18T00:13:47.7172346Z inflating: build/bin/c10_small_vector_test 2024-12-18T00:13:47.7228726Z inflating: build/bin/c10_string_util_test 2024-12-18T00:13:47.7290847Z inflating: build/bin/c10_string_view_test 2024-12-18T00:13:47.7345401Z inflating: build/bin/c10_tempfile_test 2024-12-18T00:13:47.7393909Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-12-18T00:13:47.7453200Z inflating: build/bin/c10_typeid_test 2024-12-18T00:13:47.7894625Z inflating: build/bin/protoc-3.13.0.0 2024-12-18T00:13:47.8336062Z inflating: build/bin/protoc 2024-12-18T00:13:47.8391843Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-12-18T00:13:47.8447559Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-12-18T00:13:47.8503372Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-12-18T00:13:47.8558899Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-12-18T00:13:47.8615220Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-12-18T00:13:47.8667812Z inflating: build/bin/c10_cuda_CUDATest 2024-12-18T00:13:47.8725477Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-12-18T00:13:47.8782256Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-12-18T00:13:47.9171793Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-12-18T00:13:47.9583018Z inflating: build/bin/vec_test_all_types_AVX2 2024-12-18T00:13:47.9981905Z inflating: build/bin/vec_test_all_types_AVX512 2024-12-18T00:13:48.0041685Z inflating: build/bin/TCPStoreTest 2024-12-18T00:13:48.0098640Z inflating: build/bin/FileStoreTest 2024-12-18T00:13:48.0155083Z inflating: build/bin/BackoffTest 2024-12-18T00:13:48.0212597Z inflating: build/bin/HashStoreTest 2024-12-18T00:13:48.0227319Z inflating: build/bin/ProcessGroupMPITest 2024-12-18T00:13:48.0230521Z inflating: build/bin/torch_shm_manager 2024-12-18T00:13:48.0288364Z inflating: build/bin/test_edge_op_registration 2024-12-18T00:13:48.0289729Z inflating: build/bin/example_allreduce 2024-12-18T00:13:48.0348727Z inflating: build/bin/Dimname_test 2024-12-18T00:13:48.0426317Z inflating: build/bin/Dict_test 2024-12-18T00:13:48.0487096Z inflating: build/bin/NamedTensor_test 2024-12-18T00:13:48.0555607Z inflating: build/bin/MaybeOwned_test 2024-12-18T00:13:48.0617280Z inflating: build/bin/apply_utils_test 2024-12-18T00:13:48.0680035Z inflating: build/bin/atest 2024-12-18T00:13:48.0747710Z inflating: build/bin/basic 2024-12-18T00:13:48.0802234Z inflating: build/bin/cpu_allocator_test 2024-12-18T00:13:48.0861590Z inflating: build/bin/broadcast_test 2024-12-18T00:13:48.0924193Z inflating: build/bin/cpu_generator_test 2024-12-18T00:13:48.0980497Z inflating: build/bin/cpu_profiling_allocator_test 2024-12-18T00:13:48.1034994Z inflating: build/bin/dlconvertor_test 2024-12-18T00:13:48.1087956Z inflating: build/bin/dispatch_key_set_test 2024-12-18T00:13:48.1183294Z inflating: build/bin/cpu_rng_test 2024-12-18T00:13:48.1245403Z inflating: build/bin/extension_backend_test 2024-12-18T00:13:48.1303058Z inflating: build/bin/half_test 2024-12-18T00:13:48.1401898Z inflating: build/bin/ivalue_test 2024-12-18T00:13:48.1454445Z inflating: build/bin/lazy_tensor_test 2024-12-18T00:13:48.1511682Z inflating: build/bin/math_kernel_test 2024-12-18T00:13:48.1567605Z inflating: build/bin/memory_overlapping_test 2024-12-18T00:13:48.1625387Z inflating: build/bin/memory_format_test 2024-12-18T00:13:48.1681125Z inflating: build/bin/mobile_memory_cleanup 2024-12-18T00:13:48.1742154Z inflating: build/bin/native_test 2024-12-18T00:13:48.1795646Z inflating: build/bin/operator_name_test 2024-12-18T00:13:48.1850319Z inflating: build/bin/operators_test 2024-12-18T00:13:48.1905482Z inflating: build/bin/packedtensoraccessor_test 2024-12-18T00:13:48.1966329Z inflating: build/bin/quantized_test 2024-12-18T00:13:48.2037151Z inflating: build/bin/pow_test 2024-12-18T00:13:48.2090100Z inflating: build/bin/reduce_ops_test 2024-12-18T00:13:48.2145097Z inflating: build/bin/reportMemoryUsage_test 2024-12-18T00:13:48.2204948Z inflating: build/bin/scalar_tensor_test 2024-12-18T00:13:48.2260520Z inflating: build/bin/StorageUtils_test 2024-12-18T00:13:48.2323245Z inflating: build/bin/scalar_test 2024-12-18T00:13:48.2378754Z inflating: build/bin/stride_properties_test 2024-12-18T00:13:48.2461191Z inflating: build/bin/tensor_iterator_test 2024-12-18T00:13:48.2519685Z inflating: build/bin/type_ptr_test 2024-12-18T00:13:48.2521264Z inflating: build/bin/thread_init_test 2024-12-18T00:13:48.2579630Z inflating: build/bin/test_parallel 2024-12-18T00:13:48.2636593Z inflating: build/bin/undefined_tensor_test 2024-12-18T00:13:48.2698653Z inflating: build/bin/type_test 2024-12-18T00:13:48.2699800Z inflating: build/bin/verify_api_visibility 2024-12-18T00:13:48.2755288Z inflating: build/bin/weakref_test 2024-12-18T00:13:48.2829162Z inflating: build/bin/legacy_vmap_test 2024-12-18T00:13:48.2883869Z inflating: build/bin/wrapdim_test 2024-12-18T00:13:48.2946907Z inflating: build/bin/IListRef_test 2024-12-18T00:13:48.3055056Z inflating: build/bin/List_test 2024-12-18T00:13:48.3109919Z inflating: build/bin/xla_tensor_test 2024-12-18T00:13:48.3233743Z inflating: build/bin/kernel_function_legacy_test 2024-12-18T00:13:48.3333087Z inflating: build/bin/kernel_function_test 2024-12-18T00:13:48.3402399Z inflating: build/bin/KernelFunction_test 2024-12-18T00:13:48.3532253Z inflating: build/bin/kernel_lambda_legacy_test 2024-12-18T00:13:48.3596726Z inflating: build/bin/kernel_stackbased_test 2024-12-18T00:13:48.3702782Z inflating: build/bin/kernel_lambda_test 2024-12-18T00:13:48.3757176Z inflating: build/bin/CppSignature_test 2024-12-18T00:13:48.3856451Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-12-18T00:13:48.3908349Z inflating: build/bin/op_allowlist_test 2024-12-18T00:13:48.3974593Z inflating: build/bin/inline_container_test 2024-12-18T00:13:48.4034418Z inflating: build/bin/backend_fallback_test 2024-12-18T00:13:48.4331661Z inflating: build/bin/op_registration_test 2024-12-18T00:13:48.4387382Z inflating: build/bin/cuda_apply_test 2024-12-18T00:13:48.4443522Z inflating: build/bin/cuda_allocator_test 2024-12-18T00:13:48.4502053Z inflating: build/bin/cuda_caching_host_allocator_test 2024-12-18T00:13:48.4563775Z inflating: build/bin/cuda_atomic_ops_test 2024-12-18T00:13:48.4637374Z inflating: build/bin/cuda_complex_math_test 2024-12-18T00:13:48.4698981Z inflating: build/bin/cuda_complex_test 2024-12-18T00:13:48.4752427Z inflating: build/bin/cuda_device_test 2024-12-18T00:13:48.4814602Z inflating: build/bin/cuda_cub_test 2024-12-18T00:13:48.4869288Z inflating: build/bin/cuda_dlconvertor_test 2024-12-18T00:13:48.4924331Z inflating: build/bin/cuda_integer_divider_test 2024-12-18T00:13:48.4992170Z inflating: build/bin/cuda_distributions_test 2024-12-18T00:13:48.5052647Z inflating: build/bin/cuda_generator_test 2024-12-18T00:13:48.5105298Z inflating: build/bin/cuda_half_test 2024-12-18T00:13:48.5159248Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-12-18T00:13:48.5215014Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-12-18T00:13:48.5267848Z inflating: build/bin/cuda_optional_test 2024-12-18T00:13:48.5332421Z inflating: build/bin/cuda_stream_test 2024-12-18T00:13:48.5387245Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-12-18T00:13:48.5440816Z inflating: build/bin/cuda_cudnn_test 2024-12-18T00:13:48.5495647Z inflating: build/bin/cuda_vectorized_test 2024-12-18T00:13:48.5510339Z inflating: build/bin/tutorial_tensorexpr 2024-12-18T00:13:48.5578878Z inflating: build/bin/ProcessGroupGlooTest 2024-12-18T00:13:48.5640279Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-12-18T00:13:48.5705089Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-12-18T00:13:48.5772269Z inflating: build/bin/ProcessGroupNCCLTest 2024-12-18T00:13:48.5831655Z inflating: build/bin/test_dist_autograd 2024-12-18T00:13:48.5903928Z inflating: build/bin/test_cpp_rpc 2024-12-18T00:13:48.5904666Z inflating: build/bin/parallel_benchmark 2024-12-18T00:13:48.5976355Z inflating: build/bin/test_mobile_nnc 2024-12-18T00:13:48.5983860Z inflating: build/bin/aot_model_compiler_test 2024-12-18T00:13:48.6806794Z inflating: build/bin/test_tensorexpr 2024-12-18T00:13:48.7149894Z inflating: build/bin/test_lazy 2024-12-18T00:13:48.8309583Z inflating: build/bin/test_api 2024-12-18T00:13:48.8881938Z inflating: build/bin/test_jit 2024-12-18T00:13:48.8883035Z creating: .additional_ci_files/ 2024-12-18T00:13:48.8971716Z inflating: .additional_ci_files/test-times.json 2024-12-18T00:13:48.9322810Z inflating: .additional_ci_files/test-class-times.json 2024-12-18T00:13:48.9358994Z ##[group]Run rm artifacts.zip 2024-12-18T00:13:48.9359517Z rm artifacts.zip 2024-12-18T00:13:48.9365213Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:48.9365626Z env: 2024-12-18T00:13:48.9365867Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:48.9366234Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:48.9366624Z ##[endgroup] 2024-12-18T00:13:48.9976753Z ##[group]Run df -H 2024-12-18T00:13:48.9977036Z df -H 2024-12-18T00:13:48.9981457Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:48.9981862Z env: 2024-12-18T00:13:48.9982099Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:48.9982462Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:48.9982845Z ##[endgroup] 2024-12-18T00:13:49.0038858Z Filesystem Size Used Avail Use% Mounted on 2024-12-18T00:13:49.0039352Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-12-18T00:13:49.0039942Z tmpfs 203G 0 203G 0% /dev/shm 2024-12-18T00:13:49.0040647Z tmpfs 82G 11M 82G 1% /run 2024-12-18T00:13:49.0041066Z /dev/nvme0n1p1 161G 59G 103G 37% / 2024-12-18T00:13:49.0041465Z tmpfs 203G 33k 203G 1% /tmp 2024-12-18T00:13:49.0041844Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-12-18T00:13:49.0042234Z tmpfs 41G 0 41G 0% /run/user/0 2024-12-18T00:13:49.0076566Z Prepare all required actions 2024-12-18T00:13:49.0076991Z Getting action download info 2024-12-18T00:13:49.1803284Z ##[group]Run ./.github/actions/download-td-artifacts 2024-12-18T00:13:49.1803696Z with: 2024-12-18T00:13:49.1803913Z env: 2024-12-18T00:13:49.1804133Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:49.1804502Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:49.1804904Z ##[endgroup] 2024-12-18T00:13:49.1838327Z ##[group]Run seemethere/download-artifact-s3@v4 2024-12-18T00:13:49.1838710Z with: 2024-12-18T00:13:49.1838939Z name: td_results 2024-12-18T00:13:49.1839201Z s3-bucket: gha-artifacts 2024-12-18T00:13:49.1839514Z region: us-east-1 2024-12-18T00:13:49.1839755Z env: 2024-12-18T00:13:49.1839982Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:49.1840344Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:49.1840784Z ##[endgroup] 2024-12-18T00:13:49.6218799Z (node:134603) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-12-18T00:13:49.6219550Z 2024-12-18T00:13:49.6219795Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-12-18T00:13:49.6220401Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-12-18T00:13:49.6221048Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-12-18T00:13:49.7243417Z Found 1 objects with prefix pytorch/pytorch/12383255652/td_results/ 2024-12-18T00:13:49.7244328Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-12-18T00:13:49.7859788Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-12-18T00:13:49.7864022Z Artifact download has finished successfully 2024-12-18T00:13:49.8065083Z ##[group]Run mkdir -p .additional_ci_files 2024-12-18T00:13:49.8065491Z mkdir -p .additional_ci_files 2024-12-18T00:13:49.8065982Z mv td_results.json .additional_ci_files/td_results.json || true 2024-12-18T00:13:49.8071605Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:49.8072018Z env: 2024-12-18T00:13:49.8072253Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:49.8072615Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:49.8073017Z ##[endgroup] 2024-12-18T00:13:49.8156301Z ##[group]Run .github/scripts/parse_ref.py 2024-12-18T00:13:49.8156748Z .github/scripts/parse_ref.py 2024-12-18T00:13:49.8161545Z shell: /usr/bin/bash -e {0} 2024-12-18T00:13:49.8161864Z env: 2024-12-18T00:13:49.8162119Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:49.8162495Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:49.8163031Z ##[endgroup] 2024-12-18T00:13:49.8420217Z Prepare all required actions 2024-12-18T00:13:49.8457143Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-12-18T00:13:49.8457554Z with: 2024-12-18T00:13:49.8457990Z github-token: *** 2024-12-18T00:13:49.8458270Z env: 2024-12-18T00:13:49.8458526Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:49.8458920Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:49.8459340Z ##[endgroup] 2024-12-18T00:13:49.8480453Z ##[group]Run set -eux 2024-12-18T00:13:49.8480755Z set -eux 2024-12-18T00:13:49.8481243Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-12-18T00:13:49.8486118Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:49.8486539Z env: 2024-12-18T00:13:49.8486787Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:49.8487158Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:49.8487715Z GITHUB_TOKEN: *** 2024-12-18T00:13:49.8488003Z ##[endgroup] 2024-12-18T00:13:49.8507803Z + python3 .github/scripts/get_workflow_job_id.py 12383255652 i-07b82df1ecbdd12be 2024-12-18T00:13:52.3820528Z setting job-id=34566627611 2024-12-18T00:13:52.3822229Z setting job-name=cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:13:52.4027146Z Prepare all required actions 2024-12-18T00:13:52.4027677Z Getting action download info 2024-12-18T00:13:52.5586616Z ##[group]Run ./.github/actions/filter-test-configs 2024-12-18T00:13:52.5587009Z with: 2024-12-18T00:13:52.5587521Z github-token: *** 2024-12-18T00:13:52.5588113Z test-matrix: {"include": [{"config": "pr_time_benchmarks", "shard": 1, "num_shards": 1, "runner": "linux.g4dn.metal.nvidia.gpu"}]} 2024-12-18T00:13:52.5588993Z job-name: cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:13:52.5589558Z env: 2024-12-18T00:13:52.5589793Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:52.5590203Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:52.5590607Z ##[endgroup] 2024-12-18T00:13:52.5663423Z ##[group]Run nick-fields/retry@v3.0.0 2024-12-18T00:13:52.5663742Z with: 2024-12-18T00:13:52.5663968Z shell: bash 2024-12-18T00:13:52.5664217Z timeout_minutes: 10 2024-12-18T00:13:52.5664584Z max_attempts: 5 2024-12-18T00:13:52.5664829Z retry_wait_seconds: 30 2024-12-18T00:13:52.5665651Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-12-18T00:13:52.5666522Z polling_interval_seconds: 1 2024-12-18T00:13:52.5666829Z warning_on_retry: true 2024-12-18T00:13:52.5667096Z continue_on_error: false 2024-12-18T00:13:52.5667367Z env: 2024-12-18T00:13:52.5667589Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:52.5667961Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:52.5668563Z GITHUB_TOKEN: *** 2024-12-18T00:13:52.5668821Z ##[endgroup] 2024-12-18T00:13:52.6599340Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-12-18T00:13:52.8974215Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T00:13:52.9124373Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2024-12-18T00:13:52.9126470Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2024-12-18T00:13:52.9246166Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-12-18T00:13:52.9253409Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2024-12-18T00:13:52.9256618Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.12.14) 2024-12-18T00:13:52.9264349Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-12-18T00:13:53.6446530Z Command completed after 1 attempt(s). 2024-12-18T00:13:53.6511491Z ##[group]Run set -x 2024-12-18T00:13:53.6511859Z set -x 2024-12-18T00:13:53.6512187Z  2024-12-18T00:13:53.6512662Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-12-18T00:13:53.6513225Z # in runner workspace 2024-12-18T00:13:53.6513797Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-12-18T00:13:53.6519268Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:53.6519683Z env: 2024-12-18T00:13:53.6519927Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:53.6520278Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:53.6520673Z ##[endgroup] 2024-12-18T00:13:53.6544443Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-12-18T00:13:53.6802470Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-12-18T00:13:53.6802945Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-12-18T00:13:53.6803324Z echo "Job name: ${JOB_NAME}" 2024-12-18T00:13:53.6803661Z  2024-12-18T00:13:53.6804287Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-12-18T00:13:53.6804839Z # in runner workspace 2024-12-18T00:13:53.6805325Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-12-18T00:13:53.6805864Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-12-18T00:13:53.6806249Z  --job-name "${JOB_NAME}" \ 2024-12-18T00:13:53.6806975Z  --test-matrix "{"include": [{"config": "pr_time_benchmarks", "shard": 1, "num_shards": 1, "runner": "linux.g4dn.metal.nvidia.gpu"}]}" \ 2024-12-18T00:13:53.6807728Z  --selected-test-configs "" \ 2024-12-18T00:13:53.6808117Z  --pr-number "${PR_NUMBER}" \ 2024-12-18T00:13:53.6808483Z  --tag "${TAG}" \ 2024-12-18T00:13:53.6808811Z  --event-name "${EVENT_NAME}" \ 2024-12-18T00:13:53.6809182Z  --schedule "${SCHEDULE}" \ 2024-12-18T00:13:53.6809542Z  --branch "${HEAD_BRANCH}" 2024-12-18T00:13:53.6814784Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:53.6815184Z env: 2024-12-18T00:13:53.6815419Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:53.6815770Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:53.6816376Z GITHUB_TOKEN: *** 2024-12-18T00:13:53.6816880Z JOB_NAME: cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:13:53.6817447Z PR_NUMBER: 2024-12-18T00:13:53.6817708Z TAG: 2024-12-18T00:13:53.6817954Z EVENT_NAME: push 2024-12-18T00:13:53.6818209Z SCHEDULE: 2024-12-18T00:13:53.6818467Z HEAD_BRANCH: 2024-12-18T00:13:53.6818727Z ##[endgroup] 2024-12-18T00:13:53.6841182Z Workflow: pull 2024-12-18T00:13:53.6842293Z Job name: cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:13:53.9393439Z ##[group]Run echo "Filtered matrix:" 2024-12-18T00:13:53.9393817Z echo "Filtered matrix:" 2024-12-18T00:13:53.9394488Z echo "{"include": [{"config": "pr_time_benchmarks", "shard": 1, "num_shards": 1, "runner": "linux.g4dn.metal.nvidia.gpu"}]}" 2024-12-18T00:13:53.9395129Z  2024-12-18T00:13:53.9395372Z echo 2024-12-18T00:13:53.9395690Z echo "Is the current job unstable? False" 2024-12-18T00:13:53.9396182Z  2024-12-18T00:13:53.9396405Z echo 2024-12-18T00:13:53.9396673Z echo "Is keep-going label set? False" 2024-12-18T00:13:53.9397018Z  2024-12-18T00:13:53.9397240Z echo 2024-12-18T00:13:53.9397492Z echo "Renabled issues? " 2024-12-18T00:13:53.9402007Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:53.9402564Z env: 2024-12-18T00:13:53.9402825Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:53.9403215Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:53.9403633Z ##[endgroup] 2024-12-18T00:13:53.9423020Z Filtered matrix: 2024-12-18T00:13:53.9424042Z {include: [{config: pr_time_benchmarks, shard: 1, num_shards: 1, runner: linux.g4dn.metal.nvidia.gpu}]} 2024-12-18T00:13:53.9424656Z 2024-12-18T00:13:53.9424807Z Is the current job unstable? False 2024-12-18T00:13:53.9425043Z 2024-12-18T00:13:53.9425183Z Is keep-going label set? False 2024-12-18T00:13:53.9425398Z 2024-12-18T00:13:53.9425523Z Renabled issues? 2024-12-18T00:13:53.9466822Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:53.9467397Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:53.9472062Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:53.9472470Z env: 2024-12-18T00:13:53.9472705Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:53.9473073Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:53.9473463Z JOB_TIMEOUT: 240 2024-12-18T00:13:53.9473704Z ##[endgroup] 2024-12-18T00:13:53.9544984Z ##[group]Run set -x 2024-12-18T00:13:53.9545321Z set -x 2024-12-18T00:13:53.9545568Z  2024-12-18T00:13:53.9545833Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-12-18T00:13:53.9546254Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-12-18T00:13:53.9546666Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-12-18T00:13:53.9547057Z  TEST_COMMAND=.ci/onnx/test.sh 2024-12-18T00:13:53.9547377Z else 2024-12-18T00:13:53.9547643Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-12-18T00:13:53.9547968Z fi 2024-12-18T00:13:53.9548181Z  2024-12-18T00:13:53.9548541Z # detached container should get cleaned up by teardown_ec2_linux 2024-12-18T00:13:53.9549105Z # TODO: Stop building test binaries as part of the build phase 2024-12-18T00:13:53.9549609Z # Used for GPU_FLAG since that doesn't play nice 2024-12-18T00:13:53.9550045Z # shellcheck disable=SC2086,SC2090 2024-12-18T00:13:53.9550407Z container_name=$(docker run \ 2024-12-18T00:13:53.9550740Z  ${GPU_FLAG:-} \ 2024-12-18T00:13:53.9551056Z  ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \ 2024-12-18T00:13:53.9551420Z  -e BUILD_ENVIRONMENT \ 2024-12-18T00:13:53.9551726Z  -e PR_NUMBER \ 2024-12-18T00:13:53.9552016Z  -e GITHUB_ACTIONS \ 2024-12-18T00:13:53.9552329Z  -e GITHUB_REPOSITORY \ 2024-12-18T00:13:53.9552647Z  -e GITHUB_WORKFLOW \ 2024-12-18T00:13:53.9552951Z  -e GITHUB_JOB \ 2024-12-18T00:13:53.9553223Z  -e GITHUB_RUN_ID \ 2024-12-18T00:13:53.9553518Z  -e GITHUB_RUN_NUMBER \ 2024-12-18T00:13:53.9553832Z  -e GITHUB_RUN_ATTEMPT \ 2024-12-18T00:13:53.9554143Z  -e JOB_ID \ 2024-12-18T00:13:53.9554417Z  -e JOB_NAME \ 2024-12-18T00:13:53.9554679Z  -e BASE_SHA \ 2024-12-18T00:13:53.9554951Z  -e BRANCH \ 2024-12-18T00:13:53.9555234Z  -e SHA1 \ 2024-12-18T00:13:53.9555511Z  -e AWS_DEFAULT_REGION \ 2024-12-18T00:13:53.9555836Z  -e IN_WHEEL_TEST \ 2024-12-18T00:13:53.9556127Z  -e SHARD_NUMBER \ 2024-12-18T00:13:53.9556430Z  -e TEST_CONFIG \ 2024-12-18T00:13:53.9556733Z  -e NUM_TEST_SHARDS \ 2024-12-18T00:13:53.9557052Z  -e REENABLED_ISSUES \ 2024-12-18T00:13:53.9557384Z  -e CONTINUE_THROUGH_ERROR \ 2024-12-18T00:13:53.9557726Z  -e VERBOSE_TEST_LOGS \ 2024-12-18T00:13:53.9558036Z  -e TEST_SHOWLOCALS \ 2024-12-18T00:13:53.9558357Z  -e NO_TEST_TIMEOUT \ 2024-12-18T00:13:53.9558667Z  -e NO_TD \ 2024-12-18T00:13:53.9558948Z  -e TD_DISTRIBUTED \ 2024-12-18T00:13:53.9559259Z  -e PR_LABELS \ 2024-12-18T00:13:53.9559686Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-12-18T00:13:53.9560046Z  -e SCCACHE_BUCKET \ 2024-12-18T00:13:53.9560363Z  -e SCCACHE_REGION \ 2024-12-18T00:13:53.9560682Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-12-18T00:13:53.9561015Z  -e XLA_CUDA \ 2024-12-18T00:13:53.9561319Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-12-18T00:13:53.9561713Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-12-18T00:13:53.9562114Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-12-18T00:13:53.9562519Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-12-18T00:13:53.9562894Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-12-18T00:13:53.9563236Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-12-18T00:13:53.9563584Z  -e DASHBOARD_TAG \ 2024-12-18T00:13:53.9563891Z  -e IS_A100_RUNNER \ 2024-12-18T00:13:53.9564205Z  -e ARTIFACTS_FILE_SUFFIX \ 2024-12-18T00:13:53.9564594Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-12-18T00:13:53.9565023Z  --security-opt seccomp=unconfined \ 2024-12-18T00:13:53.9565459Z  --cap-add=SYS_PTRACE \ 2024-12-18T00:13:53.9565775Z  --ipc=host \ 2024-12-18T00:13:53.9566068Z  --shm-size="${SHM_SIZE}" \ 2024-12-18T00:13:53.9566390Z  --tty \ 2024-12-18T00:13:53.9566648Z  --detach \ 2024-12-18T00:13:53.9566923Z  --name="${container_name}" \ 2024-12-18T00:13:53.9567261Z  --user jenkins \ 2024-12-18T00:13:53.9567638Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-12-18T00:13:53.9568069Z  -w /var/lib/jenkins/workspace \ 2024-12-18T00:13:53.9568409Z  "${DOCKER_IMAGE}" 2024-12-18T00:13:53.9568680Z ) 2024-12-18T00:13:53.9568994Z # Propagate download.pytorch.org IP to container 2024-12-18T00:13:53.9569696Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-12-18T00:13:53.9570452Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-12-18T00:13:53.9571195Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-12-18T00:13:53.9575572Z shell: /usr/bin/bash -e {0} 2024-12-18T00:13:53.9575857Z env: 2024-12-18T00:13:53.9576096Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:53.9576457Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:13:53.9576936Z BUILD_ENVIRONMENT: linux-focal-cuda12.4-py3.10-gcc9-sm75 2024-12-18T00:13:53.9577340Z PR_NUMBER: 2024-12-18T00:13:53.9577603Z GITHUB_REPOSITORY: pytorch/pytorch 2024-12-18T00:13:53.9577920Z GITHUB_WORKFLOW: pull 2024-12-18T00:13:53.9578192Z GITHUB_JOB: test 2024-12-18T00:13:53.9578449Z GITHUB_RUN_ID: 12383255652 2024-12-18T00:13:53.9578741Z GITHUB_RUN_NUMBER: 276594 2024-12-18T00:13:53.9579031Z GITHUB_RUN_ATTEMPT: 1 2024-12-18T00:13:53.9579286Z JOB_ID: 34566627611 2024-12-18T00:13:53.9579781Z JOB_NAME: cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:13:53.9580338Z BRANCH: release/2.6 2024-12-18T00:13:53.9580643Z SHA1: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:13:53.9581042Z BASE_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:13:53.9581406Z TEST_CONFIG: pr_time_benchmarks 2024-12-18T00:13:53.9581714Z SHARD_NUMBER: 1 2024-12-18T00:13:53.9581968Z NUM_TEST_SHARDS: 1 2024-12-18T00:13:53.9582232Z REENABLED_ISSUES: 2024-12-18T00:13:53.9582505Z CONTINUE_THROUGH_ERROR: False 2024-12-18T00:13:53.9582798Z VERBOSE_TEST_LOGS: False 2024-12-18T00:13:53.9583086Z TEST_SHOWLOCALS: False 2024-12-18T00:13:53.9583371Z NO_TEST_TIMEOUT: False 2024-12-18T00:13:53.9583642Z NO_TD: False 2024-12-18T00:13:53.9583896Z TD_DISTRIBUTED: False 2024-12-18T00:13:53.9584216Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-12-18T00:13:53.9584600Z SCCACHE_REGION: us-east-1 2024-12-18T00:13:53.9584970Z SCCACHE_S3_KEY_PREFIX: pull 2024-12-18T00:13:53.9585265Z SHM_SIZE: 2g 2024-12-18T00:13:53.9586119Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:53.9587045Z XLA_CUDA: 2024-12-18T00:13:53.9587411Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:13:53.9587896Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-12-18T00:13:53.9588242Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-12-18T00:13:53.9588568Z DASHBOARD_TAG: 2024-12-18T00:13:53.9588992Z HUGGING_FACE_HUB_TOKEN: *** 2024-12-18T00:13:53.9589433Z SCRIBE_GRAPHQL_ACCESS_TOKEN: *** 2024-12-18T00:13:53.9589736Z IS_A100_RUNNER: 0 2024-12-18T00:13:53.9590208Z ARTIFACTS_FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611 2024-12-18T00:13:53.9590751Z ##[endgroup] 2024-12-18T00:13:53.9609976Z + [[ pr_time_benchmarks == \m\u\l\t\i\g\p\u ]] 2024-12-18T00:13:53.9610475Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *onnx* ]] 2024-12-18T00:13:53.9610916Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-12-18T00:13:53.9618958Z +++ nproc --ignore=2 2024-12-18T00:13:53.9631722Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=94 -e SCCACHE_BUCKET -e SCCACHE_REGION -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --env-file=/tmp/github_env_12383255652 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:14:05.3433747Z + container_name=cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:14:05.3434436Z + grep download.pytorch.org /etc/hosts 2024-12-18T00:14:05.3435585Z + docker exec -i cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e sudo bash -c '/bin/cat >> /etc/hosts' 2024-12-18T00:14:05.4817698Z + echo DOCKER_CONTAINER_ID=cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:14:05.4821617Z ++ echo dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl 2024-12-18T00:14:05.4823481Z + docker exec -t cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e sh -c 'python3 -m pip install dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-12-18T00:14:05.8508212Z Processing ./dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl (from torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:14:06.7027444Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.16.1) 2024-12-18T00:14:06.7029100Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (4.12.2) 2024-12-18T00:14:06.7030671Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2.8.8) 2024-12-18T00:14:06.7032375Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.1.4) 2024-12-18T00:14:06.7037853Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2024.10.0) 2024-12-18T00:14:06.7040547Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.13.1) 2024-12-18T00:14:06.7064968Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.3.0) 2024-12-18T00:14:06.7078783Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.3.0) 2024-12-18T00:14:06.7097501Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.22.4) 2024-12-18T00:14:06.7472940Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.0.2) 2024-12-18T00:14:07.3209600Z Installing collected packages: torch 2024-12-18T00:14:17.8776092Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-12-18T00:14:17.8779294Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-12-18T00:14:17.8780667Z Successfully installed torch-2.6.0a0+git0cdf8b1 2024-12-18T00:14:17.9530001Z + export TERM=vt100 2024-12-18T00:14:17.9530331Z + TERM=vt100 2024-12-18T00:14:17.9530658Z ++ dirname .ci/pytorch/test.sh 2024-12-18T00:14:17.9541425Z + source .ci/pytorch/common.sh 2024-12-18T00:14:17.9544810Z +++ dirname .ci/pytorch/common.sh 2024-12-18T00:14:17.9559856Z ++ source .ci/pytorch/common_utils.sh 2024-12-18T00:14:17.9560334Z +++ declare -f -t trap_add 2024-12-18T00:14:17.9567648Z ++ set -ex 2024-12-18T00:14:17.9568123Z ++ [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *rocm* ]] 2024-12-18T00:14:17.9568602Z ++ BUILD_TEST_LIBTORCH=0 2024-12-18T00:14:17.9569009Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 != *rocm* ]] 2024-12-18T00:14:17.9569470Z + [[ -d /var/lib/jenkins/workspace ]] 2024-12-18T00:14:17.9571181Z ++ stat -c %u /var/lib/jenkins/workspace 2024-12-18T00:14:17.9589795Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-12-18T00:14:17.9590510Z + trap_add cleanup_workspace EXIT 2024-12-18T00:14:17.9590896Z + trap_add_cmd=cleanup_workspace 2024-12-18T00:14:17.9591252Z + shift 2024-12-18T00:14:17.9591519Z + for trap_add_name in "$@" 2024-12-18T00:14:17.9596778Z +++ trap -p EXIT 2024-12-18T00:14:17.9597500Z ++ eval 'extract_trap_cmd ' 2024-12-18T00:14:17.9597883Z +++ extract_trap_cmd 2024-12-18T00:14:17.9598228Z +++ printf '%s\n' '' 2024-12-18T00:14:17.9598555Z ++ printf '%s\n' cleanup_workspace 2024-12-18T00:14:17.9598933Z + trap -- ' 2024-12-18T00:14:17.9599214Z cleanup_workspace' EXIT 2024-12-18T00:14:17.9599582Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-12-18T00:14:18.3966424Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-12-18T00:14:18.3988598Z + echo 'Environment variables:' 2024-12-18T00:14:18.3989646Z Environment variables: 2024-12-18T00:14:18.3989964Z + env 2024-12-18T00:14:18.3997430Z INSTALLED_DB=yes 2024-12-18T00:14:18.3997726Z NV_LIBCUBLAS_VERSION=12.4.5.8-1 2024-12-18T00:14:18.3998117Z NVIDIA_VISIBLE_DEVICES=all 2024-12-18T00:14:18.3998507Z NV_NVML_DEV_VERSION=12.4.127-1 2024-12-18T00:14:18.3998985Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:14:18.3999503Z CONTINUE_THROUGH_ERROR=False 2024-12-18T00:14:18.3999899Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.21.5-1+cuda12.4 2024-12-18T00:14:18.4000533Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.21.5-1 2024-12-18T00:14:18.4000987Z BUILD_ENVIRONMENT=linux-focal-cuda12.4-py3.10-gcc9-sm75 2024-12-18T00:14:18.4001453Z HOSTNAME=cb9da7563640 2024-12-18T00:14:18.4002221Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4002974Z GITHUB_ACTION=__self 2024-12-18T00:14:18.4003289Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-12-18T00:14:18.4008317Z NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536 2024-12-18T00:14:18.4013745Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.5.8-1 2024-12-18T00:14:18.4014163Z NV_NVTX_VERSION=12.4.127-1 2024-12-18T00:14:18.4014466Z GITHUB_RUN_NUMBER=276594 2024-12-18T00:14:18.4014783Z TEST_CONFIG=pr_time_benchmarks 2024-12-18T00:14:18.4015129Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-12-18T00:14:18.4015478Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-12-18T00:14:18.4015837Z IS_A100_RUNNER=0 2024-12-18T00:14:18.4016134Z NV_CUDA_CUDART_DEV_VERSION=12.4.127-1 2024-12-18T00:14:18.4016500Z NV_LIBCUSPARSE_VERSION=12.3.1.170-1 2024-12-18T00:14:18.4017070Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-12-18T00:14:18.4017395Z NV_LIBNPP_VERSION=12.2.5.30-1 2024-12-18T00:14:18.4017740Z GITHUB_TRIGGERING_ACTOR=malfet 2024-12-18T00:14:18.4018122Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-12-18T00:14:18.4018532Z GITHUB_REF_TYPE=branch 2024-12-18T00:14:18.4018846Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-12-18T00:14:18.4019147Z NCCL_VERSION=2.21.5-1 2024-12-18T00:14:18.4019470Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:14:18.4030525Z XLA_CUDA= 2024-12-18T00:14:18.4030999Z HUGGING_FACE_HUB_TOKEN=*** 2024-12-18T00:14:18.4033245Z *** 2024-12-18T00:14:18.4033485Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-12-18T00:14:18.4033826Z GITHUB_REPOSITORY_ID=65600975 2024-12-18T00:14:18.4034137Z GITHUB_ACTIONS=true 2024-12-18T00:14:18.4034416Z NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:14:18.4034788Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.127-1 2024-12-18T00:14:18.4035176Z NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.30-1 2024-12-18T00:14:18.4035570Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:14:18.4035949Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-12-18T00:14:18.4036341Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:14:18.4036916Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/release/2.6 2024-12-18T00:14:18.4037442Z UCC_HOME=/usr 2024-12-18T00:14:18.4037691Z NV_LIBCUBLAS_DEV_VERSION=12.4.5.8-1 2024-12-18T00:14:18.4038021Z VERBOSE_TEST_LOGS=False 2024-12-18T00:14:18.4038305Z NVIDIA_PRODUCT_NAME=CUDA 2024-12-18T00:14:18.4038642Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4 2024-12-18T00:14:18.4039013Z GITHUB_REF=refs/heads/release/2.6 2024-12-18T00:14:18.4039339Z NV_CUDA_CUDART_VERSION=12.4.127-1 2024-12-18T00:14:18.4039650Z SHARD_NUMBER=1 2024-12-18T00:14:18.4039909Z GITHUB_REF_PROTECTED=true 2024-12-18T00:14:18.4040353Z HOME=/var/lib/jenkins 2024-12-18T00:14:18.4040640Z GITHUB_API_URL=https://api.github.com 2024-12-18T00:14:18.4040998Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-12-18T00:14:18.4041381Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-12-18T00:14:18.4041763Z SCCACHE_S3_KEY_PREFIX=pull 2024-12-18T00:14:18.4042054Z CUDA_VERSION=12.4.1 2024-12-18T00:14:18.4042339Z NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.5.8-1 2024-12-18T00:14:18.4042691Z NUM_TEST_SHARDS=1 2024-12-18T00:14:18.4042945Z UCX_HOME=/usr 2024-12-18T00:14:18.4043312Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.1-1 2024-12-18T00:14:18.4044117Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4045002Z JOB_NAME=cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:14:18.4045876Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4046733Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-12-18T00:14:18.4047338Z GITHUB_EVENT_NAME=push 2024-12-18T00:14:18.4047618Z DASHBOARD_TAG= 2024-12-18T00:14:18.4047874Z GITHUB_RUN_ID=12383255652 2024-12-18T00:14:18.4048194Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.30-1 2024-12-18T00:14:18.4048616Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4 2024-12-18T00:14:18.4049349Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4050065Z GITHUB_ACTOR=malfet 2024-12-18T00:14:18.4050343Z NV_LIBNPP_DEV_VERSION=12.2.5.30-1 2024-12-18T00:14:18.4050648Z PR_NUMBER= 2024-12-18T00:14:18.4050874Z GITHUB_RUN_ATTEMPT=1 2024-12-18T00:14:18.4051159Z ANACONDA_PYTHON_VERSION=3.10 2024-12-18T00:14:18.4051523Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-12-18T00:14:18.4051894Z TERM=vt100 2024-12-18T00:14:18.4052154Z NV_LIBCUSPARSE_DEV_VERSION=12.3.1.170-1 2024-12-18T00:14:18.4052483Z INSTALLED_VISION=yes 2024-12-18T00:14:18.4052755Z BRANCH=release/2.6 2024-12-18T00:14:18.4053023Z SCCACHE_REGION=us-east-1 2024-12-18T00:14:18.4053324Z OPENSSL_ROOT_DIR=/opt/openssl 2024-12-18T00:14:18.4053655Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-12-18T00:14:18.4053987Z CUDA_PATH=/usr/local/cuda 2024-12-18T00:14:18.4054543Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-12-18T00:14:18.4055162Z GITHUB_SERVER_URL=https://github.com 2024-12-18T00:14:18.4055557Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-12-18T00:14:18.4055931Z REENABLED_ISSUES= 2024-12-18T00:14:18.4056168Z SHLVL=1 2024-12-18T00:14:18.4056396Z MAX_JOBS=94 2024-12-18T00:14:18.4056643Z NV_CUDA_LIB_VERSION=12.4.1-1 2024-12-18T00:14:18.4056936Z NVARCH=x86_64 2024-12-18T00:14:18.4057172Z GITHUB_ACTOR_ID=2453524 2024-12-18T00:14:18.4057540Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:14:18.4057968Z GITHUB_REF_NAME=release/2.6 2024-12-18T00:14:18.4058286Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4 2024-12-18T00:14:18.4058766Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:14:18.4059213Z GITHUB_JOB=test 2024-12-18T00:14:18.4059496Z NV_LIBNCCL_PACKAGE=libnccl2=2.21.5-1+cuda12.4 2024-12-18T00:14:18.4059935Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-12-18T00:14:18.4060350Z NO_TEST_TIMEOUT=False 2024-12-18T00:14:18.4060624Z TD_DISTRIBUTED=False 2024-12-18T00:14:18.4060906Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.1-1 2024-12-18T00:14:18.4061258Z GITHUB_REPOSITORY=pytorch/pytorch 2024-12-18T00:14:18.4061589Z NV_NVPROF_VERSION=12.4.127-1 2024-12-18T00:14:18.4061889Z GITHUB_RETENTION_DAYS=90 2024-12-18T00:14:18.4062178Z OPENSSL_DIR=/opt/openssl 2024-12-18T00:14:18.4062452Z GITHUB_ACTION_REPOSITORY= 2024-12-18T00:14:18.4063270Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:14:18.4064181Z GITHUB_BASE_REF= 2024-12-18T00:14:18.4064668Z ARTIFACTS_FILE_SUFFIX=test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611 2024-12-18T00:14:18.4065233Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-12-18T00:14:18.4065538Z CI=true 2024-12-18T00:14:18.4065774Z NV_LIBNCCL_PACKAGE_VERSION=2.21.5-1 2024-12-18T00:14:18.4066112Z GITHUB_REPOSITORY_OWNER=pytorch 2024-12-18T00:14:18.4066415Z JOB_ID=34566627611 2024-12-18T00:14:18.4066682Z INSTALLED_PROTOBUF=yes 2024-12-18T00:14:18.4066944Z GITHUB_HEAD_REF= 2024-12-18T00:14:18.4067199Z GITHUB_ACTION_REF= 2024-12-18T00:14:18.4067521Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-12-18T00:14:18.4067895Z TEST_SHOWLOCALS=False 2024-12-18T00:14:18.4068172Z GITHUB_WORKFLOW=pull 2024-12-18T00:14:18.4068441Z DEBIAN_FRONTEND=noninteractive 2024-12-18T00:14:18.4069109Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4069803Z NO_TD=False 2024-12-18T00:14:18.4070056Z SKIP_SCCACHE_INITIALIZATION=1 2024-12-18T00:14:18.4070359Z _=/usr/bin/env 2024-12-18T00:14:18.4070746Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-12-18T00:14:18.4227566Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-12-18T00:14:18.4228780Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-12-18T00:14:18.4229645Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-12-18T00:14:18.4230339Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-12-18T00:14:18.4230852Z + BUILD_DIR=build 2024-12-18T00:14:18.4231145Z + BUILD_RENAMED_DIR=build_renamed 2024-12-18T00:14:18.4231492Z + BUILD_BIN_DIR=build/bin 2024-12-18T00:14:18.4231795Z + SHARD_NUMBER=1 2024-12-18T00:14:18.4232067Z + NUM_TEST_SHARDS=1 2024-12-18T00:14:18.4232338Z + export VALGRIND=ON 2024-12-18T00:14:18.4232624Z + VALGRIND=ON 2024-12-18T00:14:18.4232985Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *clang9* ]] 2024-12-18T00:14:18.4233478Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *xpu* ]] 2024-12-18T00:14:18.4233888Z + [[ 0 == \1 ]] 2024-12-18T00:14:18.4234138Z + [[ False == \1 ]] 2024-12-18T00:14:18.4234578Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 != *bazel* ]] 2024-12-18T00:14:18.4234985Z ++ realpath build/custom_test_artifacts 2024-12-18T00:14:18.4238318Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-12-18T00:14:18.4238921Z + [[ -n '' ]] 2024-12-18T00:14:18.4239188Z + echo 'Environment variables' 2024-12-18T00:14:18.4239523Z Environment variables 2024-12-18T00:14:18.4239807Z + env 2024-12-18T00:14:18.4243321Z INSTALLED_DB=yes 2024-12-18T00:14:18.4243633Z NV_LIBCUBLAS_VERSION=12.4.5.8-1 2024-12-18T00:14:18.4244051Z NVIDIA_VISIBLE_DEVICES=all 2024-12-18T00:14:18.4244400Z NV_NVML_DEV_VERSION=12.4.127-1 2024-12-18T00:14:18.4244906Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:14:18.4245443Z CONTINUE_THROUGH_ERROR=False 2024-12-18T00:14:18.4245849Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.21.5-1+cuda12.4 2024-12-18T00:14:18.4246332Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.21.5-1 2024-12-18T00:14:18.4246801Z BUILD_ENVIRONMENT=linux-focal-cuda12.4-py3.10-gcc9-sm75 2024-12-18T00:14:18.4247232Z HOSTNAME=cb9da7563640 2024-12-18T00:14:18.4247908Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4248670Z GITHUB_ACTION=__self 2024-12-18T00:14:18.4248999Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-12-18T00:14:18.4253884Z NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536 2024-12-18T00:14:18.4259334Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.5.8-1 2024-12-18T00:14:18.4259767Z NV_NVTX_VERSION=12.4.127-1 2024-12-18T00:14:18.4260108Z GITHUB_RUN_NUMBER=276594 2024-12-18T00:14:18.4260433Z TEST_CONFIG=pr_time_benchmarks 2024-12-18T00:14:18.4260809Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-12-18T00:14:18.4261175Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-12-18T00:14:18.4261630Z IS_A100_RUNNER=0 2024-12-18T00:14:18.4261952Z NV_CUDA_CUDART_DEV_VERSION=12.4.127-1 2024-12-18T00:14:18.4262356Z NV_LIBCUSPARSE_VERSION=12.3.1.170-1 2024-12-18T00:14:18.4262906Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-12-18T00:14:18.4263280Z NV_LIBNPP_VERSION=12.2.5.30-1 2024-12-18T00:14:18.4263629Z GITHUB_TRIGGERING_ACTOR=malfet 2024-12-18T00:14:18.4264051Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-12-18T00:14:18.4264502Z GITHUB_REF_TYPE=branch 2024-12-18T00:14:18.4264821Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-12-18T00:14:18.4265145Z NCCL_VERSION=2.21.5-1 2024-12-18T00:14:18.4265470Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:14:18.4265855Z XLA_CUDA= 2024-12-18T00:14:18.4266230Z HUGGING_FACE_HUB_TOKEN=*** 2024-12-18T00:14:18.4266626Z *** 2024-12-18T00:14:18.4266896Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-12-18T00:14:18.4267259Z GITHUB_REPOSITORY_ID=65600975 2024-12-18T00:14:18.4267588Z GITHUB_ACTIONS=true 2024-12-18T00:14:18.4267887Z NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:14:18.4268292Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.127-1 2024-12-18T00:14:18.4268723Z NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.30-1 2024-12-18T00:14:18.4269117Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:14:18.4269522Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-12-18T00:14:18.4269948Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:14:18.4270578Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/release/2.6 2024-12-18T00:14:18.4271144Z UCC_HOME=/usr 2024-12-18T00:14:18.4271416Z NV_LIBCUBLAS_DEV_VERSION=12.4.5.8-1 2024-12-18T00:14:18.4271775Z VERBOSE_TEST_LOGS=False 2024-12-18T00:14:18.4272087Z NVIDIA_PRODUCT_NAME=CUDA 2024-12-18T00:14:18.4272443Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4 2024-12-18T00:14:18.4272854Z GITHUB_REF=refs/heads/release/2.6 2024-12-18T00:14:18.4273191Z NV_CUDA_CUDART_VERSION=12.4.127-1 2024-12-18T00:14:18.4273534Z SHARD_NUMBER=1 2024-12-18T00:14:18.4273825Z GITHUB_REF_PROTECTED=true 2024-12-18T00:14:18.4274162Z HOME=/var/lib/jenkins 2024-12-18T00:14:18.4274502Z GITHUB_API_URL=https://api.github.com 2024-12-18T00:14:18.4274884Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-12-18T00:14:18.4275338Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-12-18T00:14:18.4275754Z SCCACHE_S3_KEY_PREFIX=pull 2024-12-18T00:14:18.4276092Z CUDA_VERSION=12.4.1 2024-12-18T00:14:18.4276444Z NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.5.8-1 2024-12-18T00:14:18.4276854Z NUM_TEST_SHARDS=1 2024-12-18T00:14:18.4277151Z UCX_HOME=/usr 2024-12-18T00:14:18.4277557Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.1-1 2024-12-18T00:14:18.4278466Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4279484Z JOB_NAME=cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:14:18.4280550Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4281512Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-12-18T00:14:18.4282121Z GITHUB_EVENT_NAME=push 2024-12-18T00:14:18.4282423Z DASHBOARD_TAG= 2024-12-18T00:14:18.4282710Z GITHUB_RUN_ID=12383255652 2024-12-18T00:14:18.4283056Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.30-1 2024-12-18T00:14:18.4283469Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4 2024-12-18T00:14:18.4284251Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4285009Z GITHUB_ACTOR=malfet 2024-12-18T00:14:18.4285292Z NV_LIBNPP_DEV_VERSION=12.2.5.30-1 2024-12-18T00:14:18.4285605Z PR_NUMBER= 2024-12-18T00:14:18.4285844Z GITHUB_RUN_ATTEMPT=1 2024-12-18T00:14:18.4286109Z VALGRIND=ON 2024-12-18T00:14:18.4286352Z ANACONDA_PYTHON_VERSION=3.10 2024-12-18T00:14:18.4286732Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-12-18T00:14:18.4287116Z TERM=vt100 2024-12-18T00:14:18.4287426Z NV_LIBCUSPARSE_DEV_VERSION=12.3.1.170-1 2024-12-18T00:14:18.4287772Z INSTALLED_VISION=yes 2024-12-18T00:14:18.4288033Z BRANCH=release/2.6 2024-12-18T00:14:18.4288302Z SCCACHE_REGION=us-east-1 2024-12-18T00:14:18.4288600Z OPENSSL_ROOT_DIR=/opt/openssl 2024-12-18T00:14:18.4288932Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-12-18T00:14:18.4289286Z CUDA_PATH=/usr/local/cuda 2024-12-18T00:14:18.4289855Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-12-18T00:14:18.4290502Z GITHUB_SERVER_URL=https://github.com 2024-12-18T00:14:18.4290901Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-12-18T00:14:18.4291281Z REENABLED_ISSUES= 2024-12-18T00:14:18.4291527Z SHLVL=1 2024-12-18T00:14:18.4291740Z MAX_JOBS=94 2024-12-18T00:14:18.4291979Z NV_CUDA_LIB_VERSION=12.4.1-1 2024-12-18T00:14:18.4292275Z NVARCH=x86_64 2024-12-18T00:14:18.4292523Z GITHUB_ACTOR_ID=2453524 2024-12-18T00:14:18.4292889Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:14:18.4293336Z GITHUB_REF_NAME=release/2.6 2024-12-18T00:14:18.4293662Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4 2024-12-18T00:14:18.4294156Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:14:18.4294632Z GITHUB_JOB=test 2024-12-18T00:14:18.4294912Z NV_LIBNCCL_PACKAGE=libnccl2=2.21.5-1+cuda12.4 2024-12-18T00:14:18.4295364Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-12-18T00:14:18.4295797Z NO_TEST_TIMEOUT=False 2024-12-18T00:14:18.4296074Z TD_DISTRIBUTED=False 2024-12-18T00:14:18.4296371Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.1-1 2024-12-18T00:14:18.4296730Z GITHUB_REPOSITORY=pytorch/pytorch 2024-12-18T00:14:18.4297072Z NV_NVPROF_VERSION=12.4.127-1 2024-12-18T00:14:18.4297379Z GITHUB_RETENTION_DAYS=90 2024-12-18T00:14:18.4297670Z OPENSSL_DIR=/opt/openssl 2024-12-18T00:14:18.4297969Z GITHUB_ACTION_REPOSITORY= 2024-12-18T00:14:18.4298839Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:14:18.4299736Z GITHUB_BASE_REF= 2024-12-18T00:14:18.4300239Z ARTIFACTS_FILE_SUFFIX=test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611 2024-12-18T00:14:18.4300829Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-12-18T00:14:18.4301140Z CI=true 2024-12-18T00:14:18.4301387Z NV_LIBNCCL_PACKAGE_VERSION=2.21.5-1 2024-12-18T00:14:18.4301812Z GITHUB_REPOSITORY_OWNER=pytorch 2024-12-18T00:14:18.4302127Z JOB_ID=34566627611 2024-12-18T00:14:18.4302389Z INSTALLED_PROTOBUF=yes 2024-12-18T00:14:18.4302674Z GITHUB_HEAD_REF= 2024-12-18T00:14:18.4302923Z GITHUB_ACTION_REF= 2024-12-18T00:14:18.4303253Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-12-18T00:14:18.4303647Z TEST_SHOWLOCALS=False 2024-12-18T00:14:18.4303931Z GITHUB_WORKFLOW=pull 2024-12-18T00:14:18.4304317Z DEBIAN_FRONTEND=noninteractive 2024-12-18T00:14:18.4305028Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_d6cbf528-e2bd-400b-addc-dfc241b1d78b 2024-12-18T00:14:18.4305768Z NO_TD=False 2024-12-18T00:14:18.4306034Z SKIP_SCCACHE_INITIALIZATION=1 2024-12-18T00:14:18.4306352Z _=/usr/bin/env 2024-12-18T00:14:18.4306621Z + echo 'Testing pytorch' 2024-12-18T00:14:18.4306908Z Testing pytorch 2024-12-18T00:14:18.4307182Z + export LANG=C.UTF-8 2024-12-18T00:14:18.4307451Z + LANG=C.UTF-8 2024-12-18T00:14:18.4307710Z + PR_NUMBER= 2024-12-18T00:14:18.4307987Z + [[ pr_time_benchmarks == \d\e\f\a\u\l\t ]] 2024-12-18T00:14:18.4308380Z + [[ pr_time_benchmarks == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-12-18T00:14:18.4308777Z + [[ pr_time_benchmarks == \s\l\o\w ]] 2024-12-18T00:14:18.4309232Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *slow-gradcheck* ]] 2024-12-18T00:14:18.4309758Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *cuda* ]] 2024-12-18T00:14:18.4310196Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-12-18T00:14:18.4310608Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-12-18T00:14:18.4310973Z + [[ pr_time_benchmarks == *crossref* ]] 2024-12-18T00:14:18.4311469Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *rocm* ]] 2024-12-18T00:14:18.4311947Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *xpu* ]] 2024-12-18T00:14:18.4312440Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 != *-bazel-* ]] 2024-12-18T00:14:18.4312891Z + pip_install --user ninja==1.10.2 2024-12-18T00:14:18.4313331Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:14:18.4313902Z + python3 -m pip install --progress-bar off --user ninja==1.10.2 2024-12-18T00:14:20.5321852Z Collecting ninja==1.10.2 2024-12-18T00:14:20.5519719Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-12-18T00:14:20.5712237Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-12-18T00:14:21.1137946Z Installing collected packages: ninja 2024-12-18T00:14:21.1212405Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-12-18T00:14:21.1215331Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-12-18T00:14:21.1268447Z Successfully installed ninja-1.10.2 2024-12-18T00:14:21.1943407Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:14:21.1948197Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:14:21.1949427Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *aarch64* ]] 2024-12-18T00:14:21.1949829Z + install_tlparse 2024-12-18T00:14:21.1950113Z + pip_install --user tlparse==0.3.25 2024-12-18T00:14:21.1950539Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:14:21.1951071Z + python3 -m pip install --progress-bar off --user tlparse==0.3.25 2024-12-18T00:14:21.5589215Z Collecting tlparse==0.3.25 2024-12-18T00:14:21.5806282Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-12-18T00:14:21.5937745Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-12-18T00:14:22.1911160Z Installing collected packages: tlparse 2024-12-18T00:14:22.2256442Z Successfully installed tlparse-0.3.25 2024-12-18T00:14:22.2943961Z ++ python -m site --user-base 2024-12-18T00:14:22.3181133Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:14:22.3182443Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *asan* ]] 2024-12-18T00:14:22.3183137Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 == *-debug* ]] 2024-12-18T00:14:22.3183661Z + [[ linux-focal-cuda12.4-py3.10-gcc9-sm75 != *-bazel-* ]] 2024-12-18T00:14:22.3184358Z + echo 'We are not in debug mode: linux-focal-cuda12.4-py3.10-gcc9-sm75. Expect the assertion to pass' 2024-12-18T00:14:22.3185206Z We are not in debug mode: linux-focal-cuda12.4-py3.10-gcc9-sm75. Expect the assertion to pass 2024-12-18T00:14:22.3185791Z + cd test 2024-12-18T00:14:22.3186196Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-12-18T00:14:23.9175915Z + [[ pr_time_benchmarks == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-12-18T00:14:23.9176899Z + [[ pr_time_benchmarks == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-12-18T00:14:23.9177317Z + DYNAMO_BENCHMARK_FLAGS=() 2024-12-18T00:14:23.9178158Z + [[ pr_time_benchmarks == *pr_time_benchmarks* ]] 2024-12-18T00:14:23.9178547Z + pr_time_benchmarks 2024-12-18T00:14:23.9178873Z + pip_install --user fbscribelogger 2024-12-18T00:14:23.9179353Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:14:23.9179934Z + python3 -m pip install --progress-bar off --user fbscribelogger 2024-12-18T00:14:24.2413994Z Requirement already satisfied: fbscribelogger in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (0.1.7) 2024-12-18T00:14:24.2425931Z Requirement already satisfied: aiohttp<4.0.0,>=3.10.4 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from fbscribelogger) (3.11.10) 2024-12-18T00:14:24.2427151Z Requirement already satisfied: thriftpy2<0.6.0,>=0.5.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from fbscribelogger) (0.5.2) 2024-12-18T00:14:24.2431474Z Requirement already satisfied: typing-extensions<5.0.0,>=4.12.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from fbscribelogger) (4.12.2) 2024-12-18T00:14:24.2468218Z Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.10.4->fbscribelogger) (2.4.4) 2024-12-18T00:14:24.2470664Z Requirement already satisfied: aiosignal>=1.1.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.10.4->fbscribelogger) (1.3.1) 2024-12-18T00:14:24.2474761Z Requirement already satisfied: async-timeout<6.0,>=4.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.10.4->fbscribelogger) (5.0.1) 2024-12-18T00:14:24.2476687Z Requirement already satisfied: attrs>=17.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.10.4->fbscribelogger) (24.2.0) 2024-12-18T00:14:24.2480779Z Requirement already satisfied: frozenlist>=1.1.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.10.4->fbscribelogger) (1.5.0) 2024-12-18T00:14:24.2486338Z Requirement already satisfied: multidict<7.0,>=4.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.10.4->fbscribelogger) (6.1.0) 2024-12-18T00:14:24.2490143Z Requirement already satisfied: propcache>=0.2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.10.4->fbscribelogger) (0.2.1) 2024-12-18T00:14:24.2493326Z Requirement already satisfied: yarl<2.0,>=1.17.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.10.4->fbscribelogger) (1.18.3) 2024-12-18T00:14:24.2513254Z Requirement already satisfied: Cython>=3.0.10 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from thriftpy2<0.6.0,>=0.5.2->fbscribelogger) (3.0.11) 2024-12-18T00:14:24.2516805Z Requirement already satisfied: ply<4.0,>=3.4 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from thriftpy2<0.6.0,>=0.5.2->fbscribelogger) (3.11) 2024-12-18T00:14:24.2519165Z Requirement already satisfied: six~=1.15 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from thriftpy2<0.6.0,>=0.5.2->fbscribelogger) (1.17.0) 2024-12-18T00:14:24.2721564Z Requirement already satisfied: idna>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from yarl<2.0,>=1.17.0->aiohttp<4.0.0,>=3.10.4->fbscribelogger) (3.10) 2024-12-18T00:14:24.8665226Z ++ pwd 2024-12-18T00:14:24.8666290Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-12-18T00:14:24.8667785Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-12-18T00:14:24.8686293Z ++ pwd 2024-12-18T00:14:24.8686894Z + PYTHONPATH=/var/lib/jenkins/workspace/benchmarks/dynamo/pr_time_benchmarks 2024-12-18T00:14:24.8688262Z + source benchmarks/dynamo/pr_time_benchmarks/benchmark_runner.sh /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv benchmarks/dynamo/pr_time_benchmarks/benchmarks 2024-12-18T00:14:24.8689389Z ++ '[' 2 -eq 0 ']' 2024-12-18T00:14:24.8689694Z ++ '[' 2 -eq 1 ']' 2024-12-18T00:14:24.8690244Z ++ output_file=/var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:14:24.8691016Z ++ python_programs_dir=benchmarks/dynamo/pr_time_benchmarks/benchmarks 2024-12-18T00:14:24.8691532Z +++ date +%s 2024-12-18T00:14:24.8701404Z ++ start=1734480864 2024-12-18T00:14:24.8702229Z ++ for file in $python_programs_dir/*.py 2024-12-18T00:14:24.8703382Z ++ python benchmarks/dynamo/pr_time_benchmarks/benchmarks/add_loop.py /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:14:27.3169817Z collecting compile time instruction count for add_loop_eager 2024-12-18T00:14:29.4148229Z compile time instruction count for iteration 0 is 3203960674 2024-12-18T00:14:30.3270368Z compile time instruction count for iteration 1 is 3093708067 2024-12-18T00:14:31.2307118Z compile time instruction count for iteration 2 is 3092594096 2024-12-18T00:14:32.1317557Z compile time instruction count for iteration 3 is 3089063187 2024-12-18T00:14:33.0315867Z compile time instruction count for iteration 4 is 3088944243 2024-12-18T00:14:33.0568446Z collecting compile time instruction count for add_loop_eager_dynamic 2024-12-18T00:14:34.6298183Z compile time instruction count for iteration 0 is 5943561712 2024-12-18T00:14:36.1646962Z compile time instruction count for iteration 1 is 5718429779 2024-12-18T00:14:37.6950450Z compile time instruction count for iteration 2 is 5718576102 2024-12-18T00:14:39.2231573Z compile time instruction count for iteration 3 is 5716478710 2024-12-18T00:14:40.7857141Z compile time instruction count for iteration 4 is 5715065762 2024-12-18T00:14:40.7908998Z collecting compile time instruction count for add_loop_inductor 2024-12-18T00:14:59.0650712Z compile time instruction count for iteration 0 is 52765735725 2024-12-18T00:15:08.3190965Z compile time instruction count for iteration 1 is 29142132030 2024-12-18T00:15:17.5592280Z compile time instruction count for iteration 2 is 29149355766 2024-12-18T00:15:26.9199344Z compile time instruction count for iteration 3 is 29165924681 2024-12-18T00:15:36.3349170Z compile time instruction count for iteration 4 is 29178714995 2024-12-18T00:15:36.3975423Z collecting compile time instruction count for add_loop_inductor_gpu 2024-12-18T00:16:04.8111138Z compile time instruction count for iteration 0 is 25653046003 2024-12-18T00:16:32.9576522Z compile time instruction count for iteration 1 is 25633933016 2024-12-18T00:17:00.9182935Z compile time instruction count for iteration 2 is 25635992080 2024-12-18T00:17:28.9135975Z compile time instruction count for iteration 3 is 25641909779 2024-12-18T00:17:57.0207926Z compile time instruction count for iteration 4 is 25641099615 2024-12-18T00:17:57.0725381Z collecting compile time instruction count for add_loop_inductor_dynamic_gpu 2024-12-18T00:18:29.4234816Z compile time instruction count for iteration 0 is 43319404235 2024-12-18T00:19:01.7714494Z compile time instruction count for iteration 1 is 43172906041 2024-12-18T00:19:34.6478273Z compile time instruction count for iteration 2 is 43165345934 2024-12-18T00:20:07.0470346Z compile time instruction count for iteration 3 is 43171267762 2024-12-18T00:20:39.5514093Z compile time instruction count for iteration 4 is 43177404157 2024-12-18T00:20:44.0963397Z ++ for file in $python_programs_dir/*.py 2024-12-18T00:20:44.0966016Z ++ python benchmarks/dynamo/pr_time_benchmarks/benchmarks/aotdispatcher.py /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:20:46.4915371Z collecting compile time instruction count for aotdispatcher_inference_nosubclass_cpu 2024-12-18T00:20:48.9849169Z compile time instruction count for iteration 0 is 6494538568 2024-12-18T00:20:49.6743362Z compile time instruction count for iteration 1 is 2057886820 2024-12-18T00:20:50.3798319Z compile time instruction count for iteration 2 is 2042898059 2024-12-18T00:20:51.0694579Z compile time instruction count for iteration 3 is 2036400321 2024-12-18T00:20:51.7517898Z compile time instruction count for iteration 4 is 2035408311 2024-12-18T00:20:51.7778553Z collecting compile time instruction count for aotdispatcher_training_nosubclass_cpu 2024-12-18T00:20:52.9069984Z compile time instruction count for iteration 0 is 4085564011 2024-12-18T00:20:53.9705869Z compile time instruction count for iteration 1 is 3888283846 2024-12-18T00:20:55.0256244Z compile time instruction count for iteration 2 is 3883872382 2024-12-18T00:20:56.0878037Z compile time instruction count for iteration 3 is 3882358009 2024-12-18T00:20:57.1487754Z compile time instruction count for iteration 4 is 3882013049 2024-12-18T00:20:57.1571189Z collecting compile time instruction count for aotdispatcher_inference_subclass_cpu 2024-12-18T00:20:58.7974518Z compile time instruction count for iteration 0 is 5901005751 2024-12-18T00:21:00.3536828Z compile time instruction count for iteration 1 is 5897398853 2024-12-18T00:21:01.9108471Z compile time instruction count for iteration 2 is 5895332534 2024-12-18T00:21:03.4744097Z compile time instruction count for iteration 3 is 5896751840 2024-12-18T00:21:05.0287468Z compile time instruction count for iteration 4 is 5893937784 2024-12-18T00:21:05.0358844Z collecting compile time instruction count for aotdispatcher_training_subclass_cpu 2024-12-18T00:21:07.5156975Z compile time instruction count for iteration 0 is 10440446059 2024-12-18T00:21:10.0074552Z compile time instruction count for iteration 1 is 10438385868 2024-12-18T00:21:12.5046321Z compile time instruction count for iteration 2 is 10437764333 2024-12-18T00:21:15.0093080Z compile time instruction count for iteration 3 is 10438390382 2024-12-18T00:21:17.5046443Z compile time instruction count for iteration 4 is 10435942800 2024-12-18T00:21:18.4374545Z ++ for file in $python_programs_dir/*.py 2024-12-18T00:21:18.4377215Z ++ python benchmarks/dynamo/pr_time_benchmarks/benchmarks/aotdispatcher_partitioner.py /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:21:20.8492972Z collecting compile time instruction count for aotdispatcher_partitioner_cpu 2024-12-18T00:21:24.9467828Z compile time instruction count for iteration 0 is 13841538687 2024-12-18T00:21:27.2726057Z compile time instruction count for iteration 1 is 9160830023 2024-12-18T00:21:29.6143834Z compile time instruction count for iteration 2 is 9147628085 2024-12-18T00:21:31.9478511Z compile time instruction count for iteration 3 is 9138248664 2024-12-18T00:21:34.2897507Z compile time instruction count for iteration 4 is 9136669307 2024-12-18T00:21:35.2211889Z ++ for file in $python_programs_dir/*.py 2024-12-18T00:21:35.2213053Z ++ python benchmarks/dynamo/pr_time_benchmarks/benchmarks/basic_modules_benchmarks.py /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:21:37.5981236Z collecting compile time instruction count for basic_modules_ListOfLinears_eager 2024-12-18T00:21:39.1380034Z compile time instruction count for iteration 0 is 1188421225 2024-12-18T00:21:39.4770494Z compile time instruction count for iteration 1 is 1049727574 2024-12-18T00:21:39.8017532Z compile time instruction count for iteration 2 is 1044779809 2024-12-18T00:21:40.1240800Z compile time instruction count for iteration 3 is 1039166769 2024-12-18T00:21:40.5034927Z compile time instruction count for iteration 4 is 1034083865 2024-12-18T00:21:40.5293114Z collecting compile time instruction count for basic_modules_ListOfLinears_inductor 2024-12-18T00:21:56.3035643Z compile time instruction count for iteration 0 is 40935635486 2024-12-18T00:22:03.1213153Z compile time instruction count for iteration 1 is 20755100701 2024-12-18T00:22:09.9966713Z compile time instruction count for iteration 2 is 20727945918 2024-12-18T00:22:16.8889383Z compile time instruction count for iteration 3 is 20690566957 2024-12-18T00:22:23.9766271Z compile time instruction count for iteration 4 is 20688003721 2024-12-18T00:22:24.0753867Z collecting compile time instruction count for basic_modules_ListOfLinears_inductor_gpu 2024-12-18T00:22:27.4422027Z W1218 00:22:27.441000 4617 site-packages/torch/_inductor/utils.py:1137] [0/0] Not enough SMs to use max_autotune_gemm mode 2024-12-18T00:22:28.4402383Z compile time instruction count for iteration 0 is 17267621820 2024-12-18T00:22:32.7157988Z compile time instruction count for iteration 1 is 17115819626 2024-12-18T00:22:37.0224376Z compile time instruction count for iteration 2 is 17112924906 2024-12-18T00:22:41.3191060Z compile time instruction count for iteration 3 is 17141104762 2024-12-18T00:22:45.6311881Z compile time instruction count for iteration 4 is 17147575116 2024-12-18T00:22:45.6676508Z collecting compile time instruction count for basic_modules_ListOfLinears_inductor_gpu_force_shape_pad 2024-12-18T00:22:50.9471524Z compile time instruction count for iteration 0 is 17110329638 2024-12-18T00:22:56.2839971Z compile time instruction count for iteration 1 is 16981163717 2024-12-18T00:23:01.6577634Z compile time instruction count for iteration 2 is 16978385454 2024-12-18T00:23:07.0098614Z compile time instruction count for iteration 3 is 16977201036 2024-12-18T00:23:12.1471443Z compile time instruction count for iteration 4 is 16975736451 2024-12-18T00:23:14.1759296Z ++ for file in $python_programs_dir/*.py 2024-12-18T00:23:14.1762833Z ++ python benchmarks/dynamo/pr_time_benchmarks/benchmarks/sum_floordiv.py /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:23:16.5832022Z collecting compile time instruction count for sum_floordiv_regression 2024-12-18T00:23:18.5534710Z compile time instruction count for iteration 0 is 1828452779 2024-12-18T00:23:19.3710156Z compile time instruction count for iteration 1 is 1130276729 2024-12-18T00:23:20.2337437Z compile time instruction count for iteration 2 is 1124246252 2024-12-18T00:23:21.0350237Z compile time instruction count for iteration 3 is 1120019709 2024-12-18T00:23:21.8794228Z compile time instruction count for iteration 4 is 1116827522 2024-12-18T00:23:22.7965019Z ++ for file in $python_programs_dir/*.py 2024-12-18T00:23:22.7967512Z ++ python benchmarks/dynamo/pr_time_benchmarks/benchmarks/symint_sum.py /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:23:25.1609470Z collecting compile time instruction count for symint_sum 2024-12-18T00:23:39.0383006Z compile time instruction count for iteration 0 is 29786566567 2024-12-18T00:23:40.1178578Z compile time instruction count for iteration 1 is 3351729330 2024-12-18T00:23:41.1901452Z compile time instruction count for iteration 2 is 3311901596 2024-12-18T00:23:42.2654776Z compile time instruction count for iteration 3 is 3305724843 2024-12-18T00:23:43.3791085Z compile time instruction count for iteration 4 is 3305549722 2024-12-18T00:23:43.4104071Z collecting compile time instruction count for symint_sum_loop 2024-12-18T00:23:45.2517748Z compile time instruction count for iteration 0 is 7461025373 2024-12-18T00:23:46.5276600Z compile time instruction count for iteration 1 is 4371491065 2024-12-18T00:23:47.8034064Z compile time instruction count for iteration 2 is 4370845098 2024-12-18T00:23:49.0736538Z compile time instruction count for iteration 3 is 4371095083 2024-12-18T00:23:50.3480596Z compile time instruction count for iteration 4 is 4370475555 2024-12-18T00:23:51.4517273Z ++ for file in $python_programs_dir/*.py 2024-12-18T00:23:51.4522407Z ++ python benchmarks/dynamo/pr_time_benchmarks/benchmarks/update_hint_benchmark.py /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:23:53.8464663Z collecting compile time instruction count for update_hint_regression 2024-12-18T00:23:58.4560178Z compile time instruction count for iteration 0 is 26507779361 2024-12-18T00:23:59.1245574Z compile time instruction count for iteration 1 is 1692701459 2024-12-18T00:23:59.7947850Z compile time instruction count for iteration 2 is 1682663341 2024-12-18T00:24:00.4652799Z compile time instruction count for iteration 3 is 1678275980 2024-12-18T00:24:01.1443014Z compile time instruction count for iteration 4 is 1676985844 2024-12-18T00:24:02.4379438Z +++ date +%s 2024-12-18T00:24:02.4383586Z ++ end=1734481442 2024-12-18T00:24:02.4383874Z ++ runtime=578 2024-12-18T00:24:02.4384177Z ++ echo 'total time to run benchmarks is:' 2024-12-18T00:24:02.4384585Z total time to run benchmarks is: 2024-12-18T00:24:02.4384903Z ++ echo 578 2024-12-18T00:24:02.4385142Z 578 2024-12-18T00:24:02.4385570Z ++ python benchmarks/dynamo/pr_time_benchmarks/log_benchmarking_time.py 578 2024-12-18T00:24:04.4354085Z + echo 'benchmark results on current PR: ' 2024-12-18T00:24:04.4355605Z benchmark results on current PR: 2024-12-18T00:24:04.4357074Z + cat /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv 2024-12-18T00:24:04.4364989Z add_loop_eager,compile_time_instruction_count,3088944243 2024-12-18T00:24:04.4365835Z 2024-12-18T00:24:04.4366420Z add_loop_eager_dynamic,compile_time_instruction_count,5715065762 2024-12-18T00:24:04.4367338Z 2024-12-18T00:24:04.4367927Z add_loop_inductor,compile_time_instruction_count,29142132030 2024-12-18T00:24:04.4368791Z 2024-12-18T00:24:04.4369388Z add_loop_inductor_gpu,compile_time_instruction_count,25633933016 2024-12-18T00:24:04.4369887Z 2024-12-18T00:24:04.4370156Z add_loop_inductor_dynamic_gpu,compile_time_instruction_count,43165345934 2024-12-18T00:24:04.4370542Z 2024-12-18T00:24:04.4370852Z aotdispatcher_inference_nosubclass_cpu,compile_time_instruction_count,2035408311 2024-12-18T00:24:04.4371319Z 2024-12-18T00:24:04.4371631Z aotdispatcher_training_nosubclass_cpu,compile_time_instruction_count,3882013049 2024-12-18T00:24:04.4372085Z 2024-12-18T00:24:04.4372398Z aotdispatcher_inference_subclass_cpu,compile_time_instruction_count,5893937784 2024-12-18T00:24:04.4372859Z 2024-12-18T00:24:04.4373166Z aotdispatcher_training_subclass_cpu,compile_time_instruction_count,10435942800 2024-12-18T00:24:04.4373623Z 2024-12-18T00:24:04.4373896Z aotdispatcher_partitioner_cpu,compile_time_instruction_count,9136669307 2024-12-18T00:24:04.4374306Z 2024-12-18T00:24:04.4374587Z basic_modules_ListOfLinears_eager,compile_time_instruction_count,1034083865 2024-12-18T00:24:04.4374998Z 2024-12-18T00:24:04.4375322Z basic_modules_ListOfLinears_inductor,compile_time_instruction_count,20688003721 2024-12-18T00:24:04.4375750Z 2024-12-18T00:24:04.4376083Z basic_modules_ListOfLinears_inductor_gpu,compile_time_instruction_count,17112924906 2024-12-18T00:24:04.4376530Z 2024-12-18T00:24:04.4376953Z basic_modules_ListOfLinears_inductor_gpu_force_shape_pad,compile_time_instruction_count,16975736451 2024-12-18T00:24:04.4377478Z 2024-12-18T00:24:04.4377833Z sum_floordiv_regression,compile_time_instruction_count,1116827522 2024-12-18T00:24:04.4378340Z 2024-12-18T00:24:04.4378516Z symint_sum,compile_time_instruction_count,3305549722 2024-12-18T00:24:04.4378817Z 2024-12-18T00:24:04.4378998Z symint_sum_loop,compile_time_instruction_count,4370475555 2024-12-18T00:24:04.4379303Z 2024-12-18T00:24:04.4379516Z update_hint_regression,compile_time_instruction_count,1676985844 2024-12-18T00:24:04.4379855Z 2024-12-18T00:24:04.4379985Z ++ pwd 2024-12-18T00:24:04.4380431Z + PYTHONPATH=/var/lib/jenkins/workspace/benchmarks/dynamo/pr_time_benchmarks 2024-12-18T00:24:04.4382010Z + python benchmarks/dynamo/pr_time_benchmarks/check_results.py benchmarks/dynamo/pr_time_benchmarks/expected_results.csv /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_results.csv /var/lib/jenkins/workspace/test/test-reports/new_expected_results.csv 2024-12-18T00:24:05.9127556Z PASS: benchmark ('add_loop_eager', 'compile_time_instruction_count') pass, actual result 3088944243 +0.75% is within expected 3066000000 ±1.50% 2024-12-18T00:24:05.9129392Z 2024-12-18T00:24:05.9680652Z PASS: benchmark ('add_loop_eager_dynamic', 'compile_time_instruction_count') pass, actual result 5715065762 +0.21% is within expected 5703000000 ±2.50% 2024-12-18T00:24:05.9681393Z 2024-12-18T00:24:05.9682138Z PASS: benchmark ('add_loop_inductor', 'compile_time_instruction_count') pass, actual result 29142132030 -1.25% is within expected 29510000000 ±1.50% 2024-12-18T00:24:05.9682836Z 2024-12-18T00:24:05.9683641Z PASS: benchmark ('add_loop_inductor_dynamic_gpu', 'compile_time_instruction_count') pass, actual result 43165345934 -0.26% is within expected 43280000000 ±2.50% 2024-12-18T00:24:05.9684383Z 2024-12-18T00:24:05.9685104Z PASS: benchmark ('add_loop_inductor_gpu', 'compile_time_instruction_count') pass, actual result 25633933016 -0.22% is within expected 25690000000 ±1.50% 2024-12-18T00:24:05.9685843Z 2024-12-18T00:24:05.9686831Z PASS: benchmark ('basic_modules_ListOfLinears_eager', 'compile_time_instruction_count') pass, actual result 1034083865 +0.10% is within expected 1033000000 ±1.50% 2024-12-18T00:24:05.9687613Z 2024-12-18T00:24:05.9688452Z PASS: benchmark ('basic_modules_ListOfLinears_inductor', 'compile_time_instruction_count') pass, actual result 20688003721 -0.59% is within expected 20810000000 ±1.50% 2024-12-18T00:24:05.9689257Z 2024-12-18T00:24:05.9690183Z PASS: benchmark ('basic_modules_ListOfLinears_inductor_gpu_force_shape_pad', 'compile_time_instruction_count') pass, actual result 16975736451 -0.26% is within expected 17020000000 ±1.50% 2024-12-18T00:24:05.9691083Z 2024-12-18T00:24:05.9691921Z PASS: benchmark ('basic_modules_ListOfLinears_inductor_gpu', 'compile_time_instruction_count') pass, actual result 17112924906 -0.85% is within expected 17260000000 ±20.00% 2024-12-18T00:24:05.9692737Z 2024-12-18T00:24:05.9693482Z PASS: benchmark ('update_hint_regression', 'compile_time_instruction_count') pass, actual result 1676985844 +0.48% is within expected 1669000000 ±2.00% 2024-12-18T00:24:05.9694207Z 2024-12-18T00:24:05.9694936Z PASS: benchmark ('sum_floordiv_regression', 'compile_time_instruction_count') pass, actual result 1116827522 +0.34% is within expected 1113000000 ±1.50% 2024-12-18T00:24:05.9695652Z 2024-12-18T00:24:05.9696308Z PASS: benchmark ('symint_sum', 'compile_time_instruction_count') pass, actual result 3305549722 +0.38% is within expected 3293000000 ±1.50% 2024-12-18T00:24:05.9696953Z 2024-12-18T00:24:05.9697787Z PASS: benchmark ('aotdispatcher_inference_nosubclass_cpu', 'compile_time_instruction_count') pass, actual result 2035408311 +0.86% is within expected 2018000000 ±1.50% 2024-12-18T00:24:05.9698617Z 2024-12-18T00:24:05.9699431Z PASS: benchmark ('aotdispatcher_inference_subclass_cpu', 'compile_time_instruction_count') pass, actual result 5893937784 +0.87% is within expected 5843000000 ±1.50% 2024-12-18T00:24:05.9700235Z 2024-12-18T00:24:05.9701020Z PASS: benchmark ('aotdispatcher_partitioner_cpu', 'compile_time_instruction_count') pass, actual result 9136669307 +0.46% is within expected 9095000000 ±1.50% 2024-12-18T00:24:05.9701894Z 2024-12-18T00:24:05.9702716Z PASS: benchmark ('aotdispatcher_training_nosubclass_cpu', 'compile_time_instruction_count') pass, actual result 3882013049 +0.49% is within expected 3863000000 ±1.50% 2024-12-18T00:24:05.9703524Z 2024-12-18T00:24:05.9704344Z PASS: benchmark ('aotdispatcher_training_subclass_cpu', 'compile_time_instruction_count') pass, actual result 10435942800 +0.25% is within expected 10410000000 ±1.50% 2024-12-18T00:24:05.9705123Z 2024-12-18T00:24:05.9705683Z MISSING REGRESSION TEST: benchmark ('symint_sum_loop', 'compile_time_instruction_count') does not have a regression test enabled for it. 2024-12-18T00:24:05.9706335Z 2024-12-18T00:24:05.9706507Z new expected results file content if needed: 2024-12-18T00:24:05.9706998Z add_loop_eager,compile_time_instruction_count,3088000000,0.015 2024-12-18T00:24:05.9707431Z 2024-12-18T00:24:05.9707435Z 2024-12-18T00:24:05.9707439Z 2024-12-18T00:24:05.9707717Z add_loop_eager_dynamic,compile_time_instruction_count,5703000000,0.025 2024-12-18T00:24:05.9708092Z 2024-12-18T00:24:05.9708096Z 2024-12-18T00:24:05.9708100Z 2024-12-18T00:24:05.9708334Z add_loop_inductor,compile_time_instruction_count,29140000000,0.015 2024-12-18T00:24:05.9708712Z 2024-12-18T00:24:05.9708717Z 2024-12-18T00:24:05.9708721Z 2024-12-18T00:24:05.9708996Z add_loop_inductor_dynamic_gpu,compile_time_instruction_count,43280000000,0.025 2024-12-18T00:24:05.9709412Z 2024-12-18T00:24:05.9709416Z 2024-12-18T00:24:05.9709420Z 2024-12-18T00:24:05.9709662Z add_loop_inductor_gpu,compile_time_instruction_count,25690000000,0.015 2024-12-18T00:24:05.9710043Z 2024-12-18T00:24:05.9710047Z 2024-12-18T00:24:05.9710051Z 2024-12-18T00:24:05.9710351Z basic_modules_ListOfLinears_eager,compile_time_instruction_count,1033000000,0.015 2024-12-18T00:24:05.9710802Z 2024-12-18T00:24:05.9710805Z 2024-12-18T00:24:05.9710809Z 2024-12-18T00:24:05.9711203Z basic_modules_ListOfLinears_inductor,compile_time_instruction_count,20680000000,0.015 2024-12-18T00:24:05.9711671Z 2024-12-18T00:24:05.9711675Z 2024-12-18T00:24:05.9711679Z 2024-12-18T00:24:05.9712084Z basic_modules_ListOfLinears_inductor_gpu_force_shape_pad,compile_time_instruction_count,17020000000,0.015 2024-12-18T00:24:05.9712631Z 2024-12-18T00:24:05.9712635Z 2024-12-18T00:24:05.9712638Z 2024-12-18T00:24:05.9712966Z basic_modules_ListOfLinears_inductor_gpu,compile_time_instruction_count,17260000000,0.2 2024-12-18T00:24:05.9713437Z 2024-12-18T00:24:05.9713441Z 2024-12-18T00:24:05.9713444Z 2024-12-18T00:24:05.9713693Z update_hint_regression,compile_time_instruction_count,1669000000,0.02 2024-12-18T00:24:05.9714079Z 2024-12-18T00:24:05.9714083Z 2024-12-18T00:24:05.9714086Z 2024-12-18T00:24:05.9714343Z sum_floordiv_regression,compile_time_instruction_count,1113000000,0.015 2024-12-18T00:24:05.9714739Z 2024-12-18T00:24:05.9714749Z 2024-12-18T00:24:05.9714752Z 2024-12-18T00:24:05.9714950Z symint_sum,compile_time_instruction_count,3293000000,0.015 2024-12-18T00:24:05.9715284Z 2024-12-18T00:24:05.9715292Z 2024-12-18T00:24:05.9715296Z 2024-12-18T00:24:05.9715625Z aotdispatcher_inference_nosubclass_cpu,compile_time_instruction_count,2035000000,0.015 2024-12-18T00:24:05.9716087Z 2024-12-18T00:24:05.9716103Z 2024-12-18T00:24:05.9716107Z 2024-12-18T00:24:05.9716426Z aotdispatcher_inference_subclass_cpu,compile_time_instruction_count,5893000000,0.015 2024-12-18T00:24:05.9716875Z 2024-12-18T00:24:05.9716879Z 2024-12-18T00:24:05.9716896Z 2024-12-18T00:24:05.9717187Z aotdispatcher_partitioner_cpu,compile_time_instruction_count,9095000000,0.015 2024-12-18T00:24:05.9717606Z 2024-12-18T00:24:05.9717610Z 2024-12-18T00:24:05.9717614Z 2024-12-18T00:24:05.9717947Z aotdispatcher_training_nosubclass_cpu,compile_time_instruction_count,3863000000,0.015 2024-12-18T00:24:05.9718404Z 2024-12-18T00:24:05.9718408Z 2024-12-18T00:24:05.9718416Z 2024-12-18T00:24:05.9718745Z aotdispatcher_training_subclass_cpu,compile_time_instruction_count,10410000000,0.015 2024-12-18T00:24:05.9719191Z 2024-12-18T00:24:05.9719199Z 2024-12-18T00:24:05.9719203Z 2024-12-18T00:24:05.9719207Z 2024-12-18T00:24:05.9719343Z All benchmarks passed 2024-12-18T00:24:06.3241136Z + exit 0 2024-12-18T00:24:06.3241863Z + cleanup_workspace 2024-12-18T00:24:06.3243402Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-12-18T00:24:06.3245743Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-12-18T00:24:06.3247628Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-12-18T00:24:06.3249034Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-12-18T00:24:06.3250597Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-12-18T00:24:06.3252374Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-12-18T00:24:06.3253426Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-12-18T00:24:06.7458638Z ##[group]Run pytorch/test-infra/.github/actions/upload-benchmark-results@release/2.6 2024-12-18T00:24:06.7459184Z with: 2024-12-18T00:24:06.7459452Z benchmark-results-dir: test/test-reports 2024-12-18T00:24:06.7459803Z dry-run: false 2024-12-18T00:24:06.7460050Z schema-version: v3 2024-12-18T00:24:06.7460504Z github-token: *** 2024-12-18T00:24:06.7460763Z env: 2024-12-18T00:24:06.7461000Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:06.7461361Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:06.7461937Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:06.7462463Z ##[endgroup] 2024-12-18T00:24:06.7492686Z ##[group]Run set -eux 2024-12-18T00:24:06.7492998Z set -eux 2024-12-18T00:24:06.7493295Z python3 -mpip install boto3==1.35.33 2024-12-18T00:24:06.7501673Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:06.7502358Z env: 2024-12-18T00:24:06.7502664Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:06.7503083Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:06.7503717Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:06.7504297Z ##[endgroup] 2024-12-18T00:24:06.7533535Z + python3 -mpip install boto3==1.35.33 2024-12-18T00:24:06.9922189Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T00:24:07.0075185Z Requirement already satisfied: boto3==1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (1.35.33) 2024-12-18T00:24:07.0125614Z Requirement already satisfied: botocore<1.36.0,>=1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (1.35.83) 2024-12-18T00:24:07.0127729Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.4) 2024-12-18T00:24:07.0131266Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0) 2024-12-18T00:24:07.0185168Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.1) 2024-12-18T00:24:07.0196138Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10) 2024-12-18T00:24:07.0237424Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0) 2024-12-18T00:24:07.1373659Z ##[group]Run set -eux 2024-12-18T00:24:07.1373985Z set -eux 2024-12-18T00:24:07.1374253Z  2024-12-18T00:24:07.1374512Z if [[ -z "${GITHUB_TOKEN}" ]]; then 2024-12-18T00:24:07.1374916Z  echo "Missing github-token input" 2024-12-18T00:24:07.1375291Z  exit 1 2024-12-18T00:24:07.1375536Z fi 2024-12-18T00:24:07.1381245Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:07.1381643Z env: 2024-12-18T00:24:07.1381882Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:07.1382255Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:07.1382849Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:07.1383744Z GITHUB_TOKEN: *** 2024-12-18T00:24:07.1384011Z ##[endgroup] 2024-12-18T00:24:07.1406331Z + [[ -z *** ]] 2024-12-18T00:24:07.1459581Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main 2024-12-18T00:24:07.1460085Z with: 2024-12-18T00:24:07.1460491Z github-token: *** 2024-12-18T00:24:07.1460776Z env: 2024-12-18T00:24:07.1461044Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:07.1461416Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:07.1462045Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:07.1462734Z ##[endgroup] 2024-12-18T00:24:07.1493479Z ##[group]Run set -eux 2024-12-18T00:24:07.1493769Z set -eux 2024-12-18T00:24:07.1494016Z  2024-12-18T00:24:07.1494512Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-12-18T00:24:07.1499625Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:07.1500024Z env: 2024-12-18T00:24:07.1500265Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:07.1500625Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:07.1501210Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:07.1502221Z GITHUB_TOKEN: *** 2024-12-18T00:24:07.1502481Z ##[endgroup] 2024-12-18T00:24:07.1528950Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 12383255652 i-07b82df1ecbdd12be 2024-12-18T00:24:10.1626218Z setting job-id=34566627611 2024-12-18T00:24:10.1628019Z setting job-name=cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:24:10.1755477Z ##[group]Run set -eux 2024-12-18T00:24:10.1755813Z set -eux 2024-12-18T00:24:10.1756086Z  2024-12-18T00:24:10.1756524Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \ 2024-12-18T00:24:10.1757090Z  --schema-version "${SCHEMA_VERSION}" \ 2024-12-18T00:24:10.1757488Z  --repo "${REPO}" \ 2024-12-18T00:24:10.1757846Z  --head-branch "${HEAD_BRANCH}" \ 2024-12-18T00:24:10.1758225Z  --head-sha "${HEAD_SHA}" \ 2024-12-18T00:24:10.1758609Z  --workflow-id "${WORKFLOW_RUN_ID}" \ 2024-12-18T00:24:10.1758991Z  --run-attempt "${RUN_ATTEMPT}" \ 2024-12-18T00:24:10.1759362Z  --job-id "${JOB_ID}" \ 2024-12-18T00:24:10.1759731Z  --job-name "${JOB_NAME}" 2024-12-18T00:24:10.1765259Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:10.1765689Z env: 2024-12-18T00:24:10.1765946Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:10.1766312Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:10.1766928Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:10.1767477Z SCHEMA_VERSION: v3 2024-12-18T00:24:10.1767774Z REPO: pytorch/pytorch 2024-12-18T00:24:10.1768093Z HEAD_BRANCH: refs/heads/release/2.6 2024-12-18T00:24:10.1768473Z HEAD_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:24:10.1768868Z WORKFLOW_RUN_ID: 12383255652 2024-12-18T00:24:10.1769183Z RUN_ATTEMPT: 1 2024-12-18T00:24:10.1769451Z JOB_ID: 34566627611 2024-12-18T00:24:10.1769957Z JOB_NAME: cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-12-18T00:24:10.1770499Z ##[endgroup] 2024-12-18T00:24:10.1802316Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/release/2.6 --head-sha 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 --workflow-id 12383255652 --run-attempt 1 --job-id 34566627611 --job-name 'cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu)' 2024-12-18T00:24:10.2156563Z ##[group]Run set -eux 2024-12-18T00:24:10.2156908Z set -eux 2024-12-18T00:24:10.2157178Z  2024-12-18T00:24:10.2157493Z # TODO (huydhn): Implement this part 2024-12-18T00:24:10.2157944Z echo "runners=[]" >> "${GITHUB_OUTPUT}" 2024-12-18T00:24:10.2162996Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:10.2163462Z env: 2024-12-18T00:24:10.2163745Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:10.2164132Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:10.2165172Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:10.2165769Z ##[endgroup] 2024-12-18T00:24:10.2189953Z + echo 'runners=[]' 2024-12-18T00:24:10.2225513Z ##[group]Run set -eux 2024-12-18T00:24:10.2225860Z set -eux 2024-12-18T00:24:10.2226133Z  2024-12-18T00:24:10.2226459Z # TODO (huydhn): Implement this part 2024-12-18T00:24:10.2226927Z echo "dependencies={}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:24:10.2232072Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:10.2232533Z env: 2024-12-18T00:24:10.2232826Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:10.2233212Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:10.2233879Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:10.2234461Z ##[endgroup] 2024-12-18T00:24:10.2258413Z + echo 'dependencies={}' 2024-12-18T00:24:10.2302203Z ##[group]Run set -eux 2024-12-18T00:24:10.2302654Z set -eux 2024-12-18T00:24:10.2302999Z  2024-12-18T00:24:10.2303361Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then 2024-12-18T00:24:10.2303911Z  echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping" 2024-12-18T00:24:10.2304475Z  # We don't want the job to fail if the directory doesn't exist 2024-12-18T00:24:10.2304959Z  exit 0 2024-12-18T00:24:10.2305255Z fi 2024-12-18T00:24:10.2305540Z  2024-12-18T00:24:10.2305855Z if [[ "${DRY_RUN}" == "true" ]]; then 2024-12-18T00:24:10.2306408Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2024-12-18T00:24:10.2307070Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2024-12-18T00:24:10.2307601Z  --metadata "${BENCHMARK_METADATA}" \ 2024-12-18T00:24:10.2308054Z  --runners "${RUNNER_INFO}" \ 2024-12-18T00:24:10.2308489Z  --dependencies "${DEPENDENCIES}" \ 2024-12-18T00:24:10.2308925Z  --dry-run 2024-12-18T00:24:10.2309243Z else 2024-12-18T00:24:10.2309718Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2024-12-18T00:24:10.2310373Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2024-12-18T00:24:10.2310891Z  --metadata "${BENCHMARK_METADATA}" \ 2024-12-18T00:24:10.2311336Z  --runners "${RUNNER_INFO}" \ 2024-12-18T00:24:10.2311767Z  --dependencies "${DEPENDENCIES}" 2024-12-18T00:24:10.2312146Z fi 2024-12-18T00:24:10.2316878Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:10.2317327Z env: 2024-12-18T00:24:10.2317613Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:10.2317985Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:10.2318588Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:10.2319174Z BENCHMARK_RESULTS_DIR: test/test-reports 2024-12-18T00:24:10.2319515Z DRY_RUN: false 2024-12-18T00:24:10.2320978Z BENCHMARK_METADATA: {"timestamp": 1734481450, "schema_version": "v3", "name": "cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255652, "run_attempt": 1, "job_id": 34566627611} 2024-12-18T00:24:10.2322486Z RUNNER_INFO: [] 2024-12-18T00:24:10.2322767Z DEPENDENCIES: {} 2024-12-18T00:24:10.2323044Z ##[endgroup] 2024-12-18T00:24:10.2346918Z + [[ ! -d test/test-reports ]] 2024-12-18T00:24:10.2347380Z + [[ false == \t\r\u\e ]] 2024-12-18T00:24:10.2350421Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/upload_benchmark_results.py --benchmark-results-dir test/test-reports --metadata '{"timestamp": 1734481450, "schema_version": "v3", "name": "cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255652, "run_attempt": 1, "job_id": 34566627611}' --runners '[]' --dependencies '{}' 2024-12-18T00:24:10.3773198Z INFO:root:Upload test/test-reports/add_loop_eager.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/add_loop_eager.json 2024-12-18T00:24:10.4031441Z INFO:botocore.credentials:Found credentials from IAM Role: gh-ci-github-action-runners-runner-role 2024-12-18T00:24:10.5723356Z INFO:root:Upload test/test-reports/add_loop_eager_dynamic.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/add_loop_eager_dynamic.json 2024-12-18T00:24:10.6706859Z INFO:root:Upload test/test-reports/add_loop_inductor.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/add_loop_inductor.json 2024-12-18T00:24:10.7652702Z INFO:root:Upload test/test-reports/add_loop_inductor_gpu.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/add_loop_inductor_gpu.json 2024-12-18T00:24:10.8672937Z INFO:root:Upload test/test-reports/add_loop_inductor_dynamic_gpu.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/add_loop_inductor_dynamic_gpu.json 2024-12-18T00:24:11.0724926Z INFO:root:Upload test/test-reports/aotdispatcher_inference_nosubclass_cpu.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/aotdispatcher_inference_nosubclass_cpu.json 2024-12-18T00:24:11.1611677Z INFO:root:Upload test/test-reports/aotdispatcher_training_nosubclass_cpu.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/aotdispatcher_training_nosubclass_cpu.json 2024-12-18T00:24:11.2448139Z INFO:root:Upload test/test-reports/aotdispatcher_inference_subclass_cpu.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/aotdispatcher_inference_subclass_cpu.json 2024-12-18T00:24:11.3595217Z INFO:root:Upload test/test-reports/aotdispatcher_training_subclass_cpu.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/aotdispatcher_training_subclass_cpu.json 2024-12-18T00:24:11.4764844Z INFO:root:Upload test/test-reports/aotdispatcher_partitioner_cpu.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/aotdispatcher_partitioner_cpu.json 2024-12-18T00:24:11.5645350Z INFO:root:Upload test/test-reports/basic_modules_ListOfLinears_eager.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/basic_modules_ListOfLinears_eager.json 2024-12-18T00:24:11.6780896Z INFO:root:Upload test/test-reports/basic_modules_ListOfLinears_inductor.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/basic_modules_ListOfLinears_inductor.json 2024-12-18T00:24:11.8262044Z INFO:root:Upload test/test-reports/basic_modules_ListOfLinears_inductor_gpu.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/basic_modules_ListOfLinears_inductor_gpu.json 2024-12-18T00:24:11.9152275Z INFO:root:Upload test/test-reports/basic_modules_ListOfLinears_inductor_gpu_force_shape_pad.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/basic_modules_ListOfLinears_inductor_gpu_force_shape_pad.json 2024-12-18T00:24:12.0143903Z INFO:root:Upload test/test-reports/sum_floordiv_regression.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/sum_floordiv_regression.json 2024-12-18T00:24:12.1142120Z INFO:root:Upload test/test-reports/symint_sum.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/symint_sum.json 2024-12-18T00:24:12.1743673Z INFO:root:Upload test/test-reports/symint_sum_loop.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/symint_sum_loop.json 2024-12-18T00:24:12.2866166Z INFO:root:Upload test/test-reports/update_hint_regression.json to s3://ossci-benchmarks/v3/pytorch/pytorch/12383255652/34566627611/update_hint_regression.json 2024-12-18T00:24:12.4274063Z ##[group]Run cat test/**/*_toprint.log || true 2024-12-18T00:24:12.4274526Z cat test/**/*_toprint.log || true 2024-12-18T00:24:12.4279825Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:12.4280268Z env: 2024-12-18T00:24:12.4280536Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:12.4280923Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:12.4281519Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:12.4282079Z ##[endgroup] 2024-12-18T00:24:12.4349240Z cat: 'test/**/*_toprint.log': No such file or directory 2024-12-18T00:24:12.4383944Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-12-18T00:24:12.4384336Z kill "$MONITOR_SCRIPT_PID" 2024-12-18T00:24:12.4388820Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:12.4389264Z env: 2024-12-18T00:24:12.4389545Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:12.4389936Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:12.4390585Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:12.4391132Z MONITOR_SCRIPT_PID: 134562 2024-12-18T00:24:12.4391451Z ##[endgroup] 2024-12-18T00:24:12.4551905Z Prepare all required actions 2024-12-18T00:24:12.4552400Z Getting action download info 2024-12-18T00:24:12.5992972Z Download action repository 'actions/upload-artifact@v4' (SHA:6f51ac03b9356f520e9adb1b1b7802705f340c2b) 2024-12-18T00:24:12.8985179Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-12-18T00:24:12.8985593Z with: 2024-12-18T00:24:12.8986040Z file-suffix: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611 2024-12-18T00:24:12.8986568Z s3-bucket: gha-artifacts 2024-12-18T00:24:12.8986873Z env: 2024-12-18T00:24:12.8987127Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:12.8987507Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:12.8988119Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:12.8988666Z ##[endgroup] 2024-12-18T00:24:12.9023658Z ##[group]Run # Remove any previous test jsons if they exist 2024-12-18T00:24:12.9024249Z # Remove any previous test jsons if they exist 2024-12-18T00:24:12.9024650Z rm -f test-jsons-*.zip 2024-12-18T00:24:12.9025139Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json' 2024-12-18T00:24:12.9030092Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:12.9030514Z env: 2024-12-18T00:24:12.9030778Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:12.9031173Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:12.9031772Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:12.9032506Z FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611 2024-12-18T00:24:12.9033043Z ##[endgroup] 2024-12-18T00:24:12.9072591Z adding: test/test-reports/add_loop_eager.json (deflated 40%) 2024-12-18T00:24:12.9074324Z adding: test/test-reports/add_loop_eager_dynamic.json (deflated 41%) 2024-12-18T00:24:12.9075919Z adding: test/test-reports/add_loop_inductor.json (deflated 40%) 2024-12-18T00:24:12.9077513Z adding: test/test-reports/add_loop_inductor_gpu.json (deflated 40%) 2024-12-18T00:24:12.9079304Z adding: test/test-reports/add_loop_inductor_dynamic_gpu.json (deflated 41%) 2024-12-18T00:24:12.9081062Z adding: test/test-reports/aotdispatcher_inference_nosubclass_cpu.json (deflated 43%) 2024-12-18T00:24:12.9081887Z adding: test/test-reports/aotdispatcher_training_nosubclass_cpu.json (deflated 42%) 2024-12-18T00:24:12.9082683Z adding: test/test-reports/aotdispatcher_inference_subclass_cpu.json (deflated 43%) 2024-12-18T00:24:12.9083463Z adding: test/test-reports/aotdispatcher_training_subclass_cpu.json (deflated 42%) 2024-12-18T00:24:12.9084193Z adding: test/test-reports/aotdispatcher_partitioner_cpu.json (deflated 46%) 2024-12-18T00:24:12.9085156Z adding: test/test-reports/basic_modules_ListOfLinears_eager.json (deflated 40%) 2024-12-18T00:24:12.9085940Z adding: test/test-reports/basic_modules_ListOfLinears_inductor.json (deflated 40%) 2024-12-18T00:24:12.9086766Z adding: test/test-reports/basic_modules_ListOfLinears_inductor_gpu.json (deflated 38%) 2024-12-18T00:24:12.9087677Z adding: test/test-reports/basic_modules_ListOfLinears_inductor_gpu_force_shape_pad.json (deflated 39%) 2024-12-18T00:24:12.9088487Z adding: test/test-reports/sum_floordiv_regression.json (deflated 39%) 2024-12-18T00:24:12.9089067Z adding: test/test-reports/symint_sum.json (deflated 34%) 2024-12-18T00:24:12.9089633Z adding: test/test-reports/symint_sum_loop.json (deflated 34%) 2024-12-18T00:24:12.9090242Z adding: test/test-reports/update_hint_regression.json (deflated 40%) 2024-12-18T00:24:12.9121023Z ##[group]Run # Remove any previous test reports if they exist 2024-12-18T00:24:12.9121562Z # Remove any previous test reports if they exist 2024-12-18T00:24:12.9122015Z rm -f test-reports-*.zip 2024-12-18T00:24:12.9122541Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv' 2024-12-18T00:24:12.9128134Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:12.9128602Z env: 2024-12-18T00:24:12.9128891Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:12.9129275Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:12.9129914Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:12.9130663Z FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611 2024-12-18T00:24:12.9131179Z ##[endgroup] 2024-12-18T00:24:12.9171167Z adding: test/test-reports/pr_time_benchmarks_results.csv (deflated 72%) 2024-12-18T00:24:12.9171848Z adding: test/test-reports/new_expected_results.csv (deflated 79%) 2024-12-18T00:24:12.9220103Z ##[group]Run # Remove any previous usage logs if they exist 2024-12-18T00:24:12.9220638Z # Remove any previous usage logs if they exist 2024-12-18T00:24:12.9221045Z rm -f logs-*.zip 2024-12-18T00:24:12.9221584Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-12-18T00:24:12.9222198Z # so check to see if the file exists first 2024-12-18T00:24:12.9222606Z if [ -f 'usage_log.txt' ]; then 2024-12-18T00:24:12.9223131Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-12-18T00:24:12.9223501Z fi 2024-12-18T00:24:12.9223888Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then 2024-12-18T00:24:12.9224473Z  zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log' 2024-12-18T00:24:12.9224893Z fi 2024-12-18T00:24:12.9229238Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:12.9229643Z env: 2024-12-18T00:24:12.9229882Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:12.9230248Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:12.9230838Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:12.9231556Z FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611 2024-12-18T00:24:12.9232043Z ##[endgroup] 2024-12-18T00:24:12.9316962Z adding: usage_log.txt (deflated 99%) 2024-12-18T00:24:12.9365041Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-12-18T00:24:12.9365618Z # Remove any previous debugging artifacts if they exist 2024-12-18T00:24:12.9366079Z rm -f debug-*.zip 2024-12-18T00:24:12.9366380Z if [ -d 'test/debug' ]; then 2024-12-18T00:24:12.9366781Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-12-18T00:24:12.9367162Z fi 2024-12-18T00:24:12.9371353Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:12.9371763Z env: 2024-12-18T00:24:12.9372021Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:12.9372519Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:12.9373109Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:12.9373853Z FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611 2024-12-18T00:24:12.9374381Z ##[endgroup] 2024-12-18T00:24:12.9455169Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T00:24:12.9455513Z with: 2024-12-18T00:24:12.9455737Z s3-bucket: gha-artifacts 2024-12-18T00:24:12.9456069Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T00:24:12.9456428Z retention-days: 14 2024-12-18T00:24:12.9456692Z if-no-files-found: warn 2024-12-18T00:24:12.9456973Z path: test-jsons-*.zip 2024-12-18T00:24:12.9457232Z name: artifact 2024-12-18T00:24:12.9457479Z region: us-east-1 2024-12-18T00:24:12.9457728Z env: 2024-12-18T00:24:12.9457959Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:12.9458309Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:12.9458887Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:12.9459408Z ##[endgroup] 2024-12-18T00:24:13.2984916Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T00:24:13.2986767Z With the provided path, there will be 1 file uploaded 2024-12-18T00:24:13.2987294Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T00:24:13.3020825Z Starting upload of test-jsons-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611.zip 2024-12-18T00:24:13.4168951Z Finished upload of test-jsons-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611.zip 2024-12-18T00:24:13.4340122Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T00:24:13.4340540Z with: 2024-12-18T00:24:13.4340809Z s3-bucket: gha-artifacts 2024-12-18T00:24:13.4341188Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T00:24:13.4341599Z retention-days: 14 2024-12-18T00:24:13.4341892Z if-no-files-found: error 2024-12-18T00:24:13.4342240Z path: test-reports-*.zip 2024-12-18T00:24:13.4342555Z name: artifact 2024-12-18T00:24:13.4342826Z region: us-east-1 2024-12-18T00:24:13.4343098Z env: 2024-12-18T00:24:13.4343344Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:13.4343722Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:13.4344356Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:13.4344916Z ##[endgroup] 2024-12-18T00:24:13.7503510Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T00:24:13.7504844Z With the provided path, there will be 1 file uploaded 2024-12-18T00:24:13.7506217Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T00:24:13.7540254Z Starting upload of test-reports-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611.zip 2024-12-18T00:24:13.8749656Z Finished upload of test-reports-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611.zip 2024-12-18T00:24:13.8918901Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T00:24:13.8919291Z with: 2024-12-18T00:24:13.8919524Z s3-bucket: gha-artifacts 2024-12-18T00:24:13.8919883Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T00:24:13.8920292Z retention-days: 14 2024-12-18T00:24:13.8920588Z if-no-files-found: ignore 2024-12-18T00:24:13.8920890Z path: logs-*.zip 2024-12-18T00:24:13.8921134Z name: artifact 2024-12-18T00:24:13.8921391Z region: us-east-1 2024-12-18T00:24:13.8921647Z env: 2024-12-18T00:24:13.8921886Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:13.8922260Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:13.8922840Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:13.8923377Z ##[endgroup] 2024-12-18T00:24:14.2079225Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T00:24:14.2079778Z With the provided path, there will be 1 file uploaded 2024-12-18T00:24:14.2080684Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T00:24:14.2113119Z Starting upload of logs-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611.zip 2024-12-18T00:24:14.3508963Z Finished upload of logs-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_34566627611.zip 2024-12-18T00:24:14.3675680Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T00:24:14.3676081Z with: 2024-12-18T00:24:14.3676430Z s3-bucket: gha-artifacts 2024-12-18T00:24:14.3676794Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T00:24:14.3677186Z retention-days: 14 2024-12-18T00:24:14.3677641Z if-no-files-found: ignore 2024-12-18T00:24:14.3677962Z path: debug-*.zip 2024-12-18T00:24:14.3678223Z name: artifact 2024-12-18T00:24:14.3678498Z region: us-east-1 2024-12-18T00:24:14.3678768Z env: 2024-12-18T00:24:14.3679023Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:14.3679409Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:14.3680023Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:14.3680601Z ##[endgroup] 2024-12-18T00:24:14.6768552Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-12-18T00:24:14.6949692Z ##[group]Run # shellcheck disable=SC2156 2024-12-18T00:24:14.6950135Z # shellcheck disable=SC2156 2024-12-18T00:24:14.6950803Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-12-18T00:24:14.6956534Z shell: /usr/bin/bash -e {0} 2024-12-18T00:24:14.6956853Z env: 2024-12-18T00:24:14.6957093Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:14.6957470Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:14.6958076Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:14.6958610Z ##[endgroup] 2024-12-18T00:24:14.8637802Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@release/2.6 2024-12-18T00:24:14.8638397Z with: 2024-12-18T00:24:14.8638785Z env: 2024-12-18T00:24:14.8639050Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:14.8639444Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:14.8640091Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:14.8640662Z ##[endgroup] 2024-12-18T00:24:14.8680203Z ##[group]Run set -eou pipefail 2024-12-18T00:24:14.8680572Z set -eou pipefail 2024-12-18T00:24:14.8680885Z  2024-12-18T00:24:14.8681310Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-12-18T00:24:14.8681847Z for _ in $(seq 1440); do 2024-12-18T00:24:14.8682226Z  # Break if no ssh session exists anymore 2024-12-18T00:24:14.8682663Z  if [ "$(who)" = "" ]; then 2024-12-18T00:24:14.8683019Z  break 2024-12-18T00:24:14.8683353Z  fi 2024-12-18T00:24:14.8683604Z  echo "." 2024-12-18T00:24:14.8683899Z  sleep 5 2024-12-18T00:24:14.8684181Z done 2024-12-18T00:24:14.8689072Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:14.8689707Z env: 2024-12-18T00:24:14.8689945Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:14.8690288Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:14.8690876Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:14.8691399Z ##[endgroup] 2024-12-18T00:24:14.8710617Z Holding runner for 2 hours until all ssh sessions have logged out 2024-12-18T00:24:14.8772716Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T00:24:14.8773313Z # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T00:24:14.8773770Z # shellcheck disable=SC2046 2024-12-18T00:24:14.8774129Z docker stop $(docker ps -q) || true 2024-12-18T00:24:14.8774502Z # Prune all of the docker images 2024-12-18T00:24:14.8774977Z docker system prune -af 2024-12-18T00:24:14.8779535Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:14.8779965Z env: 2024-12-18T00:24:14.8780227Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:24:14.8780589Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-12-18T00:24:14.8781222Z DOCKER_CONTAINER_ID: cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:14.8781803Z ##[endgroup] 2024-12-18T00:24:15.4752647Z cb9da7563640 2024-12-18T00:24:15.8300778Z Deleted Containers: 2024-12-18T00:24:15.8301887Z cb9da75636401855eeabf045a6742827bebc8102fe4c4814b84e3e8ef6e8aa7e 2024-12-18T00:24:15.8302329Z 2024-12-18T00:24:21.1822744Z Deleted Images: 2024-12-18T00:24:21.1825549Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:24:21.1829711Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.4-cudnn9-py3-gcc9-inductor-benchmarks@sha256:ff80d4c93d18e8ab7a2501f0e62b7c40cf97aa83fc9702e88b9c2d02cdcbecdb 2024-12-18T00:24:21.1831155Z deleted: sha256:67e93a8badaf799ceb664d7c453077c6c6785d56dc10c720be9358edeb91759b 2024-12-18T00:24:21.1831949Z deleted: sha256:7958cbbed07d0e7e404de5150d4669da383984a17de74e455563b7ecc409b2e8 2024-12-18T00:24:21.1832729Z deleted: sha256:dc6a8b10e3a8452ea47655ddad3b52816f12bcbe35298b3aa96aae8a0da9bc12 2024-12-18T00:24:21.1833532Z deleted: sha256:c92bf6e7cfbdecd0dfe86d452eac5dbe5aa5b2a6aa7ef2eaeffb21af2870cda7 2024-12-18T00:24:21.1834304Z deleted: sha256:f9597cb89d67c0c899e266adc5e5f04817474bad200712b3c256ed33c346b3e8 2024-12-18T00:24:21.1835091Z deleted: sha256:eb062308fcca86ab5a341555bf03af093d21f1d44dbe3dce6f9b7781b650b2f1 2024-12-18T00:24:21.1836191Z deleted: sha256:96f28e0a6369023dd4e75125d2454531ff686a14467f3e06d3b5c6da89893472 2024-12-18T00:24:21.1836936Z deleted: sha256:3e6e64b255956d1bf66c97393ae4325f7fc67414cd710e284c17190cb262c92d 2024-12-18T00:24:21.1837681Z deleted: sha256:a3c0a58b4f23e46b45dd1b385363731800042b3f04ca66f8867b99f3c9311f11 2024-12-18T00:24:21.1838444Z deleted: sha256:435e519973ffb9c85330ae8db1d1fb1fa75d673e2f27640c2ca7277c6352092b 2024-12-18T00:24:21.1839180Z deleted: sha256:69800681a8b6382d520ac4b8b8828bd5540a297961ddeb004e415bc46b33f80d 2024-12-18T00:24:21.1839912Z deleted: sha256:1e837ad662894f46afc56a73aa5ccb04064e4a974c9e3cad86ce9e5546b1d63d 2024-12-18T00:24:21.1840654Z deleted: sha256:688eccf2945022bd75f9f2782e2397ea54f1032c2435aa8f7dffa23cbcf2ae99 2024-12-18T00:24:21.1841385Z deleted: sha256:4855651bf4c3c8acad23029fda7d17f43bf32a69e8d575bb43f4491f0d653c1f 2024-12-18T00:24:21.1842127Z deleted: sha256:ca2d39907b7e10e3c7ae753b8bd230fac77c4e4b15980befd71173da8a36da93 2024-12-18T00:24:21.1842891Z deleted: sha256:d4f04a8342f272455eb816a413dc2dfcc75b9ebb9ef7f6fab32436621412ba6b 2024-12-18T00:24:21.1843621Z deleted: sha256:63ae01c22dc840b763ddc08bf4e145c14a04e0ff8a833b357ed45cb0962a8116 2024-12-18T00:24:21.1844382Z deleted: sha256:cf91e4695bf05d3607b7fa68e3ba3d6cc8762e6fac8773483f8116812f3d52c0 2024-12-18T00:24:21.1845131Z deleted: sha256:71baa7b72633376bb45367512dcb676c81b1e09964085a3151381530df7cdc28 2024-12-18T00:24:21.1845837Z deleted: sha256:68855433b69809d035da2a30cb22864ed1cd2795434571a0c77532de19344497 2024-12-18T00:24:21.1846546Z deleted: sha256:929280209b1f4e29860f386a519df32161cb608338d5338f24735201939dc91f 2024-12-18T00:24:21.1847264Z deleted: sha256:25133b63282efce5897b0e8fbf64d8b2a2625e15792dad95bdada277b78c777d 2024-12-18T00:24:21.1848000Z deleted: sha256:11fddfe713ea9ddd5acd8285319a606609b5c428111f15a019c8286e7164b9b4 2024-12-18T00:24:21.1848740Z deleted: sha256:b1464f3888e3b0a1694aa960a726584d01ae6b62df53fe8743d197d2d5051036 2024-12-18T00:24:21.1849482Z deleted: sha256:9627c2925d7a3936b439a6f519083e650d160bc2522d2a9244d6a1dfda02bc83 2024-12-18T00:24:21.1850203Z deleted: sha256:33880827ded8236cc91531c2f928d6de5c7cfb95a241da2653b7e8a8d1ea4881 2024-12-18T00:24:21.1850961Z deleted: sha256:6851b39610a99eb7ec6939a15e35657e144eb3e628a3856afa0a0adff49b8c2f 2024-12-18T00:24:21.1851834Z deleted: sha256:1a76c7f0af1e05689638a3792e8b9d4418648384aed1f56d3ccde5b0a9681d29 2024-12-18T00:24:21.1852549Z deleted: sha256:072f501c97aae0be55d1457426bc5f8238b0bb86eac9e92889b01924352d79a5 2024-12-18T00:24:21.1853299Z deleted: sha256:8277868848759cc86b200280dee8701d7e8328a811bf75330ed24aeaf490e69e 2024-12-18T00:24:21.1854016Z deleted: sha256:1da994d575d08f659512ea580648bfddd62020acc1aef2f7d4c6008d36a6f83f 2024-12-18T00:24:21.1854750Z deleted: sha256:ddf6d49d71559688ae65aeecccbbc58dd555887d4b3306d02a87d049114dd2f9 2024-12-18T00:24:21.1855483Z deleted: sha256:648d99cd03665c7b88aae7e3291f27daa65f496f7ab2c37f0ee62c72a4459151 2024-12-18T00:24:21.1856216Z deleted: sha256:6e57cd88598cddad4070d39467d8e1d4c387388f89d2970a55391653f9243e1a 2024-12-18T00:24:21.1856938Z deleted: sha256:9b0c5db353ac5d4e0995c2a70ae3c28390676afe60dbd11e4ade07c792eac4ce 2024-12-18T00:24:21.1857693Z deleted: sha256:8fa5311fe41b6caf697456e9678220a152bbf6a7645f4b7ff89ea9317ae04444 2024-12-18T00:24:21.1858449Z deleted: sha256:dc438d6465050b81bff4a8c5925e70c2167712dbab174c38f79b6a5d7af407af 2024-12-18T00:24:21.1859180Z deleted: sha256:29b8f0a42a1f3b944f2c54348348d173d322522b578e3d485428d67996f6adde 2024-12-18T00:24:21.1859900Z deleted: sha256:26231024334c7a704f9acba86430547a013e959014bfd7a31e26c6ed78521479 2024-12-18T00:24:21.1860645Z deleted: sha256:4166e9dd7564ae2f46ea2c3dcb8a8ef6bef9e06f4faf1742f4c6f21861967193 2024-12-18T00:24:21.1861772Z deleted: sha256:80a3113f256f146f0a2528ca69aa9244a1f9ba1ecdf54c3ef8ba0fb21507cbc4 2024-12-18T00:24:21.1862700Z deleted: sha256:e90bbba5d7c08e01c5bedb0a855cc5cdd371688e23994155674704963591296f 2024-12-18T00:24:21.1863465Z deleted: sha256:d3b3df431f230849965cc370c2f1853a81d78dd6eb3f7ac3bc3b4ca64aa9818a 2024-12-18T00:24:21.1864216Z deleted: sha256:7a33f9ca143b08c9f5d8c53974b2d6fe840739b5d2cd30694ba1c86db9393908 2024-12-18T00:24:21.1865077Z deleted: sha256:bad1d7dae968956b4a81369dedfbcf539fd5b61dd3051e2eccb5457174fe788c 2024-12-18T00:24:21.1865865Z deleted: sha256:08a420245ca6eed4aa5662d0fec04e7892165cdb3fd2f5b99428adbb4d6199c0 2024-12-18T00:24:21.1866607Z deleted: sha256:c3fda6b9a4d08a345824508dc5625f52e4d23163843d0caf337c60feda68a830 2024-12-18T00:24:21.1867386Z deleted: sha256:c74a8a3ca5e31670eed41e4bbb4a89f25c7c05dacabdf93cbd03984ead0330e2 2024-12-18T00:24:21.1868160Z deleted: sha256:4171d4c54045bd3035546906a7dd3b63c9ca748e0a34eeba27fe918f52cdcf85 2024-12-18T00:24:21.1869052Z deleted: sha256:f6a1d112657a4aeaca96ac2792a10ea09463dc3d633cb8572314814d5abf1ddb 2024-12-18T00:24:21.1869798Z deleted: sha256:af5d54d84b9c302254498eed8b0bbce1cdd705351bf5cc210d3f11c0deb269b3 2024-12-18T00:24:21.1870520Z deleted: sha256:45ae227353c6db8230b86fc1c4b8c50def31bd64895b879d91ea6e600669045d 2024-12-18T00:24:21.1871255Z deleted: sha256:6032ea27ad90071e3b75290e03fd0763a74155f513f356d21e56663a878b0ed9 2024-12-18T00:24:21.1871994Z deleted: sha256:d5aef8ace96787c48070530c09b68e4bcb23bc92a9fb0978220204f64bfbd97f 2024-12-18T00:24:21.1872727Z deleted: sha256:e3116153021ece2a3d29eccdce1f7e0f092316e889c1d534257789f6b5743d51 2024-12-18T00:24:21.1873469Z deleted: sha256:fb0f11460e5fa2e4895230ae84c97fe0552e9509dfbae60abf94e1b8a6563fb9 2024-12-18T00:24:21.1874220Z deleted: sha256:e262415e0abb361b284df9e05790ae27cc3a1ea7b8d4618e7eb3eca17cf1d18e 2024-12-18T00:24:21.1874991Z deleted: sha256:7f810eab57a6121f1a2aae664f7a5940d12f789661445ce3500ecd3b3688b46b 2024-12-18T00:24:21.1875673Z deleted: sha256:6ed71f55ff78520154c43468df2f05a92eaa28ee2aa2e28b8ea860b9ffb258ef 2024-12-18T00:24:21.1876335Z deleted: sha256:92a10d8d42a56a8516d0e9e14fec53263302fe6e6438ced263a3845680456dd7 2024-12-18T00:24:21.1877004Z deleted: sha256:ec67f912ff53e9b7164f48250da3bb4c1ffc94c3eb2c1c56c534a94fe55e3845 2024-12-18T00:24:21.1877677Z deleted: sha256:c85033e4f60ace56eaad80a8151b1bdd1619865b10a9ccee5638878b0a027c23 2024-12-18T00:24:21.1878345Z deleted: sha256:0e8680489f0a37851beb2cb5e42f0df129247a68b755b08a6367ea42180b3e7a 2024-12-18T00:24:21.1878999Z deleted: sha256:3a767fb38f6b1124e5fe9a230fdd383ccb188c38fe1d6ec252260676efe255c8 2024-12-18T00:24:21.1879740Z deleted: sha256:2cce59d2a43773cb7c6b83d239dab3a53659767f96bc0d47a70ee0d51cfa096f 2024-12-18T00:24:21.1880414Z deleted: sha256:51e50e75789ab5b4e40a66bb2f284e2da947e37c0e757c74d49fdeea5da9cbec 2024-12-18T00:24:21.1881080Z deleted: sha256:29e55e4feccba0660950ed92941d309527fe5f41bea609662d0e703b9c76b3a1 2024-12-18T00:24:21.1881757Z deleted: sha256:d15bee8fc455fcb45d16b0abc67f18c99ce1cf2c9e998ef5a100bf8373f2f8ab 2024-12-18T00:24:21.1882430Z deleted: sha256:363936db6a8869d44b6f0bee97a786b168093848e9c08c8042830fc7fccd956b 2024-12-18T00:24:21.1883082Z deleted: sha256:0f54d1f89ceaf71ded488007635a618fac1528bf3603d9415a593fe4926f8b2a 2024-12-18T00:24:21.1883757Z deleted: sha256:2f5796e9879cab7dac02bdbb178aec5301ac00029b38be8613333ac639c4dc3a 2024-12-18T00:24:21.1884429Z deleted: sha256:e68525d57f9da8f6c74b456d92869c4e60e451b88cb403addbc4ea917d8ab3ac 2024-12-18T00:24:21.1885101Z deleted: sha256:3386e25983944ce3b2ebdde10d840832d581a7dfafd1df66568822a18979e268 2024-12-18T00:24:21.1885772Z deleted: sha256:d3a036e6bd36f014b3a1540d5b848655ecdf72a20dc81c0da5f80430700cfa9a 2024-12-18T00:24:21.1886442Z deleted: sha256:96d0556708ff4ec0d5d727d5947d6cb29a9d6c16e1a1ee76a92dc85aa3ea8f25 2024-12-18T00:24:21.1887110Z deleted: sha256:f3c2fb3abccb3a33dbf204d3f0d8857537348e6c1d3cc87a431afe866435d41b 2024-12-18T00:24:21.1887787Z deleted: sha256:45cd6c9a41f12991ee60a89e775abb604b0892ef3936526c18184bbbf4de57da 2024-12-18T00:24:21.1888459Z deleted: sha256:b3cacd0508bbfd2fd668f30c539033e7c6b606bf669258c8e8a3cbf80bf050c6 2024-12-18T00:24:21.1889131Z deleted: sha256:de72ce930361a96c151a8a4725f8360f33df6c812b6ed6d3dd5b6e6710a5d2c0 2024-12-18T00:24:21.1889804Z deleted: sha256:2e5d223d2bfa0f47e628b631a540d20c284dabb380ad9ee4caec65bf8d0ecde2 2024-12-18T00:24:21.1890475Z deleted: sha256:14a85e604a0401093323d356b3bb7f75a8473abd712b4bf1a2ef01fa432b344c 2024-12-18T00:24:21.1891186Z deleted: sha256:15a95a1e8f47d7c18dcbf9a6e2fc530cddcb161c0093c663181f3e73dc9f599e 2024-12-18T00:24:21.1891859Z deleted: sha256:106e8431b412f51ccd75ea46a2d5cb4343b23273cbcf50188377cb93aa9a6d82 2024-12-18T00:24:21.1892269Z 2024-12-18T00:24:21.1892410Z Total reclaimed space: 42.87GB 2024-12-18T00:24:21.1959274Z Post job cleanup. 2024-12-18T00:24:21.2011432Z Post job cleanup. 2024-12-18T00:24:21.2753354Z [command]/usr/bin/git version 2024-12-18T00:24:21.2787640Z git version 2.40.1 2024-12-18T00:24:21.2831899Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/9458bc6e-7bf2-4d9f-9960-c803faf0c4d6' before making global git config changes 2024-12-18T00:24:21.2833018Z Adding repository directory to the temporary git global config as a safe directory 2024-12-18T00:24:21.2834627Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:24:21.2861537Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-12-18T00:24:21.2885174Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-12-18T00:24:21.3156001Z Entering 'android/libs/fbjni' 2024-12-18T00:24:21.3222643Z Entering 'third_party/FP16' 2024-12-18T00:24:21.3281258Z Entering 'third_party/FXdiv' 2024-12-18T00:24:21.3336976Z Entering 'third_party/NNPACK' 2024-12-18T00:24:21.3391562Z Entering 'third_party/NVTX' 2024-12-18T00:24:21.3447498Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:24:21.3495139Z Entering 'third_party/XNNPACK' 2024-12-18T00:24:21.3565516Z Entering 'third_party/benchmark' 2024-12-18T00:24:21.3625580Z Entering 'third_party/composable_kernel' 2024-12-18T00:24:21.3687773Z Entering 'third_party/cpp-httplib' 2024-12-18T00:24:21.3742301Z Entering 'third_party/cpuinfo' 2024-12-18T00:24:21.3793631Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:24:21.3846797Z Entering 'third_party/cutlass' 2024-12-18T00:24:21.3910367Z Entering 'third_party/eigen' 2024-12-18T00:24:21.3968236Z Entering 'third_party/fbgemm' 2024-12-18T00:24:21.4023692Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:24:21.4073956Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:24:21.4119626Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:24:21.4176464Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:24:21.4223212Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:24:21.4283352Z Entering 'third_party/flatbuffers' 2024-12-18T00:24:21.4344353Z Entering 'third_party/fmt' 2024-12-18T00:24:21.4395936Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:24:21.4454067Z Entering 'third_party/gloo' 2024-12-18T00:24:21.4510855Z Entering 'third_party/googletest' 2024-12-18T00:24:21.4562826Z Entering 'third_party/ideep' 2024-12-18T00:24:21.4612150Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:24:21.4666621Z Entering 'third_party/ittapi' 2024-12-18T00:24:21.4714618Z Entering 'third_party/kineto' 2024-12-18T00:24:21.4766961Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:24:21.4811773Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:24:21.4859842Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:24:21.4907140Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:24:21.4953640Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:24:21.5002336Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:24:21.5051735Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:24:21.5104168Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:24:21.5162792Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:24:21.5222710Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:24:21.5272125Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:24:21.5323512Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:24:21.5375873Z Entering 'third_party/mimalloc' 2024-12-18T00:24:21.5423137Z Entering 'third_party/nccl/nccl' 2024-12-18T00:24:21.5473680Z Entering 'third_party/nlohmann' 2024-12-18T00:24:21.5527693Z Entering 'third_party/onnx' 2024-12-18T00:24:21.5600049Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:24:21.5654586Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:24:21.5711418Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:24:21.5763802Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:24:21.5815916Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:24:21.5861975Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:24:21.5912223Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:24:21.5961901Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:24:21.6009216Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:24:21.6058463Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:24:21.6110713Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:24:21.6162300Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:24:21.6235365Z Entering 'third_party/pocketfft' 2024-12-18T00:24:21.6293282Z Entering 'third_party/protobuf' 2024-12-18T00:24:21.6353720Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:24:21.6410792Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:24:21.6459881Z Entering 'third_party/psimd' 2024-12-18T00:24:21.6516927Z Entering 'third_party/pthreadpool' 2024-12-18T00:24:21.6573828Z Entering 'third_party/pybind11' 2024-12-18T00:24:21.6625584Z Entering 'third_party/python-peachpy' 2024-12-18T00:24:21.6678178Z Entering 'third_party/sleef' 2024-12-18T00:24:21.6725216Z Entering 'third_party/tensorpipe' 2024-12-18T00:24:21.6771895Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:24:21.6824288Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:24:21.6874875Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:24:21.6923216Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:24:21.6969189Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:24:21.7044193Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-12-18T00:24:21.7062707Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7069542Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-12-18T00:24:21.7093274Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-12-18T00:24:21.7355616Z Entering 'android/libs/fbjni' 2024-12-18T00:24:21.7389286Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7425192Z Entering 'third_party/FP16' 2024-12-18T00:24:21.7464259Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7496608Z Entering 'third_party/FXdiv' 2024-12-18T00:24:21.7529485Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7565310Z Entering 'third_party/NNPACK' 2024-12-18T00:24:21.7603656Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7635335Z Entering 'third_party/NVTX' 2024-12-18T00:24:21.7667777Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7698601Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:24:21.7735888Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7766264Z Entering 'third_party/XNNPACK' 2024-12-18T00:24:21.7803309Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7849983Z Entering 'third_party/benchmark' 2024-12-18T00:24:21.7882006Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7923124Z Entering 'third_party/composable_kernel' 2024-12-18T00:24:21.7958082Z http.https://github.com/.extraheader 2024-12-18T00:24:21.7995558Z Entering 'third_party/cpp-httplib' 2024-12-18T00:24:21.8030044Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8060785Z Entering 'third_party/cpuinfo' 2024-12-18T00:24:21.8095756Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8126774Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:24:21.8164498Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8195191Z Entering 'third_party/cutlass' 2024-12-18T00:24:21.8229209Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8268414Z Entering 'third_party/eigen' 2024-12-18T00:24:21.8303975Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8338937Z Entering 'third_party/fbgemm' 2024-12-18T00:24:21.8375025Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8405639Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:24:21.8438475Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8470586Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:24:21.8503163Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8533999Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:24:21.8566537Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8603343Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:24:21.8636637Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8665921Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:24:21.8698332Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8735520Z Entering 'third_party/flatbuffers' 2024-12-18T00:24:21.8770253Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8804272Z Entering 'third_party/fmt' 2024-12-18T00:24:21.8838760Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8868096Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:24:21.8904662Z http.https://github.com/.extraheader 2024-12-18T00:24:21.8937596Z Entering 'third_party/gloo' 2024-12-18T00:24:21.8969322Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9004396Z Entering 'third_party/googletest' 2024-12-18T00:24:21.9040658Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9074026Z Entering 'third_party/ideep' 2024-12-18T00:24:21.9107290Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9140448Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:24:21.9175937Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9218205Z Entering 'third_party/ittapi' 2024-12-18T00:24:21.9252738Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9285884Z Entering 'third_party/kineto' 2024-12-18T00:24:21.9325495Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9359972Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:24:21.9393730Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9428768Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:24:21.9459889Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9501685Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:24:21.9535123Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9565408Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:24:21.9597389Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9631133Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:24:21.9663758Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9695796Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:24:21.9729648Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9765755Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:24:21.9797044Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9840425Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:24:21.9871286Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9913923Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:24:21.9945533Z http.https://github.com/.extraheader 2024-12-18T00:24:21.9983011Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:24:22.0016387Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0052275Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:24:22.0085154Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0122351Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:24:22.0157687Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0192251Z Entering 'third_party/mimalloc' 2024-12-18T00:24:22.0225341Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0255973Z Entering 'third_party/nccl/nccl' 2024-12-18T00:24:22.0288974Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0322501Z Entering 'third_party/nlohmann' 2024-12-18T00:24:22.0354312Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0395391Z Entering 'third_party/onnx' 2024-12-18T00:24:22.0430202Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0476727Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:24:22.0517068Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0553191Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:24:22.0587426Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0619777Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:24:22.0649192Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0686181Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:24:22.0727606Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0760547Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:24:22.0796575Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0829371Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:24:22.0862939Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0894971Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:24:22.0928794Z http.https://github.com/.extraheader 2024-12-18T00:24:22.0960920Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:24:22.0997429Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1031309Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:24:22.1062336Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1093944Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:24:22.1130678Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1163857Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:24:22.1198097Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1233318Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:24:22.1265291Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1319784Z Entering 'third_party/pocketfft' 2024-12-18T00:24:22.1351852Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1386923Z Entering 'third_party/protobuf' 2024-12-18T00:24:22.1426227Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1458731Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:24:22.1493622Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1524581Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:24:22.1557773Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1590563Z Entering 'third_party/psimd' 2024-12-18T00:24:22.1622293Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1657473Z Entering 'third_party/pthreadpool' 2024-12-18T00:24:22.1695793Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1731788Z Entering 'third_party/pybind11' 2024-12-18T00:24:22.1762502Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1798406Z Entering 'third_party/python-peachpy' 2024-12-18T00:24:22.1833474Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1865047Z Entering 'third_party/sleef' 2024-12-18T00:24:22.1897662Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1929004Z Entering 'third_party/tensorpipe' 2024-12-18T00:24:22.1961507Z http.https://github.com/.extraheader 2024-12-18T00:24:22.1997601Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:24:22.2029559Z http.https://github.com/.extraheader 2024-12-18T00:24:22.2058224Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:24:22.2089180Z http.https://github.com/.extraheader 2024-12-18T00:24:22.2125377Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:24:22.2156205Z http.https://github.com/.extraheader 2024-12-18T00:24:22.2199113Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:24:22.2230401Z http.https://github.com/.extraheader 2024-12-18T00:24:22.2263669Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:24:22.2298462Z http.https://github.com/.extraheader 2024-12-18T00:24:22.2419628Z A job completed hook has been configured by the self-hosted runner administrator 2024-12-18T00:24:22.2446398Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-12-18T00:24:22.2450581Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:24:22.2451016Z ##[endgroup] 2024-12-18T00:24:22.2534799Z [!ALERT!] Swap in detected! [!ALERT!] 2024-12-18T00:24:32.9889335Z [!ALERT!] Swap out detected [!ALERT!] 2024-12-18T00:24:49.7437167Z Cleaning up orphan processes