2024-08-20T21:47:29.9904223Z Current runner version: '2.319.1' 2024-08-20T21:47:29.9910180Z Runner name: 'i-08ae0a5bf17e62139' 2024-08-20T21:47:29.9910971Z Runner group name: 'Default' 2024-08-20T21:47:29.9911688Z Machine name: 'ip-10-0-45-47' 2024-08-20T21:47:29.9928666Z Testing runner upgrade compatibility 2024-08-20T21:47:30.1105167Z ##[group]GITHUB_TOKEN Permissions 2024-08-20T21:47:30.1107102Z Actions: read 2024-08-20T21:47:30.1107628Z Attestations: read 2024-08-20T21:47:30.1108085Z Checks: read 2024-08-20T21:47:30.1108468Z Contents: read 2024-08-20T21:47:30.1108954Z Deployments: read 2024-08-20T21:47:30.1109415Z Discussions: read 2024-08-20T21:47:30.1109824Z Issues: read 2024-08-20T21:47:30.1110315Z Metadata: read 2024-08-20T21:47:30.1110760Z Packages: read 2024-08-20T21:47:30.1111159Z Pages: read 2024-08-20T21:47:30.1111613Z PullRequests: read 2024-08-20T21:47:30.1112103Z RepositoryProjects: read 2024-08-20T21:47:30.1112600Z SecurityEvents: read 2024-08-20T21:47:30.1113139Z Statuses: read 2024-08-20T21:47:30.1113679Z ##[endgroup] 2024-08-20T21:47:30.1116841Z Secret source: Actions 2024-08-20T21:47:30.1117474Z Prepare workflow directory 2024-08-20T21:47:30.2057515Z Prepare all required actions 2024-08-20T21:47:30.2221083Z Getting action download info 2024-08-20T21:47:30.4464682Z Download action repository 'pytorch/test-infra@main' (SHA:0c3a2634aaa2f638c8f640e743f03d696ce1191f) 2024-08-20T21:47:30.7692755Z Download action repository 'pytorch/pytorch@main' (SHA:2e1830c7c8dfc1141c89232e0356671ac07aa979) 2024-08-20T21:47:33.7156430Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-08-20T21:47:33.8872636Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-20T21:47:34.1272007Z Getting action download info 2024-08-20T21:47:34.2221759Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-08-20T21:47:34.4100096Z Getting action download info 2024-08-20T21:47:34.5188075Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-20T21:47:34.7378244Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/pull/133712/merge (f2fb9405c2fa9f9502a76363091cce6fd8179736) 2024-08-20T21:47:34.7380602Z ##[group] Inputs 2024-08-20T21:47:34.7381103Z build-environment: linux-focal-cuda12.1-py3.10-gcc9-sm75 2024-08-20T21:47:34.7382097Z test-matrix: {"include": [{"config": "pr_time_benchmarks", "shard": 1, "num_shards": 1, "runner": "linux.g4dn.metal.nvidia.gpu"}]} 2024-08-20T21:47:34.7383833Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:47:34.7385120Z sync-tag: 2024-08-20T21:47:34.7387439Z timeout-minutes: 240 2024-08-20T21:47:34.7387835Z use-gha: 2024-08-20T21:47:34.7388141Z dashboard-tag: 2024-08-20T21:47:34.7388497Z s3-bucket: gha-artifacts 2024-08-20T21:47:34.7388898Z aws-role-to-assume: 2024-08-20T21:47:34.7389238Z ##[endgroup] 2024-08-20T21:47:34.7390256Z Complete job name: cuda12.1-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-08-20T21:47:34.8345429Z A job started hook has been configured by the self-hosted runner administrator 2024-08-20T21:47:34.8494417Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-20T21:47:34.8503581Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:47:34.8504117Z ##[endgroup] 2024-08-20T21:47:35.8356935Z Runner Type: linux.g4dn.metal.nvidia.gpu 2024-08-20T21:47:35.8357454Z Instance Type: g4dn.metal 2024-08-20T21:47:35.8358146Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-20T21:47:35.8358710Z AMI ID: ami-06c68f701d8090592 2024-08-20T21:47:41.2461994Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-08-20T21:47:41.2462622Z with: 2024-08-20T21:47:41.2463371Z github-secret: *** 2024-08-20T21:47:41.2464541Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T21:47:41.2465594Z activate-with-label: false 2024-08-20T21:47:41.2465954Z label: with-ssh 2024-08-20T21:47:41.2466272Z remove-existing-keys: true 2024-08-20T21:47:41.2466620Z fail-silently: true 2024-08-20T21:47:41.2466925Z env: 2024-08-20T21:47:41.2467185Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:47:41.2467509Z ##[endgroup] 2024-08-20T21:47:41.3319007Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-20T21:47:41.5731102Z Grabbing public ssh keys from https://github.com/pytorchmergebot.keys 2024-08-20T21:47:41.6466940Z No SSH keys found for user pytorchmergebot 2024-08-20T21:47:41.6467689Z Grabbing public ssh keys from https://github.com/XuehaiPan.keys 2024-08-20T21:47:41.7183206Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-20T21:47:41.7198651Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-20T21:47:41.7231164Z Login using: ssh ec2-user@ec2-3-83-123-107.compute-1.amazonaws.com 2024-08-20T21:47:41.7232399Z All testing is done inside the container, to start an interactive session run: 2024-08-20T21:47:41.7233316Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-20T21:47:41.7355335Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-08-20T21:47:41.7355937Z with: 2024-08-20T21:47:41.7356257Z submodules: recursive 2024-08-20T21:47:41.7356645Z fetch-depth: 0 2024-08-20T21:47:41.7356946Z env: 2024-08-20T21:47:41.7357257Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:47:41.7357645Z ##[endgroup] 2024-08-20T21:47:41.7555621Z ##[group]Run retry () { 2024-08-20T21:47:41.7556027Z retry () { 2024-08-20T21:47:41.7556537Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-08-20T21:47:41.7557143Z } 2024-08-20T21:47:41.7557478Z echo "${GITHUB_WORKSPACE}" 2024-08-20T21:47:41.7557910Z if [ -z "${NO_SUDO}" ]; then 2024-08-20T21:47:41.7558418Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T21:47:41.7558911Z else 2024-08-20T21:47:41.7559250Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-08-20T21:47:41.7559713Z fi 2024-08-20T21:47:41.7560092Z mkdir "${GITHUB_WORKSPACE}" 2024-08-20T21:47:41.7567892Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:47:41.7568437Z env: 2024-08-20T21:47:41.7568717Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:47:41.7569084Z NO_SUDO: 2024-08-20T21:47:41.7569387Z ##[endgroup] 2024-08-20T21:47:41.7596246Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T21:47:41.8846647Z ##[group]Run malfet/checkout@silent-checkout 2024-08-20T21:47:41.8847117Z with: 2024-08-20T21:47:41.8847449Z ref: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T21:47:41.8847948Z fetch-depth: 0 2024-08-20T21:47:41.8848337Z submodules: recursive 2024-08-20T21:47:41.8848706Z quiet-checkout: true 2024-08-20T21:47:41.8849059Z repository: pytorch/pytorch 2024-08-20T21:47:41.8849579Z token: *** 2024-08-20T21:47:41.8849886Z ssh-strict: true 2024-08-20T21:47:41.8850209Z persist-credentials: true 2024-08-20T21:47:41.8850587Z clean: true 2024-08-20T21:47:41.8850949Z sparse-checkout-cone-mode: true 2024-08-20T21:47:41.8851337Z lfs: false 2024-08-20T21:47:41.8851656Z set-safe-directory: true 2024-08-20T21:47:41.8852009Z env: 2024-08-20T21:47:41.8852275Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:47:41.8852781Z ##[endgroup] 2024-08-20T21:47:41.9792840Z Syncing repository: pytorch/pytorch 2024-08-20T21:47:41.9794620Z ##[group]Getting Git version info 2024-08-20T21:47:41.9795477Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T21:47:41.9796466Z [command]/usr/bin/git version 2024-08-20T21:47:41.9796860Z git version 2.40.1 2024-08-20T21:47:41.9798603Z ##[endgroup] 2024-08-20T21:47:41.9810759Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/da747711-cbc0-458a-b905-c2a6770c5802' before making global git config changes 2024-08-20T21:47:41.9812173Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T21:47:41.9813447Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T21:47:41.9838699Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-20T21:47:41.9841854Z ##[group]Initializing the repository 2024-08-20T21:47:41.9844324Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T21:47:41.9875680Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-20T21:47:41.9876915Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-20T21:47:41.9877833Z hint: of your new repositories, which will suppress this warning, call: 2024-08-20T21:47:41.9878576Z hint: 2024-08-20T21:47:41.9879088Z hint: git config --global init.defaultBranch 2024-08-20T21:47:41.9879693Z hint: 2024-08-20T21:47:41.9880228Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-20T21:47:41.9881275Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-20T21:47:41.9882130Z hint: 2024-08-20T21:47:41.9882497Z hint: git branch -m 2024-08-20T21:47:41.9883307Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-08-20T21:47:41.9884939Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-08-20T21:47:41.9913374Z ##[endgroup] 2024-08-20T21:47:41.9914649Z ##[group]Disabling automatic garbage collection 2024-08-20T21:47:41.9915344Z [command]/usr/bin/git config --local gc.auto 0 2024-08-20T21:47:41.9943248Z ##[endgroup] 2024-08-20T21:47:41.9943911Z ##[group]Setting up auth 2024-08-20T21:47:41.9947109Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T21:47:41.9975034Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T21:47:42.0265572Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T21:47:42.0295412Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T21:47:42.0540851Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T21:47:42.0581926Z ##[endgroup] 2024-08-20T21:47:42.0583375Z ##[group]Fetching the repository 2024-08-20T21:47:42.0586513Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-08-20T21:47:44.7571392Z remote: Enumerating objects: 1008519 2024-08-20T21:47:44.7572948Z remote: Enumerating objects: 1010157, done. 2024-08-20T21:47:44.7574563Z remote: Counting objects: 0% (1/1638) 2024-08-20T21:47:44.7576467Z remote: Counting objects: 1% (17/1638) 2024-08-20T21:47:44.7577262Z remote: Counting objects: 2% (33/1638) 2024-08-20T21:47:44.7577896Z remote: Counting objects: 3% (50/1638) 2024-08-20T21:47:44.7578448Z remote: Counting objects: 4% (66/1638) 2024-08-20T21:47:44.7579004Z remote: Counting objects: 5% (82/1638) 2024-08-20T21:47:44.7579575Z remote: Counting objects: 6% (99/1638) 2024-08-20T21:47:44.7580135Z remote: Counting objects: 7% (115/1638) 2024-08-20T21:47:44.7580697Z remote: Counting objects: 8% (132/1638) 2024-08-20T21:47:44.7581270Z remote: Counting objects: 9% (148/1638) 2024-08-20T21:47:44.7582191Z remote: Counting objects: 10% (164/1638) 2024-08-20T21:47:44.7582774Z remote: Counting objects: 11% (181/1638) 2024-08-20T21:47:44.7583349Z remote: Counting objects: 12% (197/1638) 2024-08-20T21:47:44.7584013Z remote: Counting objects: 13% (213/1638) 2024-08-20T21:47:44.7584532Z remote: Counting objects: 14% (230/1638) 2024-08-20T21:47:44.7585088Z remote: Counting objects: 15% (246/1638) 2024-08-20T21:47:44.7586051Z remote: Counting objects: 16% (263/1638) 2024-08-20T21:47:44.7586601Z remote: Counting objects: 17% (279/1638) 2024-08-20T21:47:44.7587169Z remote: Counting objects: 18% (295/1638) 2024-08-20T21:47:44.7587739Z remote: Counting objects: 19% (312/1638) 2024-08-20T21:47:44.7588280Z remote: Counting objects: 20% (328/1638) 2024-08-20T21:47:44.7588844Z remote: Counting objects: 21% (344/1638) 2024-08-20T21:47:44.7589400Z remote: Counting objects: 22% (361/1638) 2024-08-20T21:47:44.7589964Z remote: Counting objects: 23% (377/1638) 2024-08-20T21:47:44.7590490Z remote: Counting objects: 24% (394/1638) 2024-08-20T21:47:44.7591143Z remote: Counting objects: 25% (410/1638) 2024-08-20T21:47:44.7591686Z remote: Counting objects: 26% (426/1638) 2024-08-20T21:47:44.7592225Z remote: Counting objects: 27% (443/1638) 2024-08-20T21:47:44.7592948Z remote: Counting objects: 28% (459/1638) 2024-08-20T21:47:44.7593515Z remote: Counting objects: 29% (476/1638) 2024-08-20T21:47:44.7594071Z remote: Counting objects: 30% (492/1638) 2024-08-20T21:47:44.7594606Z remote: Counting objects: 31% (508/1638) 2024-08-20T21:47:44.7595179Z remote: Counting objects: 32% (525/1638) 2024-08-20T21:47:44.7595743Z remote: Counting objects: 33% (541/1638) 2024-08-20T21:47:44.7596281Z remote: Counting objects: 34% (557/1638) 2024-08-20T21:47:44.7596844Z remote: Counting objects: 35% (574/1638) 2024-08-20T21:47:44.7597403Z remote: Counting objects: 36% (590/1638) 2024-08-20T21:47:44.7597939Z remote: Counting objects: 37% (607/1638) 2024-08-20T21:47:44.7598477Z remote: Counting objects: 38% (623/1638) 2024-08-20T21:47:44.7599022Z remote: Counting objects: 39% (639/1638) 2024-08-20T21:47:44.7599550Z remote: Counting objects: 40% (656/1638) 2024-08-20T21:47:44.7600094Z remote: Counting objects: 41% (672/1638) 2024-08-20T21:47:44.7600649Z remote: Counting objects: 42% (688/1638) 2024-08-20T21:47:44.7601182Z remote: Counting objects: 43% (705/1638) 2024-08-20T21:47:44.7601730Z remote: Counting objects: 44% (721/1638) 2024-08-20T21:47:44.7602394Z remote: Counting objects: 45% (738/1638) 2024-08-20T21:47:44.7602928Z remote: Counting objects: 46% (754/1638) 2024-08-20T21:47:44.7603535Z remote: Counting objects: 47% (770/1638) 2024-08-20T21:47:44.7604052Z remote: Counting objects: 48% (787/1638) 2024-08-20T21:47:44.7604570Z remote: Counting objects: 49% (803/1638) 2024-08-20T21:47:44.7605066Z remote: Counting objects: 50% (819/1638) 2024-08-20T21:47:44.7605575Z remote: Counting objects: 51% (836/1638) 2024-08-20T21:47:44.7606079Z remote: Counting objects: 52% (852/1638) 2024-08-20T21:47:44.7606569Z remote: Counting objects: 53% (869/1638) 2024-08-20T21:47:44.7607084Z remote: Counting objects: 54% (885/1638) 2024-08-20T21:47:44.7607591Z remote: Counting objects: 55% (901/1638) 2024-08-20T21:47:44.7608080Z remote: Counting objects: 56% (918/1638) 2024-08-20T21:47:44.7608587Z remote: Counting objects: 57% (934/1638) 2024-08-20T21:47:44.7609095Z remote: Counting objects: 58% (951/1638) 2024-08-20T21:47:44.7609590Z remote: Counting objects: 59% (967/1638) 2024-08-20T21:47:44.7610098Z remote: Counting objects: 60% (983/1638) 2024-08-20T21:47:44.7610619Z remote: Counting objects: 61% (1000/1638) 2024-08-20T21:47:44.7611261Z remote: Counting objects: 62% (1016/1638) 2024-08-20T21:47:44.7611821Z remote: Counting objects: 63% (1032/1638) 2024-08-20T21:47:44.7612361Z remote: Counting objects: 64% (1049/1638) 2024-08-20T21:47:44.7612899Z remote: Counting objects: 65% (1065/1638) 2024-08-20T21:47:44.7613415Z remote: Counting objects: 66% (1082/1638) 2024-08-20T21:47:44.7613946Z remote: Counting objects: 67% (1098/1638) 2024-08-20T21:47:44.7614477Z remote: Counting objects: 68% (1114/1638) 2024-08-20T21:47:44.7615016Z remote: Counting objects: 69% (1131/1638) 2024-08-20T21:47:44.7615531Z remote: Counting objects: 70% (1147/1638) 2024-08-20T21:47:44.7616065Z remote: Counting objects: 71% (1163/1638) 2024-08-20T21:47:44.7616590Z remote: Counting objects: 72% (1180/1638) 2024-08-20T21:47:44.7617099Z remote: Counting objects: 73% (1196/1638) 2024-08-20T21:47:44.7617627Z remote: Counting objects: 74% (1213/1638) 2024-08-20T21:47:44.7618159Z remote: Counting objects: 75% (1229/1638) 2024-08-20T21:47:44.7618670Z remote: Counting objects: 76% (1245/1638) 2024-08-20T21:47:44.7619197Z remote: Counting objects: 77% (1262/1638) 2024-08-20T21:47:44.7619717Z remote: Counting objects: 78% (1278/1638) 2024-08-20T21:47:44.7620295Z remote: Counting objects: 79% (1295/1638) 2024-08-20T21:47:44.7620822Z remote: Counting objects: 80% (1311/1638) 2024-08-20T21:47:44.7621342Z remote: Counting objects: 81% (1327/1638) 2024-08-20T21:47:44.7621853Z remote: Counting objects: 82% (1344/1638) 2024-08-20T21:47:44.7622386Z remote: Counting objects: 83% (1360/1638) 2024-08-20T21:47:44.7622917Z remote: Counting objects: 84% (1376/1638) 2024-08-20T21:47:44.7623426Z remote: Counting objects: 85% (1393/1638) 2024-08-20T21:47:44.7623957Z remote: Counting objects: 86% (1409/1638) 2024-08-20T21:47:44.7624487Z remote: Counting objects: 87% (1426/1638) 2024-08-20T21:47:44.7625014Z remote: Counting objects: 88% (1442/1638) 2024-08-20T21:47:44.7625530Z remote: Counting objects: 89% (1458/1638) 2024-08-20T21:47:44.7626051Z remote: Counting objects: 90% (1475/1638) 2024-08-20T21:47:44.7626580Z remote: Counting objects: 91% (1491/1638) 2024-08-20T21:47:44.7627097Z remote: Counting objects: 92% (1507/1638) 2024-08-20T21:47:44.7627626Z remote: Counting objects: 93% (1524/1638) 2024-08-20T21:47:44.7628158Z remote: Counting objects: 94% (1540/1638) 2024-08-20T21:47:44.7628669Z remote: Counting objects: 95% (1557/1638) 2024-08-20T21:47:44.7629189Z remote: Counting objects: 96% (1573/1638) 2024-08-20T21:47:44.7629718Z remote: Counting objects: 97% (1589/1638) 2024-08-20T21:47:44.7630226Z remote: Counting objects: 98% (1606/1638) 2024-08-20T21:47:44.7630972Z remote: Counting objects: 99% (1622/1638) 2024-08-20T21:47:44.7631529Z remote: Counting objects: 100% (1638/1638) 2024-08-20T21:47:44.7632131Z remote: Counting objects: 100% (1638/1638), done. 2024-08-20T21:47:44.7721272Z remote: Compressing objects: 0% (1/847) 2024-08-20T21:47:44.7981216Z remote: Compressing objects: 1% (9/847) 2024-08-20T21:47:44.8364240Z remote: Compressing objects: 2% (17/847) 2024-08-20T21:47:44.9021807Z remote: Compressing objects: 3% (26/847) 2024-08-20T21:47:44.9740201Z remote: Compressing objects: 4% (34/847) 2024-08-20T21:47:45.0223260Z remote: Compressing objects: 5% (43/847) 2024-08-20T21:47:45.0639573Z remote: Compressing objects: 6% (51/847) 2024-08-20T21:47:45.1026933Z remote: Compressing objects: 7% (60/847) 2024-08-20T21:47:45.1335547Z remote: Compressing objects: 8% (68/847) 2024-08-20T21:47:45.1569398Z remote: Compressing objects: 9% (77/847) 2024-08-20T21:47:45.1859559Z remote: Compressing objects: 10% (85/847) 2024-08-20T21:47:45.2066877Z remote: Compressing objects: 11% (94/847) 2024-08-20T21:47:45.2303611Z remote: Compressing objects: 12% (102/847) 2024-08-20T21:47:45.2442918Z remote: Compressing objects: 13% (111/847) 2024-08-20T21:47:45.2569820Z remote: Compressing objects: 14% (119/847) 2024-08-20T21:47:45.2635989Z remote: Compressing objects: 15% (128/847) 2024-08-20T21:47:45.2721346Z remote: Compressing objects: 16% (136/847) 2024-08-20T21:47:45.2805706Z remote: Compressing objects: 17% (144/847) 2024-08-20T21:47:45.2855466Z remote: Compressing objects: 18% (153/847) 2024-08-20T21:47:45.2902302Z remote: Compressing objects: 19% (161/847) 2024-08-20T21:47:45.2934786Z remote: Compressing objects: 20% (170/847) 2024-08-20T21:47:45.2962650Z remote: Compressing objects: 21% (178/847) 2024-08-20T21:47:45.2973187Z remote: Compressing objects: 22% (187/847) 2024-08-20T21:47:45.2973859Z remote: Compressing objects: 23% (195/847) 2024-08-20T21:47:45.2979203Z remote: Compressing objects: 24% (204/847) 2024-08-20T21:47:45.2984432Z remote: Compressing objects: 25% (212/847) 2024-08-20T21:47:45.2987945Z remote: Compressing objects: 26% (221/847) 2024-08-20T21:47:45.2998321Z remote: Compressing objects: 27% (229/847) 2024-08-20T21:47:45.3018471Z remote: Compressing objects: 28% (238/847) 2024-08-20T21:47:45.3034028Z remote: Compressing objects: 29% (246/847) 2024-08-20T21:47:45.3038521Z remote: Compressing objects: 30% (255/847) 2024-08-20T21:47:45.3055458Z remote: Compressing objects: 31% (263/847) 2024-08-20T21:47:45.3056624Z remote: Compressing objects: 32% (272/847) 2024-08-20T21:47:45.3065622Z remote: Compressing objects: 33% (280/847) 2024-08-20T21:47:45.3070714Z remote: Compressing objects: 34% (288/847) 2024-08-20T21:47:45.3078685Z remote: Compressing objects: 35% (297/847) 2024-08-20T21:47:45.3086046Z remote: Compressing objects: 36% (305/847) 2024-08-20T21:47:45.3094538Z remote: Compressing objects: 37% (314/847) 2024-08-20T21:47:45.3100629Z remote: Compressing objects: 38% (322/847) 2024-08-20T21:47:45.3106359Z remote: Compressing objects: 39% (331/847) 2024-08-20T21:47:45.3112458Z remote: Compressing objects: 40% (339/847) 2024-08-20T21:47:45.3122424Z remote: Compressing objects: 41% (348/847) 2024-08-20T21:47:45.3124268Z remote: Compressing objects: 42% (356/847) 2024-08-20T21:47:45.3130141Z remote: Compressing objects: 43% (365/847) 2024-08-20T21:47:45.3136544Z remote: Compressing objects: 44% (373/847) 2024-08-20T21:47:45.3142014Z remote: Compressing objects: 45% (382/847) 2024-08-20T21:47:45.3146719Z remote: Compressing objects: 46% (390/847) 2024-08-20T21:47:45.3148705Z remote: Compressing objects: 47% (399/847) 2024-08-20T21:47:45.3153198Z remote: Compressing objects: 48% (407/847) 2024-08-20T21:47:45.3155620Z remote: Compressing objects: 49% (416/847) 2024-08-20T21:47:45.3157891Z remote: Compressing objects: 50% (424/847) 2024-08-20T21:47:45.3162080Z remote: Compressing objects: 51% (432/847) 2024-08-20T21:47:45.3163964Z remote: Compressing objects: 52% (441/847) 2024-08-20T21:47:45.3166695Z remote: Compressing objects: 53% (449/847) 2024-08-20T21:47:45.3167410Z remote: Compressing objects: 54% (458/847) 2024-08-20T21:47:45.3169895Z remote: Compressing objects: 55% (466/847) 2024-08-20T21:47:45.3171463Z remote: Compressing objects: 56% (475/847) 2024-08-20T21:47:45.3172993Z remote: Compressing objects: 57% (483/847) 2024-08-20T21:47:45.3174320Z remote: Compressing objects: 58% (492/847) 2024-08-20T21:47:45.3174922Z remote: Compressing objects: 59% (500/847) 2024-08-20T21:47:45.3175557Z remote: Compressing objects: 60% (509/847) 2024-08-20T21:47:45.3176584Z remote: Compressing objects: 61% (517/847) 2024-08-20T21:47:45.3177183Z remote: Compressing objects: 62% (526/847) 2024-08-20T21:47:45.3177824Z remote: Compressing objects: 63% (534/847) 2024-08-20T21:47:45.3178561Z remote: Compressing objects: 64% (543/847) 2024-08-20T21:47:45.3186912Z remote: Compressing objects: 65% (551/847) 2024-08-20T21:47:45.3191024Z remote: Compressing objects: 66% (560/847) 2024-08-20T21:47:45.3195053Z remote: Compressing objects: 67% (568/847) 2024-08-20T21:47:45.3200195Z remote: Compressing objects: 68% (576/847) 2024-08-20T21:47:45.3204318Z remote: Compressing objects: 69% (585/847) 2024-08-20T21:47:45.3208670Z remote: Compressing objects: 70% (593/847) 2024-08-20T21:47:45.3211858Z remote: Compressing objects: 71% (602/847) 2024-08-20T21:47:45.3215212Z remote: Compressing objects: 72% (610/847) 2024-08-20T21:47:45.3217960Z remote: Compressing objects: 73% (619/847) 2024-08-20T21:47:45.3221475Z remote: Compressing objects: 74% (627/847) 2024-08-20T21:47:45.3224640Z remote: Compressing objects: 75% (636/847) 2024-08-20T21:47:45.3226884Z remote: Compressing objects: 76% (644/847) 2024-08-20T21:47:45.3230389Z remote: Compressing objects: 77% (653/847) 2024-08-20T21:47:45.3231396Z remote: Compressing objects: 78% (661/847) 2024-08-20T21:47:45.3232781Z remote: Compressing objects: 79% (670/847) 2024-08-20T21:47:45.3234477Z remote: Compressing objects: 80% (678/847) 2024-08-20T21:47:45.3237421Z remote: Compressing objects: 81% (687/847) 2024-08-20T21:47:45.3239357Z remote: Compressing objects: 82% (695/847) 2024-08-20T21:47:45.3240981Z remote: Compressing objects: 83% (704/847) 2024-08-20T21:47:45.3242326Z remote: Compressing objects: 84% (712/847) 2024-08-20T21:47:45.3245127Z remote: Compressing objects: 85% (720/847) 2024-08-20T21:47:45.3246697Z remote: Compressing objects: 86% (729/847) 2024-08-20T21:47:45.3247638Z remote: Compressing objects: 87% (737/847) 2024-08-20T21:47:45.3249822Z remote: Compressing objects: 88% (746/847) 2024-08-20T21:47:45.3252191Z remote: Compressing objects: 89% (754/847) 2024-08-20T21:47:45.3253298Z remote: Compressing objects: 90% (763/847) 2024-08-20T21:47:45.3254458Z remote: Compressing objects: 91% (771/847) 2024-08-20T21:47:45.3255531Z remote: Compressing objects: 92% (780/847) 2024-08-20T21:47:45.3256193Z remote: Compressing objects: 93% (788/847) 2024-08-20T21:47:45.3256842Z remote: Compressing objects: 94% (797/847) 2024-08-20T21:47:45.3257480Z remote: Compressing objects: 95% (805/847) 2024-08-20T21:47:45.3258812Z remote: Compressing objects: 96% (814/847) 2024-08-20T21:47:45.3259685Z remote: Compressing objects: 97% (822/847) 2024-08-20T21:47:45.3260917Z remote: Compressing objects: 98% (831/847) 2024-08-20T21:47:45.3262178Z remote: Compressing objects: 99% (839/847) 2024-08-20T21:47:45.3262774Z remote: Compressing objects: 100% (847/847) 2024-08-20T21:47:45.3263454Z remote: Compressing objects: 100% (847/847), done. 2024-08-20T21:48:05.8623112Z remote: Total 1010157 (delta 1053), reused 1269 (delta 788), pack-reused 1008519 (from 1) 2024-08-20T21:48:21.8901000Z [command]/usr/bin/git rev-parse --verify --quiet 40ec5f6ddd9787aca0449b24128343ff4c4a88b3^{object} 2024-08-20T21:48:21.8927098Z 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T21:48:21.8931062Z ##[endgroup] 2024-08-20T21:48:21.8935108Z ##[group]Determining the checkout info 2024-08-20T21:48:21.8936030Z ##[endgroup] 2024-08-20T21:48:21.8936693Z ##[group]Checking out the ref 2024-08-20T21:48:21.8937674Z [command]/usr/bin/git checkout --quiet --force 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T21:48:23.2403309Z ##[endgroup] 2024-08-20T21:48:23.2404385Z ##[group]Setting up auth for fetching submodules 2024-08-20T21:48:23.2406529Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-20T21:48:23.2457087Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-20T21:48:23.2483006Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-20T21:48:23.2509310Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-20T21:48:23.2535721Z ##[endgroup] 2024-08-20T21:48:23.2536431Z ##[group]Fetching submodules 2024-08-20T21:48:23.2537604Z [command]/usr/bin/git submodule sync --recursive 2024-08-20T21:48:23.2809921Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-08-20T21:48:23.3074623Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-08-20T21:48:23.3076360Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-08-20T21:48:23.3078220Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-08-20T21:48:23.3079856Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-08-20T21:48:23.3082213Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-08-20T21:48:23.3084273Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-08-20T21:48:23.3086132Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-08-20T21:48:23.3087868Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-08-20T21:48:23.3090314Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-08-20T21:48:23.3092759Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-08-20T21:48:23.3131193Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-08-20T21:48:23.3132698Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-08-20T21:48:23.3134127Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-08-20T21:48:23.3135664Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-08-20T21:48:23.3137147Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-08-20T21:48:23.3138712Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-08-20T21:48:23.3140310Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-08-20T21:48:23.3141863Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-08-20T21:48:23.3143325Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-08-20T21:48:23.3144705Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-08-20T21:48:23.3146100Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-08-20T21:48:23.3147585Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-08-20T21:48:23.3149085Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-08-20T21:48:23.3150725Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-08-20T21:48:23.3152119Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-08-20T21:48:23.3153836Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-08-20T21:48:23.3155617Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-08-20T21:48:23.3157228Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-08-20T21:48:23.3158869Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-08-20T21:48:23.3161718Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-08-20T21:48:23.3165498Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-08-20T21:48:23.3169690Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-08-20T21:48:23.3173606Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-08-20T21:48:23.3179234Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-08-20T21:48:23.3204894Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-08-20T21:48:23.6017211Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-08-20T21:48:23.7580023Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-08-20T21:48:23.9248361Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-08-20T21:48:24.1815345Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-08-20T21:48:25.9377388Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-08-20T21:48:35.2524182Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-08-20T21:48:35.6541652Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-08-20T21:48:36.0165690Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-08-20T21:48:36.6106147Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-08-20T21:48:37.7775088Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-08-20T21:48:39.6897592Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-08-20T21:48:45.6506697Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-08-20T21:48:46.9736828Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-08-20T21:48:48.5408472Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-08-20T21:48:49.5894844Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-08-20T21:48:49.9857605Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-08-20T21:48:50.3009793Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-08-20T21:48:51.2170125Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-08-20T21:48:51.5195046Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-08-20T21:48:51.7602428Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-08-20T21:48:53.2584990Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-08-20T21:48:53.9171614Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-08-20T21:48:54.5909556Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-08-20T21:49:00.3620442Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-08-20T21:49:02.1005490Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-08-20T21:49:05.2299584Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-08-20T21:49:05.4565568Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-08-20T21:49:13.6586379Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-08-20T21:49:13.8294623Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-08-20T21:49:14.0211673Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-08-20T21:49:14.8268736Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-08-20T21:49:15.1072871Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-08-20T21:49:15.6950059Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-08-20T21:49:16.1048366Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-08-20T21:49:16.1168640Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-08-20T21:49:16.1251716Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-08-20T21:49:16.1482517Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-08-20T21:49:16.1838880Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-08-20T21:49:17.0743986Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-08-20T21:49:17.0956330Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-08-20T21:49:17.1370463Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-08-20T21:49:17.2309083Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-08-20T21:49:17.2620618Z Submodule path 'third_party/cudnn_frontend': checked out '23511ba176243f27b3b275da1fb3814ea805a171' 2024-08-20T21:49:17.7305672Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-08-20T21:49:17.9710969Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-08-20T21:49:18.0514771Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-08-20T21:49:18.0536533Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-08-20T21:49:18.0539262Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T21:49:18.0540980Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-08-20T21:49:18.0542747Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-08-20T21:49:18.0544689Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T21:49:18.0567464Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-08-20T21:49:19.0689904Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-08-20T21:49:19.6493403Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-08-20T21:49:21.5593060Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-08-20T21:49:22.4825049Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-08-20T21:49:22.7947469Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-08-20T21:49:22.8859052Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-08-20T21:49:23.2698894Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-08-20T21:49:23.3292349Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-08-20T21:49:23.3402307Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-08-20T21:49:23.4486066Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-08-20T21:49:23.4862947Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-08-20T21:49:23.5220184Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-08-20T21:49:23.5454640Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-08-20T21:49:23.5868798Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T21:49:23.5988615Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-08-20T21:49:23.6006565Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-08-20T21:49:23.6026802Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-08-20T21:49:35.2438841Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-08-20T21:49:35.2608398Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-08-20T21:49:35.3439865Z Submodule path 'third_party/kineto': checked out 'd9753139d181b9ff42872465aac0e5d3018be415' 2024-08-20T21:49:35.3459067Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T21:49:35.3461801Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T21:49:35.3463791Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T21:49:35.3490829Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-08-20T21:49:35.8369086Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-08-20T21:49:36.8494107Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-08-20T21:49:37.8844032Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-08-20T21:49:37.8860242Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T21:49:37.8863879Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T21:49:37.8866068Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T21:49:37.8868288Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T21:49:37.8870508Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T21:49:37.8872596Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T21:49:37.8874677Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T21:49:37.8876623Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T21:49:37.8896636Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-08-20T21:49:38.7042149Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-08-20T21:49:39.0543525Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-08-20T21:49:40.0845137Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-08-20T21:49:40.3832468Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-08-20T21:49:40.8911929Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-08-20T21:49:41.8169472Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-08-20T21:49:47.0180134Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-08-20T21:49:47.4347768Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-08-20T21:49:47.4516430Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-08-20T21:49:47.4857896Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-08-20T21:49:47.4976706Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-08-20T21:49:47.4995627Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T21:49:47.5017693Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-08-20T21:49:48.2436326Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-08-20T21:49:48.2622671Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-08-20T21:49:48.3032669Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-08-20T21:49:48.4023386Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-08-20T21:49:48.4173195Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-08-20T21:49:48.4532129Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-08-20T21:49:48.5072835Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-08-20T21:49:48.5431217Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-08-20T21:49:48.5670067Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-08-20T21:49:48.6671223Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-08-20T21:49:49.0031936Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557' 2024-08-20T21:49:49.0066549Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-08-20T21:49:49.0071013Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-08-20T21:49:49.0087213Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-08-20T21:49:50.1830855Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-08-20T21:49:51.0408388Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-08-20T21:49:51.0727390Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-08-20T21:49:51.1349111Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-08-20T21:49:51.1372272Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T21:49:51.1374548Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T21:49:51.1376674Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T21:49:51.1378868Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T21:49:51.1381471Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T21:49:51.1383818Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T21:49:51.1386256Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T21:49:51.1388153Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T21:49:51.1408643Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-08-20T21:49:51.5319704Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-08-20T21:49:52.4756581Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-08-20T21:49:52.7564952Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-08-20T21:49:58.0218755Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-08-20T21:49:58.2681753Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-08-20T21:49:58.4723933Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-08-20T21:49:58.7649563Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-08-20T21:50:06.3834063Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-08-20T21:50:06.4213841Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-08-20T21:50:06.4350646Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-08-20T21:50:06.5280972Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-08-20T21:50:06.5392587Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-08-20T21:50:06.5521940Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-08-20T21:50:06.5661777Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-08-20T21:50:06.5675969Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T21:50:06.5681813Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T21:50:06.5696380Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-08-20T21:50:08.2105023Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-08-20T21:50:09.4160870Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-08-20T21:50:09.4595256Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-20T21:50:09.8998967Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-08-20T21:50:09.9103451Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-08-20T21:50:10.1588021Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-08-20T21:50:10.1612789Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-08-20T21:50:10.1614900Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-08-20T21:50:10.1635680Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-08-20T21:50:10.5849476Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-08-20T21:50:11.5213123Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-08-20T21:50:11.5882276Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-08-20T21:50:11.5967012Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-08-20T21:50:11.6077130Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-08-20T21:50:11.6422831Z Submodule path 'third_party/pybind11': checked out '941f45bcb51457884fa1afd6e24a67377d70f75c' 2024-08-20T21:50:11.6689081Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-08-20T21:50:11.7077075Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-08-20T21:50:11.7323888Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-08-20T21:50:11.7345775Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-08-20T21:50:11.7347903Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-08-20T21:50:11.7349882Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-08-20T21:50:11.7351747Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T21:50:11.7372927Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-08-20T21:50:12.6601497Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-08-20T21:50:12.8702175Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-08-20T21:50:13.9625049Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-08-20T21:50:14.8279033Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-08-20T21:50:14.8421679Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-08-20T21:50:14.9055527Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-08-20T21:50:14.9333377Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-08-20T21:50:14.9345878Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T21:50:14.9373619Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-08-20T21:50:15.1352287Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-08-20T21:50:15.1388438Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-20T21:50:15.1675931Z Entering 'android/libs/fbjni' 2024-08-20T21:50:15.1720040Z Entering 'third_party/FP16' 2024-08-20T21:50:15.1764224Z Entering 'third_party/FXdiv' 2024-08-20T21:50:15.1803286Z Entering 'third_party/NNPACK' 2024-08-20T21:50:15.1848044Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T21:50:15.1892610Z Entering 'third_party/XNNPACK' 2024-08-20T21:50:15.1945481Z Entering 'third_party/benchmark' 2024-08-20T21:50:15.1987085Z Entering 'third_party/cpp-httplib' 2024-08-20T21:50:15.2028244Z Entering 'third_party/cpuinfo' 2024-08-20T21:50:15.2063438Z Entering 'third_party/cudnn_frontend' 2024-08-20T21:50:15.2106754Z Entering 'third_party/cutlass' 2024-08-20T21:50:15.2152457Z Entering 'third_party/eigen' 2024-08-20T21:50:15.2197248Z Entering 'third_party/fbgemm' 2024-08-20T21:50:15.2234041Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T21:50:15.2275375Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T21:50:15.2310312Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T21:50:15.2364456Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T21:50:15.2412291Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T21:50:15.2448253Z Entering 'third_party/flatbuffers' 2024-08-20T21:50:15.2488463Z Entering 'third_party/fmt' 2024-08-20T21:50:15.2524721Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T21:50:15.2568644Z Entering 'third_party/gloo' 2024-08-20T21:50:15.2613532Z Entering 'third_party/googletest' 2024-08-20T21:50:15.2656059Z Entering 'third_party/ideep' 2024-08-20T21:50:15.2695071Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T21:50:15.2754257Z Entering 'third_party/ittapi' 2024-08-20T21:50:15.2790250Z Entering 'third_party/kineto' 2024-08-20T21:50:15.2836865Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T21:50:15.2875055Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T21:50:15.2910750Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T21:50:15.2944623Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T21:50:15.2991576Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T21:50:15.3035731Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T21:50:15.3079948Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T21:50:15.3117591Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T21:50:15.3163510Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T21:50:15.3197184Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T21:50:15.3240853Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T21:50:15.3285037Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T21:50:15.3329068Z Entering 'third_party/mimalloc' 2024-08-20T21:50:15.3373113Z Entering 'third_party/nccl/nccl' 2024-08-20T21:50:15.3417331Z Entering 'third_party/nlohmann' 2024-08-20T21:50:15.3458314Z Entering 'third_party/onnx' 2024-08-20T21:50:15.3511978Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T21:50:15.3556841Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T21:50:15.3600246Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T21:50:15.3639281Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T21:50:15.3673379Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T21:50:15.3709979Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T21:50:15.3744029Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T21:50:15.3794612Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T21:50:15.3827189Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T21:50:15.3862430Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T21:50:15.3895589Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T21:50:15.3941248Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T21:50:15.3987720Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T21:50:15.4043611Z Entering 'third_party/pocketfft' 2024-08-20T21:50:15.4083472Z Entering 'third_party/protobuf' 2024-08-20T21:50:15.4126788Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T21:50:15.4166683Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T21:50:15.4213415Z Entering 'third_party/psimd' 2024-08-20T21:50:15.4256708Z Entering 'third_party/pthreadpool' 2024-08-20T21:50:15.4298447Z Entering 'third_party/pybind11' 2024-08-20T21:50:15.4337074Z Entering 'third_party/python-peachpy' 2024-08-20T21:50:15.4372180Z Entering 'third_party/sleef' 2024-08-20T21:50:15.4413568Z Entering 'third_party/tensorpipe' 2024-08-20T21:50:15.4455406Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T21:50:15.4488492Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T21:50:15.4533766Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T21:50:15.4575708Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T21:50:15.4608870Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T21:50:15.4666105Z ##[endgroup] 2024-08-20T21:50:15.4670214Z ##[group]Persisting credentials for submodules 2024-08-20T21:50:15.4673140Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-20T21:50:15.4958075Z Entering 'android/libs/fbjni' 2024-08-20T21:50:15.5002543Z Entering 'third_party/FP16' 2024-08-20T21:50:15.5047725Z Entering 'third_party/FXdiv' 2024-08-20T21:50:15.5093733Z Entering 'third_party/NNPACK' 2024-08-20T21:50:15.5138936Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T21:50:15.5185585Z Entering 'third_party/XNNPACK' 2024-08-20T21:50:15.5247951Z Entering 'third_party/benchmark' 2024-08-20T21:50:15.5293961Z Entering 'third_party/cpp-httplib' 2024-08-20T21:50:15.5338205Z Entering 'third_party/cpuinfo' 2024-08-20T21:50:15.5387597Z Entering 'third_party/cudnn_frontend' 2024-08-20T21:50:15.5434234Z Entering 'third_party/cutlass' 2024-08-20T21:50:15.5491644Z Entering 'third_party/eigen' 2024-08-20T21:50:15.5538919Z Entering 'third_party/fbgemm' 2024-08-20T21:50:15.5586260Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T21:50:15.5632082Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T21:50:15.5675832Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T21:50:15.5729937Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T21:50:15.5774118Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T21:50:15.5824052Z Entering 'third_party/flatbuffers' 2024-08-20T21:50:15.5870831Z Entering 'third_party/fmt' 2024-08-20T21:50:15.5917478Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T21:50:15.5963110Z Entering 'third_party/gloo' 2024-08-20T21:50:15.6009066Z Entering 'third_party/googletest' 2024-08-20T21:50:15.6056837Z Entering 'third_party/ideep' 2024-08-20T21:50:15.6101653Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T21:50:15.6154976Z Entering 'third_party/ittapi' 2024-08-20T21:50:15.6201293Z Entering 'third_party/kineto' 2024-08-20T21:50:15.6255253Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T21:50:15.6302817Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T21:50:15.6346819Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T21:50:15.6390387Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T21:50:15.6443487Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T21:50:15.6493314Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T21:50:15.6539031Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T21:50:15.6584030Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T21:50:15.6633572Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T21:50:15.6686587Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T21:50:15.6738092Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T21:50:15.6781990Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T21:50:15.6832599Z Entering 'third_party/mimalloc' 2024-08-20T21:50:15.6878264Z Entering 'third_party/nccl/nccl' 2024-08-20T21:50:15.6925283Z Entering 'third_party/nlohmann' 2024-08-20T21:50:15.6981946Z Entering 'third_party/onnx' 2024-08-20T21:50:15.7046854Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T21:50:15.7094362Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T21:50:15.7142639Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T21:50:15.7190186Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T21:50:15.7236805Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T21:50:15.7284859Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T21:50:15.7330805Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T21:50:15.7376628Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T21:50:15.7425361Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T21:50:15.7472818Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T21:50:15.7523943Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T21:50:15.7568660Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T21:50:15.7620585Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T21:50:15.7683119Z Entering 'third_party/pocketfft' 2024-08-20T21:50:15.7730030Z Entering 'third_party/protobuf' 2024-08-20T21:50:15.7780193Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T21:50:15.7825260Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T21:50:15.7877351Z Entering 'third_party/psimd' 2024-08-20T21:50:15.7923214Z Entering 'third_party/pthreadpool' 2024-08-20T21:50:15.7970267Z Entering 'third_party/pybind11' 2024-08-20T21:50:15.8017755Z Entering 'third_party/python-peachpy' 2024-08-20T21:50:15.8063477Z Entering 'third_party/sleef' 2024-08-20T21:50:15.8108371Z Entering 'third_party/tensorpipe' 2024-08-20T21:50:15.8154235Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T21:50:15.8198204Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T21:50:15.8243018Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T21:50:15.8293317Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T21:50:15.8341677Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T21:50:15.8403455Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-20T21:50:15.8671853Z Entering 'android/libs/fbjni' 2024-08-20T21:50:15.8719893Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-08-20T21:50:15.8736203Z Entering 'third_party/FP16' 2024-08-20T21:50:15.8779678Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-08-20T21:50:15.8799679Z Entering 'third_party/FXdiv' 2024-08-20T21:50:15.8847918Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-08-20T21:50:15.8864976Z Entering 'third_party/NNPACK' 2024-08-20T21:50:15.8908363Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-08-20T21:50:15.8923501Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T21:50:15.8970114Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-08-20T21:50:15.8991066Z Entering 'third_party/XNNPACK' 2024-08-20T21:50:15.9028237Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-08-20T21:50:15.9062284Z Entering 'third_party/benchmark' 2024-08-20T21:50:15.9106717Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-08-20T21:50:15.9122335Z Entering 'third_party/cpp-httplib' 2024-08-20T21:50:15.9173499Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-08-20T21:50:15.9189590Z Entering 'third_party/cpuinfo' 2024-08-20T21:50:15.9231972Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T21:50:15.9247598Z Entering 'third_party/cudnn_frontend' 2024-08-20T21:50:15.9296396Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-08-20T21:50:15.9312515Z Entering 'third_party/cutlass' 2024-08-20T21:50:15.9354175Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-08-20T21:50:15.9377605Z Entering 'third_party/eigen' 2024-08-20T21:50:15.9423436Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-08-20T21:50:15.9441690Z Entering 'third_party/fbgemm' 2024-08-20T21:50:15.9488274Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-08-20T21:50:15.9504884Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T21:50:15.9552044Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-08-20T21:50:15.9566287Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T21:50:15.9609964Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-08-20T21:50:15.9624024Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T21:50:15.9665505Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-08-20T21:50:15.9690829Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T21:50:15.9742331Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-08-20T21:50:15.9754453Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T21:50:15.9797651Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-08-20T21:50:15.9822190Z Entering 'third_party/flatbuffers' 2024-08-20T21:50:15.9865259Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-08-20T21:50:15.9883157Z Entering 'third_party/fmt' 2024-08-20T21:50:15.9931844Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-08-20T21:50:15.9948317Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T21:50:15.9995444Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-08-20T21:50:16.0011144Z Entering 'third_party/gloo' 2024-08-20T21:50:16.0056833Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-08-20T21:50:16.0074773Z Entering 'third_party/googletest' 2024-08-20T21:50:16.0118629Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-08-20T21:50:16.0133615Z Entering 'third_party/ideep' 2024-08-20T21:50:16.0182856Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-08-20T21:50:16.0195783Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T21:50:16.0242601Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-08-20T21:50:16.0265086Z Entering 'third_party/ittapi' 2024-08-20T21:50:16.0310048Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-08-20T21:50:16.0326023Z Entering 'third_party/kineto' 2024-08-20T21:50:16.0370650Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-08-20T21:50:16.0385874Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T21:50:16.0438049Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-08-20T21:50:16.0450360Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T21:50:16.0493334Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-08-20T21:50:16.0505854Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T21:50:16.0553709Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-08-20T21:50:16.0569219Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T21:50:16.0612250Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-08-20T21:50:16.0623072Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T21:50:16.0667679Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-08-20T21:50:16.0681376Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T21:50:16.0727410Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-08-20T21:50:16.0744411Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T21:50:16.0785237Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-08-20T21:50:16.0805059Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T21:50:16.0844804Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-08-20T21:50:16.0859490Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T21:50:16.0901997Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-08-20T21:50:16.0913581Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T21:50:16.0954931Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-08-20T21:50:16.0975756Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T21:50:16.1023910Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-08-20T21:50:16.1043058Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T21:50:16.1090641Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-08-20T21:50:16.1107003Z Entering 'third_party/mimalloc' 2024-08-20T21:50:16.1152984Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-08-20T21:50:16.1168527Z Entering 'third_party/nccl/nccl' 2024-08-20T21:50:16.1214271Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-08-20T21:50:16.1229964Z Entering 'third_party/nlohmann' 2024-08-20T21:50:16.1274641Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-08-20T21:50:16.1290423Z Entering 'third_party/onnx' 2024-08-20T21:50:16.1337197Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-08-20T21:50:16.1367660Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T21:50:16.1410574Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-08-20T21:50:16.1428848Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T21:50:16.1472677Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-08-20T21:50:16.1488249Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T21:50:16.1531248Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-08-20T21:50:16.1546933Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T21:50:16.1588154Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-08-20T21:50:16.1601299Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T21:50:16.1644445Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-08-20T21:50:16.1666353Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T21:50:16.1717447Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-08-20T21:50:16.1732812Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T21:50:16.1777941Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-08-20T21:50:16.1799739Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T21:50:16.1842952Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-08-20T21:50:16.1855579Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T21:50:16.1899573Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-08-20T21:50:16.1918424Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T21:50:16.1965287Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-08-20T21:50:16.1978987Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T21:50:16.2021906Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-08-20T21:50:16.2036600Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T21:50:16.2078821Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-08-20T21:50:16.2091908Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T21:50:16.2145079Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-08-20T21:50:16.2186443Z Entering 'third_party/pocketfft' 2024-08-20T21:50:16.2235430Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-08-20T21:50:16.2254986Z Entering 'third_party/protobuf' 2024-08-20T21:50:16.2303775Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-08-20T21:50:16.2322577Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T21:50:16.2364090Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-08-20T21:50:16.2380417Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T21:50:16.2424997Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-08-20T21:50:16.2444136Z Entering 'third_party/psimd' 2024-08-20T21:50:16.2494628Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-08-20T21:50:16.2510668Z Entering 'third_party/pthreadpool' 2024-08-20T21:50:16.2554125Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-08-20T21:50:16.2570275Z Entering 'third_party/pybind11' 2024-08-20T21:50:16.2617220Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-08-20T21:50:16.2634493Z Entering 'third_party/python-peachpy' 2024-08-20T21:50:16.2686069Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-08-20T21:50:16.2704874Z Entering 'third_party/sleef' 2024-08-20T21:50:16.2748097Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-08-20T21:50:16.2767416Z Entering 'third_party/tensorpipe' 2024-08-20T21:50:16.2810088Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-08-20T21:50:16.2832466Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T21:50:16.2872443Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-08-20T21:50:16.2884313Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T21:50:16.2930595Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-08-20T21:50:16.2942540Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T21:50:16.2986625Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-08-20T21:50:16.2999837Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T21:50:16.3041658Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-08-20T21:50:16.3053319Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T21:50:16.3104024Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-08-20T21:50:16.3777063Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-20T21:50:16.4039271Z Entering 'android/libs/fbjni' 2024-08-20T21:50:16.4082953Z Entering 'third_party/FP16' 2024-08-20T21:50:16.4125773Z Entering 'third_party/FXdiv' 2024-08-20T21:50:16.4167039Z Entering 'third_party/NNPACK' 2024-08-20T21:50:16.4213141Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T21:50:16.4257555Z Entering 'third_party/XNNPACK' 2024-08-20T21:50:16.4315469Z Entering 'third_party/benchmark' 2024-08-20T21:50:16.4355957Z Entering 'third_party/cpp-httplib' 2024-08-20T21:50:16.4397294Z Entering 'third_party/cpuinfo' 2024-08-20T21:50:16.4438506Z Entering 'third_party/cudnn_frontend' 2024-08-20T21:50:16.4479291Z Entering 'third_party/cutlass' 2024-08-20T21:50:16.4531931Z Entering 'third_party/eigen' 2024-08-20T21:50:16.4575900Z Entering 'third_party/fbgemm' 2024-08-20T21:50:16.4622212Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T21:50:16.4665319Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T21:50:16.4704975Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T21:50:16.4743450Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T21:50:16.4778073Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T21:50:16.4814276Z Entering 'third_party/flatbuffers' 2024-08-20T21:50:16.4859828Z Entering 'third_party/fmt' 2024-08-20T21:50:16.4900850Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T21:50:16.4944487Z Entering 'third_party/gloo' 2024-08-20T21:50:16.4987890Z Entering 'third_party/googletest' 2024-08-20T21:50:16.5029935Z Entering 'third_party/ideep' 2024-08-20T21:50:16.5067571Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T21:50:16.5113445Z Entering 'third_party/ittapi' 2024-08-20T21:50:16.5158008Z Entering 'third_party/kineto' 2024-08-20T21:50:16.5198281Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T21:50:16.5242024Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T21:50:16.5286689Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T21:50:16.5328532Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T21:50:16.5371659Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T21:50:16.5413139Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T21:50:16.5450778Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T21:50:16.5487724Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T21:50:16.5524615Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T21:50:16.5560844Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T21:50:16.5595405Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T21:50:16.5639332Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T21:50:16.5679283Z Entering 'third_party/mimalloc' 2024-08-20T21:50:16.5724703Z Entering 'third_party/nccl/nccl' 2024-08-20T21:50:16.5767336Z Entering 'third_party/nlohmann' 2024-08-20T21:50:16.5816016Z Entering 'third_party/onnx' 2024-08-20T21:50:16.5876684Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T21:50:16.5918889Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T21:50:16.5965496Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T21:50:16.6010561Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T21:50:16.6044683Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T21:50:16.6080496Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T21:50:16.6116728Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T21:50:16.6156991Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T21:50:16.6189267Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T21:50:16.6224469Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T21:50:16.6266151Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T21:50:16.6303611Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T21:50:16.6340662Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T21:50:16.6400349Z Entering 'third_party/pocketfft' 2024-08-20T21:50:16.6440091Z Entering 'third_party/protobuf' 2024-08-20T21:50:16.6486335Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T21:50:16.6526632Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T21:50:16.6563037Z Entering 'third_party/psimd' 2024-08-20T21:50:16.6613909Z Entering 'third_party/pthreadpool' 2024-08-20T21:50:16.6653919Z Entering 'third_party/pybind11' 2024-08-20T21:50:16.6688181Z Entering 'third_party/python-peachpy' 2024-08-20T21:50:16.6729504Z Entering 'third_party/sleef' 2024-08-20T21:50:16.6773203Z Entering 'third_party/tensorpipe' 2024-08-20T21:50:16.6820152Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T21:50:16.6854893Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T21:50:16.6887861Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T21:50:16.6927512Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T21:50:16.6967937Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T21:50:16.7023271Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-20T21:50:16.7282982Z Entering 'android/libs/fbjni' 2024-08-20T21:50:16.7323984Z Entering 'third_party/FP16' 2024-08-20T21:50:16.7367482Z Entering 'third_party/FXdiv' 2024-08-20T21:50:16.7403675Z Entering 'third_party/NNPACK' 2024-08-20T21:50:16.7444091Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T21:50:16.7492541Z Entering 'third_party/XNNPACK' 2024-08-20T21:50:16.7550802Z Entering 'third_party/benchmark' 2024-08-20T21:50:16.7587138Z Entering 'third_party/cpp-httplib' 2024-08-20T21:50:16.7627324Z Entering 'third_party/cpuinfo' 2024-08-20T21:50:16.7668183Z Entering 'third_party/cudnn_frontend' 2024-08-20T21:50:16.7708711Z Entering 'third_party/cutlass' 2024-08-20T21:50:16.7755133Z Entering 'third_party/eigen' 2024-08-20T21:50:16.7798241Z Entering 'third_party/fbgemm' 2024-08-20T21:50:16.7835654Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T21:50:16.7874288Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T21:50:16.7918729Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T21:50:16.7961855Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T21:50:16.7997381Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T21:50:16.8039779Z Entering 'third_party/flatbuffers' 2024-08-20T21:50:16.8086179Z Entering 'third_party/fmt' 2024-08-20T21:50:16.8128658Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T21:50:16.8169505Z Entering 'third_party/gloo' 2024-08-20T21:50:16.8209158Z Entering 'third_party/googletest' 2024-08-20T21:50:16.8247407Z Entering 'third_party/ideep' 2024-08-20T21:50:16.8286963Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T21:50:16.8329785Z Entering 'third_party/ittapi' 2024-08-20T21:50:16.8367639Z Entering 'third_party/kineto' 2024-08-20T21:50:16.8414014Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T21:50:16.8449126Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T21:50:16.8484903Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T21:50:16.8520615Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T21:50:16.8555809Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T21:50:16.8589030Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T21:50:16.8635945Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T21:50:16.8670911Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T21:50:16.8706179Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T21:50:16.8742079Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T21:50:16.8783095Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T21:50:16.8823216Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T21:50:16.8861430Z Entering 'third_party/mimalloc' 2024-08-20T21:50:16.8907358Z Entering 'third_party/nccl/nccl' 2024-08-20T21:50:16.8948147Z Entering 'third_party/nlohmann' 2024-08-20T21:50:16.8987130Z Entering 'third_party/onnx' 2024-08-20T21:50:16.9041980Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T21:50:16.9084128Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T21:50:16.9135276Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T21:50:16.9183140Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T21:50:16.9218047Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T21:50:16.9258565Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T21:50:16.9296855Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T21:50:16.9343586Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T21:50:16.9388206Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T21:50:16.9422849Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T21:50:16.9456072Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T21:50:16.9490866Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T21:50:16.9531573Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T21:50:16.9588121Z Entering 'third_party/pocketfft' 2024-08-20T21:50:16.9623139Z Entering 'third_party/protobuf' 2024-08-20T21:50:16.9666767Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T21:50:16.9715004Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T21:50:16.9759759Z Entering 'third_party/psimd' 2024-08-20T21:50:16.9804144Z Entering 'third_party/pthreadpool' 2024-08-20T21:50:16.9848012Z Entering 'third_party/pybind11' 2024-08-20T21:50:16.9888088Z Entering 'third_party/python-peachpy' 2024-08-20T21:50:16.9929160Z Entering 'third_party/sleef' 2024-08-20T21:50:16.9973346Z Entering 'third_party/tensorpipe' 2024-08-20T21:50:17.0014203Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T21:50:17.0054855Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T21:50:17.0096509Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T21:50:17.0137743Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T21:50:17.0174915Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T21:50:17.0224448Z ##[endgroup] 2024-08-20T21:50:17.0257748Z [command]/usr/bin/git log -1 --format='%H' 2024-08-20T21:50:17.0284645Z '40ec5f6ddd9787aca0449b24128343ff4c4a88b3' 2024-08-20T21:50:17.0519427Z Prepare all required actions 2024-08-20T21:50:17.0519934Z Getting action download info 2024-08-20T21:50:17.1906311Z ##[group]Run ./.github/actions/setup-linux 2024-08-20T21:50:17.1906746Z env: 2024-08-20T21:50:17.1907006Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:17.1907328Z ##[endgroup] 2024-08-20T21:50:17.1975530Z ##[group]Run set -euo pipefail 2024-08-20T21:50:17.1976037Z set -euo pipefail 2024-08-20T21:50:17.1976459Z function get_ec2_metadata() { 2024-08-20T21:50:17.1977037Z  # Pulled from instance metadata endpoint for EC2 2024-08-20T21:50:17.1978059Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-20T21:50:17.1978939Z  category=$1 2024-08-20T21:50:17.1979514Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-08-20T21:50:17.1980397Z  runner_name_str=i-08ae0a5bf17e62139 2024-08-20T21:50:17.1980955Z  if [[ -f /.inarc ]]; then 2024-08-20T21:50:17.1981625Z  echo "ARC Runner, no info on ec2 metadata" 2024-08-20T21:50:17.1982247Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-08-20T21:50:17.1983018Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-08-20T21:50:17.1983678Z  else 2024-08-20T21:50:17.1984212Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-20T21:50:17.1984847Z  fi 2024-08-20T21:50:17.1985129Z } 2024-08-20T21:50:17.1985564Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-20T21:50:17.1986377Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-20T21:50:17.1987116Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-20T21:50:17.1987769Z echo "system info $(uname -a)" 2024-08-20T21:50:17.1995895Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:17.1996455Z env: 2024-08-20T21:50:17.1996762Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:17.1997257Z ##[endgroup] 2024-08-20T21:50:17.2088574Z ami-id: ami-06c68f701d8090592 2024-08-20T21:50:17.2136309Z instance-id: i-08ae0a5bf17e62139 2024-08-20T21:50:17.2187752Z instance-type: g4dn.metal 2024-08-20T21:50:17.2197866Z system info Linux ip-10-0-45-47.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-20T21:50:17.2224348Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T21:50:17.2225339Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-20T21:50:17.2231379Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:17.2231946Z env: 2024-08-20T21:50:17.2232238Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:17.2232630Z ##[endgroup] 2024-08-20T21:50:17.2306409Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-20T21:50:17.2307112Z if systemctl is-active --quiet docker; then 2024-08-20T21:50:17.2307725Z  echo "Docker daemon is running..."; 2024-08-20T21:50:17.2308238Z else 2024-08-20T21:50:17.2308774Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-20T21:50:17.2309450Z fi 2024-08-20T21:50:17.2314816Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:17.2315339Z env: 2024-08-20T21:50:17.2315641Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:17.2316020Z ##[endgroup] 2024-08-20T21:50:17.2391484Z Docker daemon is running... 2024-08-20T21:50:17.2446115Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T21:50:17.2446720Z with: 2024-08-20T21:50:17.2446997Z shell: bash 2024-08-20T21:50:17.2447282Z timeout_minutes: 5 2024-08-20T21:50:17.2447618Z max_attempts: 3 2024-08-20T21:50:17.2447959Z retry_wait_seconds: 30 2024-08-20T21:50:17.2451319Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-08-20T21:50:17.2454620Z polling_interval_seconds: 1 2024-08-20T21:50:17.2454989Z warning_on_retry: true 2024-08-20T21:50:17.2455360Z continue_on_error: false 2024-08-20T21:50:17.2455714Z env: 2024-08-20T21:50:17.2455972Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:17.2456349Z AWS_RETRY_MODE: standard 2024-08-20T21:50:17.2456794Z AWS_MAX_ATTEMPTS: 5 2024-08-20T21:50:17.2457128Z AWS_DEFAULT_REGION: us-east-1 2024-08-20T21:50:17.2457521Z ##[endgroup] 2024-08-20T21:50:18.3288205Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T21:50:18.3289142Z Configure a credential helper to remove this warning. See 2024-08-20T21:50:18.3290105Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T21:50:18.3290699Z 2024-08-20T21:50:18.3290831Z Login Succeeded 2024-08-20T21:50:19.2993663Z Command completed after 1 attempt(s). 2024-08-20T21:50:19.3054864Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T21:50:19.3055720Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T21:50:19.3056492Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-20T21:50:19.3063834Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:19.3064361Z env: 2024-08-20T21:50:19.3064706Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:19.3065100Z ##[endgroup] 2024-08-20T21:50:19.3161866Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T21:50:19.3162753Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T21:50:19.3163445Z # shellcheck disable=SC2046 2024-08-20T21:50:19.3163981Z docker stop $(docker ps -q) || true 2024-08-20T21:50:19.3164501Z # Prune all of the docker images 2024-08-20T21:50:19.3165020Z docker system prune -af 2024-08-20T21:50:19.3170538Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:19.3171051Z env: 2024-08-20T21:50:19.3171375Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:19.3171766Z ##[endgroup] 2024-08-20T21:50:19.3495848Z "docker stop" requires at least 1 argument. 2024-08-20T21:50:19.3496704Z See 'docker stop --help'. 2024-08-20T21:50:19.3497014Z 2024-08-20T21:50:19.3497276Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-20T21:50:19.3497893Z 2024-08-20T21:50:19.3498061Z Stop one or more running containers 2024-08-20T21:50:19.3706855Z Total reclaimed space: 0B 2024-08-20T21:50:19.3749757Z ##[group]Run set +e 2024-08-20T21:50:19.3750185Z set +e 2024-08-20T21:50:19.3750490Z set -x 2024-08-20T21:50:19.3750815Z  2024-08-20T21:50:19.3751171Z PT_DOMAIN=download.pytorch.org 2024-08-20T21:50:19.3752002Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-08-20T21:50:19.3753180Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-08-20T21:50:19.3753996Z # one is returned at random 2024-08-20T21:50:19.3754554Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-08-20T21:50:19.3755121Z  2024-08-20T21:50:19.3755468Z if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T21:50:19.3756107Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-08-20T21:50:19.3757071Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-08-20T21:50:19.3757682Z  2024-08-20T21:50:19.3758003Z  if [ -z "${RESOLVED_IP}" ]; then 2024-08-20T21:50:19.3758546Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-08-20T21:50:19.3759062Z  exit 1 2024-08-20T21:50:19.3759371Z  fi 2024-08-20T21:50:19.3759633Z fi 2024-08-20T21:50:19.3759904Z  2024-08-20T21:50:19.3760259Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-08-20T21:50:19.3760766Z  # Clean up any old records first 2024-08-20T21:50:19.3761277Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-08-20T21:50:19.3761740Z fi 2024-08-20T21:50:19.3761991Z  2024-08-20T21:50:19.3762419Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-08-20T21:50:19.3762973Z cat /etc/hosts 2024-08-20T21:50:19.3768229Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:19.3768738Z env: 2024-08-20T21:50:19.3769015Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:19.3769340Z ##[endgroup] 2024-08-20T21:50:19.3791829Z + PT_DOMAIN=download.pytorch.org 2024-08-20T21:50:19.3796652Z ++ dig -4 +short download.pytorch.org 2024-08-20T21:50:19.3797203Z ++ tail -n1 2024-08-20T21:50:19.4225479Z + RESOLVED_IP=18.160.10.76 2024-08-20T21:50:19.4226027Z + '[' -z 18.160.10.76 ']' 2024-08-20T21:50:19.4226514Z + grep -r download.pytorch.org /etc/hosts 2024-08-20T21:50:19.4245405Z + echo '18.160.10.76 download.pytorch.org' 2024-08-20T21:50:19.4245998Z + sudo tee -a /etc/hosts 2024-08-20T21:50:19.6314719Z 18.160.10.76 download.pytorch.org 2024-08-20T21:50:19.6330928Z + cat /etc/hosts 2024-08-20T21:50:19.6340515Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-08-20T21:50:19.6352539Z ::1 localhost6 localhost6.localdomain6 2024-08-20T21:50:19.6353183Z 18.160.10.76 download.pytorch.org 2024-08-20T21:50:19.6565626Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-08-20T21:50:19.6566230Z with: 2024-08-20T21:50:19.6567387Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:19.6568695Z docker-build-dir: .ci/docker 2024-08-20T21:50:19.6569039Z working-directory: . 2024-08-20T21:50:19.6569486Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:19.6570000Z force-push: false 2024-08-20T21:50:19.6570278Z env: 2024-08-20T21:50:19.6570526Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:19.6570841Z ##[endgroup] 2024-08-20T21:50:19.6592400Z ##[group]Run set -ex 2024-08-20T21:50:19.6592769Z set -ex 2024-08-20T21:50:19.6593070Z  2024-08-20T21:50:19.6593663Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-20T21:50:19.6594817Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-20T21:50:19.6595713Z # job could then download the pre-built image as usual 2024-08-20T21:50:19.6596550Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-20T21:50:19.6597303Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6598182Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6598734Z  2024-08-20T21:50:19.6599240Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-20T21:50:19.6599871Z  exit 0 2024-08-20T21:50:19.6600143Z else 2024-08-20T21:50:19.6600491Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6600930Z fi 2024-08-20T21:50:19.6601174Z  2024-08-20T21:50:19.6601641Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-20T21:50:19.6602529Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-20T21:50:19.6603315Z  # use it as it is, but first let's extract the tag 2024-08-20T21:50:19.6604031Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-20T21:50:19.6604768Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6605477Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6606030Z else 2024-08-20T21:50:19.6606454Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-20T21:50:19.6607128Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6608040Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6608820Z fi 2024-08-20T21:50:19.6615055Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:19.6615663Z env: 2024-08-20T21:50:19.6615930Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:19.6616263Z REPO_NAME: pytorch 2024-08-20T21:50:19.6617478Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:19.6618777Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T21:50:19.6619269Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:19.6619773Z ##[endgroup] 2024-08-20T21:50:19.6642031Z + [[ ! -d .ci/docker ]] 2024-08-20T21:50:19.6642540Z + [[ ! -f .ci/docker/build.sh ]] 2024-08-20T21:50:19.6642932Z + echo skip=false 2024-08-20T21:50:19.6645371Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-08-20T21:50:19.6649602Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:19.6652331Z ++ awk -F '[:,]' '{print $2}' 2024-08-20T21:50:19.6673914Z + DOCKER_TAG=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:19.6674894Z + echo docker-tag=f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:19.6676883Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:19.6706125Z ##[group]Run set +e 2024-08-20T21:50:19.6706461Z set +e 2024-08-20T21:50:19.6706738Z set -x 2024-08-20T21:50:19.6706994Z  2024-08-20T21:50:19.6707246Z login() { 2024-08-20T21:50:19.6707914Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T21:50:19.6708645Z } 2024-08-20T21:50:19.6708880Z  2024-08-20T21:50:19.6709132Z retry () { 2024-08-20T21:50:19.6709503Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T21:50:19.6709924Z } 2024-08-20T21:50:19.6710176Z  2024-08-20T21:50:19.6710457Z retry login "${DOCKER_REGISTRY}" 2024-08-20T21:50:19.6710866Z  2024-08-20T21:50:19.6711329Z # Check if image already exists, if it does then skip building it 2024-08-20T21:50:19.6712042Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-08-20T21:50:19.6712528Z  exit 0 2024-08-20T21:50:19.6712809Z fi 2024-08-20T21:50:19.6713064Z  2024-08-20T21:50:19.6713545Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-08-20T21:50:19.6714387Z # be empty. The default action would be to continue rebuild the image 2024-08-20T21:50:19.6715143Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-08-20T21:50:19.6715807Z  # if we're on the base branch then use the parent commit 2024-08-20T21:50:19.6716398Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-08-20T21:50:19.6716819Z else 2024-08-20T21:50:19.6717262Z  # otherwise we're on a PR, so use the most recent base commit 2024-08-20T21:50:19.6717958Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-08-20T21:50:19.6718457Z fi 2024-08-20T21:50:19.6718702Z  2024-08-20T21:50:19.6718996Z if [[ -z "${MERGE_BASE}" ]]; then 2024-08-20T21:50:19.6719492Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6719937Z  2024-08-20T21:50:19.6720584Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-08-20T21:50:19.6721362Z  exit 0 2024-08-20T21:50:19.6721640Z fi 2024-08-20T21:50:19.6721883Z  2024-08-20T21:50:19.6722433Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-08-20T21:50:19.6723445Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-08-20T21:50:19.6724263Z  exit 1 2024-08-20T21:50:19.6724549Z fi 2024-08-20T21:50:19.6724810Z  2024-08-20T21:50:19.6725283Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-08-20T21:50:19.6726263Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-08-20T21:50:19.6727146Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-08-20T21:50:19.6728152Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-08-20T21:50:19.6729284Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-08-20T21:50:19.6730037Z fi 2024-08-20T21:50:19.6730303Z  2024-08-20T21:50:19.6730629Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-20T21:50:19.6735630Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:19.6736134Z env: 2024-08-20T21:50:19.6736400Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:19.6736742Z DOCKER_BUILD_DIR: .ci/docker 2024-08-20T21:50:19.6737207Z BASE_REVISION: 91f3d614142df02f619e44a68e3d9e0dfeba49ec 2024-08-20T21:50:19.6738580Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:19.6739938Z DOCKER_TAG: f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:19.6740538Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:19.6741070Z ##[endgroup] 2024-08-20T21:50:19.6764698Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:19.6766726Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:19.6768463Z + aws ecr get-login-password --region us-east-1 2024-08-20T21:50:19.6770742Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:20.1782471Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T21:50:20.1783713Z Configure a credential helper to remove this warning. See 2024-08-20T21:50:20.1784692Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T21:50:20.1785295Z 2024-08-20T21:50:20.1785540Z Login Succeeded 2024-08-20T21:50:20.1802927Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:20.3869839Z { 2024-08-20T21:50:20.3870181Z "schemaVersion": 2, 2024-08-20T21:50:20.3870834Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-08-20T21:50:20.3871616Z "config": { 2024-08-20T21:50:20.3872107Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-08-20T21:50:20.3872697Z "size": 48711, 2024-08-20T21:50:20.3873310Z "digest": "sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb" 2024-08-20T21:50:20.3874032Z }, 2024-08-20T21:50:20.3874294Z "layers": [ 2024-08-20T21:50:20.3874563Z { 2024-08-20T21:50:20.3875036Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3875667Z "size": 28580681, 2024-08-20T21:50:20.3876292Z "digest": "sha256:7a2c559011895d255fce249c00396abff5ae7e0c0a92931d0ed493e71de78e3a" 2024-08-20T21:50:20.3876987Z }, 2024-08-20T21:50:20.3877239Z { 2024-08-20T21:50:20.3877697Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3878315Z "size": 7943451, 2024-08-20T21:50:20.3878912Z "digest": "sha256:224fe954d7252f10539d243d6c9688806f7d13ad775ed02e7f7c79077844510d" 2024-08-20T21:50:20.3879803Z }, 2024-08-20T21:50:20.3880064Z { 2024-08-20T21:50:20.3880542Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3881154Z "size": 55728572, 2024-08-20T21:50:20.3881765Z "digest": "sha256:75722010b82e31715876aeeed0b2cee414296f0124fdfa061ab845ba2a158450" 2024-08-20T21:50:20.3882458Z }, 2024-08-20T21:50:20.3882696Z { 2024-08-20T21:50:20.3883167Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3883790Z "size": 186, 2024-08-20T21:50:20.3884381Z "digest": "sha256:d527cbbb87e3016fd72a18a9b468c945ad0ca27c5770b39debd6ed704db3a195" 2024-08-20T21:50:20.3885087Z }, 2024-08-20T21:50:20.3885344Z { 2024-08-20T21:50:20.3886019Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3886633Z "size": 6886, 2024-08-20T21:50:20.3887231Z "digest": "sha256:b57676e46aee1a8c82e528d78e5a13e31142524eea31c8b213d69ddcb6f1fe80" 2024-08-20T21:50:20.3887910Z }, 2024-08-20T21:50:20.3888292Z { 2024-08-20T21:50:20.3888784Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3889423Z "size": 1329001756, 2024-08-20T21:50:20.3890073Z "digest": "sha256:a8c1e85b5e14cec7af70bf304cb4d4cee6a1d25eb8215b2cf4fdc33e5af5e108" 2024-08-20T21:50:20.3890968Z }, 2024-08-20T21:50:20.3891208Z { 2024-08-20T21:50:20.3891691Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3892325Z "size": 62501, 2024-08-20T21:50:20.3892822Z + exit 0 2024-08-20T21:50:20.3893410Z "digest": "sha256:a41a8d1c11c8d80fe4e82b0d05478f8d51176ff20b8350905fc1b25c93a51198" 2024-08-20T21:50:20.3894111Z }, 2024-08-20T21:50:20.3894371Z { 2024-08-20T21:50:20.3894854Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3895478Z "size": 1684, 2024-08-20T21:50:20.3896081Z "digest": "sha256:0c12278907551c2962927d27c115f6f7bf0df894318b8aea6ece3ef01ccd0a8a" 2024-08-20T21:50:20.3896769Z }, 2024-08-20T21:50:20.3897018Z { 2024-08-20T21:50:20.3897502Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3898252Z "size": 1523, 2024-08-20T21:50:20.3898855Z "digest": "sha256:d8d1234baab3ec9ccb8bb710fc6b8ff6c10896ba2e8d27a347583eca770f9ff1" 2024-08-20T21:50:20.3899566Z }, 2024-08-20T21:50:20.3899813Z { 2024-08-20T21:50:20.3900270Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3900889Z "size": 2528295403, 2024-08-20T21:50:20.3901511Z "digest": "sha256:7ed32bc8e4696fcdb2feef850781160597b2275ad756819c4add88236b0577d5" 2024-08-20T21:50:20.3902193Z }, 2024-08-20T21:50:20.3902440Z { 2024-08-20T21:50:20.3902908Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3903505Z "size": 86016, 2024-08-20T21:50:20.3904112Z "digest": "sha256:ec1e7978c1fe161ced1d98092a51e7c5953ca5fda5577f54df9dbda4afff1b2b" 2024-08-20T21:50:20.3904824Z }, 2024-08-20T21:50:20.3905067Z { 2024-08-20T21:50:20.3905539Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3906154Z "size": 1822, 2024-08-20T21:50:20.3906747Z "digest": "sha256:ac23c5fcc1ef310e9cd0d138b180281188e20a3e28c51cd14751622e3c7d92ea" 2024-08-20T21:50:20.3907440Z }, 2024-08-20T21:50:20.3907689Z { 2024-08-20T21:50:20.3908140Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3908767Z "size": 246761563, 2024-08-20T21:50:20.3909417Z "digest": "sha256:ca426ffc9d2bd051ad1ff5c4f02fd5d9be161e70953cc37882c815080c708f4d" 2024-08-20T21:50:20.3910128Z }, 2024-08-20T21:50:20.3910363Z { 2024-08-20T21:50:20.3910827Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3911617Z "size": 544, 2024-08-20T21:50:20.3912202Z "digest": "sha256:4373aa743caf6660c671295b837048c8350a2165f2336dc3b7b6c96462579e50" 2024-08-20T21:50:20.3912877Z }, 2024-08-20T21:50:20.3913124Z { 2024-08-20T21:50:20.3913583Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3914295Z "size": 1258, 2024-08-20T21:50:20.3914890Z "digest": "sha256:75b2abb16c685854c017d0cf75c626526c956734c656d9e78fdd4520317e9b3c" 2024-08-20T21:50:20.3915571Z }, 2024-08-20T21:50:20.3915853Z { 2024-08-20T21:50:20.3916352Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3916975Z "size": 484, 2024-08-20T21:50:20.3917579Z "digest": "sha256:ef1e3ef1e85f0124270b8506721219150e230184181f8207d64463bf5c67e656" 2024-08-20T21:50:20.3918282Z }, 2024-08-20T21:50:20.3918537Z { 2024-08-20T21:50:20.3919041Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3919690Z "size": 91711766, 2024-08-20T21:50:20.3920308Z "digest": "sha256:0bf61114d37b2d09065aa6852b1e78a32580a1ff011dd5d23f03b0f5c4e710af" 2024-08-20T21:50:20.3921017Z }, 2024-08-20T21:50:20.3921299Z { 2024-08-20T21:50:20.3921773Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3922492Z "size": 3390, 2024-08-20T21:50:20.3923125Z "digest": "sha256:2df849f72ba4258df10c9c45ace21a66d93b73196e78e96f12c13098822f60e2" 2024-08-20T21:50:20.3923815Z }, 2024-08-20T21:50:20.3924094Z { 2024-08-20T21:50:20.3924602Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3925223Z "size": 1909, 2024-08-20T21:50:20.3925839Z "digest": "sha256:34c47d63c5de27418739aa048b4dd781c3006d65691e9b903c95304d0509d89c" 2024-08-20T21:50:20.3926543Z }, 2024-08-20T21:50:20.3926797Z { 2024-08-20T21:50:20.3927302Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3927950Z "size": 701, 2024-08-20T21:50:20.3928553Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T21:50:20.3929274Z }, 2024-08-20T21:50:20.3929555Z { 2024-08-20T21:50:20.3930027Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3930673Z "size": 2864254879, 2024-08-20T21:50:20.3931348Z "digest": "sha256:6efb96fc87ea1bca54876d85331e5585e28f325a1d60ee1aef7811eabb74f933" 2024-08-20T21:50:20.3932054Z }, 2024-08-20T21:50:20.3932334Z { 2024-08-20T21:50:20.3932835Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3933453Z "size": 380, 2024-08-20T21:50:20.3934072Z "digest": "sha256:b119c4fc6c58d9e72744201ff4850b34184a94eb3566031b7d36e87ecce950a6" 2024-08-20T21:50:20.3934785Z }, 2024-08-20T21:50:20.3935044Z { 2024-08-20T21:50:20.3935540Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3936185Z "size": 12900, 2024-08-20T21:50:20.3936800Z "digest": "sha256:33b639226eeefa41d7bb26a8ecc20d271ceef45571dabfd80aaee3634926381b" 2024-08-20T21:50:20.3937543Z }, 2024-08-20T21:50:20.3937825Z { 2024-08-20T21:50:20.3938323Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3938939Z "size": 803, 2024-08-20T21:50:20.3939551Z "digest": "sha256:d3547bd43146930aa830d54562c98aa678e355cf5f84527e9717eb72fffe8ca3" 2024-08-20T21:50:20.3940271Z }, 2024-08-20T21:50:20.3940528Z { 2024-08-20T21:50:20.3941030Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3941668Z "size": 106, 2024-08-20T21:50:20.3942259Z "digest": "sha256:5645520256fa6d7f2270608eaed53849a131d03fbf4c5d4472c9cfde1a439e47" 2024-08-20T21:50:20.3942966Z }, 2024-08-20T21:50:20.3943242Z { 2024-08-20T21:50:20.3943716Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3944362Z "size": 503, 2024-08-20T21:50:20.3944979Z "digest": "sha256:829ed7d91e3818d0e11834c71551117c7aeec0a51d798e93d641faa0c02582cb" 2024-08-20T21:50:20.3945687Z }, 2024-08-20T21:50:20.3945942Z { 2024-08-20T21:50:20.3946441Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3947057Z "size": 121477267, 2024-08-20T21:50:20.3947706Z "digest": "sha256:385d0421d67c533d628985c453a186028a61f6ad4209ae519ec3d4ecea661d3e" 2024-08-20T21:50:20.3948476Z }, 2024-08-20T21:50:20.3948731Z { 2024-08-20T21:50:20.3949232Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3949872Z "size": 109, 2024-08-20T21:50:20.3950506Z "digest": "sha256:7cbfce999d76851e07dd71056a6d852629d789ccfd46be44cc405b451fb8bb58" 2024-08-20T21:50:20.3951206Z }, 2024-08-20T21:50:20.3951489Z { 2024-08-20T21:50:20.3951960Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3952606Z "size": 490, 2024-08-20T21:50:20.3953227Z "digest": "sha256:6658e558ebe496f0d628947534b0ea1e44808f84f2dfd8a9a704e8aa5329d791" 2024-08-20T21:50:20.3953938Z }, 2024-08-20T21:50:20.3954198Z { 2024-08-20T21:50:20.3954691Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3955339Z "size": 297, 2024-08-20T21:50:20.3955925Z "digest": "sha256:33444a5a7e01a3010fd1cc16b32a66892a08600d7f700747d23faf3c36624f3a" 2024-08-20T21:50:20.3956709Z }, 2024-08-20T21:50:20.3956991Z { 2024-08-20T21:50:20.3957467Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3958111Z "size": 103, 2024-08-20T21:50:20.3958742Z "digest": "sha256:7c47122f4e09b47e891b4ae9e499a35a4eb46faacae87d0e946615adda6e0706" 2024-08-20T21:50:20.3959449Z }, 2024-08-20T21:50:20.3959734Z { 2024-08-20T21:50:20.3960239Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3960856Z "size": 1473, 2024-08-20T21:50:20.3961482Z "digest": "sha256:1811ff4d3556ac255604f346d879528aff2aadd7652c2d39baf4fe6eaa60aec3" 2024-08-20T21:50:20.3962194Z }, 2024-08-20T21:50:20.3962447Z { 2024-08-20T21:50:20.3962948Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3963595Z "size": 594729516, 2024-08-20T21:50:20.3964216Z "digest": "sha256:7754ee068b33f760d9c320c26a1a3935247ace0c8c463a976105c1586a43fb1c" 2024-08-20T21:50:20.3964915Z }, 2024-08-20T21:50:20.3965204Z { 2024-08-20T21:50:20.3965677Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3966323Z "size": 164, 2024-08-20T21:50:20.3966939Z "digest": "sha256:0479fbac3361713c075bf788e778117917dcacdd1ff71ed79a789dd2016a1714" 2024-08-20T21:50:20.3967628Z }, 2024-08-20T21:50:20.3967906Z { 2024-08-20T21:50:20.3968407Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3969028Z "size": 564, 2024-08-20T21:50:20.3969640Z "digest": "sha256:f1d6874dee9c34d154278d2b6935d04447f07fa89d25d4a09398234040d8a7e8" 2024-08-20T21:50:20.3970356Z }, 2024-08-20T21:50:20.3970612Z { 2024-08-20T21:50:20.3971111Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3971756Z "size": 35874203, 2024-08-20T21:50:20.3972390Z "digest": "sha256:afc429e87b593a64f3e0a1be51e09e966ea1aa71e6e8a0bec4edc9f2f7bc1c05" 2024-08-20T21:50:20.3973122Z }, 2024-08-20T21:50:20.3973405Z { 2024-08-20T21:50:20.3973895Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3974536Z "size": 104, 2024-08-20T21:50:20.3975146Z "digest": "sha256:019620471c2592cd22437fe8ed1a94c784114cf7445c5c2ab36dd0bae727fc66" 2024-08-20T21:50:20.3975833Z }, 2024-08-20T21:50:20.3976110Z { 2024-08-20T21:50:20.3976608Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3977226Z "size": 425, 2024-08-20T21:50:20.3977875Z "digest": "sha256:27aeb1b2cd5e28d8f0e54fc1090baf88abc29ebf5fce088b493fcae99c9550d1" 2024-08-20T21:50:20.3978621Z }, 2024-08-20T21:50:20.3978879Z { 2024-08-20T21:50:20.3979377Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3980024Z "size": 20262183, 2024-08-20T21:50:20.3980638Z "digest": "sha256:829c0e19f4b7797e9120a86172fabfd710f9b3971ffd714a616931a3fadc7192" 2024-08-20T21:50:20.3981356Z }, 2024-08-20T21:50:20.3981635Z { 2024-08-20T21:50:20.3982115Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3982994Z "size": 438, 2024-08-20T21:50:20.3983621Z "digest": "sha256:560cd6122a3868e7e82e75eb103d182edf6512114d61ccdfae099af00cb16b4c" 2024-08-20T21:50:20.3984339Z }, 2024-08-20T21:50:20.3984595Z { 2024-08-20T21:50:20.3985100Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3985999Z "size": 701, 2024-08-20T21:50:20.3986628Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T21:50:20.3987374Z }, 2024-08-20T21:50:20.3987668Z { 2024-08-20T21:50:20.3988163Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3988827Z "size": 141, 2024-08-20T21:50:20.3989479Z "digest": "sha256:5a4eb19d72198a01f3babd4711c40fcf7c6e5cb9d5cfedc507b0061408d47097" 2024-08-20T21:50:20.3990231Z }, 2024-08-20T21:50:20.3990493Z { 2024-08-20T21:50:20.3991008Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3991763Z "size": 135, 2024-08-20T21:50:20.3992559Z "digest": "sha256:da6a838a66c72b5de9a5590c233779880ea901c1264940a1c618825d2501ffd1" 2024-08-20T21:50:20.3993286Z }, 2024-08-20T21:50:20.3993548Z { 2024-08-20T21:50:20.3994062Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3994728Z "size": 4838068375, 2024-08-20T21:50:20.3995399Z "digest": "sha256:cbb79a7053537bed2d80b77198ea552b985563b11d3f8616593c6ab575a3a090" 2024-08-20T21:50:20.3996111Z }, 2024-08-20T21:50:20.3996392Z { 2024-08-20T21:50:20.3996873Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.3997628Z "size": 194, 2024-08-20T21:50:20.3998253Z "digest": "sha256:4d4fa6802ab3e6b36d8d4adb650046e9370c4a16a19876970559ef8a312ca855" 2024-08-20T21:50:20.3998972Z }, 2024-08-20T21:50:20.3999226Z { 2024-08-20T21:50:20.3999715Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4000354Z "size": 564, 2024-08-20T21:50:20.4000966Z "digest": "sha256:0f085d4fa279366fcd52d303b7ad8abddc5962a8872174b8109f3f5d5ca5f2cf" 2024-08-20T21:50:20.4001682Z }, 2024-08-20T21:50:20.4001956Z { 2024-08-20T21:50:20.4002432Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4003080Z "size": 43162921, 2024-08-20T21:50:20.4003708Z "digest": "sha256:4a0412373305517489d891a4749e6d2b80b4aeb7df3b8adca0ed0abb2f3e5300" 2024-08-20T21:50:20.4004392Z }, 2024-08-20T21:50:20.4004672Z { 2024-08-20T21:50:20.4005165Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4005782Z "size": 106, 2024-08-20T21:50:20.4006393Z "digest": "sha256:302c8c1779444e54919f83e91c6d5e1fdea653fc899be802b3a2a34d34d99d5d" 2024-08-20T21:50:20.4007090Z }, 2024-08-20T21:50:20.4007343Z { 2024-08-20T21:50:20.4007837Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4008479Z "size": 1380, 2024-08-20T21:50:20.4009066Z "digest": "sha256:02970347dff622ee45629bc28788716d00528464f71f88ec7b74ae5f44a486e2" 2024-08-20T21:50:20.4009768Z }, 2024-08-20T21:50:20.4010044Z { 2024-08-20T21:50:20.4010516Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4011156Z "size": 701, 2024-08-20T21:50:20.4011781Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T21:50:20.4012471Z }, 2024-08-20T21:50:20.4012743Z { 2024-08-20T21:50:20.4013242Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4013857Z "size": 139, 2024-08-20T21:50:20.4014468Z "digest": "sha256:916c5e8580164926a3aec87e88a5d1c2d02756e49fdeed4198e1e6304efa2fd3" 2024-08-20T21:50:20.4015174Z }, 2024-08-20T21:50:20.4015422Z { 2024-08-20T21:50:20.4016015Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4016636Z "size": 118, 2024-08-20T21:50:20.4017212Z "digest": "sha256:c42b3602a1fb4df5111224650f15adffb025979ae9c614807379ea84e189533b" 2024-08-20T21:50:20.4017997Z }, 2024-08-20T21:50:20.4018266Z { 2024-08-20T21:50:20.4018728Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4019358Z "size": 4324672728, 2024-08-20T21:50:20.4020007Z "digest": "sha256:11fad972ef6cb9d2dc236504b0ee5b6e5ea996e4576ece0ed3262fbb9ee2de60" 2024-08-20T21:50:20.4020697Z }, 2024-08-20T21:50:20.4020971Z { 2024-08-20T21:50:20.4021453Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4022045Z "size": 174, 2024-08-20T21:50:20.4022628Z "digest": "sha256:f957c16244819132b478272aaf24231699c4fcbd495c229a574f94daab8d6b86" 2024-08-20T21:50:20.4023309Z }, 2024-08-20T21:50:20.4023556Z { 2024-08-20T21:50:20.4024036Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4024661Z "size": 907, 2024-08-20T21:50:20.4025260Z "digest": "sha256:768c31dca016b80bbdc973c8ee818034bdbd17b7ea9bdadbf0ec45ea51005720" 2024-08-20T21:50:20.4026042Z }, 2024-08-20T21:50:20.4026320Z { 2024-08-20T21:50:20.4026785Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4027413Z "size": 701, 2024-08-20T21:50:20.4028025Z "digest": "sha256:1fef4bd19792cbf9d3aea12795089ad41164bb6d607c339b7484e1899825b1d2" 2024-08-20T21:50:20.4028701Z }, 2024-08-20T21:50:20.4028976Z { 2024-08-20T21:50:20.4029466Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4030062Z "size": 134, 2024-08-20T21:50:20.4030678Z "digest": "sha256:8c32d0ecebbe2054c96a3a5c1f3d6c8b87c2e826686b369e5242cd55d0f01c2d" 2024-08-20T21:50:20.4031380Z }, 2024-08-20T21:50:20.4031628Z { 2024-08-20T21:50:20.4032111Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4032740Z "size": 32, 2024-08-20T21:50:20.4033324Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T21:50:20.4034025Z }, 2024-08-20T21:50:20.4034307Z { 2024-08-20T21:50:20.4034763Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4035392Z "size": 158, 2024-08-20T21:50:20.4036011Z "digest": "sha256:78ee77eddef23f20afc78e2924f4467041cadb754634ee3df431c68211cf676d" 2024-08-20T21:50:20.4036691Z }, 2024-08-20T21:50:20.4036969Z { 2024-08-20T21:50:20.4037455Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4038053Z "size": 1841, 2024-08-20T21:50:20.4038657Z "digest": "sha256:37513e9b43d7123e7ddee09100f62a72b57af7b3833eaecd515e247e2f63e13f" 2024-08-20T21:50:20.4039351Z }, 2024-08-20T21:50:20.4039601Z { 2024-08-20T21:50:20.4040093Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4040724Z "size": 7529776, 2024-08-20T21:50:20.4041322Z "digest": "sha256:a7a5392e2bf6b73d9be292cc22a99ad4637636c15733beb7afbe6403b5ba21a8" 2024-08-20T21:50:20.4042021Z }, 2024-08-20T21:50:20.4042292Z { 2024-08-20T21:50:20.4042758Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4043387Z "size": 163, 2024-08-20T21:50:20.4043985Z "digest": "sha256:b10de02255c021b2366b85bf12ddf593aac89f88964201c455b71a145bc5ca2e" 2024-08-20T21:50:20.4044654Z }, 2024-08-20T21:50:20.4044924Z { 2024-08-20T21:50:20.4045407Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4046012Z "size": 7943, 2024-08-20T21:50:20.4046629Z "digest": "sha256:e56eeff2db93ffe5002a2bb764795b7333321c6802cc28bef0801a619fe6a07e" 2024-08-20T21:50:20.4047334Z }, 2024-08-20T21:50:20.4047584Z { 2024-08-20T21:50:20.4048061Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4048687Z "size": 8068, 2024-08-20T21:50:20.4049281Z "digest": "sha256:70ac3e38d0fd1f0f46ad710c3fc485fd01406606054e8cf84a63af1570bc9f3a" 2024-08-20T21:50:20.4049978Z }, 2024-08-20T21:50:20.4050245Z { 2024-08-20T21:50:20.4050717Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4051401Z "size": 302, 2024-08-20T21:50:20.4052003Z "digest": "sha256:eb09cbf3e4168749cc8605e3188ed35070f6037d13930e443c38d8941734488f" 2024-08-20T21:50:20.4052667Z }, 2024-08-20T21:50:20.4052945Z { 2024-08-20T21:50:20.4053435Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4054041Z "size": 7629638, 2024-08-20T21:50:20.4054650Z "digest": "sha256:ee1273153675e6543b58f5be50321abee5e91f7351701d5d501a6837eaf676ef" 2024-08-20T21:50:20.4055330Z }, 2024-08-20T21:50:20.4055575Z { 2024-08-20T21:50:20.4056057Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4056685Z "size": 108, 2024-08-20T21:50:20.4057276Z "digest": "sha256:e22979f9e0eedfa16f98eb4fa26f30a50c237f5ffd2f6e5b898f2b908058496d" 2024-08-20T21:50:20.4057986Z }, 2024-08-20T21:50:20.4058254Z { 2024-08-20T21:50:20.4058712Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4059412Z "size": 54145661, 2024-08-20T21:50:20.4060056Z "digest": "sha256:6c1f0aabce7c84f9b0b9ab3b96325778dba1c1465b7463c5b4c6be1cf52b74db" 2024-08-20T21:50:20.4060742Z }, 2024-08-20T21:50:20.4061017Z { 2024-08-20T21:50:20.4061508Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4062107Z "size": 473, 2024-08-20T21:50:20.4062727Z "digest": "sha256:7ebe49c3a23e71b289ce012b48dad35791a2f2aa7fcee2326a64d763b0d14df8" 2024-08-20T21:50:20.4063431Z }, 2024-08-20T21:50:20.4063679Z { 2024-08-20T21:50:20.4064160Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4064782Z "size": 1374858766, 2024-08-20T21:50:20.4065393Z "digest": "sha256:5d115b29b5d53e5418762bc41ae975dd245bcffc3d058b8902c58146d505cb37" 2024-08-20T21:50:20.4066090Z }, 2024-08-20T21:50:20.4066360Z { 2024-08-20T21:50:20.4066820Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4067437Z "size": 106, 2024-08-20T21:50:20.4068070Z "digest": "sha256:7f2d7a04fbe65bbe1e895138e0cfeeef53ad926c890bab8e7e132ad1e655e48f" 2024-08-20T21:50:20.4068754Z }, 2024-08-20T21:50:20.4069026Z { 2024-08-20T21:50:20.4069509Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4070111Z "size": 559, 2024-08-20T21:50:20.4070706Z "digest": "sha256:d79fd7d526989e554455eda7d459f2c88444030f61710101e52ec8c7a49b7b79" 2024-08-20T21:50:20.4071387Z }, 2024-08-20T21:50:20.4071633Z { 2024-08-20T21:50:20.4072115Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4072738Z "size": 46248488, 2024-08-20T21:50:20.4073338Z "digest": "sha256:9752d6fbbcab4e7403f26777c5b65911320de6389c81b833a47ba45c4f3354b4" 2024-08-20T21:50:20.4074031Z }, 2024-08-20T21:50:20.4074302Z { 2024-08-20T21:50:20.4074764Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4075384Z "size": 111, 2024-08-20T21:50:20.4075992Z "digest": "sha256:83808b2eff4d71ed46db7c29f66fe918f328405c25b314225dfad01b4868d1f4" 2024-08-20T21:50:20.4076676Z }, 2024-08-20T21:50:20.4076988Z { 2024-08-20T21:50:20.4077470Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4078073Z "size": 32, 2024-08-20T21:50:20.4078687Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T21:50:20.4079389Z }, 2024-08-20T21:50:20.4079636Z { 2024-08-20T21:50:20.4080126Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4080751Z "size": 32, 2024-08-20T21:50:20.4081336Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T21:50:20.4082038Z }, 2024-08-20T21:50:20.4082311Z { 2024-08-20T21:50:20.4082771Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4083402Z "size": 32, 2024-08-20T21:50:20.4084015Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T21:50:20.4084753Z }, 2024-08-20T21:50:20.4085032Z { 2024-08-20T21:50:20.4085566Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-20T21:50:20.4086363Z "size": 32, 2024-08-20T21:50:20.4087034Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-20T21:50:20.4087775Z } 2024-08-20T21:50:20.4088036Z ] 2024-08-20T21:50:20.4088319Z } 2024-08-20T21:50:20.4209772Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T21:50:20.4210395Z tag=${ECR_DOCKER_IMAGE##*/} 2024-08-20T21:50:20.4210977Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-08-20T21:50:20.4217154Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:20.4217689Z env: 2024-08-20T21:50:20.4217971Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:20.4219345Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:20.4220619Z ##[endgroup] 2024-08-20T21:50:20.4247662Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks-f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:20.4302567Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-08-20T21:50:20.4303159Z with: 2024-08-20T21:50:20.4304372Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:20.4305869Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:20.4306404Z env: 2024-08-20T21:50:20.4306675Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:20.4307021Z ##[endgroup] 2024-08-20T21:50:20.4325253Z ##[group]Run set -x 2024-08-20T21:50:20.4325594Z set -x 2024-08-20T21:50:20.4325887Z set +e 2024-08-20T21:50:20.4326174Z  2024-08-20T21:50:20.4326447Z login() { 2024-08-20T21:50:20.4327151Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-20T21:50:20.4327926Z } 2024-08-20T21:50:20.4328181Z  2024-08-20T21:50:20.4328499Z retry () { 2024-08-20T21:50:20.4328882Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-20T21:50:20.4329353Z } 2024-08-20T21:50:20.4329623Z  2024-08-20T21:50:20.4329921Z retry login "${DOCKER_REGISTRY}" 2024-08-20T21:50:20.4330354Z  2024-08-20T21:50:20.4330626Z set -e 2024-08-20T21:50:20.4331100Z # ignore output since only exit code is used for conditional 2024-08-20T21:50:20.4331856Z # only pull docker image if it's not available locally 2024-08-20T21:50:20.4332678Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-20T21:50:20.4333424Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-20T21:50:20.4333873Z fi 2024-08-20T21:50:20.4338592Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:50:20.4339091Z env: 2024-08-20T21:50:20.4339343Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:50:20.4340575Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:20.4341983Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:20.4342492Z ##[endgroup] 2024-08-20T21:50:20.4362188Z + set +e 2024-08-20T21:50:20.4362816Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:20.4363532Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:20.4365888Z + aws ecr get-login-password --region us-east-1 2024-08-20T21:50:20.4369786Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-20T21:50:20.9455793Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-20T21:50:20.9461170Z Configure a credential helper to remove this warning. See 2024-08-20T21:50:20.9462938Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-20T21:50:20.9463494Z 2024-08-20T21:50:20.9463617Z Login Succeeded 2024-08-20T21:50:20.9468236Z + set -e 2024-08-20T21:50:20.9469949Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:20.9599305Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:20.9602083Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:50:21.1944066Z f6d216893d65c7b8ae43df4daaf247db808378e9: Pulling from pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks 2024-08-20T21:50:21.1945250Z 7a2c55901189: Pulling fs layer 2024-08-20T21:50:21.1945706Z 224fe954d725: Pulling fs layer 2024-08-20T21:50:21.1946451Z 75722010b82e: Pulling fs layer 2024-08-20T21:50:21.1946887Z d527cbbb87e3: Pulling fs layer 2024-08-20T21:50:21.1947314Z b57676e46aee: Pulling fs layer 2024-08-20T21:50:21.1947712Z a8c1e85b5e14: Pulling fs layer 2024-08-20T21:50:21.1948138Z a41a8d1c11c8: Pulling fs layer 2024-08-20T21:50:21.1948546Z 0c1227890755: Pulling fs layer 2024-08-20T21:50:21.1948940Z d8d1234baab3: Pulling fs layer 2024-08-20T21:50:21.1949356Z 7ed32bc8e469: Pulling fs layer 2024-08-20T21:50:21.1949771Z ec1e7978c1fe: Pulling fs layer 2024-08-20T21:50:21.1950152Z d527cbbb87e3: Waiting 2024-08-20T21:50:21.1950522Z ac23c5fcc1ef: Pulling fs layer 2024-08-20T21:50:21.1950942Z ca426ffc9d2b: Pulling fs layer 2024-08-20T21:50:21.1951340Z 4373aa743caf: Pulling fs layer 2024-08-20T21:50:21.1951772Z 75b2abb16c68: Pulling fs layer 2024-08-20T21:50:21.1952151Z b57676e46aee: Waiting 2024-08-20T21:50:21.1952516Z ef1e3ef1e85f: Pulling fs layer 2024-08-20T21:50:21.1952928Z 0bf61114d37b: Pulling fs layer 2024-08-20T21:50:21.1953312Z a8c1e85b5e14: Waiting 2024-08-20T21:50:21.1953675Z 2df849f72ba4: Pulling fs layer 2024-08-20T21:50:21.1954084Z 34c47d63c5de: Pulling fs layer 2024-08-20T21:50:21.1954460Z a41a8d1c11c8: Waiting 2024-08-20T21:50:21.1954824Z 1fef4bd19792: Pulling fs layer 2024-08-20T21:50:21.1955240Z 6efb96fc87ea: Pulling fs layer 2024-08-20T21:50:21.1955633Z b119c4fc6c58: Pulling fs layer 2024-08-20T21:50:21.1956029Z 0c1227890755: Waiting 2024-08-20T21:50:21.1956388Z 33b639226eee: Pulling fs layer 2024-08-20T21:50:21.1956777Z d3547bd43146: Pulling fs layer 2024-08-20T21:50:21.1957199Z 5645520256fa: Pulling fs layer 2024-08-20T21:50:21.1957749Z 829ed7d91e38: Pulling fs layer 2024-08-20T21:50:21.1958134Z d8d1234baab3: Waiting 2024-08-20T21:50:21.1958493Z 385d0421d67c: Pulling fs layer 2024-08-20T21:50:21.1959003Z 7cbfce999d76: Pulling fs layer 2024-08-20T21:50:21.1959402Z 75b2abb16c68: Waiting 2024-08-20T21:50:21.1959730Z 7ed32bc8e469: Waiting 2024-08-20T21:50:21.1960098Z 6658e558ebe4: Pulling fs layer 2024-08-20T21:50:21.1960511Z ef1e3ef1e85f: Waiting 2024-08-20T21:50:21.1960858Z 33444a5a7e01: Pulling fs layer 2024-08-20T21:50:21.1961265Z ca426ffc9d2b: Waiting 2024-08-20T21:50:21.1961630Z 7c47122f4e09: Pulling fs layer 2024-08-20T21:50:21.1962003Z 4373aa743caf: Waiting 2024-08-20T21:50:21.1962350Z ec1e7978c1fe: Waiting 2024-08-20T21:50:21.1962713Z 1811ff4d3556: Pulling fs layer 2024-08-20T21:50:21.1963092Z ac23c5fcc1ef: Waiting 2024-08-20T21:50:21.1963459Z 7754ee068b33: Pulling fs layer 2024-08-20T21:50:21.1963853Z 34c47d63c5de: Waiting 2024-08-20T21:50:21.1964244Z 0479fbac3361: Pulling fs layer 2024-08-20T21:50:21.1964662Z f1d6874dee9c: Pulling fs layer 2024-08-20T21:50:21.1965093Z 0bf61114d37b: Waiting 2024-08-20T21:50:21.1965534Z afc429e87b59: Pulling fs layer 2024-08-20T21:50:21.1965937Z 2df849f72ba4: Waiting 2024-08-20T21:50:21.1966484Z 019620471c25: Pulling fs layer 2024-08-20T21:50:21.1966866Z 6efb96fc87ea: Waiting 2024-08-20T21:50:21.1967217Z 33b639226eee: Waiting 2024-08-20T21:50:21.1967589Z 27aeb1b2cd5e: Pulling fs layer 2024-08-20T21:50:21.1967976Z 829ed7d91e38: Waiting 2024-08-20T21:50:21.1968328Z 7cbfce999d76: Waiting 2024-08-20T21:50:21.1968669Z 33444a5a7e01: Waiting 2024-08-20T21:50:21.1969007Z 829c0e19f4b7: Pulling fs layer 2024-08-20T21:50:21.1969420Z 560cd6122a38: Pulling fs layer 2024-08-20T21:50:21.1969857Z 385d0421d67c: Waiting 2024-08-20T21:50:21.1970189Z 0479fbac3361: Waiting 2024-08-20T21:50:21.1970555Z 5a4eb19d7219: Pulling fs layer 2024-08-20T21:50:21.1970977Z da6a838a66c7: Pulling fs layer 2024-08-20T21:50:21.1971361Z 560cd6122a38: Waiting 2024-08-20T21:50:21.1971703Z 6658e558ebe4: Waiting 2024-08-20T21:50:21.1972067Z 7c47122f4e09: Waiting 2024-08-20T21:50:21.1972423Z cbb79a705353: Pulling fs layer 2024-08-20T21:50:21.1972847Z 4d4fa6802ab3: Pulling fs layer 2024-08-20T21:50:21.1973274Z 0f085d4fa279: Pulling fs layer 2024-08-20T21:50:21.1973669Z 4a0412373305: Pulling fs layer 2024-08-20T21:50:21.1974100Z f1d6874dee9c: Waiting 2024-08-20T21:50:21.1974468Z 302c8c177944: Pulling fs layer 2024-08-20T21:50:21.1974969Z afc429e87b59: Waiting 2024-08-20T21:50:21.1975348Z 02970347dff6: Pulling fs layer 2024-08-20T21:50:21.1975755Z 4a0412373305: Waiting 2024-08-20T21:50:21.1976100Z 916c5e858016: Pulling fs layer 2024-08-20T21:50:21.1976497Z 829c0e19f4b7: Waiting 2024-08-20T21:50:21.1976878Z c42b3602a1fb: Pulling fs layer 2024-08-20T21:50:21.1977287Z 27aeb1b2cd5e: Waiting 2024-08-20T21:50:21.1977646Z 4d4fa6802ab3: Waiting 2024-08-20T21:50:21.1978044Z 11fad972ef6c: Pulling fs layer 2024-08-20T21:50:21.1978464Z f957c1624481: Pulling fs layer 2024-08-20T21:50:21.1978862Z 0f085d4fa279: Waiting 2024-08-20T21:50:21.1979189Z 02970347dff6: Waiting 2024-08-20T21:50:21.1979549Z 768c31dca016: Pulling fs layer 2024-08-20T21:50:21.1979969Z 8c32d0ecebbe: Pulling fs layer 2024-08-20T21:50:21.1980368Z 4f4fb700ef54: Pulling fs layer 2024-08-20T21:50:21.1980785Z 768c31dca016: Waiting 2024-08-20T21:50:21.1981129Z 302c8c177944: Waiting 2024-08-20T21:50:21.1981480Z 78ee77eddef2: Pulling fs layer 2024-08-20T21:50:21.1981907Z 37513e9b43d7: Pulling fs layer 2024-08-20T21:50:21.1982329Z a7a5392e2bf6: Pulling fs layer 2024-08-20T21:50:21.1982734Z b10de02255c0: Pulling fs layer 2024-08-20T21:50:21.1983143Z 37513e9b43d7: Waiting 2024-08-20T21:50:21.1983486Z 11fad972ef6c: Waiting 2024-08-20T21:50:21.1983834Z e56eeff2db93: Pulling fs layer 2024-08-20T21:50:21.1984240Z 8c32d0ecebbe: Waiting 2024-08-20T21:50:21.1984594Z b10de02255c0: Waiting 2024-08-20T21:50:21.1984933Z 70ac3e38d0fd: Pulling fs layer 2024-08-20T21:50:21.1985350Z eb09cbf3e416: Pulling fs layer 2024-08-20T21:50:21.1985894Z ee1273153675: Pulling fs layer 2024-08-20T21:50:21.1986290Z e22979f9e0ee: Pulling fs layer 2024-08-20T21:50:21.1986696Z 78ee77eddef2: Waiting 2024-08-20T21:50:21.1987105Z 6c1f0aabce7c: Pulling fs layer 2024-08-20T21:50:21.1987488Z 70ac3e38d0fd: Waiting 2024-08-20T21:50:21.1987843Z ee1273153675: Waiting 2024-08-20T21:50:21.1988206Z 7ebe49c3a23e: Pulling fs layer 2024-08-20T21:50:21.1988606Z 5d115b29b5d5: Pulling fs layer 2024-08-20T21:50:21.1989002Z eb09cbf3e416: Waiting 2024-08-20T21:50:21.1989362Z e22979f9e0ee: Waiting 2024-08-20T21:50:21.1989739Z 7f2d7a04fbe6: Pulling fs layer 2024-08-20T21:50:21.1990147Z d79fd7d52698: Pulling fs layer 2024-08-20T21:50:21.1990542Z 7f2d7a04fbe6: Waiting 2024-08-20T21:50:21.1990895Z 7ebe49c3a23e: Waiting 2024-08-20T21:50:21.1991260Z 9752d6fbbcab: Pulling fs layer 2024-08-20T21:50:21.1991662Z 6c1f0aabce7c: Waiting 2024-08-20T21:50:21.1991987Z 5d115b29b5d5: Waiting 2024-08-20T21:50:21.1992328Z d79fd7d52698: Waiting 2024-08-20T21:50:21.1992689Z 83808b2eff4d: Pulling fs layer 2024-08-20T21:50:21.1993069Z 9752d6fbbcab: Waiting 2024-08-20T21:50:21.1993410Z 83808b2eff4d: Waiting 2024-08-20T21:50:21.3315132Z 224fe954d725: Verifying Checksum 2024-08-20T21:50:21.3315616Z 224fe954d725: Download complete 2024-08-20T21:50:21.4147856Z d527cbbb87e3: Verifying Checksum 2024-08-20T21:50:21.4148323Z d527cbbb87e3: Download complete 2024-08-20T21:50:21.5192740Z b57676e46aee: Verifying Checksum 2024-08-20T21:50:21.5193175Z b57676e46aee: Download complete 2024-08-20T21:50:21.5401838Z 7a2c55901189: Verifying Checksum 2024-08-20T21:50:21.5402312Z 7a2c55901189: Download complete 2024-08-20T21:50:21.6156367Z a41a8d1c11c8: Verifying Checksum 2024-08-20T21:50:21.6156915Z a41a8d1c11c8: Download complete 2024-08-20T21:50:21.6932760Z 0c1227890755: Download complete 2024-08-20T21:50:21.7708403Z d8d1234baab3: Verifying Checksum 2024-08-20T21:50:21.7708936Z d8d1234baab3: Download complete 2024-08-20T21:50:21.8062489Z 75722010b82e: Verifying Checksum 2024-08-20T21:50:21.8934725Z ec1e7978c1fe: Verifying Checksum 2024-08-20T21:50:21.8935221Z ec1e7978c1fe: Download complete 2024-08-20T21:50:22.0139764Z ac23c5fcc1ef: Verifying Checksum 2024-08-20T21:50:22.0140288Z ac23c5fcc1ef: Download complete 2024-08-20T21:50:22.3209486Z 7a2c55901189: Pull complete 2024-08-20T21:50:22.5234628Z 224fe954d725: Pull complete 2024-08-20T21:50:23.2776481Z 75722010b82e: Pull complete 2024-08-20T21:50:23.2919137Z d527cbbb87e3: Pull complete 2024-08-20T21:50:23.3054183Z b57676e46aee: Pull complete 2024-08-20T21:50:24.5517577Z ca426ffc9d2b: Verifying Checksum 2024-08-20T21:50:24.5518247Z ca426ffc9d2b: Download complete 2024-08-20T21:50:24.6335078Z 4373aa743caf: Download complete 2024-08-20T21:50:24.7067818Z 75b2abb16c68: Download complete 2024-08-20T21:50:24.7749807Z ef1e3ef1e85f: Verifying Checksum 2024-08-20T21:50:24.7751041Z ef1e3ef1e85f: Download complete 2024-08-20T21:50:25.7706377Z 0bf61114d37b: Verifying Checksum 2024-08-20T21:50:25.7706983Z 0bf61114d37b: Download complete 2024-08-20T21:50:25.8903224Z 2df849f72ba4: Verifying Checksum 2024-08-20T21:50:25.8904467Z 2df849f72ba4: Download complete 2024-08-20T21:50:25.9737245Z 34c47d63c5de: Verifying Checksum 2024-08-20T21:50:25.9738402Z 34c47d63c5de: Download complete 2024-08-20T21:50:26.0599833Z 1fef4bd19792: Verifying Checksum 2024-08-20T21:50:26.0600365Z 1fef4bd19792: Download complete 2024-08-20T21:50:34.8618947Z a8c1e85b5e14: Verifying Checksum 2024-08-20T21:50:34.8620136Z a8c1e85b5e14: Download complete 2024-08-20T21:50:34.9567892Z b119c4fc6c58: Download complete 2024-08-20T21:50:35.0283571Z 33b639226eee: Download complete 2024-08-20T21:50:35.1052424Z d3547bd43146: Download complete 2024-08-20T21:50:35.1749016Z 5645520256fa: Download complete 2024-08-20T21:50:35.2381094Z 829ed7d91e38: Verifying Checksum 2024-08-20T21:50:35.2381583Z 829ed7d91e38: Download complete 2024-08-20T21:50:36.5035329Z 385d0421d67c: Verifying Checksum 2024-08-20T21:50:36.5035935Z 385d0421d67c: Download complete 2024-08-20T21:50:36.5936124Z 7cbfce999d76: Verifying Checksum 2024-08-20T21:50:36.5936648Z 7cbfce999d76: Download complete 2024-08-20T21:50:36.7717543Z 6658e558ebe4: Verifying Checksum 2024-08-20T21:50:36.7718061Z 6658e558ebe4: Download complete 2024-08-20T21:50:36.9024856Z 33444a5a7e01: Download complete 2024-08-20T21:50:36.9933945Z 7c47122f4e09: Verifying Checksum 2024-08-20T21:50:36.9934442Z 7c47122f4e09: Download complete 2024-08-20T21:50:37.0760931Z 1811ff4d3556: Download complete 2024-08-20T21:50:43.0746818Z 7754ee068b33: Verifying Checksum 2024-08-20T21:50:43.0747355Z 7754ee068b33: Download complete 2024-08-20T21:50:43.1542981Z 0479fbac3361: Verifying Checksum 2024-08-20T21:50:43.1543889Z 0479fbac3361: Download complete 2024-08-20T21:50:43.2554986Z f1d6874dee9c: Verifying Checksum 2024-08-20T21:50:43.2555830Z f1d6874dee9c: Download complete 2024-08-20T21:50:43.8228141Z afc429e87b59: Verifying Checksum 2024-08-20T21:50:43.8228650Z afc429e87b59: Download complete 2024-08-20T21:50:43.9104271Z 019620471c25: Download complete 2024-08-20T21:50:43.9862032Z 27aeb1b2cd5e: Download complete 2024-08-20T21:50:44.3700738Z 829c0e19f4b7: Verifying Checksum 2024-08-20T21:50:44.3701247Z 829c0e19f4b7: Download complete 2024-08-20T21:50:44.4344584Z 560cd6122a38: Download complete 2024-08-20T21:50:44.5171129Z 5a4eb19d7219: Verifying Checksum 2024-08-20T21:50:44.5171871Z 5a4eb19d7219: Download complete 2024-08-20T21:50:44.6047328Z da6a838a66c7: Download complete 2024-08-20T21:50:46.7743849Z a8c1e85b5e14: Pull complete 2024-08-20T21:50:47.1199844Z 7ed32bc8e469: Verifying Checksum 2024-08-20T21:50:47.1200386Z 7ed32bc8e469: Download complete 2024-08-20T21:50:47.1700272Z a41a8d1c11c8: Pull complete 2024-08-20T21:50:47.2096633Z 4d4fa6802ab3: Verifying Checksum 2024-08-20T21:50:47.2097516Z 4d4fa6802ab3: Download complete 2024-08-20T21:50:47.3041829Z 0f085d4fa279: Verifying Checksum 2024-08-20T21:50:47.3042482Z 0f085d4fa279: Download complete 2024-08-20T21:50:47.5309440Z 0c1227890755: Pull complete 2024-08-20T21:50:47.8192205Z 4a0412373305: Verifying Checksum 2024-08-20T21:50:47.8192743Z 4a0412373305: Download complete 2024-08-20T21:50:47.8840451Z 302c8c177944: Verifying Checksum 2024-08-20T21:50:47.8841631Z 302c8c177944: Download complete 2024-08-20T21:50:47.8885268Z d8d1234baab3: Pull complete 2024-08-20T21:50:47.9858902Z 02970347dff6: Verifying Checksum 2024-08-20T21:50:47.9860051Z 02970347dff6: Download complete 2024-08-20T21:50:48.0676986Z 916c5e858016: Verifying Checksum 2024-08-20T21:50:48.0677514Z 916c5e858016: Download complete 2024-08-20T21:50:48.1423991Z c42b3602a1fb: Download complete 2024-08-20T21:50:54.7652866Z 6efb96fc87ea: Verifying Checksum 2024-08-20T21:50:54.7653608Z 6efb96fc87ea: Download complete 2024-08-20T21:50:54.8452467Z f957c1624481: Verifying Checksum 2024-08-20T21:50:54.8453032Z f957c1624481: Download complete 2024-08-20T21:50:54.9104869Z 768c31dca016: Verifying Checksum 2024-08-20T21:50:54.9105673Z 768c31dca016: Download complete 2024-08-20T21:50:54.9757369Z 8c32d0ecebbe: Download complete 2024-08-20T21:50:55.0509524Z 78ee77eddef2: Download complete 2024-08-20T21:50:55.1177244Z 37513e9b43d7: Download complete 2024-08-20T21:50:55.2607512Z a7a5392e2bf6: Verifying Checksum 2024-08-20T21:50:55.2608096Z a7a5392e2bf6: Download complete 2024-08-20T21:50:55.3371524Z b10de02255c0: Download complete 2024-08-20T21:50:55.4140374Z e56eeff2db93: Download complete 2024-08-20T21:50:55.4819076Z 70ac3e38d0fd: Download complete 2024-08-20T21:50:55.5444197Z eb09cbf3e416: Verifying Checksum 2024-08-20T21:50:55.5444739Z eb09cbf3e416: Download complete 2024-08-20T21:50:55.7173512Z ee1273153675: Verifying Checksum 2024-08-20T21:50:55.7174088Z ee1273153675: Download complete 2024-08-20T21:50:55.7859240Z e22979f9e0ee: Verifying Checksum 2024-08-20T21:50:55.7859774Z e22979f9e0ee: Download complete 2024-08-20T21:50:56.3747117Z 6c1f0aabce7c: Verifying Checksum 2024-08-20T21:50:56.3747649Z 6c1f0aabce7c: Download complete 2024-08-20T21:50:56.4479994Z 7ebe49c3a23e: Download complete 2024-08-20T21:51:10.3150450Z 5d115b29b5d5: Verifying Checksum 2024-08-20T21:51:10.3151027Z 5d115b29b5d5: Download complete 2024-08-20T21:51:10.4355156Z 7f2d7a04fbe6: Verifying Checksum 2024-08-20T21:51:10.4356057Z 7f2d7a04fbe6: Download complete 2024-08-20T21:51:10.5388864Z d79fd7d52698: Verifying Checksum 2024-08-20T21:51:11.0586941Z 9752d6fbbcab: Verifying Checksum 2024-08-20T21:51:11.0588237Z 9752d6fbbcab: Download complete 2024-08-20T21:51:11.1330777Z 83808b2eff4d: Verifying Checksum 2024-08-20T21:51:11.1331392Z 83808b2eff4d: Download complete 2024-08-20T21:51:14.7172810Z 7ed32bc8e469: Pull complete 2024-08-20T21:51:15.1396126Z ec1e7978c1fe: Pull complete 2024-08-20T21:51:15.3726492Z ac23c5fcc1ef: Pull complete 2024-08-20T21:51:22.0646347Z ca426ffc9d2b: Pull complete 2024-08-20T21:51:22.4776993Z 4373aa743caf: Pull complete 2024-08-20T21:51:22.9366952Z 75b2abb16c68: Pull complete 2024-08-20T21:51:23.4121709Z ef1e3ef1e85f: Pull complete 2024-08-20T21:51:25.7539484Z 0bf61114d37b: Pull complete 2024-08-20T21:51:26.2007456Z 2df849f72ba4: Pull complete 2024-08-20T21:51:26.6884858Z 34c47d63c5de: Pull complete 2024-08-20T21:51:27.0842537Z 1fef4bd19792: Pull complete 2024-08-20T21:51:31.5404861Z 11fad972ef6c: Verifying Checksum 2024-08-20T21:51:31.5405432Z 11fad972ef6c: Download complete 2024-08-20T21:51:33.0381687Z cbb79a705353: Verifying Checksum 2024-08-20T21:51:33.0382290Z cbb79a705353: Download complete 2024-08-20T21:52:10.9553076Z 6efb96fc87ea: Pull complete 2024-08-20T21:52:11.4104731Z b119c4fc6c58: Pull complete 2024-08-20T21:52:11.8870175Z 33b639226eee: Pull complete 2024-08-20T21:52:12.3139870Z d3547bd43146: Pull complete 2024-08-20T21:52:12.7761794Z 5645520256fa: Pull complete 2024-08-20T21:52:13.2178524Z 829ed7d91e38: Pull complete 2024-08-20T21:52:16.9052223Z 385d0421d67c: Pull complete 2024-08-20T21:52:17.1919887Z 7cbfce999d76: Pull complete 2024-08-20T21:52:17.4530576Z 6658e558ebe4: Pull complete 2024-08-20T21:52:17.7223568Z 33444a5a7e01: Pull complete 2024-08-20T21:52:18.0798720Z 7c47122f4e09: Pull complete 2024-08-20T21:52:18.5239261Z 1811ff4d3556: Pull complete 2024-08-20T21:52:27.2118332Z 7754ee068b33: Pull complete 2024-08-20T21:52:27.6105194Z 0479fbac3361: Pull complete 2024-08-20T21:52:28.0556186Z f1d6874dee9c: Pull complete 2024-08-20T21:52:29.1586097Z afc429e87b59: Pull complete 2024-08-20T21:52:29.6114541Z 019620471c25: Pull complete 2024-08-20T21:52:30.0784907Z 27aeb1b2cd5e: Pull complete 2024-08-20T21:52:30.7836731Z 829c0e19f4b7: Pull complete 2024-08-20T21:52:31.2465608Z 560cd6122a38: Pull complete 2024-08-20T21:52:32.0881024Z 5a4eb19d7219: Pull complete 2024-08-20T21:52:32.5618906Z da6a838a66c7: Pull complete 2024-08-20T21:53:06.3757319Z cbb79a705353: Pull complete 2024-08-20T21:53:06.8568061Z 4d4fa6802ab3: Pull complete 2024-08-20T21:53:07.2708115Z 0f085d4fa279: Pull complete 2024-08-20T21:53:09.3962154Z 4a0412373305: Pull complete 2024-08-20T21:53:09.7915567Z 302c8c177944: Pull complete 2024-08-20T21:53:10.1326841Z 02970347dff6: Pull complete 2024-08-20T21:53:10.8719956Z 916c5e858016: Pull complete 2024-08-20T21:53:11.2778508Z c42b3602a1fb: Pull complete 2024-08-20T21:54:22.0872817Z 11fad972ef6c: Pull complete 2024-08-20T21:54:22.5019255Z f957c1624481: Pull complete 2024-08-20T21:54:22.9667891Z 768c31dca016: Pull complete 2024-08-20T21:54:23.8965535Z 8c32d0ecebbe: Pull complete 2024-08-20T21:54:24.3173697Z 4f4fb700ef54: Pull complete 2024-08-20T21:54:24.8108597Z 78ee77eddef2: Pull complete 2024-08-20T21:54:25.2952395Z 37513e9b43d7: Pull complete 2024-08-20T21:54:25.8505119Z a7a5392e2bf6: Pull complete 2024-08-20T21:54:26.2663920Z b10de02255c0: Pull complete 2024-08-20T21:54:26.7692518Z e56eeff2db93: Pull complete 2024-08-20T21:54:27.2527971Z 70ac3e38d0fd: Pull complete 2024-08-20T21:54:27.7315914Z eb09cbf3e416: Pull complete 2024-08-20T21:54:29.0318167Z ee1273153675: Pull complete 2024-08-20T21:54:29.5118220Z e22979f9e0ee: Pull complete 2024-08-20T21:54:31.6158384Z 6c1f0aabce7c: Pull complete 2024-08-20T21:54:32.0081974Z 7ebe49c3a23e: Pull complete 2024-08-20T21:54:45.1127607Z 5d115b29b5d5: Pull complete 2024-08-20T21:54:45.5688553Z 7f2d7a04fbe6: Pull complete 2024-08-20T21:54:45.9861021Z d79fd7d52698: Pull complete 2024-08-20T21:54:47.0323310Z 9752d6fbbcab: Pull complete 2024-08-20T21:54:47.4191646Z 83808b2eff4d: Pull complete 2024-08-20T21:54:49.2294921Z Digest: sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T21:54:49.3018385Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:54:49.3293339Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:54:49.3386968Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T21:54:49.3388053Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-20T21:54:49.3397428Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:54:49.3398113Z env: 2024-08-20T21:54:49.3398376Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:54:49.3398737Z ##[endgroup] 2024-08-20T21:54:49.3737169Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2024-08-20T21:54:49.3737722Z with: 2024-08-20T21:54:49.3738009Z driver-version: 550.54.15 2024-08-20T21:54:49.3738583Z env: 2024-08-20T21:54:49.3738835Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:54:49.3739183Z ##[endgroup] 2024-08-20T21:54:49.3800687Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T21:54:49.3801282Z with: 2024-08-20T21:54:49.3801546Z timeout_minutes: 10 2024-08-20T21:54:49.3801881Z max_attempts: 3 2024-08-20T21:54:49.3839148Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils if [[ "${DISTRIBUTION}" == "amzn2023" ]] ; then YUM_REPO_URL="https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo" else # Amazon Linux 2 YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" fi sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x # Install nvidia-driver package if not installed status="$(dpkg-query -W --showformat='${db:Status-Status}' nvidia-docker2 2>&1)" if [ ! $? = 0 ] || [ ! "$status" = installed ]; then sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker fi ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi # NB: Annoyingly, nvidia-smi command returns successfully with return code 0 even in # the case where the driver has already crashed as it still can get the driver version # and some basic information like the bus ID. However, the rest of the information # would be missing (ERR!), for example: # # +-----------------------------------------------------------------------------+ # | NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 | # |-------------------------------+----------------------+----------------------+ # | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | # | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | # | | | MIG M. | # |===============================+======================+======================| # | 0 ERR! Off | 00000000:00:1E.0 Off | ERR! | # |ERR! ERR! ERR! ERR! / ERR! | 4184MiB / 23028MiB | ERR! Default | # | | | ERR! | # +-------------------------------+----------------------+----------------------+ # # +-----------------------------------------------------------------------------+ # | Processes: | # | GPU GI CI PID Type Process name GPU Memory | # | ID ID Usage | # |=============================================================================| # +-----------------------------------------------------------------------------+ # # This should be reported as a failure instead as it will guarantee to fail when # Docker tries to run with --gpus all # # So, the correct check here is to query one of the missing piece of info like # GPU name, so that the command can fail accordingly nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all -e NVIDIA_DRIVER_CAPABILITIES=all" >> "${GITHUB_ENV}" # Fix https://github.com/NVIDIA/nvidia-docker/issues/1648 on runners with # more than one GPUs. This just needs to be run once. The command fails # on subsequent runs and complains that the mode is already on, but that's # ok sudo nvidia-persistenced || true # This should show persistence mode ON nvidia-smi 2024-08-20T21:54:49.3876712Z retry_wait_seconds: 10 2024-08-20T21:54:49.3877073Z polling_interval_seconds: 1 2024-08-20T21:54:49.3877435Z warning_on_retry: true 2024-08-20T21:54:49.3877785Z continue_on_error: false 2024-08-20T21:54:49.3878131Z env: 2024-08-20T21:54:49.3878380Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:54:49.3878741Z DRIVER_VERSION: 550.54.15 2024-08-20T21:54:49.3879092Z ##[endgroup] 2024-08-20T21:54:49.4653607Z == Installing nvidia driver NVIDIA-Linux-x86_64-550.54.15.run == 2024-08-20T21:54:49.4654230Z + pre_install_nvidia_driver_amzn2 2024-08-20T21:54:49.4654798Z + sudo yum remove -y nvidia-driver-latest-dkms 2024-08-20T21:54:49.8903510Z No match for argument: nvidia-driver-latest-dkms 2024-08-20T21:54:49.8904958Z No packages marked for removal. 2024-08-20T21:54:49.8966520Z Dependencies resolved. 2024-08-20T21:54:49.8974262Z Nothing to do. 2024-08-20T21:54:49.8974780Z Complete! 2024-08-20T21:54:50.0154067Z + install_nvidia_driver_common 2024-08-20T21:54:50.0157292Z + echo 'Before installing NVIDIA driver' 2024-08-20T21:54:50.0158244Z + lspci 2024-08-20T21:54:50.0158719Z Before installing NVIDIA driver 2024-08-20T21:54:50.1322291Z 00:00.0 Host bridge: Intel Corporation Sky Lake-E DMI3 Registers (rev 07) 2024-08-20T21:54:50.1325008Z 00:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1326789Z 00:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1327810Z 00:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1328855Z 00:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1329879Z 00:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1330889Z 00:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1331907Z 00:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1333119Z 00:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1334279Z 00:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 07) 2024-08-20T21:54:50.1335420Z 00:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 07) 2024-08-20T21:54:50.1336234Z 00:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 07) 2024-08-20T21:54:50.1337119Z 00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:54:50.1338149Z 00:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:54:50.1339191Z 00:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:54:50.1340367Z 00:11.0 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 0 (rev 09) 2024-08-20T21:54:50.1341444Z 00:11.1 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 1 (rev 09) 2024-08-20T21:54:50.1342604Z 00:11.5 SATA controller: Intel Corporation C620 Series Chipset Family SSATA Controller [AHCI mode] (rev 09) 2024-08-20T21:54:50.1343827Z 00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09) 2024-08-20T21:54:50.1345072Z 00:14.2 Signal processing controller: Intel Corporation C620 Series Chipset Family Thermal Subsystem (rev 09) 2024-08-20T21:54:50.1346314Z 00:16.0 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #1 (rev 09) 2024-08-20T21:54:50.1347545Z 00:16.4 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #3 (rev 09) 2024-08-20T21:54:50.1348785Z 00:17.0 SATA controller: Intel Corporation C620 Series Chipset Family SATA Controller [AHCI mode] (rev 09) 2024-08-20T21:54:50.1349912Z 00:1f.0 ISA bridge: Intel Corporation C621 Series Chipset LPC/eSPI Controller (rev 09) 2024-08-20T21:54:50.1351060Z 00:1f.2 Memory controller: Intel Corporation C620 Series Chipset Family Power Management Controller (rev 09) 2024-08-20T21:54:50.1352139Z 00:1f.4 SMBus: Intel Corporation C620 Series Chipset Family SMBus (rev 09) 2024-08-20T21:54:50.1353268Z 00:1f.5 Serial bus controller [0c80]: Intel Corporation C620 Series Chipset Family SPI Controller (rev 09) 2024-08-20T21:54:50.1354419Z 17:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:54:50.1355432Z 17:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:54:50.1356529Z 17:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:54:50.1357575Z 17:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:54:50.1358702Z 17:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:54:50.1359735Z 17:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1360740Z 17:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1361725Z 17:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1362714Z 17:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1363704Z 17:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1364676Z 17:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1365673Z 17:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1366670Z 17:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1367656Z 17:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1368636Z 17:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1369624Z 17:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1370677Z 17:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1371654Z 17:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1372673Z 17:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1373753Z 17:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1374744Z 17:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1375769Z 17:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1376788Z 17:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1377812Z 17:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1378811Z 17:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1379831Z 17:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1380864Z 17:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1381863Z 17:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1382892Z 17:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1383931Z 17:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1384927Z 17:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1386050Z 17:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1387074Z 17:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1388103Z 17:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1389102Z 17:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1390130Z 17:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1391158Z 17:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1392159Z 17:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1393198Z 17:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1394228Z 17:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1395229Z 17:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1396248Z 17:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1397274Z 17:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1398469Z 17:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1399393Z 17:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1400350Z 17:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1401294Z 17:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1402221Z 17:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1403168Z 17:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1404116Z 17:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1405039Z 17:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1405982Z 17:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1406927Z 17:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1407877Z 17:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1408882Z 17:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1409828Z 17:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1410771Z 17:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1411755Z 17:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1412695Z 17:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1413641Z 17:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1414561Z 17:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1415503Z 17:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1416458Z 17:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1417409Z 17:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1418329Z 17:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1419280Z 17:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1420234Z 17:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1421151Z 17:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1422100Z 17:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1423051Z 17:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1423968Z 17:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1424922Z 17:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1425746Z 18:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:54:50.1426514Z 19:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:54:50.1427406Z 34:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:54:50.1428401Z 34:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:54:50.1429325Z 34:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:54:50.1430305Z 34:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:54:50.1431368Z 34:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:54:50.1432441Z 34:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1433544Z 34:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1434669Z 34:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1435796Z 34:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1437065Z 34:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1438159Z 34:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1439278Z 34:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1440300Z 34:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-08-20T21:54:50.1441218Z 34:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-08-20T21:54:50.1442171Z 34:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-08-20T21:54:50.1443120Z 34:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-08-20T21:54:50.1444071Z 34:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-08-20T21:54:50.1445040Z 34:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-08-20T21:54:50.1445983Z 34:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-08-20T21:54:50.1447021Z 34:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1448186Z 34:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1449304Z 34:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1450431Z 34:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1451551Z 34:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1452552Z 34:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-08-20T21:54:50.1453497Z 34:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-08-20T21:54:50.1454449Z 34:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-08-20T21:54:50.1455375Z 34:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-08-20T21:54:50.1456319Z 34:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-08-20T21:54:50.1457255Z 34:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-08-20T21:54:50.1458183Z 34:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-08-20T21:54:50.1459000Z 35:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:54:50.1459753Z 36:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:54:50.1460635Z 7a:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:54:50.1461618Z 7a:01.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port B (rev 07) 2024-08-20T21:54:50.1462589Z 7a:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:54:50.1463505Z 7a:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:54:50.1464477Z 7a:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:54:50.1465539Z 7a:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:54:50.1466480Z 7a:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:54:50.1467386Z 7a:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:54:50.1468306Z 7a:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:54:50.1469222Z 7a:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:54:50.1470138Z 7a:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:54:50.1471035Z 7a:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:54:50.1472024Z 7a:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1473036Z 7a:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1474009Z 7a:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1475006Z 7a:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1476013Z 7a:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1476985Z 7a:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:54:50.1477979Z 7a:15.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:54:50.1478969Z 7a:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:54:50.1479959Z 7a:16.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:54:50.1480978Z 7a:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:54:50.1481974Z 7a:16.5 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:54:50.1482961Z 7a:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:54:50.1483979Z 7a:17.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:54:50.1484725Z 7b:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1485282Z 7c:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1485906Z 7c:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1486718Z 7c:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1487314Z 7c:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1487886Z 7c:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1488482Z 7c:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1489079Z 7c:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1489649Z 7c:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1490241Z 7c:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1490835Z 7c:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1491409Z 7c:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1491999Z 7c:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1492592Z 7c:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1493163Z 7c:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1493754Z 7c:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1494345Z 7c:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1494934Z 7c:10.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1495501Z 7c:11.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1496093Z 7c:12.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1496682Z 7c:13.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1497248Z 7c:14.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1497942Z 7c:15.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1498493Z 7c:16.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1499021Z 7c:17.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1499562Z 7c:18.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1500107Z 7c:19.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1500623Z 7c:1a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1501177Z 7c:1b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1501725Z 7c:1c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1502243Z 7c:1d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1502794Z 7c:1e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1503344Z 7c:1f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1503871Z 9d:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1504416Z 9e:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1504960Z 9e:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1505479Z 9e:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1506029Z 9e:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1506579Z 9e:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1507099Z 9e:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1507647Z 9e:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1508191Z 9e:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1508707Z 9e:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1509245Z 9e:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1509779Z 9e:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1510289Z 9e:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1510819Z 9e:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1511445Z 9e:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1511992Z 9e:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1512508Z 9e:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1513047Z 9e:10.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1513648Z 9e:11.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1514156Z 9e:12.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1514698Z 9e:13.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1515235Z 9e:14.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1515747Z 9e:15.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1516285Z 9e:16.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1516820Z 9e:17.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1517336Z 9e:18.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1517867Z 9e:19.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1518410Z 9e:1a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1518926Z 9e:1b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1519457Z 9e:1c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1519991Z 9e:1d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1520513Z 9e:1e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1521055Z 9e:1f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1521624Z 9f:00.0 Serial controller: Amazon.com, Inc. Device 8250 2024-08-20T21:54:50.1522387Z a0:00.0 Non-Volatile memory controller: Amazon.com, Inc. Device 0061 2024-08-20T21:54:50.1523228Z bf:00.0 Non-Volatile memory controller: Amazon.com, Inc. Device cd00 2024-08-20T21:54:50.1524071Z bf:00.1 Non-Volatile memory controller: Amazon.com, Inc. Device cd00 2024-08-20T21:54:50.1524959Z c0:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1525934Z c0:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1526902Z c0:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1527864Z c0:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1528812Z c0:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1529775Z c0:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1530734Z c0:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1531672Z c0:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:54:50.1532738Z c0:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 07) 2024-08-20T21:54:50.1533728Z c0:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 07) 2024-08-20T21:54:50.1534474Z c0:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 07) 2024-08-20T21:54:50.1535317Z c0:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:54:50.1536300Z c0:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:54:50.1537285Z c0:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:54:50.1538250Z c2:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:54:50.1539171Z c2:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:54:50.1540174Z c2:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:54:50.1541218Z c2:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:54:50.1542207Z c2:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1543159Z c2:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1544085Z c2:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1545096Z c2:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1546051Z c2:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1547054Z c2:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1547972Z c2:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1548917Z c2:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1549866Z c2:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1550782Z c2:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1551731Z c2:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1552671Z c2:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1553593Z c2:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1554534Z c2:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1555483Z c2:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1556433Z c2:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1557359Z c2:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1558310Z c2:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1559253Z c2:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1560182Z c2:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1561127Z c2:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1562074Z c2:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1563006Z c2:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1563949Z c2:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1564903Z c2:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1565852Z c2:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1566767Z c2:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1567712Z c2:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1568652Z c2:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1569567Z c2:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1570521Z c2:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1571483Z c2:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1572399Z c2:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1573341Z c2:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1574292Z c2:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1575231Z c2:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1576154Z c2:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1577094Z c2:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1578035Z c2:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1578952Z c2:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1579899Z c2:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1580912Z c2:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1581822Z c2:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1582810Z c2:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1583748Z c2:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1584695Z c2:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1585671Z c2:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1586847Z c2:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1587874Z c2:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1588879Z c2:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1589902Z c2:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1590921Z c2:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1591914Z c2:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1592941Z c2:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1593958Z c2:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1594972Z c2:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1595964Z c2:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1596979Z c2:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1597997Z c2:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1599026Z c2:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:54:50.1599963Z c2:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1600904Z c2:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1601822Z c2:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1602765Z c2:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1603707Z c2:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1604646Z c2:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1605563Z c2:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:54:50.1606271Z c3:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1606819Z c4:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1607341Z c4:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1607898Z c4:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1608444Z c4:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1608959Z c4:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1609561Z c4:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1610305Z c4:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1610886Z c4:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1611490Z c4:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1612094Z c4:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1612674Z c4:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1613281Z c4:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1613888Z c4:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1614464Z c4:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1615068Z c4:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1615777Z c4:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:54:50.1616535Z c6:00.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T21:54:50.1617626Z e6:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:54:50.1620470Z e6:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:54:50.1621495Z e6:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:54:50.1622931Z e6:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:54:50.1624415Z e6:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:54:50.1625950Z e6:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1627413Z e6:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1628693Z e6:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1629970Z e6:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1631233Z e6:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1632478Z e6:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1633919Z e6:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1635363Z e6:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-08-20T21:54:50.1636647Z e6:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-08-20T21:54:50.1637984Z e6:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-08-20T21:54:50.1639182Z e6:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-08-20T21:54:50.1640237Z e6:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-08-20T21:54:50.1641366Z e6:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-08-20T21:54:50.1642587Z e6:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-08-20T21:54:50.1643777Z e6:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1645022Z e6:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1646293Z e6:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1647570Z e6:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1648820Z e6:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:54:50.1649973Z e6:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-08-20T21:54:50.1651046Z e6:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-08-20T21:54:50.1652111Z e6:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-08-20T21:54:50.1653169Z e6:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-08-20T21:54:50.1654362Z e6:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-08-20T21:54:50.1655392Z e6:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-08-20T21:54:50.1656406Z e6:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-08-20T21:54:50.1657305Z e7:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:54:50.1658135Z e8:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:54:50.1659103Z f3:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:54:50.1660478Z f3:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:54:50.1661777Z f3:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:54:50.1663167Z f3:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:54:50.1664408Z f3:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:54:50.1665674Z f3:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:54:50.1666722Z f3:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:54:50.1667739Z f3:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:54:50.1668854Z f3:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:54:50.1669864Z f3:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:54:50.1670905Z f3:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:54:50.1672016Z f3:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1673123Z f3:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1674231Z f3:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1675336Z f3:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1676432Z f3:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:54:50.1677654Z f3:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:54:50.1678736Z f3:15.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:54:50.1679804Z f3:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:54:50.1680862Z f3:16.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:54:50.1682166Z f3:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:54:50.1683515Z f3:16.5 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:54:50.1684809Z f3:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:54:50.1686134Z f3:17.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:54:50.1687083Z f4:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:54:50.1687915Z f5:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:54:50.1688557Z + lsmod 2024-08-20T21:54:50.1688895Z Module Size Used by 2024-08-20T21:54:50.1689348Z xt_conntrack 16384 1 2024-08-20T21:54:50.1689793Z nft_chain_nat 16384 3 2024-08-20T21:54:50.1690234Z xt_MASQUERADE 20480 1 2024-08-20T21:54:50.1690744Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T21:54:50.1691322Z nf_conntrack_netlink 57344 0 2024-08-20T21:54:50.1692012Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T21:54:50.1710208Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T21:54:50.1710749Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T21:54:50.1711204Z xfrm_user 57344 1 2024-08-20T21:54:50.1711623Z xfrm_algo 16384 1 xfrm_user 2024-08-20T21:54:50.1712066Z xt_addrtype 16384 2 2024-08-20T21:54:50.1712451Z nft_compat 20480 4 2024-08-20T21:54:50.1712936Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T21:54:50.1713614Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T21:54:50.1714200Z br_netfilter 36864 0 2024-08-20T21:54:50.1714633Z bridge 307200 1 br_netfilter 2024-08-20T21:54:50.1715098Z stp 16384 1 bridge 2024-08-20T21:54:50.1715533Z llc 16384 2 bridge,stp 2024-08-20T21:54:50.1716138Z overlay 167936 0 2024-08-20T21:54:50.1716526Z tls 114688 0 2024-08-20T21:54:50.1716900Z nls_ascii 16384 1 2024-08-20T21:54:50.1717288Z nls_cp437 20480 1 2024-08-20T21:54:50.1717742Z vfat 24576 1 2024-08-20T21:54:50.1718111Z fat 86016 1 vfat 2024-08-20T21:54:50.1718522Z skx_edac 24576 0 2024-08-20T21:54:50.1718919Z x86_pkg_temp_thermal 20480 0 2024-08-20T21:54:50.1719305Z kvm_intel 393216 0 2024-08-20T21:54:50.1719712Z kvm 1155072 1 kvm_intel 2024-08-20T21:54:50.1720160Z irqbypass 16384 1 kvm 2024-08-20T21:54:50.1720568Z ghash_clmulni_intel 16384 0 2024-08-20T21:54:50.1720967Z sunrpc 692224 1 2024-08-20T21:54:50.1721358Z aesni_intel 393216 0 2024-08-20T21:54:50.1721725Z ena 167936 0 2024-08-20T21:54:50.1722106Z lpc_ich 28672 0 2024-08-20T21:54:50.1722498Z ptp 36864 1 ena 2024-08-20T21:54:50.1722930Z crypto_simd 16384 1 aesni_intel 2024-08-20T21:54:50.1723493Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T21:54:50.1724049Z mfd_core 20480 1 lpc_ich 2024-08-20T21:54:50.1724477Z pps_core 24576 1 ptp 2024-08-20T21:54:50.1724888Z ioatdma 69632 0 2024-08-20T21:54:50.1725289Z dca 16384 1 ioatdma 2024-08-20T21:54:50.1725699Z button 24576 0 2024-08-20T21:54:50.1726094Z sch_fq_codel 20480 33 2024-08-20T21:54:50.1726490Z dm_mod 188416 0 2024-08-20T21:54:50.1726855Z fuse 163840 1 2024-08-20T21:54:50.1727232Z loop 36864 0 2024-08-20T21:54:50.1727622Z dax 45056 1 dm_mod 2024-08-20T21:54:50.1728029Z configfs 57344 1 2024-08-20T21:54:50.1728415Z dmi_sysfs 20480 0 2024-08-20T21:54:50.1728805Z crc32_pclmul 16384 0 2024-08-20T21:54:50.1729187Z crc32c_intel 24576 0 2024-08-20T21:54:50.1729569Z + modinfo nvidia 2024-08-20T21:54:50.1730327Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T21:54:50.1731099Z alias: char-major-195-* 2024-08-20T21:54:50.1731508Z version: 550.54.15 2024-08-20T21:54:50.1731867Z supported: external 2024-08-20T21:54:50.1732207Z license: NVIDIA 2024-08-20T21:54:50.1732607Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T21:54:50.1733127Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T21:54:50.1733608Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T21:54:50.1734103Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T21:54:50.1734639Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T21:54:50.1735160Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T21:54:50.1735690Z depends: i2c-core,drm 2024-08-20T21:54:50.1736067Z retpoline: Y 2024-08-20T21:54:50.1736370Z name: nvidia 2024-08-20T21:54:50.1737048Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T21:54:50.1737826Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T21:54:50.1738534Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T21:54:50.1739185Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T21:54:50.1739660Z parm: NVreg_RmLogonRC:int 2024-08-20T21:54:50.1740107Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T21:54:50.1740592Z parm: NVreg_DeviceFileUID:int 2024-08-20T21:54:50.1741059Z parm: NVreg_DeviceFileGID:int 2024-08-20T21:54:50.1741516Z parm: NVreg_DeviceFileMode:int 2024-08-20T21:54:50.1742093Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T21:54:50.1742711Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T21:54:50.1743218Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T21:54:50.1743679Z parm: NVreg_EnableMSI:int 2024-08-20T21:54:50.1744215Z parm: NVreg_TCEBypassMode:int 2024-08-20T21:54:50.1744694Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T21:54:50.1745273Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T21:54:50.1745977Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T21:54:50.1746596Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T21:54:50.1747262Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T21:54:50.1747929Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T21:54:50.1748616Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T21:54:50.1749267Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T21:54:50.1749806Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T21:54:50.1750395Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T21:54:50.1750981Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T21:54:50.1751523Z parm: NVreg_MemoryPoolSize:int 2024-08-20T21:54:50.1752025Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T21:54:50.1752534Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T21:54:50.1753040Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T21:54:50.1753527Z parm: NVreg_NvLinkDisable:int 2024-08-20T21:54:50.1754064Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T21:54:50.1754641Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T21:54:50.1755155Z parm: NVreg_EnableResizableBar:int 2024-08-20T21:54:50.1755667Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T21:54:50.1756207Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T21:54:50.1756738Z parm: NVreg_RegistryDwords:charp 2024-08-20T21:54:50.1757265Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T21:54:50.1757780Z parm: NVreg_RmMsg:charp 2024-08-20T21:54:50.1758210Z parm: NVreg_GpuBlacklist:charp 2024-08-20T21:54:50.1758700Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T21:54:50.1759205Z parm: NVreg_ExcludedGpus:charp 2024-08-20T21:54:50.1759693Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T21:54:50.1760192Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T21:54:50.1760706Z parm: NVreg_ImexChannelCount:int 2024-08-20T21:54:50.1761193Z parm: rm_firmware_active:charp 2024-08-20T21:54:50.1761621Z + HAS_NVIDIA_DRIVER=0 2024-08-20T21:54:50.1762026Z ++ command -v nvidia-smi 2024-08-20T21:54:50.1762448Z + '[' -x /usr/bin/nvidia-smi ']' 2024-08-20T21:54:50.1762815Z + set +e 2024-08-20T21:54:50.1763371Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2024-08-20T21:55:00.0729157Z + INSTALLED_DRIVER_VERSION=550.54.15 2024-08-20T21:55:00.0729695Z + NVIDIA_SMI_STATUS=0 2024-08-20T21:55:00.0730291Z + '[' 0 -ne 0 ']' 2024-08-20T21:55:00.0730691Z + '[' 550.54.15 '!=' 550.54.15 ']' 2024-08-20T21:55:00.0731099Z + HAS_NVIDIA_DRIVER=1 2024-08-20T21:55:00.0731940Z + echo 'NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation' 2024-08-20T21:55:00.0732737Z + set -e 2024-08-20T21:55:00.0733058Z + '[' 1 -eq 0 ']' 2024-08-20T21:55:00.0733676Z NVIDIA driver (550.54.15) has already been installed. Skipping NVIDIA driver installation 2024-08-20T21:55:00.0734462Z + post_install_nvidia_driver_common 2024-08-20T21:55:00.0734897Z + sudo modprobe nvidia 2024-08-20T21:55:00.1654222Z + echo 'After installing NVIDIA driver' 2024-08-20T21:55:00.1655408Z + lspci 2024-08-20T21:55:00.1656165Z After installing NVIDIA driver 2024-08-20T21:55:00.1869862Z 00:00.0 Host bridge: Intel Corporation Sky Lake-E DMI3 Registers (rev 07) 2024-08-20T21:55:00.1872628Z 00:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.1875364Z 00:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.1878049Z 00:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.1880026Z 00:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.1881061Z 00:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.1882189Z 00:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.1883202Z 00:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.1884207Z 00:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.1885350Z 00:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 07) 2024-08-20T21:55:00.1886476Z 00:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 07) 2024-08-20T21:55:00.1887274Z 00:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 07) 2024-08-20T21:55:00.1888164Z 00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:55:00.1889208Z 00:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:55:00.1890249Z 00:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:55:00.1891236Z 00:11.0 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 0 (rev 09) 2024-08-20T21:55:00.1892315Z 00:11.1 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 1 (rev 09) 2024-08-20T21:55:00.1893477Z 00:11.5 SATA controller: Intel Corporation C620 Series Chipset Family SSATA Controller [AHCI mode] (rev 09) 2024-08-20T21:55:00.1894677Z 00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09) 2024-08-20T21:55:00.1895909Z 00:14.2 Signal processing controller: Intel Corporation C620 Series Chipset Family Thermal Subsystem (rev 09) 2024-08-20T21:55:00.1897176Z 00:16.0 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #1 (rev 09) 2024-08-20T21:55:00.1898413Z 00:16.4 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #3 (rev 09) 2024-08-20T21:55:00.1899641Z 00:17.0 SATA controller: Intel Corporation C620 Series Chipset Family SATA Controller [AHCI mode] (rev 09) 2024-08-20T21:55:00.1900771Z 00:1f.0 ISA bridge: Intel Corporation C621 Series Chipset LPC/eSPI Controller (rev 09) 2024-08-20T21:55:00.1901933Z 00:1f.2 Memory controller: Intel Corporation C620 Series Chipset Family Power Management Controller (rev 09) 2024-08-20T21:55:00.1902998Z 00:1f.4 SMBus: Intel Corporation C620 Series Chipset Family SMBus (rev 09) 2024-08-20T21:55:00.1904039Z 00:1f.5 Serial bus controller [0c80]: Intel Corporation C620 Series Chipset Family SPI Controller (rev 09) 2024-08-20T21:55:00.1905231Z 17:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:55:00.1906370Z 17:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:55:00.1907489Z 17:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:55:00.1908624Z 17:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:55:00.1909780Z 17:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:55:00.1910831Z 17:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1911868Z 17:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1912900Z 17:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1913908Z 17:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1914927Z 17:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1915952Z 17:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1916971Z 17:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1918075Z 17:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1919096Z 17:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1920123Z 17:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1921267Z 17:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1922287Z 17:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1923314Z 17:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1924436Z 17:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1925422Z 17:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1926407Z 17:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1927393Z 17:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1928390Z 17:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1929389Z 17:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1930397Z 17:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1931378Z 17:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1932379Z 17:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1933546Z 17:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1934577Z 17:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1935591Z 17:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1936606Z 17:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1937885Z 17:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1938877Z 17:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1939853Z 17:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1940846Z 17:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1941838Z 17:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1942827Z 17:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1943796Z 17:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1944787Z 17:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1945780Z 17:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1946764Z 17:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1947760Z 17:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1948749Z 17:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1949724Z 17:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1950711Z 17:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1951700Z 17:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1952689Z 17:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1953663Z 17:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1954651Z 17:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1955636Z 17:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1956711Z 17:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1957698Z 17:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1958687Z 17:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1959707Z 17:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1960702Z 17:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1961686Z 17:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1962675Z 17:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1963647Z 17:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1964633Z 17:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1965617Z 17:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1966593Z 17:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1967576Z 17:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1968565Z 17:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1969537Z 17:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1970527Z 17:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.1971514Z 17:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.1972500Z 17:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.1973473Z 17:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.1974462Z 17:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.1975453Z 17:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.1976425Z 17:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.1977411Z 17:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.1978269Z 18:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:55:00.1979047Z 19:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:55:00.1980003Z 34:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:55:00.1981034Z 34:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:55:00.1981989Z 34:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:55:00.1983029Z 34:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:55:00.1984147Z 34:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:55:00.1985280Z 34:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.1986804Z 34:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.1988042Z 34:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.1989278Z 34:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.1990505Z 34:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.1991724Z 34:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.1992953Z 34:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.1994237Z 34:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-08-20T21:55:00.1995526Z 34:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-08-20T21:55:00.1996694Z 34:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-08-20T21:55:00.1997780Z 34:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-08-20T21:55:00.1998909Z 34:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-08-20T21:55:00.1999937Z 34:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-08-20T21:55:00.2000998Z 34:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-08-20T21:55:00.2002293Z 34:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2003690Z 34:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2004930Z 34:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2006167Z 34:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2007382Z 34:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2008503Z 34:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-08-20T21:55:00.2009534Z 34:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-08-20T21:55:00.2010569Z 34:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-08-20T21:55:00.2011591Z 34:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-08-20T21:55:00.2012618Z 34:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-08-20T21:55:00.2013653Z 34:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-08-20T21:55:00.2014689Z 34:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-08-20T21:55:00.2015597Z 35:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:55:00.2016407Z 36:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:55:00.2017385Z 7a:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:55:00.2018468Z 7a:01.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port B (rev 07) 2024-08-20T21:55:00.2019530Z 7a:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:55:00.2020509Z 7a:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:55:00.2021580Z 7a:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:55:00.2022738Z 7a:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:55:00.2023765Z 7a:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:55:00.2024760Z 7a:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:55:00.2025761Z 7a:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:55:00.2026765Z 7a:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:55:00.2027747Z 7a:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:55:00.2028755Z 7a:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:55:00.2029818Z 7a:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2030914Z 7a:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2031973Z 7a:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2033053Z 7a:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2034148Z 7a:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2035275Z 7a:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:55:00.2036348Z 7a:15.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:55:00.2037418Z 7a:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:55:00.2040823Z 7a:16.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:55:00.2041898Z 7a:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:55:00.2042972Z 7a:16.5 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:55:00.2044043Z 7a:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:55:00.2045110Z 7a:17.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:55:00.2045905Z 7b:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2046492Z 7c:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2047065Z 7c:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2047644Z 7c:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2048213Z 7c:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2048767Z 7c:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2049345Z 7c:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2049917Z 7c:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2050467Z 7c:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2051034Z 7c:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2051602Z 7c:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2052157Z 7c:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2052730Z 7c:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2053300Z 7c:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2053857Z 7c:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2054433Z 7c:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2055001Z 7c:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2055562Z 7c:10.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2056139Z 7c:11.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2056716Z 7c:12.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2057276Z 7c:13.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2057844Z 7c:14.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2058411Z 7c:15.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2059034Z 7c:16.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2059623Z 7c:17.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2060196Z 7c:18.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2060763Z 7c:19.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2061322Z 7c:1a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2061890Z 7c:1b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2062470Z 7c:1c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2063023Z 7c:1d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2063596Z 7c:1e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2064201Z 7c:1f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2064820Z 9d:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2065388Z 9e:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2065958Z 9e:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2066513Z 9e:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2067082Z 9e:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2067647Z 9e:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2068204Z 9e:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2068769Z 9e:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2069338Z 9e:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2069973Z 9e:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2070543Z 9e:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2071113Z 9e:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2071728Z 9e:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2072297Z 9e:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2072864Z 9e:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2073478Z 9e:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2074053Z 9e:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2074622Z 9e:10.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2075176Z 9e:11.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2075744Z 9e:12.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2076310Z 9e:13.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2076869Z 9e:14.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2077441Z 9e:15.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2078012Z 9e:16.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2078577Z 9e:17.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2079138Z 9e:18.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2079704Z 9e:19.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2080272Z 9e:1a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2080831Z 9e:1b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2081402Z 9e:1c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2081979Z 9e:1d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2082535Z 9e:1e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2083107Z 9e:1f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2083722Z 9f:00.0 Serial controller: Amazon.com, Inc. Device 8250 2024-08-20T21:55:00.2084559Z a0:00.0 Non-Volatile memory controller: Amazon.com, Inc. Device 0061 2024-08-20T21:55:00.2085552Z bf:00.0 Non-Volatile memory controller: Amazon.com, Inc. Device cd00 2024-08-20T21:55:00.2086601Z bf:00.1 Non-Volatile memory controller: Amazon.com, Inc. Device cd00 2024-08-20T21:55:00.2087598Z c0:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.2088660Z c0:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.2089715Z c0:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.2090747Z c0:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.2091793Z c0:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.2092842Z c0:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.2093895Z c0:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.2094933Z c0:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 07) 2024-08-20T21:55:00.2096104Z c0:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 07) 2024-08-20T21:55:00.2097189Z c0:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 07) 2024-08-20T21:55:00.2098183Z c0:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 07) 2024-08-20T21:55:00.2099068Z c0:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:55:00.2100104Z c0:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:55:00.2101121Z c0:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 07) 2024-08-20T21:55:00.2102153Z c2:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:55:00.2103116Z c2:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:55:00.2104167Z c2:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:55:00.2105383Z c2:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:55:00.2106418Z c2:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2107498Z c2:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2108484Z c2:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2109478Z c2:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2110472Z c2:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2111454Z c2:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2112448Z c2:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2113443Z c2:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2114444Z c2:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2115424Z c2:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2116412Z c2:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2117403Z c2:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2118373Z c2:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2119360Z c2:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2120347Z c2:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2121320Z c2:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2122303Z c2:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2123300Z c2:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2124290Z c2:0a.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2125267Z c2:0a.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2126263Z c2:0a.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2127256Z c2:0a.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2128234Z c2:0a.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2129227Z c2:0a.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2130220Z c2:0b.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2131196Z c2:0b.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2132183Z c2:0b.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2133184Z c2:0b.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2134172Z c2:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2135151Z c2:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2136144Z c2:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2137132Z c2:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2138110Z c2:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2139106Z c2:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2140099Z c2:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2141078Z c2:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2142136Z c2:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2143133Z c2:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2144121Z c2:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2145147Z c2:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2146136Z c2:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2147123Z c2:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2148097Z c2:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2149085Z c2:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2150072Z c2:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2151045Z c2:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2152043Z c2:10.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2153053Z c2:10.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2154069Z c2:10.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2155068Z c2:10.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2156077Z c2:10.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2157083Z c2:10.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2158074Z c2:11.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2159088Z c2:11.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2160104Z c2:11.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2161097Z c2:11.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2162113Z c2:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2163133Z c2:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2164168Z c2:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2165158Z c2:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 07) 2024-08-20T21:55:00.2166172Z c2:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.2167188Z c2:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.2168178Z c2:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.2169196Z c2:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.2170211Z c2:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.2171212Z c2:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.2172227Z c2:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 07) 2024-08-20T21:55:00.2173007Z c3:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2173616Z c4:00.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2174189Z c4:01.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2174783Z c4:02.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2175369Z c4:03.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2175928Z c4:04.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2176514Z c4:05.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2177098Z c4:06.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2177656Z c4:07.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2178237Z c4:08.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2178880Z c4:09.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2179439Z c4:0a.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2180031Z c4:0b.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2180622Z c4:0c.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2181281Z c4:0d.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2181874Z c4:0e.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2182460Z c4:0f.0 PCI bridge: Amazon.com, Inc. Device bec2 2024-08-20T21:55:00.2183188Z c6:00.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2024-08-20T21:55:00.2184238Z e6:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:55:00.2185303Z e6:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:55:00.2186527Z e6:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:55:00.2187623Z e6:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:55:00.2188810Z e6:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:55:00.2190012Z e6:08.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2191260Z e6:09.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2192526Z e6:0a.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2193792Z e6:0a.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2195032Z e6:0a.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2196296Z e6:0a.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2197559Z e6:0a.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2198790Z e6:0a.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-08-20T21:55:00.2199792Z e6:0a.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-08-20T21:55:00.2200830Z e6:0a.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-08-20T21:55:00.2201874Z e6:0b.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-08-20T21:55:00.2202881Z e6:0b.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-08-20T21:55:00.2203899Z e6:0b.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-08-20T21:55:00.2204932Z e6:0b.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-08-20T21:55:00.2206043Z e6:0c.0 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2207266Z e6:0c.1 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2208493Z e6:0c.2 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2209717Z e6:0c.3 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2210924Z e6:0c.4 System peripheral: Intel Corporation Sky Lake-E Integrated Memory Controller (rev 07) 2024-08-20T21:55:00.2212040Z e6:0c.5 System peripheral: Intel Corporation Sky Lake-E LM Channel 1 (rev 07) 2024-08-20T21:55:00.2213074Z e6:0c.6 System peripheral: Intel Corporation Sky Lake-E LMS Channel 1 (rev 07) 2024-08-20T21:55:00.2214085Z e6:0c.7 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 1 (rev 07) 2024-08-20T21:55:00.2215119Z e6:0d.0 System peripheral: Intel Corporation Sky Lake-E DECS Channel 2 (rev 07) 2024-08-20T21:55:00.2216148Z e6:0d.1 System peripheral: Intel Corporation Sky Lake-E LM Channel 2 (rev 07) 2024-08-20T21:55:00.2217170Z e6:0d.2 System peripheral: Intel Corporation Sky Lake-E LMS Channel 2 (rev 07) 2024-08-20T21:55:00.2218271Z e6:0d.3 System peripheral: Intel Corporation Sky Lake-E LMDP Channel 2 (rev 07) 2024-08-20T21:55:00.2219164Z e7:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:55:00.2219989Z e8:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:55:00.2221025Z f3:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 07) 2024-08-20T21:55:00.2222094Z f3:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 07) 2024-08-20T21:55:00.2223089Z f3:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 07) 2024-08-20T21:55:00.2224148Z f3:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 07) 2024-08-20T21:55:00.2225300Z f3:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 07) 2024-08-20T21:55:00.2226328Z f3:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:55:00.2227338Z f3:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:55:00.2228325Z f3:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:55:00.2229329Z f3:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:55:00.2230329Z f3:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 07) 2024-08-20T21:55:00.2231302Z f3:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 07) 2024-08-20T21:55:00.2232363Z f3:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2233456Z f3:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2234502Z f3:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2235573Z f3:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2236654Z f3:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 07) 2024-08-20T21:55:00.2237734Z f3:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:55:00.2238795Z f3:15.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:55:00.2239860Z f3:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:55:00.2240950Z f3:16.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:55:00.2241999Z f3:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:55:00.2243061Z f3:16.5 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:55:00.2244127Z f3:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 07) 2024-08-20T21:55:00.2245185Z f3:17.1 Performance counters: Intel Corporation Sky Lake-E DDRIO Registers (rev 07) 2024-08-20T21:55:00.2246097Z f4:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:55:00.2246917Z f5:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) 2024-08-20T21:55:00.2247538Z + lsmod 2024-08-20T21:55:00.2247837Z Module Size Used by 2024-08-20T21:55:00.2248291Z nvidia_uvm 4706304 0 2024-08-20T21:55:00.2248735Z nvidia 54071296 1 nvidia_uvm 2024-08-20T21:55:00.2249201Z drm 602112 1 nvidia 2024-08-20T21:55:00.2249697Z drm_panel_orientation_quirks 28672 1 drm 2024-08-20T21:55:00.2250206Z backlight 24576 1 drm 2024-08-20T21:55:00.2250650Z i2c_core 106496 2 nvidia,drm 2024-08-20T21:55:00.2251133Z xt_conntrack 16384 1 2024-08-20T21:55:00.2251560Z nft_chain_nat 16384 3 2024-08-20T21:55:00.2251961Z xt_MASQUERADE 20480 1 2024-08-20T21:55:00.2252472Z nf_nat 57344 2 nft_chain_nat,xt_MASQUERADE 2024-08-20T21:55:00.2253027Z nf_conntrack_netlink 57344 0 2024-08-20T21:55:00.2253673Z nf_conntrack 184320 4 xt_conntrack,nf_nat,nf_conntrack_netlink,xt_MASQUERADE 2024-08-20T21:55:00.2254484Z nf_defrag_ipv6 24576 1 nf_conntrack 2024-08-20T21:55:00.2255022Z nf_defrag_ipv4 16384 1 nf_conntrack 2024-08-20T21:55:00.2255488Z xfrm_user 57344 1 2024-08-20T21:55:00.2255931Z xfrm_algo 16384 1 xfrm_user 2024-08-20T21:55:00.2256467Z xt_addrtype 16384 2 2024-08-20T21:55:00.2256866Z nft_compat 20480 4 2024-08-20T21:55:00.2257377Z nf_tables 307200 57 nft_compat,nft_chain_nat 2024-08-20T21:55:00.2258076Z nfnetlink 20480 4 nft_compat,nf_conntrack_netlink,nf_tables 2024-08-20T21:55:00.2258674Z br_netfilter 36864 0 2024-08-20T21:55:00.2259130Z bridge 307200 1 br_netfilter 2024-08-20T21:55:00.2259634Z stp 16384 1 bridge 2024-08-20T21:55:00.2260080Z llc 16384 2 bridge,stp 2024-08-20T21:55:00.2260551Z overlay 167936 0 2024-08-20T21:55:00.2260962Z tls 114688 0 2024-08-20T21:55:00.2261348Z nls_ascii 16384 1 2024-08-20T21:55:00.2261767Z nls_cp437 20480 1 2024-08-20T21:55:00.2262182Z vfat 24576 1 2024-08-20T21:55:00.2262567Z fat 86016 1 vfat 2024-08-20T21:55:00.2263005Z skx_edac 24576 0 2024-08-20T21:55:00.2263429Z x86_pkg_temp_thermal 20480 0 2024-08-20T21:55:00.2263831Z kvm_intel 393216 0 2024-08-20T21:55:00.2264264Z kvm 1155072 1 kvm_intel 2024-08-20T21:55:00.2264745Z irqbypass 16384 1 kvm 2024-08-20T21:55:00.2265170Z ghash_clmulni_intel 16384 0 2024-08-20T21:55:00.2265591Z sunrpc 692224 1 2024-08-20T21:55:00.2266003Z aesni_intel 393216 0 2024-08-20T21:55:00.2266385Z ena 167936 0 2024-08-20T21:55:00.2266784Z lpc_ich 28672 0 2024-08-20T21:55:00.2267196Z ptp 36864 1 ena 2024-08-20T21:55:00.2267640Z crypto_simd 16384 1 aesni_intel 2024-08-20T21:55:00.2268234Z cryptd 28672 2 crypto_simd,ghash_clmulni_intel 2024-08-20T21:55:00.2268811Z mfd_core 20480 1 lpc_ich 2024-08-20T21:55:00.2269252Z pps_core 24576 1 ptp 2024-08-20T21:55:00.2269694Z ioatdma 69632 0 2024-08-20T21:55:00.2270118Z dca 16384 1 ioatdma 2024-08-20T21:55:00.2270547Z button 24576 0 2024-08-20T21:55:00.2270967Z sch_fq_codel 20480 33 2024-08-20T21:55:00.2271389Z dm_mod 188416 0 2024-08-20T21:55:00.2271772Z fuse 163840 1 2024-08-20T21:55:00.2272173Z loop 36864 0 2024-08-20T21:55:00.2272590Z dax 45056 1 dm_mod 2024-08-20T21:55:00.2273015Z configfs 57344 1 2024-08-20T21:55:00.2273421Z dmi_sysfs 20480 0 2024-08-20T21:55:00.2273834Z crc32_pclmul 16384 0 2024-08-20T21:55:00.2274225Z crc32c_intel 24576 0 2024-08-20T21:55:00.2274630Z + modinfo nvidia 2024-08-20T21:55:00.2275372Z filename: /lib/modules/6.1.94-99.176.amzn2023.x86_64/kernel/drivers/video/nvidia.ko 2024-08-20T21:55:00.2276160Z alias: char-major-195-* 2024-08-20T21:55:00.2276598Z version: 550.54.15 2024-08-20T21:55:00.2276992Z supported: external 2024-08-20T21:55:00.2277356Z license: NVIDIA 2024-08-20T21:55:00.2277773Z firmware: nvidia/550.54.15/gsp_tu10x.bin 2024-08-20T21:55:00.2278325Z firmware: nvidia/550.54.15/gsp_ga10x.bin 2024-08-20T21:55:00.2278818Z srcversion: 833721318DA517F0C2FEC97 2024-08-20T21:55:00.2279351Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2024-08-20T21:55:00.2279918Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2024-08-20T21:55:00.2280451Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2024-08-20T21:55:00.2281006Z depends: i2c-core,drm 2024-08-20T21:55:00.2281405Z retpoline: Y 2024-08-20T21:55:00.2281722Z name: nvidia 2024-08-20T21:55:00.2282423Z vermagic: 6.1.94-99.176.amzn2023.x86_64 SMP preempt mod_unload modversions 2024-08-20T21:55:00.2283314Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2024-08-20T21:55:00.2284038Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2024-08-20T21:55:00.2284718Z parm: NVreg_ResmanDebugLevel:int 2024-08-20T21:55:00.2285276Z parm: NVreg_RmLogonRC:int 2024-08-20T21:55:00.2285778Z parm: NVreg_ModifyDeviceFiles:int 2024-08-20T21:55:00.2286486Z parm: NVreg_DeviceFileUID:int 2024-08-20T21:55:00.2286995Z parm: NVreg_DeviceFileGID:int 2024-08-20T21:55:00.2287504Z parm: NVreg_DeviceFileMode:int 2024-08-20T21:55:00.2288101Z parm: NVreg_InitializeSystemMemoryAllocations:int 2024-08-20T21:55:00.2288772Z parm: NVreg_UsePageAttributeTable:int 2024-08-20T21:55:00.2289332Z parm: NVreg_EnablePCIeGen3:int 2024-08-20T21:55:00.2289814Z parm: NVreg_EnableMSI:int 2024-08-20T21:55:00.2290294Z parm: NVreg_TCEBypassMode:int 2024-08-20T21:55:00.2290829Z parm: NVreg_EnableStreamMemOPs:int 2024-08-20T21:55:00.2291437Z parm: NVreg_RestrictProfilingToAdminUsers:int 2024-08-20T21:55:00.2292130Z parm: NVreg_PreserveVideoMemoryAllocations:int 2024-08-20T21:55:00.2292795Z parm: NVreg_EnableS0ixPowerManagement:int 2024-08-20T21:55:00.2293503Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2024-08-20T21:55:00.2294218Z parm: NVreg_DynamicPowerManagement:int 2024-08-20T21:55:00.2294946Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2024-08-20T21:55:00.2295627Z parm: NVreg_EnableGpuFirmware:int 2024-08-20T21:55:00.2296197Z parm: NVreg_EnableGpuFirmwareLogs:int 2024-08-20T21:55:00.2296831Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2024-08-20T21:55:00.2297459Z parm: NVreg_EnableUserNUMAManagement:int 2024-08-20T21:55:00.2298141Z parm: NVreg_MemoryPoolSize:int 2024-08-20T21:55:00.2298670Z parm: NVreg_KMallocHeapMaxSize:int 2024-08-20T21:55:00.2299194Z parm: NVreg_VMallocHeapMaxSize:int 2024-08-20T21:55:00.2299741Z parm: NVreg_IgnoreMMIOCheck:int 2024-08-20T21:55:00.2300247Z parm: NVreg_NvLinkDisable:int 2024-08-20T21:55:00.2300797Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2024-08-20T21:55:00.2301403Z parm: NVreg_RegisterPCIDriver:int 2024-08-20T21:55:00.2301945Z parm: NVreg_EnableResizableBar:int 2024-08-20T21:55:00.2302479Z parm: NVreg_EnableDbgBreakpoint:int 2024-08-20T21:55:00.2303046Z parm: NVreg_EnableNonblockingOpen:int 2024-08-20T21:55:00.2303600Z parm: NVreg_RegistryDwords:charp 2024-08-20T21:55:00.2304146Z parm: NVreg_RegistryDwordsPerDevice:charp 2024-08-20T21:55:00.2304690Z parm: NVreg_RmMsg:charp 2024-08-20T21:55:00.2305156Z parm: NVreg_GpuBlacklist:charp 2024-08-20T21:55:00.2305659Z parm: NVreg_TemporaryFilePath:charp 2024-08-20T21:55:00.2306198Z parm: NVreg_ExcludedGpus:charp 2024-08-20T21:55:00.2306717Z parm: NVreg_DmaRemapPeerMmio:int 2024-08-20T21:55:00.2307272Z parm: NVreg_RmNvlinkBandwidth:charp 2024-08-20T21:55:00.2307791Z parm: NVreg_ImexChannelCount:int 2024-08-20T21:55:00.2308309Z parm: rm_firmware_active:charp 2024-08-20T21:55:00.2308767Z + set +e 2024-08-20T21:55:00.2309088Z + nvidia-smi 2024-08-20T21:55:05.8326935Z Tue Aug 20 21:55:05 2024 2024-08-20T21:55:05.8328955Z +-----------------------------------------------------------------------------------------+ 2024-08-20T21:55:05.8329947Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T21:55:05.8330874Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.8331819Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T21:55:05.8332927Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T21:55:05.8333868Z | | | MIG M. | 2024-08-20T21:55:05.8334463Z |=========================================+========================+======================| 2024-08-20T21:55:05.8431083Z | 0 Tesla T4 Off | 00000000:18:00.0 Off | 0 | 2024-08-20T21:55:05.8433631Z | N/A 36C P0 24W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:55:05.8435494Z | | | N/A | 2024-08-20T21:55:05.8437594Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.8522166Z | 1 Tesla T4 Off | 00000000:19:00.0 Off | 0 | 2024-08-20T21:55:05.8524328Z | N/A 35C P0 25W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:55:05.8525841Z | | | N/A | 2024-08-20T21:55:05.8526759Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.8610963Z | 2 Tesla T4 Off | 00000000:35:00.0 Off | 0 | 2024-08-20T21:55:05.8611982Z | N/A 37C P0 26W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:55:05.8612718Z | | | N/A | 2024-08-20T21:55:05.8613561Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.8707639Z | 3 Tesla T4 Off | 00000000:36:00.0 Off | 0 | 2024-08-20T21:55:05.8708475Z | N/A 35C P0 25W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:55:05.8709227Z | | | N/A | 2024-08-20T21:55:05.8710076Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.8798272Z | 4 Tesla T4 Off | 00000000:E7:00.0 Off | 0 | 2024-08-20T21:55:05.8799690Z | N/A 36C P0 26W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:55:05.8800431Z | | | N/A | 2024-08-20T21:55:05.8801287Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.8890329Z | 5 Tesla T4 Off | 00000000:E8:00.0 Off | 0 | 2024-08-20T21:55:05.8892486Z | N/A 36C P0 26W / 70W | 0MiB / 15360MiB | 7% Default | 2024-08-20T21:55:05.8894387Z | | | N/A | 2024-08-20T21:55:05.8896323Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.8979481Z | 6 Tesla T4 Off | 00000000:F4:00.0 Off | 0 | 2024-08-20T21:55:05.8980512Z | N/A 35C P0 26W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:55:05.8981273Z | | | N/A | 2024-08-20T21:55:05.8982125Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.9081148Z | 7 Tesla T4 Off | 00000000:F5:00.0 Off | 0 | 2024-08-20T21:55:05.9083324Z | N/A 35C P0 25W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:55:05.9085228Z | | | N/A | 2024-08-20T21:55:05.9087478Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:55:05.9090605Z 2024-08-20T21:55:05.9091417Z +-----------------------------------------------------------------------------------------+ 2024-08-20T21:55:05.9092237Z | Processes: | 2024-08-20T21:55:05.9093045Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T21:55:05.9093847Z | ID ID Usage | 2024-08-20T21:55:05.9094502Z |=========================================================================================| 2024-08-20T21:55:05.9125320Z | No running processes found | 2024-08-20T21:55:05.9126617Z +-----------------------------------------------------------------------------------------+ 2024-08-20T21:55:10.2324250Z + nvidia-smi --query-gpu=gpu_name --format=csv,noheader --id=0 2024-08-20T21:55:15.8328951Z Tesla T4 2024-08-20T21:55:19.4087130Z + NVIDIA_SMI_STATUS=0 2024-08-20T21:55:19.4087987Z + '[' 0 -eq 0 ']' 2024-08-20T21:55:19.4088459Z + echo 'INFO: Ignoring allowed status 0' 2024-08-20T21:55:19.4088940Z + set -e 2024-08-20T21:55:19.4089272Z INFO: Ignoring allowed status 0 2024-08-20T21:55:19.4092189Z == Installing nvidia container toolkit for amzn2023 == 2024-08-20T21:55:19.4095576Z + sudo yum install -y yum-utils 2024-08-20T21:55:19.9064669Z Last metadata expiration check: 0:21:27 ago on Tue Aug 20 21:33:52 2024. 2024-08-20T21:55:19.9302555Z Package dnf-utils-4.3.0-13.amzn2023.0.4.noarch is already installed. 2024-08-20T21:55:19.9638513Z Dependencies resolved. 2024-08-20T21:55:19.9789017Z Nothing to do. 2024-08-20T21:55:19.9789608Z Complete! 2024-08-20T21:55:20.0914274Z + [[ amzn2023 == \a\m\z\n\2\0\2\3 ]] 2024-08-20T21:55:20.0917031Z + YUM_REPO_URL=https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T21:55:20.0921134Z + sudo yum-config-manager --add-repo https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T21:55:20.3606276Z Adding repo from: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo 2024-08-20T21:55:20.4270216Z + sudo yum install -y nvidia-docker2 2024-08-20T21:55:20.9110565Z nvidia-container-toolkit 11 kB/s | 833 B 00:00 2024-08-20T21:55:20.9362834Z Package nvidia-docker2-2.14.0-1.noarch is already installed. 2024-08-20T21:55:20.9692180Z Dependencies resolved. 2024-08-20T21:55:20.9841158Z Nothing to do. 2024-08-20T21:55:20.9842109Z Complete! 2024-08-20T21:55:21.1329697Z + sudo systemctl restart docker 2024-08-20T21:56:49.8845771Z Tue Aug 20 21:56:49 2024 2024-08-20T21:56:49.8846953Z +-----------------------------------------------------------------------------------------+ 2024-08-20T21:56:49.8848004Z | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | 2024-08-20T21:56:49.8848988Z |-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.8849958Z | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | 2024-08-20T21:56:49.8851076Z | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | 2024-08-20T21:56:49.8851889Z | | | MIG M. | 2024-08-20T21:56:49.8852531Z |=========================================+========================+======================| 2024-08-20T21:56:49.9016576Z | 0 Tesla T4 On | 00000000:18:00.0 Off | 0 | 2024-08-20T21:56:49.9017454Z | N/A 32C P8 9W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:56:49.9018215Z | | | N/A | 2024-08-20T21:56:49.9019373Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.9109684Z | 1 Tesla T4 On | 00000000:19:00.0 Off | 0 | 2024-08-20T21:56:49.9111890Z | N/A 32C P0 25W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:56:49.9114250Z | | | N/A | 2024-08-20T21:56:49.9115955Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.9205753Z | 2 Tesla T4 On | 00000000:35:00.0 Off | 0 | 2024-08-20T21:56:49.9206633Z | N/A 33C P0 25W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:56:49.9207396Z | | | N/A | 2024-08-20T21:56:49.9208235Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.9295918Z | 3 Tesla T4 On | 00000000:36:00.0 Off | 0 | 2024-08-20T21:56:49.9297122Z | N/A 32C P0 25W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:56:49.9297900Z | | | N/A | 2024-08-20T21:56:49.9298738Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.9388452Z | 4 Tesla T4 On | 00000000:E7:00.0 Off | 0 | 2024-08-20T21:56:49.9390649Z | N/A 32C P0 25W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:56:49.9392558Z | | | N/A | 2024-08-20T21:56:49.9394698Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.9484310Z | 5 Tesla T4 On | 00000000:E8:00.0 Off | 0 | 2024-08-20T21:56:49.9485294Z | N/A 33C P0 26W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:56:49.9486153Z | | | N/A | 2024-08-20T21:56:49.9487171Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.9593098Z | 6 Tesla T4 On | 00000000:F4:00.0 Off | 0 | 2024-08-20T21:56:49.9594028Z | N/A 31C P0 25W / 70W | 0MiB / 15360MiB | 0% Default | 2024-08-20T21:56:49.9594762Z | | | N/A | 2024-08-20T21:56:49.9595593Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.9670273Z | 7 Tesla T4 On | 00000000:F5:00.0 Off | 0 | 2024-08-20T21:56:49.9672442Z | N/A 31C P0 24W / 70W | 0MiB / 15360MiB | 8% Default | 2024-08-20T21:56:49.9674304Z | | | N/A | 2024-08-20T21:56:49.9676449Z +-----------------------------------------+------------------------+----------------------+ 2024-08-20T21:56:49.9683811Z 2024-08-20T21:56:49.9685993Z +-----------------------------------------------------------------------------------------+ 2024-08-20T21:56:49.9687867Z | Processes: | 2024-08-20T21:56:49.9689953Z | GPU GI CI PID Type Process name GPU Memory | 2024-08-20T21:56:49.9691959Z | ID ID Usage | 2024-08-20T21:56:49.9692909Z |=========================================================================================| 2024-08-20T21:56:49.9775160Z | No running processes found | 2024-08-20T21:56:49.9776180Z +-----------------------------------------------------------------------------------------+ 2024-08-20T21:56:51.5833513Z Command completed after 1 attempt(s). 2024-08-20T21:56:51.5920381Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T21:56:51.5921188Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-20T21:56:51.5921921Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-08-20T21:56:51.5922617Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-08-20T21:56:51.5933684Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:56:51.5934181Z env: 2024-08-20T21:56:51.5934464Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:56:51.5934933Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:56:51.5935416Z ##[endgroup] 2024-08-20T21:56:51.9181012Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T21:56:52.3072644Z Collecting psutil==5.9.1 2024-08-20T21:56:52.3459699Z Downloading psutil-5.9.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 kB) 2024-08-20T21:56:52.3932695Z Collecting nvidia-ml-py==11.525.84 2024-08-20T21:56:52.3975925Z Downloading nvidia_ml_py-11.525.84-py3-none-any.whl (34 kB) 2024-08-20T21:56:52.4907606Z Installing collected packages: psutil, nvidia-ml-py 2024-08-20T21:56:52.6473666Z Successfully installed nvidia-ml-py-11.525.84 psutil-5.9.1 2024-08-20T21:56:52.8312332Z Prepare all required actions 2024-08-20T21:56:52.8312841Z Getting action download info 2024-08-20T21:56:52.9920705Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-08-20T21:56:53.1635247Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-20T21:56:53.3003234Z ##[group]Run ./.github/actions/download-build-artifacts 2024-08-20T21:56:53.3003867Z with: 2024-08-20T21:56:53.3004203Z name: linux-focal-cuda12.1-py3.10-gcc9-sm75 2024-08-20T21:56:53.3004702Z s3-bucket: gha-artifacts 2024-08-20T21:56:53.3005049Z env: 2024-08-20T21:56:53.3005310Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:56:53.3005782Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:56:53.3006291Z ##[endgroup] 2024-08-20T21:56:53.3041671Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T21:56:53.3042129Z with: 2024-08-20T21:56:53.3042559Z name: linux-focal-cuda12.1-py3.10-gcc9-sm75 2024-08-20T21:56:53.3043202Z s3-bucket: gha-artifacts 2024-08-20T21:56:53.3043596Z region: us-east-1 2024-08-20T21:56:53.3043930Z env: 2024-08-20T21:56:53.3044206Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:56:53.3044702Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:56:53.3045245Z ##[endgroup] 2024-08-20T21:56:53.7578255Z (node:60321) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T21:56:53.7579254Z 2024-08-20T21:56:53.7579586Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T21:56:53.7580399Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T21:56:53.7581419Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T21:56:53.8212180Z Found 1 objects with prefix pytorch/pytorch/10479309237/linux-focal-cuda12.1-py3.10-gcc9-sm75/ 2024-08-20T21:56:53.8213507Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T21:57:15.3827098Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-20T21:57:15.3832974Z Artifact download has finished successfully 2024-08-20T21:57:15.4034106Z ##[group]Run unzip -o artifacts.zip 2024-08-20T21:57:15.4034730Z unzip -o artifacts.zip 2024-08-20T21:57:15.4040683Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:15.4041253Z env: 2024-08-20T21:57:15.4041560Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:15.4042177Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:15.4042725Z ##[endgroup] 2024-08-20T21:57:15.4120560Z Archive: artifacts.zip 2024-08-20T21:57:15.4121009Z creating: dist/ 2024-08-20T21:57:17.2521994Z inflating: dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T21:57:17.2522816Z creating: build/custom_test_artifacts/ 2024-08-20T21:57:17.2523532Z creating: build/custom_test_artifacts/custom-op-build/ 2024-08-20T21:57:17.2527086Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-08-20T21:57:17.2528130Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-08-20T21:57:17.2529365Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T21:57:17.2530494Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-08-20T21:57:17.2531633Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T21:57:17.2532833Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T21:57:17.2533970Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T21:57:17.2535302Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T21:57:17.2536904Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T21:57:17.2538112Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T21:57:17.2539282Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T21:57:17.2540692Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T21:57:17.2542103Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T21:57:17.2543466Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T21:57:17.2544860Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T21:57:17.2546277Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T21:57:17.2547697Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T21:57:17.2548928Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T21:57:17.2550139Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T21:57:17.2584953Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T21:57:17.2623851Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T21:57:17.2625632Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T21:57:17.2668224Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T21:57:17.2670002Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T21:57:17.2671767Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T21:57:17.2673546Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T21:57:17.2675277Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T21:57:17.2676968Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T21:57:17.2678876Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T21:57:17.2680558Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T21:57:17.2682216Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T21:57:17.2683780Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T21:57:17.2685285Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T21:57:17.2686806Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T21:57:17.2688317Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T21:57:17.2689771Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T21:57:17.2691218Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T21:57:17.2739063Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T21:57:17.2801184Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T21:57:17.2802673Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T21:57:17.2803861Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-08-20T21:57:17.2804917Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2024-08-20T21:57:17.2806032Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-08-20T21:57:17.2807145Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-08-20T21:57:17.2808359Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-08-20T21:57:17.2809768Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-08-20T21:57:17.2811103Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-08-20T21:57:17.2812336Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-08-20T21:57:17.2813637Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-08-20T21:57:17.2814935Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-08-20T21:57:17.2816239Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-08-20T21:57:17.2817520Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-08-20T21:57:17.2818808Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-08-20T21:57:17.2827349Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-08-20T21:57:17.2974704Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-08-20T21:57:17.2975920Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-08-20T21:57:17.2977257Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-08-20T21:57:17.2978732Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-08-20T21:57:17.2980110Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-08-20T21:57:17.2981608Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-08-20T21:57:17.2982979Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-08-20T21:57:17.2984363Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-08-20T21:57:17.2985783Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-08-20T21:57:17.2987162Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-08-20T21:57:17.2988522Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-08-20T21:57:17.2999225Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-08-20T21:57:17.3081867Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-08-20T21:57:17.3083351Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T21:57:17.3084667Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-08-20T21:57:17.3086086Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-08-20T21:57:17.3087187Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-08-20T21:57:17.3088268Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-08-20T21:57:17.3089356Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2024-08-20T21:57:17.3090333Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-08-20T21:57:17.3091262Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-08-20T21:57:17.3092227Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-08-20T21:57:17.3207671Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-08-20T21:57:17.3269308Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-08-20T21:57:17.3270214Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-08-20T21:57:17.3271056Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-08-20T21:57:17.3272011Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-08-20T21:57:17.3276375Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T21:57:17.3277484Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-08-20T21:57:17.3278579Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T21:57:17.3279754Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T21:57:17.3280901Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T21:57:17.3282207Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T21:57:17.3283502Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T21:57:17.3284689Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T21:57:17.3285919Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T21:57:17.3287301Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T21:57:17.3288656Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T21:57:17.3290017Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T21:57:17.3291546Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T21:57:17.3292908Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T21:57:17.3294300Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T21:57:17.3295537Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T21:57:17.3296724Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T21:57:17.3330944Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T21:57:17.3369772Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T21:57:17.3371564Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T21:57:17.3415620Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T21:57:17.3417340Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T21:57:17.3419265Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T21:57:17.3421069Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T21:57:17.3422799Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T21:57:17.3424453Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T21:57:17.3426148Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T21:57:17.3427836Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T21:57:17.3429475Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T21:57:17.3430997Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T21:57:17.3432494Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T21:57:17.3433965Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T21:57:17.3435534Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T21:57:17.3436910Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T21:57:17.3438334Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T21:57:17.3485565Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T21:57:17.3545643Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T21:57:17.3547111Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T21:57:17.3548308Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-08-20T21:57:17.3549342Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2024-08-20T21:57:17.3550393Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-08-20T21:57:17.3551722Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-08-20T21:57:17.3553002Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-08-20T21:57:17.3554421Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-08-20T21:57:17.3555813Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-08-20T21:57:17.3557112Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-08-20T21:57:17.3558462Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-08-20T21:57:17.3559782Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-08-20T21:57:17.3561122Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-08-20T21:57:17.3562465Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-08-20T21:57:17.3563797Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-08-20T21:57:17.3571488Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-08-20T21:57:17.3637728Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-08-20T21:57:17.3639204Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T21:57:17.3640515Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-08-20T21:57:17.3641661Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-08-20T21:57:17.3642736Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-08-20T21:57:17.3643820Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-08-20T21:57:17.3644876Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2024-08-20T21:57:17.3645884Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-08-20T21:57:17.3646802Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-08-20T21:57:17.3647728Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-08-20T21:57:17.3696097Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-08-20T21:57:17.3697031Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-08-20T21:57:17.3697952Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-08-20T21:57:17.3698995Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-08-20T21:57:17.3703215Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-20T21:57:17.3704420Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-08-20T21:57:17.3705628Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-20T21:57:17.3706872Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-20T21:57:17.3708119Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-20T21:57:17.3709518Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-20T21:57:17.3710907Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-20T21:57:17.3712174Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-20T21:57:17.3713433Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-20T21:57:17.3715065Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-20T21:57:17.3716518Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-20T21:57:17.3717963Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-20T21:57:17.3719416Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-20T21:57:17.3720894Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-20T21:57:17.3722353Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-20T21:57:17.3723674Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/ 2024-08-20T21:57:17.3724954Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/ 2024-08-20T21:57:17.3757454Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2024-08-20T21:57:17.3798121Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2024-08-20T21:57:17.3800161Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2024-08-20T21:57:17.3842482Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2024-08-20T21:57:17.3844330Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2024-08-20T21:57:17.3846156Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2024-08-20T21:57:17.3848043Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2024-08-20T21:57:17.3849831Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2024-08-20T21:57:17.3851611Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2024-08-20T21:57:17.3853369Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2024-08-20T21:57:17.3855137Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2024-08-20T21:57:17.3856854Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2024-08-20T21:57:17.3858481Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2024-08-20T21:57:17.3860017Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.reg.c 2024-08-20T21:57:17.3861550Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin 2024-08-20T21:57:17.3863111Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2024-08-20T21:57:17.3864601Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/tmp/a_dlink.o 2024-08-20T21:57:17.3866134Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/CMakeCUDACompilerId.cu 2024-08-20T21:57:17.3914539Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCUDA/a.out 2024-08-20T21:57:17.3976142Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CUDA.bin 2024-08-20T21:57:17.3977846Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCUDACompiler.cmake 2024-08-20T21:57:17.3979085Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-08-20T21:57:17.3980166Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2024-08-20T21:57:17.3981308Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-08-20T21:57:17.3982475Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-08-20T21:57:17.3983810Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-08-20T21:57:17.3985305Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-08-20T21:57:17.3986829Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-08-20T21:57:17.3988170Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-08-20T21:57:17.3989575Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-08-20T21:57:17.3991066Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-08-20T21:57:17.3992477Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-08-20T21:57:17.3993865Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-08-20T21:57:17.3995255Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-08-20T21:57:17.3996735Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-08-20T21:57:17.4113131Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-08-20T21:57:17.4114551Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-08-20T21:57:17.4115973Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-08-20T21:57:17.4117547Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-08-20T21:57:17.4119039Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-08-20T21:57:17.4120462Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-08-20T21:57:17.4121938Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-08-20T21:57:17.4123428Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-08-20T21:57:17.4124895Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-08-20T21:57:17.4126363Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-08-20T21:57:17.4127908Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-08-20T21:57:17.4137093Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-08-20T21:57:17.4191588Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-08-20T21:57:17.4193170Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-20T21:57:17.4194709Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-08-20T21:57:17.4195926Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-08-20T21:57:17.4197051Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-08-20T21:57:17.4198179Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-08-20T21:57:17.4199305Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2024-08-20T21:57:17.4200345Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-08-20T21:57:17.4201315Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-08-20T21:57:17.4202311Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-08-20T21:57:17.4305556Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-08-20T21:57:17.4348116Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-08-20T21:57:17.4348865Z creating: build/lib/ 2024-08-20T21:57:17.4357400Z inflating: build/lib/libpthreadpool.a 2024-08-20T21:57:17.4365521Z inflating: build/lib/libcpuinfo_internals.a 2024-08-20T21:57:17.4373868Z inflating: build/lib/libcpuinfo.a 2024-08-20T21:57:17.4462496Z inflating: build/lib/libprotobuf-lite.a 2024-08-20T21:57:17.4463243Z inflating: build/lib/libclog.a 2024-08-20T21:57:17.4464112Z inflating: build/lib/libnnpack_reference_layers.a 2024-08-20T21:57:17.4909287Z inflating: build/lib/libprotobuf.a 2024-08-20T21:57:17.4972794Z inflating: build/lib/libgtest.a 2024-08-20T21:57:17.5046722Z inflating: build/lib/libbenchmark.a 2024-08-20T21:57:17.5065522Z inflating: build/lib/libnnpack.a 2024-08-20T21:57:17.5072034Z inflating: build/lib/libittnotify.a 2024-08-20T21:57:17.5137492Z inflating: build/lib/libasmjit.a 2024-08-20T21:57:17.5166086Z inflating: build/lib/libtensorpipe_uv.a 2024-08-20T21:57:17.5289977Z inflating: build/lib/libgloo.a 2024-08-20T21:57:17.5311600Z inflating: build/lib/libfmt.a 2024-08-20T21:57:17.5312175Z inflating: build/lib/libcaffe2_nvrtc.so 2024-08-20T21:57:17.5407736Z inflating: build/lib/libc10.so 2024-08-20T21:57:17.5408308Z inflating: build/lib/libtorch_global_deps.so 2024-08-20T21:57:17.5428824Z inflating: build/lib/libpytorch_qnnpack.a 2024-08-20T21:57:17.5921812Z inflating: build/lib/libprotoc.a 2024-08-20T21:57:17.5940902Z inflating: build/lib/libgmock.a 2024-08-20T21:57:17.5941434Z inflating: build/lib/libgtest_main.a 2024-08-20T21:57:17.5941986Z inflating: build/lib/libbenchmark_main.a 2024-08-20T21:57:18.5586685Z inflating: build/lib/libdnnl.a 2024-08-20T21:57:18.6137327Z inflating: build/lib/libtensorpipe.a 2024-08-20T21:57:18.6194725Z inflating: build/lib/libc10_cuda.so 2024-08-20T21:57:18.7383285Z inflating: build/lib/libfbgemm.a 2024-08-20T21:57:18.7383841Z inflating: build/lib/libgmock_main.a 2024-08-20T21:57:18.7876402Z inflating: build/lib/libkineto.a 2024-08-20T21:57:18.8121950Z inflating: build/lib/libtensorpipe_cuda.a 2024-08-20T21:57:18.8487535Z inflating: build/lib/libgloo_cuda.a 2024-08-20T21:57:18.8668929Z inflating: build/lib/libXNNPACK.a 2024-08-20T21:57:18.8710801Z inflating: build/lib/libonnx_proto.a 2024-08-20T21:57:18.9382414Z inflating: build/lib/libonnx.a 2024-08-20T21:57:21.2947347Z inflating: build/lib/libtorch_cpu.so 2024-08-20T21:57:21.2950304Z inflating: build/lib/libshm.so 2024-08-20T21:57:21.2955112Z inflating: build/lib/libunbox_lib.a 2024-08-20T21:57:22.9076812Z inflating: build/lib/libtorch_cuda.so 2024-08-20T21:57:22.9077386Z inflating: build/lib/libtorch.so 2024-08-20T21:57:22.9079350Z inflating: build/lib/libc10d_cuda_test.so 2024-08-20T21:57:23.7088616Z inflating: build/lib/libtorch_cuda_linalg.so 2024-08-20T21:57:23.7110227Z inflating: build/lib/libjitbackend_test.so 2024-08-20T21:57:23.7180843Z inflating: build/lib/libtorchbind_test.so 2024-08-20T21:57:23.7207220Z inflating: build/lib/libbackend_with_compiler.so 2024-08-20T21:57:23.7233799Z inflating: build/lib/libaoti_custom_ops.so 2024-08-20T21:57:23.9164544Z inflating: build/lib/libtorch_python.so 2024-08-20T21:57:23.9200007Z inflating: build/lib/libnnapi_backend.so 2024-08-20T21:57:23.9200576Z creating: build/bin/ 2024-08-20T21:57:23.9250949Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-08-20T21:57:23.9302660Z inflating: build/bin/c10_DeviceGuard_test 2024-08-20T21:57:23.9353926Z inflating: build/bin/c10_Device_test 2024-08-20T21:57:23.9413257Z inflating: build/bin/c10_DispatchKeySet_test 2024-08-20T21:57:23.9466787Z inflating: build/bin/c10_Scalar_test 2024-08-20T21:57:23.9516345Z inflating: build/bin/c10_StreamGuard_test 2024-08-20T21:57:23.9567867Z inflating: build/bin/c10_SymInt_test 2024-08-20T21:57:23.9623645Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-08-20T21:57:23.9679567Z inflating: build/bin/c10_InlineStreamGuard_test 2024-08-20T21:57:23.9736390Z inflating: build/bin/c10_SizesAndStrides_test 2024-08-20T21:57:23.9808352Z inflating: build/bin/c10_cow_test 2024-08-20T21:57:23.9861111Z inflating: build/bin/c10_Bitset_test 2024-08-20T21:57:23.9910716Z inflating: build/bin/c10_ConstexprCrc_test 2024-08-20T21:57:23.9961357Z inflating: build/bin/c10_DeadlockDetection_test 2024-08-20T21:57:24.0012469Z inflating: build/bin/c10_Half_test 2024-08-20T21:57:24.0068802Z inflating: build/bin/c10_LeftRight_test 2024-08-20T21:57:24.0124187Z inflating: build/bin/c10_Metaprogramming_test 2024-08-20T21:57:24.0174441Z inflating: build/bin/c10_Synchronized_test 2024-08-20T21:57:24.0230911Z inflating: build/bin/c10_ThreadLocal_test 2024-08-20T21:57:24.0282617Z inflating: build/bin/c10_TypeIndex_test 2024-08-20T21:57:24.0334346Z inflating: build/bin/c10_TypeList_test 2024-08-20T21:57:24.0383647Z inflating: build/bin/c10_TypeTraits_test 2024-08-20T21:57:24.0436009Z inflating: build/bin/c10_accumulate_test 2024-08-20T21:57:24.0491042Z inflating: build/bin/c10_bfloat16_test 2024-08-20T21:57:24.0542746Z inflating: build/bin/c10_bit_cast_test 2024-08-20T21:57:24.0599659Z inflating: build/bin/c10_complex_math_test 2024-08-20T21:57:24.0655938Z inflating: build/bin/c10_complex_test 2024-08-20T21:57:24.0708972Z inflating: build/bin/c10_exception_test 2024-08-20T21:57:24.0759697Z inflating: build/bin/c10_flags_test 2024-08-20T21:57:24.0810364Z inflating: build/bin/c10_generic_math_test 2024-08-20T21:57:24.0970111Z inflating: build/bin/c10_intrusive_ptr_test 2024-08-20T21:57:24.1021229Z inflating: build/bin/c10_irange_test 2024-08-20T21:57:24.1074999Z inflating: build/bin/c10_lazy_test 2024-08-20T21:57:24.1132922Z inflating: build/bin/c10_logging_test 2024-08-20T21:57:24.1208257Z inflating: build/bin/c10_optional_test 2024-08-20T21:57:24.1270700Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-08-20T21:57:24.1326437Z inflating: build/bin/c10_registry_test 2024-08-20T21:57:24.1473047Z inflating: build/bin/c10_small_vector_test 2024-08-20T21:57:24.1526054Z inflating: build/bin/c10_ssize_test 2024-08-20T21:57:24.1578284Z inflating: build/bin/c10_string_util_test 2024-08-20T21:57:24.1637514Z inflating: build/bin/c10_string_view_test 2024-08-20T21:57:24.1688262Z inflating: build/bin/c10_tempfile_test 2024-08-20T21:57:24.1744535Z inflating: build/bin/c10_typeid_test 2024-08-20T21:57:24.1793195Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-08-20T21:57:24.2237596Z inflating: build/bin/protoc-3.13.0.0 2024-08-20T21:57:24.2675322Z inflating: build/bin/protoc 2024-08-20T21:57:24.2728771Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2024-08-20T21:57:24.2781809Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2024-08-20T21:57:24.2835101Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2024-08-20T21:57:24.2887315Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2024-08-20T21:57:24.2937114Z inflating: build/bin/c10_cuda_CUDATest 2024-08-20T21:57:24.2990905Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2024-08-20T21:57:24.3044273Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2024-08-20T21:57:24.3096143Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2024-08-20T21:57:24.3431111Z inflating: build/bin/vec_test_all_types_AVX512 2024-08-20T21:57:24.3751181Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-08-20T21:57:24.4097242Z inflating: build/bin/vec_test_all_types_AVX2 2024-08-20T21:57:24.4150128Z inflating: build/bin/FileStoreTest 2024-08-20T21:57:24.4206167Z inflating: build/bin/TCPStoreTest 2024-08-20T21:57:24.4258548Z inflating: build/bin/BackoffTest 2024-08-20T21:57:24.4312362Z inflating: build/bin/HashStoreTest 2024-08-20T21:57:24.4326511Z inflating: build/bin/ProcessGroupMPITest 2024-08-20T21:57:24.4329451Z inflating: build/bin/torch_shm_manager 2024-08-20T21:57:24.4384009Z inflating: build/bin/test_edge_op_registration 2024-08-20T21:57:24.4385647Z inflating: build/bin/example_allreduce 2024-08-20T21:57:24.4439509Z inflating: build/bin/Dimname_test 2024-08-20T21:57:24.4513135Z inflating: build/bin/Dict_test 2024-08-20T21:57:24.4576865Z inflating: build/bin/MaybeOwned_test 2024-08-20T21:57:24.4633797Z inflating: build/bin/NamedTensor_test 2024-08-20T21:57:24.4692383Z inflating: build/bin/apply_utils_test 2024-08-20T21:57:24.4751030Z inflating: build/bin/atest 2024-08-20T21:57:24.4813764Z inflating: build/bin/basic 2024-08-20T21:57:24.4869556Z inflating: build/bin/broadcast_test 2024-08-20T21:57:24.4921179Z inflating: build/bin/cpu_allocator_test 2024-08-20T21:57:24.4979052Z inflating: build/bin/cpu_generator_test 2024-08-20T21:57:24.5032744Z inflating: build/bin/cpu_profiling_allocator_test 2024-08-20T21:57:24.5124221Z inflating: build/bin/cpu_rng_test 2024-08-20T21:57:24.5174303Z inflating: build/bin/dlconvertor_test 2024-08-20T21:57:24.5224740Z inflating: build/bin/dispatch_key_set_test 2024-08-20T21:57:24.5282423Z inflating: build/bin/extension_backend_test 2024-08-20T21:57:24.5337324Z inflating: build/bin/half_test 2024-08-20T21:57:24.5431840Z inflating: build/bin/ivalue_test 2024-08-20T21:57:24.5481468Z inflating: build/bin/lazy_tensor_test 2024-08-20T21:57:24.5535468Z inflating: build/bin/memory_format_test 2024-08-20T21:57:24.5590714Z inflating: build/bin/math_kernel_test 2024-08-20T21:57:24.5644070Z inflating: build/bin/memory_overlapping_test 2024-08-20T21:57:24.5697036Z inflating: build/bin/mobile_memory_cleanup 2024-08-20T21:57:24.5748588Z inflating: build/bin/operator_name_test 2024-08-20T21:57:24.5804616Z inflating: build/bin/native_test 2024-08-20T21:57:24.5855797Z inflating: build/bin/operators_test 2024-08-20T21:57:24.5908358Z inflating: build/bin/packedtensoraccessor_test 2024-08-20T21:57:24.5975720Z inflating: build/bin/pow_test 2024-08-20T21:57:24.6027651Z inflating: build/bin/reportMemoryUsage_test 2024-08-20T21:57:24.6084398Z inflating: build/bin/quantized_test 2024-08-20T21:57:24.6134835Z inflating: build/bin/reduce_ops_test 2024-08-20T21:57:24.6191065Z inflating: build/bin/scalar_tensor_test 2024-08-20T21:57:24.6249228Z inflating: build/bin/scalar_test 2024-08-20T21:57:24.6300956Z inflating: build/bin/StorageUtils_test 2024-08-20T21:57:24.6353202Z inflating: build/bin/stride_properties_test 2024-08-20T21:57:24.6431425Z inflating: build/bin/tensor_iterator_test 2024-08-20T21:57:24.6485323Z inflating: build/bin/test_parallel 2024-08-20T21:57:24.6541334Z inflating: build/bin/type_ptr_test 2024-08-20T21:57:24.6543031Z inflating: build/bin/thread_init_test 2024-08-20T21:57:24.6604714Z inflating: build/bin/type_test 2024-08-20T21:57:24.6656821Z inflating: build/bin/undefined_tensor_test 2024-08-20T21:57:24.6657580Z inflating: build/bin/verify_api_visibility 2024-08-20T21:57:24.6727569Z inflating: build/bin/legacy_vmap_test 2024-08-20T21:57:24.6778808Z inflating: build/bin/weakref_test 2024-08-20T21:57:24.6830079Z inflating: build/bin/wrapdim_test 2024-08-20T21:57:24.6882244Z inflating: build/bin/xla_tensor_test 2024-08-20T21:57:24.6986900Z inflating: build/bin/List_test 2024-08-20T21:57:24.7046648Z inflating: build/bin/IListRef_test 2024-08-20T21:57:24.7165976Z inflating: build/bin/kernel_function_legacy_test 2024-08-20T21:57:24.7231645Z inflating: build/bin/KernelFunction_test 2024-08-20T21:57:24.7326562Z inflating: build/bin/kernel_function_test 2024-08-20T21:57:24.7451606Z inflating: build/bin/kernel_lambda_legacy_test 2024-08-20T21:57:24.7553165Z inflating: build/bin/kernel_lambda_test 2024-08-20T21:57:24.7613972Z inflating: build/bin/kernel_stackbased_test 2024-08-20T21:57:24.7664643Z inflating: build/bin/CppSignature_test 2024-08-20T21:57:24.7761956Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-08-20T21:57:24.7810764Z inflating: build/bin/op_allowlist_test 2024-08-20T21:57:24.7866037Z inflating: build/bin/backend_fallback_test 2024-08-20T21:57:24.8158663Z inflating: build/bin/op_registration_test 2024-08-20T21:57:24.8221732Z inflating: build/bin/inline_container_test 2024-08-20T21:57:24.8275436Z inflating: build/bin/cuda_apply_test 2024-08-20T21:57:24.8327309Z inflating: build/bin/cuda_allocator_test 2024-08-20T21:57:24.8381507Z inflating: build/bin/cuda_caching_host_allocator_test 2024-08-20T21:57:24.8440225Z inflating: build/bin/cuda_atomic_ops_test 2024-08-20T21:57:24.8509448Z inflating: build/bin/cuda_complex_math_test 2024-08-20T21:57:24.8558960Z inflating: build/bin/cuda_device_test 2024-08-20T21:57:24.8617668Z inflating: build/bin/cuda_complex_test 2024-08-20T21:57:24.8674590Z inflating: build/bin/cuda_cub_test 2024-08-20T21:57:24.8725872Z inflating: build/bin/cuda_dlconvertor_test 2024-08-20T21:57:24.8776741Z inflating: build/bin/cuda_integer_divider_test 2024-08-20T21:57:24.8841420Z inflating: build/bin/cuda_distributions_test 2024-08-20T21:57:24.8898930Z inflating: build/bin/cuda_generator_test 2024-08-20T21:57:24.8948389Z inflating: build/bin/cuda_half_test 2024-08-20T21:57:24.8999735Z inflating: build/bin/cuda_optional_test 2024-08-20T21:57:24.9048441Z inflating: build/bin/cuda_allocatorTraceTracker_test 2024-08-20T21:57:24.9100842Z inflating: build/bin/cuda_reportMemoryUsage_test 2024-08-20T21:57:24.9160890Z inflating: build/bin/cuda_stream_test 2024-08-20T21:57:24.9213234Z inflating: build/bin/cuda_packedtensoraccessor_test 2024-08-20T21:57:24.9262206Z inflating: build/bin/cuda_cudnn_test 2024-08-20T21:57:24.9315290Z inflating: build/bin/cuda_vectorized_test 2024-08-20T21:57:24.9330280Z inflating: build/bin/tutorial_tensorexpr 2024-08-20T21:57:24.9394750Z inflating: build/bin/ProcessGroupGlooTest 2024-08-20T21:57:24.9452649Z inflating: build/bin/ProcessGroupGlooAsyncTest 2024-08-20T21:57:24.9516850Z inflating: build/bin/ProcessGroupNCCLTest 2024-08-20T21:57:24.9578482Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2024-08-20T21:57:24.9633522Z inflating: build/bin/test_dist_autograd 2024-08-20T21:57:24.9634754Z inflating: build/bin/parallel_benchmark 2024-08-20T21:57:24.9705288Z inflating: build/bin/test_cpp_rpc 2024-08-20T21:57:24.9713159Z inflating: build/bin/aot_model_compiler_test 2024-08-20T21:57:24.9780625Z inflating: build/bin/test_mobile_nnc 2024-08-20T21:57:25.0114552Z inflating: build/bin/test_lazy 2024-08-20T21:57:25.0920485Z inflating: build/bin/test_tensorexpr 2024-08-20T21:57:25.2070369Z inflating: build/bin/test_api 2024-08-20T21:57:25.2635384Z inflating: build/bin/test_jit 2024-08-20T21:57:25.2635890Z creating: .additional_ci_files/ 2024-08-20T21:57:25.2695286Z inflating: .additional_ci_files/test-times.json 2024-08-20T21:57:25.2928296Z inflating: .additional_ci_files/test-class-times.json 2024-08-20T21:57:25.2961176Z ##[group]Run rm artifacts.zip 2024-08-20T21:57:25.2961568Z rm artifacts.zip 2024-08-20T21:57:25.2967412Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:25.2967943Z env: 2024-08-20T21:57:25.2968205Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:25.2968677Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:25.2969194Z ##[endgroup] 2024-08-20T21:57:25.3572489Z ##[group]Run df -H 2024-08-20T21:57:25.3572816Z df -H 2024-08-20T21:57:25.3577553Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:25.3578069Z env: 2024-08-20T21:57:25.3578347Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:25.3578820Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:25.3579323Z ##[endgroup] 2024-08-20T21:57:25.3618706Z Filesystem Size Used Avail Use% Mounted on 2024-08-20T21:57:25.3619647Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-08-20T21:57:25.3620234Z tmpfs 203G 0 203G 0% /dev/shm 2024-08-20T21:57:25.3620907Z tmpfs 82G 11M 82G 1% /run 2024-08-20T21:57:25.3621407Z /dev/nvme0n1p1 161G 52G 110G 33% / 2024-08-20T21:57:25.3622088Z tmpfs 203G 4.1k 203G 1% /tmp 2024-08-20T21:57:25.3622605Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-08-20T21:57:25.3623159Z tmpfs 41G 0 41G 0% /run/user/0 2024-08-20T21:57:25.3666753Z Prepare all required actions 2024-08-20T21:57:25.3667252Z Getting action download info 2024-08-20T21:57:25.5293431Z ##[group]Run ./.github/actions/download-td-artifacts 2024-08-20T21:57:25.5293947Z with: 2024-08-20T21:57:25.5294231Z env: 2024-08-20T21:57:25.5294546Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:25.5295045Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:25.5295603Z ##[endgroup] 2024-08-20T21:57:25.5332320Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-20T21:57:25.5332824Z with: 2024-08-20T21:57:25.5333094Z name: td_results 2024-08-20T21:57:25.5333448Z s3-bucket: gha-artifacts 2024-08-20T21:57:25.5333836Z region: us-east-1 2024-08-20T21:57:25.5334145Z env: 2024-08-20T21:57:25.5334438Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:25.5334932Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:25.5335444Z ##[endgroup] 2024-08-20T21:57:25.9834904Z (node:60350) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-20T21:57:25.9835741Z 2024-08-20T21:57:25.9836030Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-20T21:57:25.9836876Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-20T21:57:25.9837890Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-20T21:57:26.0615237Z Found 1 objects with prefix pytorch/pytorch/10479309237/td_results/ 2024-08-20T21:57:26.0616437Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-08-20T21:57:26.1151501Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-08-20T21:57:26.1157009Z Artifact download has finished successfully 2024-08-20T21:57:26.1321765Z ##[group]Run mkdir -p .additional_ci_files 2024-08-20T21:57:26.1322316Z mkdir -p .additional_ci_files 2024-08-20T21:57:26.1322971Z mv td_results.json .additional_ci_files/td_results.json 2024-08-20T21:57:26.1329005Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:26.1329578Z env: 2024-08-20T21:57:26.1329898Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:26.1330386Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:26.1330944Z ##[endgroup] 2024-08-20T21:57:26.1439946Z ##[group]Run .github/scripts/parse_ref.py 2024-08-20T21:57:26.1440425Z .github/scripts/parse_ref.py 2024-08-20T21:57:26.1445194Z shell: /usr/bin/bash -e {0} 2024-08-20T21:57:26.1445522Z env: 2024-08-20T21:57:26.1445781Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:26.1446230Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:26.1446702Z ##[endgroup] 2024-08-20T21:57:26.1717049Z Prepare all required actions 2024-08-20T21:57:26.1758641Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-08-20T21:57:26.1759088Z with: 2024-08-20T21:57:26.1759660Z github-token: *** 2024-08-20T21:57:26.1759951Z env: 2024-08-20T21:57:26.1760195Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:26.1760636Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:26.1761115Z ##[endgroup] 2024-08-20T21:57:26.1778663Z ##[group]Run set -eux 2024-08-20T21:57:26.1778985Z set -eux 2024-08-20T21:57:26.1779574Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-08-20T21:57:26.1784564Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:26.1785047Z env: 2024-08-20T21:57:26.1785309Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:26.1785976Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:26.1786756Z GITHUB_TOKEN: *** 2024-08-20T21:57:26.1787080Z ##[endgroup] 2024-08-20T21:57:26.1808289Z + python3 .github/scripts/get_workflow_job_id.py 10479309237 i-08ae0a5bf17e62139 2024-08-20T21:57:28.4851351Z setting job-id=29025840824 2024-08-20T21:57:28.4852388Z setting job-name=cuda12.1-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-08-20T21:57:28.5118212Z Prepare all required actions 2024-08-20T21:57:28.5118679Z Getting action download info 2024-08-20T21:57:28.6835735Z ##[group]Run ./.github/actions/filter-test-configs 2024-08-20T21:57:28.6836294Z with: 2024-08-20T21:57:28.6836821Z github-token: *** 2024-08-20T21:57:28.6837776Z test-matrix: {"include": [{"config": "pr_time_benchmarks", "shard": 1, "num_shards": 1, "runner": "linux.g4dn.metal.nvidia.gpu"}]} 2024-08-20T21:57:28.6839047Z job-name: cuda12.1-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-08-20T21:57:28.6839833Z env: 2024-08-20T21:57:28.6840124Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:28.6840619Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:28.6841157Z ##[endgroup] 2024-08-20T21:57:28.6891349Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-20T21:57:28.6892027Z with: 2024-08-20T21:57:28.6892367Z shell: bash 2024-08-20T21:57:28.6892704Z timeout_minutes: 10 2024-08-20T21:57:28.6893201Z max_attempts: 5 2024-08-20T21:57:28.6893565Z retry_wait_seconds: 30 2024-08-20T21:57:28.6894903Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T21:57:28.6896336Z polling_interval_seconds: 1 2024-08-20T21:57:28.6896796Z warning_on_retry: true 2024-08-20T21:57:28.6897187Z continue_on_error: false 2024-08-20T21:57:28.6897712Z env: 2024-08-20T21:57:28.6898170Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:28.6898640Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:28.6899376Z GITHUB_TOKEN: *** 2024-08-20T21:57:28.6899737Z ##[endgroup] 2024-08-20T21:57:28.7597282Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-20T21:57:28.9957588Z Defaulting to user installation because normal site-packages is not writeable 2024-08-20T21:57:29.1329181Z Collecting requests==2.27.1 2024-08-20T21:57:29.1690058Z Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB) 2024-08-20T21:57:29.3466429Z Collecting pyyaml==6.0.1 2024-08-20T21:57:29.3533199Z Downloading PyYAML-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (738 kB) 2024-08-20T21:57:29.6833458Z Collecting charset-normalizer~=2.0.0 2024-08-20T21:57:29.6879365Z Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB) 2024-08-20T21:57:29.7336733Z Collecting certifi>=2017.4.17 2024-08-20T21:57:29.7380819Z Downloading certifi-2024.7.4-py3-none-any.whl (162 kB) 2024-08-20T21:57:29.7462239Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-08-20T21:57:29.7469841Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-08-20T21:57:29.8230292Z Installing collected packages: charset-normalizer, certifi, requests, pyyaml 2024-08-20T21:57:29.9385284Z Successfully installed certifi-2024.7.4 charset-normalizer-2.0.12 pyyaml-6.0.1 requests-2.27.1 2024-08-20T21:57:30.7436863Z Command completed after 1 attempt(s). 2024-08-20T21:57:30.7494559Z ##[group]Run set -x 2024-08-20T21:57:30.7494931Z set -x 2024-08-20T21:57:30.7495265Z  2024-08-20T21:57:30.7495857Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T21:57:30.7496582Z # in runner workspace 2024-08-20T21:57:30.7497156Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-08-20T21:57:30.7503630Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:30.7504153Z env: 2024-08-20T21:57:30.7504468Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:30.7504969Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:30.7505469Z ##[endgroup] 2024-08-20T21:57:30.7531881Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-08-20T21:57:30.7783986Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T21:57:30.7784570Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-20T21:57:30.7785073Z echo "Job name: ${JOB_NAME}" 2024-08-20T21:57:30.7785576Z  2024-08-20T21:57:30.7786389Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-20T21:57:30.7787331Z # in runner workspace 2024-08-20T21:57:30.7787984Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-08-20T21:57:30.7788740Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-08-20T21:57:30.7789272Z  --job-name "${JOB_NAME}" \ 2024-08-20T21:57:30.7790289Z  --test-matrix "{"include": [{"config": "pr_time_benchmarks", "shard": 1, "num_shards": 1, "runner": "linux.g4dn.metal.nvidia.gpu"}]}" \ 2024-08-20T21:57:30.7791306Z  --selected-test-configs "" \ 2024-08-20T21:57:30.7791831Z  --pr-number "${PR_NUMBER}" \ 2024-08-20T21:57:30.7792323Z  --tag "${TAG}" \ 2024-08-20T21:57:30.7792744Z  --event-name "${EVENT_NAME}" \ 2024-08-20T21:57:30.7793262Z  --schedule "${SCHEDULE}" \ 2024-08-20T21:57:30.7793752Z  --branch "${HEAD_BRANCH}" 2024-08-20T21:57:30.7799215Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:30.7800078Z env: 2024-08-20T21:57:30.7800381Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:30.7800833Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:30.7801571Z GITHUB_TOKEN: *** 2024-08-20T21:57:30.7802275Z JOB_NAME: cuda12.1-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-08-20T21:57:30.7803060Z PR_NUMBER: 133712 2024-08-20T21:57:30.7803366Z TAG: 2024-08-20T21:57:30.7803674Z EVENT_NAME: pull_request 2024-08-20T21:57:30.7804051Z SCHEDULE: 2024-08-20T21:57:30.7804334Z HEAD_BRANCH: 2024-08-20T21:57:30.7804647Z ##[endgroup] 2024-08-20T21:57:30.7826116Z Workflow: pull 2024-08-20T21:57:30.7827156Z Job name: cuda12.1-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-08-20T21:57:31.0235227Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-08-20T21:57:31.1712103Z ##[group]Run echo "Filtered matrix:" 2024-08-20T21:57:31.1712543Z echo "Filtered matrix:" 2024-08-20T21:57:31.1713492Z echo "{"include": [{"config": "pr_time_benchmarks", "shard": 1, "num_shards": 1, "runner": "linux.g4dn.metal.nvidia.gpu"}]}" 2024-08-20T21:57:31.1714308Z  2024-08-20T21:57:31.1714565Z echo 2024-08-20T21:57:31.1714918Z echo "Is the current job unstable? False" 2024-08-20T21:57:31.1715375Z  2024-08-20T21:57:31.1715626Z echo 2024-08-20T21:57:31.1715955Z echo "Is keep-going label set? False" 2024-08-20T21:57:31.1716390Z  2024-08-20T21:57:31.1716641Z echo 2024-08-20T21:57:31.1716926Z echo "Renabled issues? " 2024-08-20T21:57:31.1721923Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:31.1722425Z env: 2024-08-20T21:57:31.1722675Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:31.1723119Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:31.1723600Z ##[endgroup] 2024-08-20T21:57:31.1744521Z Filtered matrix: 2024-08-20T21:57:31.1745302Z {include: [{config: pr_time_benchmarks, shard: 1, num_shards: 1, runner: linux.g4dn.metal.nvidia.gpu}]} 2024-08-20T21:57:31.1746030Z 2024-08-20T21:57:31.1746197Z Is the current job unstable? False 2024-08-20T21:57:31.1746511Z 2024-08-20T21:57:31.1746817Z Is keep-going label set? False 2024-08-20T21:57:31.1747089Z 2024-08-20T21:57:31.1747225Z Renabled issues? 2024-08-20T21:57:31.1792275Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T21:57:31.1793059Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-20T21:57:31.1798551Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:57:31.1799063Z env: 2024-08-20T21:57:31.1799339Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:31.1799809Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:31.1800305Z JOB_TIMEOUT: 240 2024-08-20T21:57:31.1800612Z ##[endgroup] 2024-08-20T21:57:31.1874405Z ##[group]Run set -x 2024-08-20T21:57:31.1874795Z set -x 2024-08-20T21:57:31.1875085Z  2024-08-20T21:57:31.1875420Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-08-20T21:57:31.1875955Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-08-20T21:57:31.1876517Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-08-20T21:57:31.1877024Z  TEST_COMMAND=.ci/onnx/test.sh 2024-08-20T21:57:31.1877413Z else 2024-08-20T21:57:31.1877736Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T21:57:31.1878145Z fi 2024-08-20T21:57:31.1878388Z  2024-08-20T21:57:31.1878845Z # detached container should get cleaned up by teardown_ec2_linux 2024-08-20T21:57:31.1879619Z # TODO: Stop building test binaries as part of the build phase 2024-08-20T21:57:31.1880292Z # Used for GPU_FLAG since that doesn't play nice 2024-08-20T21:57:31.1880881Z # shellcheck disable=SC2086,SC2090 2024-08-20T21:57:31.1881326Z container_name=$(docker run \ 2024-08-20T21:57:31.1881743Z  ${GPU_FLAG:-} \ 2024-08-20T21:57:31.1882108Z  -e BUILD_ENVIRONMENT \ 2024-08-20T21:57:31.1882482Z  -e PR_NUMBER \ 2024-08-20T21:57:31.1882838Z  -e GITHUB_ACTIONS \ 2024-08-20T21:57:31.1883217Z  -e GITHUB_REPOSITORY \ 2024-08-20T21:57:31.1883598Z  -e GITHUB_WORKFLOW \ 2024-08-20T21:57:31.1883970Z  -e GITHUB_JOB \ 2024-08-20T21:57:31.1884316Z  -e GITHUB_RUN_ID \ 2024-08-20T21:57:31.1884687Z  -e GITHUB_RUN_NUMBER \ 2024-08-20T21:57:31.1885067Z  -e GITHUB_RUN_ATTEMPT \ 2024-08-20T21:57:31.1885528Z  -e JOB_ID \ 2024-08-20T21:57:31.1886023Z  -e JOB_NAME \ 2024-08-20T21:57:31.1886376Z  -e BASE_SHA \ 2024-08-20T21:57:31.1886732Z  -e BRANCH \ 2024-08-20T21:57:31.1887075Z  -e SHA1 \ 2024-08-20T21:57:31.1887415Z  -e AWS_DEFAULT_REGION \ 2024-08-20T21:57:31.1887846Z  -e IN_WHEEL_TEST \ 2024-08-20T21:57:31.1888371Z  -e SHARD_NUMBER \ 2024-08-20T21:57:31.1888743Z  -e TEST_CONFIG \ 2024-08-20T21:57:31.1889131Z  -e NUM_TEST_SHARDS \ 2024-08-20T21:57:31.1889547Z  -e REENABLED_ISSUES \ 2024-08-20T21:57:31.1889969Z  -e CONTINUE_THROUGH_ERROR \ 2024-08-20T21:57:31.1890421Z  -e VERBOSE_TEST_LOGS \ 2024-08-20T21:57:31.1890846Z  -e TEST_SHOWLOCALS \ 2024-08-20T21:57:31.1891245Z  -e NO_TEST_TIMEOUT \ 2024-08-20T21:57:31.1891636Z  -e NO_TD \ 2024-08-20T21:57:31.1891984Z  -e TD_DISTRIBUTED \ 2024-08-20T21:57:31.1892367Z  -e PR_LABELS \ 2024-08-20T21:57:31.1892803Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-08-20T21:57:31.1893330Z  -e SCCACHE_BUCKET \ 2024-08-20T21:57:31.1893729Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-08-20T21:57:31.1894165Z  -e XLA_CUDA \ 2024-08-20T21:57:31.1894590Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-08-20T21:57:31.1895131Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-08-20T21:57:31.1895701Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-08-20T21:57:31.1896257Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-08-20T21:57:31.1896750Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-08-20T21:57:31.1897233Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-08-20T21:57:31.1897795Z  -e DASHBOARD_TAG \ 2024-08-20T21:57:31.1898251Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-08-20T21:57:31.1898803Z  --security-opt seccomp=unconfined \ 2024-08-20T21:57:31.1899260Z  --cap-add=SYS_PTRACE \ 2024-08-20T21:57:31.1899643Z  --ipc=host \ 2024-08-20T21:57:31.1899972Z  --shm-size="${SHM_SIZE}" \ 2024-08-20T21:57:31.1900356Z  --tty \ 2024-08-20T21:57:31.1900652Z  --detach \ 2024-08-20T21:57:31.1901093Z  --name="${container_name}" \ 2024-08-20T21:57:31.1901509Z  --user jenkins \ 2024-08-20T21:57:31.1901995Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-08-20T21:57:31.1902546Z  -w /var/lib/jenkins/workspace \ 2024-08-20T21:57:31.1902971Z  "${DOCKER_IMAGE}" 2024-08-20T21:57:31.1903307Z ) 2024-08-20T21:57:31.1903690Z # Propagate download.pytorch.org IP to container 2024-08-20T21:57:31.1904653Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-08-20T21:57:31.1905662Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-08-20T21:57:31.1906592Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-08-20T21:57:31.1911597Z shell: /usr/bin/bash -e {0} 2024-08-20T21:57:31.1911935Z env: 2024-08-20T21:57:31.1912179Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:57:31.1912625Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:31.1913234Z BUILD_ENVIRONMENT: linux-focal-cuda12.1-py3.10-gcc9-sm75 2024-08-20T21:57:31.1913748Z PR_NUMBER: 133712 2024-08-20T21:57:31.1914062Z GITHUB_REPOSITORY: pytorch/pytorch 2024-08-20T21:57:31.1914466Z GITHUB_WORKFLOW: pull 2024-08-20T21:57:31.1914781Z GITHUB_JOB: test 2024-08-20T21:57:31.1915064Z GITHUB_RUN_ID: 10479309237 2024-08-20T21:57:31.1915410Z GITHUB_RUN_NUMBER: 238988 2024-08-20T21:57:31.1915751Z GITHUB_RUN_ATTEMPT: 1 2024-08-20T21:57:31.1916054Z JOB_ID: 29025840824 2024-08-20T21:57:31.1916706Z JOB_NAME: cuda12.1-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-08-20T21:57:31.1917443Z BRANCH: pull/133712 2024-08-20T21:57:31.1917802Z SHA1: 40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T21:57:31.1918319Z BASE_SHA: 91f3d614142df02f619e44a68e3d9e0dfeba49ec 2024-08-20T21:57:31.1918796Z TEST_CONFIG: pr_time_benchmarks 2024-08-20T21:57:31.1919156Z SHARD_NUMBER: 1 2024-08-20T21:57:31.1919445Z NUM_TEST_SHARDS: 1 2024-08-20T21:57:31.1919741Z REENABLED_ISSUES: 2024-08-20T21:57:31.1920117Z CONTINUE_THROUGH_ERROR: False 2024-08-20T21:57:31.1920490Z VERBOSE_TEST_LOGS: False 2024-08-20T21:57:31.1920832Z TEST_SHOWLOCALS: False 2024-08-20T21:57:31.1921147Z NO_TEST_TIMEOUT: False 2024-08-20T21:57:31.1921467Z NO_TD: False 2024-08-20T21:57:31.1921749Z TD_DISTRIBUTED: False 2024-08-20T21:57:31.1922143Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-08-20T21:57:31.1922630Z SCCACHE_S3_KEY_PREFIX: pull 2024-08-20T21:57:31.1922975Z SHM_SIZE: 2g 2024-08-20T21:57:31.1924124Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:57:31.1925377Z XLA_CUDA: 2024-08-20T21:57:31.1925850Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-08-20T21:57:31.1926483Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-08-20T21:57:31.1926894Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-08-20T21:57:31.1927301Z DASHBOARD_TAG: 2024-08-20T21:57:31.1927604Z HUGGING_FACE_HUB_TOKEN: 2024-08-20T21:57:31.1927941Z SCRIBE_GRAPHQL_ACCESS_TOKEN: 2024-08-20T21:57:31.1928303Z ##[endgroup] 2024-08-20T21:57:31.1948485Z + [[ pr_time_benchmarks == \m\u\l\t\i\g\p\u ]] 2024-08-20T21:57:31.1949360Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *onnx* ]] 2024-08-20T21:57:31.1949918Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-08-20T21:57:31.1956704Z +++ nproc --ignore=2 2024-08-20T21:57:31.1990342Z ++ docker run --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=94 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_10479309237 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:57:42.1612063Z + container_name=574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:57:42.1614251Z + grep download.pytorch.org /etc/hosts 2024-08-20T21:57:42.1615913Z + docker exec -i 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 sudo bash -c '/bin/cat >> /etc/hosts' 2024-08-20T21:57:42.3102457Z + echo DOCKER_CONTAINER_ID=574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:57:42.3108968Z ++ echo dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl 2024-08-20T21:57:42.3110830Z + docker exec -t 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 sh -c 'pip install dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-08-20T21:57:42.6793401Z Processing ./dist/torch-2.5.0a0+git40ec5f6-cp310-cp310-linux_x86_64.whl (from torch==2.5.0a0+git40ec5f6) 2024-08-20T21:57:43.4990391Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.13.1) 2024-08-20T21:57:43.4992763Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (4.12.2) 2024-08-20T21:57:43.4995013Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.8.8) 2024-08-20T21:57:43.4997432Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.1.4) 2024-08-20T21:57:43.4999593Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2024.6.1) 2024-08-20T21:57:43.5003703Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.13.1) 2024-08-20T21:57:43.5026361Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.3.0) 2024-08-20T21:57:43.5040564Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (3.3.0) 2024-08-20T21:57:43.5059876Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (1.22.4) 2024-08-20T21:57:43.5426222Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.5.0a0+git40ec5f6->torch==2.5.0a0+git40ec5f6) (2.1.5) 2024-08-20T21:57:44.0860977Z Installing collected packages: torch 2024-08-20T21:57:53.6112512Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-08-20T21:57:53.6114203Z timm 1.0.9.dev0 requires torchvision, which is not installed. 2024-08-20T21:57:53.6115371Z Successfully installed torch-2.5.0a0+git40ec5f6 2024-08-20T21:57:53.6855567Z + export TERM=vt100 2024-08-20T21:57:53.6856478Z + TERM=vt100 2024-08-20T21:57:53.6856909Z ++ dirname .ci/pytorch/test.sh 2024-08-20T21:57:53.6862684Z + source .ci/pytorch/common.sh 2024-08-20T21:57:53.6864778Z +++ dirname .ci/pytorch/common.sh 2024-08-20T21:57:53.6875370Z ++ source .ci/pytorch/common_utils.sh 2024-08-20T21:57:53.6876836Z +++ declare -f -t trap_add 2024-08-20T21:57:53.6878424Z ++ set -ex 2024-08-20T21:57:53.6880159Z ++ [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *rocm* ]] 2024-08-20T21:57:53.6880753Z ++ BUILD_TEST_LIBTORCH=0 2024-08-20T21:57:53.6881315Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 != *rocm* ]] 2024-08-20T21:57:53.6883000Z ++ stat -c %u /var/lib/jenkins/workspace 2024-08-20T21:57:53.6900614Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-08-20T21:57:53.6901126Z + trap_add cleanup_workspace EXIT 2024-08-20T21:57:53.6901641Z + trap_add_cmd=cleanup_workspace 2024-08-20T21:57:53.6902068Z + shift 2024-08-20T21:57:53.6902373Z + for trap_add_name in "$@" 2024-08-20T21:57:53.6904283Z +++ trap -p EXIT 2024-08-20T21:57:53.6905871Z ++ eval 'extract_trap_cmd ' 2024-08-20T21:57:53.6906277Z +++ extract_trap_cmd 2024-08-20T21:57:53.6906704Z +++ printf '%s\n' '' 2024-08-20T21:57:53.6907165Z ++ printf '%s\n' cleanup_workspace 2024-08-20T21:57:53.6907972Z + trap -- ' 2024-08-20T21:57:53.6908392Z cleanup_workspace' EXIT 2024-08-20T21:57:53.6908932Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-08-20T21:57:54.0849508Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-08-20T21:57:54.0866198Z + echo 'Environment variables:' 2024-08-20T21:57:54.0867374Z Environment variables: 2024-08-20T21:57:54.0868261Z + env 2024-08-20T21:57:54.0869137Z INSTALLED_DB=yes 2024-08-20T21:57:54.0869548Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T21:57:54.0871937Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T21:57:54.0872489Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T21:57:54.0873248Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T21:57:54.0873931Z CONTINUE_THROUGH_ERROR=False 2024-08-20T21:57:54.0874734Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T21:57:54.0875344Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T21:57:54.0876021Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm75 2024-08-20T21:57:54.0876597Z HOSTNAME=574b88dd3d61 2024-08-20T21:57:54.0877579Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.0878532Z GITHUB_ACTION=__self 2024-08-20T21:57:54.0878922Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T21:57:54.0883507Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T21:57:54.0888302Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T21:57:54.0888872Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T21:57:54.0889286Z GITHUB_RUN_NUMBER=238988 2024-08-20T21:57:54.0889696Z TEST_CONFIG=pr_time_benchmarks 2024-08-20T21:57:54.0890120Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T21:57:54.0890664Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T21:57:54.0891194Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T21:57:54.0891672Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T21:57:54.0892185Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T21:57:54.0892735Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T21:57:54.0893197Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2024-08-20T21:57:54.0893746Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T21:57:54.0894294Z GITHUB_REF_TYPE=branch 2024-08-20T21:57:54.0894684Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T21:57:54.0895096Z NCCL_VERSION=2.17.1-1 2024-08-20T21:57:54.0895544Z BASE_SHA=91f3d614142df02f619e44a68e3d9e0dfeba49ec 2024-08-20T21:57:54.0896051Z XLA_CUDA= 2024-08-20T21:57:54.0896349Z HUGGING_FACE_HUB_TOKEN= 2024-08-20T21:57:54.0899307Z *** 2024-08-20T21:57:54.0899649Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T21:57:54.0900114Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T21:57:54.0900500Z GITHUB_ACTIONS=true 2024-08-20T21:57:54.0900878Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:54.0901491Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T21:57:54.0902096Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T21:57:54.0902646Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T21:57:54.0903259Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T21:57:54.0903790Z GITHUB_SHA=f2fb9405c2fa9f9502a76363091cce6fd8179736 2024-08-20T21:57:54.0904621Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/133712/merge 2024-08-20T21:57:54.0905361Z UCC_HOME=/usr 2024-08-20T21:57:54.0905718Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T21:57:54.0906170Z VERBOSE_TEST_LOGS=False 2024-08-20T21:57:54.0906557Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T21:57:54.0907066Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T21:57:54.0907608Z GITHUB_REF=refs/pull/133712/merge 2024-08-20T21:57:54.0908081Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T21:57:54.0908480Z SHARD_NUMBER=1 2024-08-20T21:57:54.0908832Z GITHUB_REF_PROTECTED=false 2024-08-20T21:57:54.0909227Z HOME=/var/lib/jenkins 2024-08-20T21:57:54.0909609Z GITHUB_API_URL=https://api.github.com 2024-08-20T21:57:54.0910113Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T21:57:54.0910665Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T21:57:54.0911193Z SCCACHE_S3_KEY_PREFIX=pull 2024-08-20T21:57:54.0911733Z CUDA_VERSION=12.1.1 2024-08-20T21:57:54.0912230Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T21:57:54.0912717Z NUM_TEST_SHARDS=1 2024-08-20T21:57:54.0913063Z UCX_HOME=/usr 2024-08-20T21:57:54.0913672Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T21:57:54.0914931Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.0916367Z JOB_NAME=cuda12.1-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-08-20T21:57:54.0917794Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.0919088Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T21:57:54.0919863Z GITHUB_EVENT_NAME=pull_request 2024-08-20T21:57:54.0920282Z DASHBOARD_TAG= 2024-08-20T21:57:54.0920603Z GITHUB_RUN_ID=10479309237 2024-08-20T21:57:54.0921129Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T21:57:54.0921755Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T21:57:54.0922913Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.0923941Z GITHUB_ACTOR=pytorchmergebot 2024-08-20T21:57:54.0924395Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T21:57:54.0924801Z PR_NUMBER=133712 2024-08-20T21:57:54.0925152Z GITHUB_RUN_ATTEMPT=1 2024-08-20T21:57:54.0925527Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T21:57:54.0926008Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T21:57:54.0926531Z TERM=vt100 2024-08-20T21:57:54.0926911Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T21:57:54.0927362Z INSTALLED_VISION=yes 2024-08-20T21:57:54.0927723Z BRANCH=pull/133712 2024-08-20T21:57:54.0928086Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T21:57:54.0931117Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T21:57:54.0931653Z CUDA_PATH=/usr/local/cuda 2024-08-20T21:57:54.0932584Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T21:57:54.0933444Z GITHUB_SERVER_URL=https://github.com 2024-08-20T21:57:54.0933995Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T21:57:54.0934533Z REENABLED_ISSUES= 2024-08-20T21:57:54.0934844Z SHLVL=1 2024-08-20T21:57:54.0935138Z MAX_JOBS=94 2024-08-20T21:57:54.0935491Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T21:57:54.0935866Z NVARCH=x86_64 2024-08-20T21:57:54.0936197Z GITHUB_ACTOR_ID=97764156 2024-08-20T21:57:54.0936718Z GITHUB_WORKFLOW_SHA=f2fb9405c2fa9f9502a76363091cce6fd8179736 2024-08-20T21:57:54.0937287Z GITHUB_REF_NAME=133712/merge 2024-08-20T21:57:54.0937782Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T21:57:54.0938559Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T21:57:54.0939197Z GITHUB_JOB=test 2024-08-20T21:57:54.0939656Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T21:57:54.0940290Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T21:57:54.0940854Z NO_TEST_TIMEOUT=False 2024-08-20T21:57:54.0941221Z TD_DISTRIBUTED=False 2024-08-20T21:57:54.0941642Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T21:57:54.0942118Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T21:57:54.0942595Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T21:57:54.0943001Z GITHUB_RETENTION_DAYS=90 2024-08-20T21:57:54.0943374Z OPENSSL_DIR=/opt/openssl 2024-08-20T21:57:54.0943771Z GITHUB_ACTION_REPOSITORY= 2024-08-20T21:57:54.0944987Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T21:57:54.0946280Z GITHUB_BASE_REF=gh/XuehaiPan/146/base 2024-08-20T21:57:54.0946745Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T21:57:54.0947156Z CI=true 2024-08-20T21:57:54.0947521Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T21:57:54.0947965Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T21:57:54.0948477Z JOB_ID=29025840824 2024-08-20T21:57:54.0948833Z INSTALLED_PROTOBUF=yes 2024-08-20T21:57:54.0949218Z GITHUB_HEAD_REF=gh/XuehaiPan/146/head 2024-08-20T21:57:54.0949679Z GITHUB_ACTION_REF= 2024-08-20T21:57:54.0950192Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T21:57:54.0950709Z TEST_SHOWLOCALS=False 2024-08-20T21:57:54.0951092Z GITHUB_WORKFLOW=pull 2024-08-20T21:57:54.0951481Z DEBIAN_FRONTEND=noninteractive 2024-08-20T21:57:54.0952526Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.0953475Z NO_TD=False 2024-08-20T21:57:54.0953812Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T21:57:54.0954205Z _=/usr/bin/env 2024-08-20T21:57:54.0954750Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-08-20T21:57:54.1097110Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch 2024-08-20T21:57:54.1098317Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/bin 2024-08-20T21:57:54.1099360Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/lib 2024-08-20T21:57:54.1100406Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/test 2024-08-20T21:57:54.1101093Z + BUILD_DIR=build 2024-08-20T21:57:54.1101463Z + BUILD_RENAMED_DIR=build_renamed 2024-08-20T21:57:54.1101909Z + BUILD_BIN_DIR=build/bin 2024-08-20T21:57:54.1102265Z + SHARD_NUMBER=1 2024-08-20T21:57:54.1102600Z + NUM_TEST_SHARDS=1 2024-08-20T21:57:54.1102955Z + export VALGRIND=ON 2024-08-20T21:57:54.1103289Z + VALGRIND=ON 2024-08-20T21:57:54.1103819Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *clang9* ]] 2024-08-20T21:57:54.1104389Z + [[ 0 == \1 ]] 2024-08-20T21:57:54.1104696Z + [[ False == \1 ]] 2024-08-20T21:57:54.1105244Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 != *bazel* ]] 2024-08-20T21:57:54.1105845Z ++ realpath build/custom_test_artifacts 2024-08-20T21:57:54.1108465Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-08-20T21:57:54.1109289Z + [[ -n '' ]] 2024-08-20T21:57:54.1109695Z + echo 'Environment variables' 2024-08-20T21:57:54.1110125Z Environment variables 2024-08-20T21:57:54.1110456Z + env 2024-08-20T21:57:54.1115047Z INSTALLED_DB=yes 2024-08-20T21:57:54.1115491Z NV_LIBCUBLAS_VERSION=12.1.3.1-1 2024-08-20T21:57:54.1115911Z NVIDIA_VISIBLE_DEVICES=all 2024-08-20T21:57:54.1116351Z NV_NVML_DEV_VERSION=12.1.105-1 2024-08-20T21:57:54.1117056Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T21:57:54.1117700Z CONTINUE_THROUGH_ERROR=False 2024-08-20T21:57:54.1118455Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 2024-08-20T21:57:54.1119072Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 2024-08-20T21:57:54.1119737Z BUILD_ENVIRONMENT=linux-focal-cuda12.1-py3.10-gcc9-sm75 2024-08-20T21:57:54.1120337Z HOSTNAME=574b88dd3d61 2024-08-20T21:57:54.1121411Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.1122389Z GITHUB_ACTION=__self 2024-08-20T21:57:54.1122824Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-20T21:57:54.1127537Z NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 2024-08-20T21:57:54.1132369Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 2024-08-20T21:57:54.1133115Z NV_NVTX_VERSION=12.1.105-1 2024-08-20T21:57:54.1133533Z GITHUB_RUN_NUMBER=238988 2024-08-20T21:57:54.1133934Z TEST_CONFIG=pr_time_benchmarks 2024-08-20T21:57:54.1134396Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-20T21:57:54.1134960Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-20T21:57:54.1135592Z NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 2024-08-20T21:57:54.1136094Z NV_LIBCUSPARSE_VERSION=12.1.0.106-1 2024-08-20T21:57:54.1136556Z SCRIBE_GRAPHQL_ACCESS_TOKEN= 2024-08-20T21:57:54.1136977Z NV_LIBNPP_VERSION=12.1.0.40-1 2024-08-20T21:57:54.1137427Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2024-08-20T21:57:54.1137985Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2024-08-20T21:57:54.1138500Z GITHUB_REF_TYPE=branch 2024-08-20T21:57:54.1138882Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-20T21:57:54.1139308Z NCCL_VERSION=2.17.1-1 2024-08-20T21:57:54.1139723Z BASE_SHA=91f3d614142df02f619e44a68e3d9e0dfeba49ec 2024-08-20T21:57:54.1140231Z XLA_CUDA= 2024-08-20T21:57:54.1140546Z HUGGING_FACE_HUB_TOKEN= 2024-08-20T21:57:54.1140975Z *** 2024-08-20T21:57:54.1141295Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2024-08-20T21:57:54.1141752Z GITHUB_REPOSITORY_ID=65600975 2024-08-20T21:57:54.1142144Z GITHUB_ACTIONS=true 2024-08-20T21:57:54.1142528Z NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:57:54.1143100Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 2024-08-20T21:57:54.1143700Z NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 2024-08-20T21:57:54.1144242Z SHA1=40ec5f6ddd9787aca0449b24128343ff4c4a88b3 2024-08-20T21:57:54.1144834Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2024-08-20T21:57:54.1145365Z GITHUB_SHA=f2fb9405c2fa9f9502a76363091cce6fd8179736 2024-08-20T21:57:54.1146184Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/133712/merge 2024-08-20T21:57:54.1146913Z UCC_HOME=/usr 2024-08-20T21:57:54.1147270Z NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 2024-08-20T21:57:54.1147723Z VERBOSE_TEST_LOGS=False 2024-08-20T21:57:54.1148175Z NVIDIA_PRODUCT_NAME=CUDA 2024-08-20T21:57:54.1148686Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 2024-08-20T21:57:54.1149239Z GITHUB_REF=refs/pull/133712/merge 2024-08-20T21:57:54.1149726Z NV_CUDA_CUDART_VERSION=12.1.105-1 2024-08-20T21:57:54.1150132Z SHARD_NUMBER=1 2024-08-20T21:57:54.1150486Z GITHUB_REF_PROTECTED=false 2024-08-20T21:57:54.1150875Z HOME=/var/lib/jenkins 2024-08-20T21:57:54.1151261Z GITHUB_API_URL=https://api.github.com 2024-08-20T21:57:54.1151756Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-20T21:57:54.1152297Z UCX_COMMIT=7bb2722ff2187a0cad557ae4a6afa090569f83fb 2024-08-20T21:57:54.1152824Z SCCACHE_S3_KEY_PREFIX=pull 2024-08-20T21:57:54.1153216Z CUDA_VERSION=12.1.1 2024-08-20T21:57:54.1153695Z NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 2024-08-20T21:57:54.1154171Z NUM_TEST_SHARDS=1 2024-08-20T21:57:54.1154505Z UCX_HOME=/usr 2024-08-20T21:57:54.1155102Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 2024-08-20T21:57:54.1156364Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.1157810Z JOB_NAME=cuda12.1-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) 2024-08-20T21:57:54.1159245Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.1160564Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-20T21:57:54.1161308Z GITHUB_EVENT_NAME=pull_request 2024-08-20T21:57:54.1161721Z DASHBOARD_TAG= 2024-08-20T21:57:54.1162056Z GITHUB_RUN_ID=10479309237 2024-08-20T21:57:54.1162560Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 2024-08-20T21:57:54.1163179Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 2024-08-20T21:57:54.1164355Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.1165358Z GITHUB_ACTOR=pytorchmergebot 2024-08-20T21:57:54.1165823Z NV_LIBNPP_DEV_VERSION=12.1.0.40-1 2024-08-20T21:57:54.1166251Z PR_NUMBER=133712 2024-08-20T21:57:54.1166635Z GITHUB_RUN_ATTEMPT=1 2024-08-20T21:57:54.1166997Z VALGRIND=ON 2024-08-20T21:57:54.1167340Z ANACONDA_PYTHON_VERSION=3.10 2024-08-20T21:57:54.1167824Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-20T21:57:54.1168361Z TERM=vt100 2024-08-20T21:57:54.1168748Z NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 2024-08-20T21:57:54.1169194Z INSTALLED_VISION=yes 2024-08-20T21:57:54.1169554Z BRANCH=pull/133712 2024-08-20T21:57:54.1169918Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-20T21:57:54.1170345Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2024-08-20T21:57:54.1170824Z CUDA_PATH=/usr/local/cuda 2024-08-20T21:57:54.1171708Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-20T21:57:54.1172552Z GITHUB_SERVER_URL=https://github.com 2024-08-20T21:57:54.1173109Z UCC_COMMIT=20eae37090a4ce1b32bcce6144ccad0b49943e0b 2024-08-20T21:57:54.1173653Z REENABLED_ISSUES= 2024-08-20T21:57:54.1173962Z SHLVL=1 2024-08-20T21:57:54.1174253Z MAX_JOBS=94 2024-08-20T21:57:54.1174608Z NV_CUDA_LIB_VERSION=12.1.1-1 2024-08-20T21:57:54.1174979Z NVARCH=x86_64 2024-08-20T21:57:54.1175304Z GITHUB_ACTOR_ID=97764156 2024-08-20T21:57:54.1175825Z GITHUB_WORKFLOW_SHA=f2fb9405c2fa9f9502a76363091cce6fd8179736 2024-08-20T21:57:54.1176396Z GITHUB_REF_NAME=133712/merge 2024-08-20T21:57:54.1176892Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 2024-08-20T21:57:54.1177822Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-20T21:57:54.1178476Z GITHUB_JOB=test 2024-08-20T21:57:54.1178941Z NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 2024-08-20T21:57:54.1179580Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2024-08-20T21:57:54.1180145Z NO_TEST_TIMEOUT=False 2024-08-20T21:57:54.1180523Z TD_DISTRIBUTED=False 2024-08-20T21:57:54.1180950Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 2024-08-20T21:57:54.1181424Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-20T21:57:54.1181968Z NV_NVPROF_VERSION=12.1.105-1 2024-08-20T21:57:54.1182388Z GITHUB_RETENTION_DAYS=90 2024-08-20T21:57:54.1182767Z OPENSSL_DIR=/opt/openssl 2024-08-20T21:57:54.1183176Z GITHUB_ACTION_REPOSITORY= 2024-08-20T21:57:54.1184402Z PATH=/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T21:57:54.1185794Z GITHUB_BASE_REF=gh/XuehaiPan/146/base 2024-08-20T21:57:54.1186579Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2024-08-20T21:57:54.1187014Z CI=true 2024-08-20T21:57:54.1187446Z NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 2024-08-20T21:57:54.1187931Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-20T21:57:54.1188460Z JOB_ID=29025840824 2024-08-20T21:57:54.1188855Z INSTALLED_PROTOBUF=yes 2024-08-20T21:57:54.1189273Z GITHUB_HEAD_REF=gh/XuehaiPan/146/head 2024-08-20T21:57:54.1189750Z GITHUB_ACTION_REF= 2024-08-20T21:57:54.1190253Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-20T21:57:54.1190815Z TEST_SHOWLOCALS=False 2024-08-20T21:57:54.1191199Z GITHUB_WORKFLOW=pull 2024-08-20T21:57:54.1191573Z DEBIAN_FRONTEND=noninteractive 2024-08-20T21:57:54.1192688Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_e3879d10-03ac-4898-b577-63468bced6b6 2024-08-20T21:57:54.1193663Z NO_TD=False 2024-08-20T21:57:54.1193986Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-20T21:57:54.1194412Z _=/usr/bin/env 2024-08-20T21:57:54.1194812Z + echo 'Testing pytorch' 2024-08-20T21:57:54.1195189Z Testing pytorch 2024-08-20T21:57:54.1195565Z + export LANG=C.UTF-8 2024-08-20T21:57:54.1195945Z + LANG=C.UTF-8 2024-08-20T21:57:54.1196260Z + PR_NUMBER=133712 2024-08-20T21:57:54.1196672Z + [[ pr_time_benchmarks == \d\e\f\a\u\l\t ]] 2024-08-20T21:57:54.1197375Z + [[ pr_time_benchmarks == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-08-20T21:57:54.1197904Z + [[ pr_time_benchmarks == \s\l\o\w ]] 2024-08-20T21:57:54.1198628Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *slow-gradcheck* ]] 2024-08-20T21:57:54.1199439Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *cuda* ]] 2024-08-20T21:57:54.1200045Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T21:57:54.1200689Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2024-08-20T21:57:54.1201199Z + [[ pr_time_benchmarks == *crossref* ]] 2024-08-20T21:57:54.1201845Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *rocm* ]] 2024-08-20T21:57:54.1202597Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *xpu* ]] 2024-08-20T21:57:54.1203361Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 != *-bazel-* ]] 2024-08-20T21:57:54.1203990Z + pip_install --user ninja==1.10.2 2024-08-20T21:57:54.1204599Z + pip install --progress-bar off --user ninja==1.10.2 2024-08-20T21:57:57.2535936Z Collecting ninja==1.10.2 2024-08-20T21:57:57.2783554Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-08-20T21:57:57.2880448Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-08-20T21:57:57.8151243Z Installing collected packages: ninja 2024-08-20T21:57:57.8226308Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-08-20T21:57:57.8230315Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-08-20T21:57:57.8268606Z Successfully installed ninja-1.10.2 2024-08-20T21:57:57.8933749Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T21:57:57.8939567Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T21:57:57.8941312Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *aarch64* ]] 2024-08-20T21:57:57.8941900Z + install_tlparse 2024-08-20T21:57:57.8942321Z + pip_install --user tlparse==0.3.25 2024-08-20T21:57:57.8943188Z + pip install --progress-bar off --user tlparse==0.3.25 2024-08-20T21:57:58.2568924Z Collecting tlparse==0.3.25 2024-08-20T21:57:58.2736932Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-08-20T21:57:58.2837715Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-08-20T21:57:58.8583187Z Installing collected packages: tlparse 2024-08-20T21:57:58.8929294Z Successfully installed tlparse-0.3.25 2024-08-20T21:57:58.9720619Z ++ python -m site --user-base 2024-08-20T21:57:58.9953884Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/envs/py_3.10/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-20T21:57:58.9958837Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *asan* ]] 2024-08-20T21:57:58.9960307Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 == *-debug* ]] 2024-08-20T21:57:58.9961051Z + [[ linux-focal-cuda12.1-py3.10-gcc9-sm75 != *-bazel-* ]] 2024-08-20T21:57:58.9962078Z + echo 'We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm75. Expect the assertion to pass' 2024-08-20T21:57:58.9963314Z We are not in debug mode: linux-focal-cuda12.1-py3.10-gcc9-sm75. Expect the assertion to pass 2024-08-20T21:57:58.9964066Z + cd test 2024-08-20T21:57:58.9964606Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-08-20T21:58:00.5756203Z + [[ pr_time_benchmarks == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-08-20T21:58:00.5756969Z + [[ pr_time_benchmarks == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-08-20T21:58:00.5757512Z + DYNAMO_BENCHMARK_FLAGS=() 2024-08-20T21:58:00.5757976Z + [[ pr_time_benchmarks == *pr_time_benchmarks* ]] 2024-08-20T21:58:00.5758469Z + pr_time_benchmarks 2024-08-20T21:58:00.5761093Z ++ pwd 2024-08-20T21:58:00.5762562Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports 2024-08-20T21:58:00.5763356Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports 2024-08-20T21:58:00.5787341Z ++ pwd 2024-08-20T21:58:00.5788011Z + PYTHONPATH=/var/lib/jenkins/workspace/benchmarks/dynamo/pr_time_benchmarks 2024-08-20T21:58:00.5790378Z + source benchmarks/dynamo/pr_time_benchmarks/benchmark_runner.sh /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_after.txt benchmarks/dynamo/pr_time_benchmarks/benchmarks 2024-08-20T21:58:00.5791858Z ++ '[' 2 -eq 0 ']' 2024-08-20T21:58:00.5792230Z ++ '[' 2 -eq 1 ']' 2024-08-20T21:58:00.5793008Z ++ output_file=/var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_after.txt 2024-08-20T21:58:00.5793973Z ++ python_programs_dir=benchmarks/dynamo/pr_time_benchmarks/benchmarks 2024-08-20T21:58:00.5813524Z ++ for file in $python_programs_dir/*.py 2024-08-20T21:58:00.5814993Z ++ python benchmarks/dynamo/pr_time_benchmarks/benchmarks/update_hint_benchmark.py /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_after.txt 2024-08-20T21:58:01.9143706Z collecting instruction count for update_hint_regression 2024-08-20T21:58:09.4048366Z instruction count for iteration 0 is 35887454978 2024-08-20T21:58:11.4192799Z instruction count for iteration 1 is 10953468253 2024-08-20T21:58:13.5411779Z instruction count for iteration 2 is 11010126551 2024-08-20T21:58:15.5365985Z instruction count for iteration 3 is 10855373572 2024-08-20T21:58:17.5352058Z instruction count for iteration 4 is 10847023581 2024-08-20T21:58:19.6829790Z instruction count for iteration 5 is 11029692910 2024-08-20T21:58:21.6718343Z instruction count for iteration 6 is 10844930974 2024-08-20T21:58:23.6659593Z instruction count for iteration 7 is 10850227218 2024-08-20T21:58:25.6625806Z instruction count for iteration 8 is 10867233499 2024-08-20T21:58:27.8222937Z instruction count for iteration 9 is 11032313641 2024-08-20T21:58:28.6752589Z + echo 'benchmark results on current PR: ' 2024-08-20T21:58:28.6753179Z benchmark results on current PR: 2024-08-20T21:58:28.6754420Z + cat /var/lib/jenkins/workspace/test/test-reports/pr_time_benchmarks_after.txt 2024-08-20T21:58:28.6760914Z update_hint_regression,instruction_count,10844930974 2024-08-20T21:58:28.6761356Z 2024-08-20T21:58:28.6761466Z + exit 0 2024-08-20T21:58:28.6761752Z + cleanup_workspace 2024-08-20T21:58:28.6766155Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-08-20T21:58:28.6767448Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-08-20T21:58:28.6768521Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-08-20T21:58:28.6769221Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-08-20T21:58:28.6770137Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-08-20T21:58:28.6771145Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-08-20T21:58:28.6771907Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-08-20T21:58:29.0840116Z ##[group]Run cat test/**/*_toprint.log || true 2024-08-20T21:58:29.0840694Z cat test/**/*_toprint.log || true 2024-08-20T21:58:29.0849774Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:29.0850333Z env: 2024-08-20T21:58:29.0850629Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:29.0851137Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:29.0851980Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:29.0852689Z ##[endgroup] 2024-08-20T21:58:29.0927307Z cat: 'test/**/*_toprint.log': No such file or directory 2024-08-20T21:58:29.0968027Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-08-20T21:58:29.0968513Z kill "$MONITOR_SCRIPT_PID" 2024-08-20T21:58:29.0973185Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:29.0973690Z env: 2024-08-20T21:58:29.0973980Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:29.0974452Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:29.0975218Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:29.0976100Z MONITOR_SCRIPT_PID: 60292 2024-08-20T21:58:29.0976472Z ##[endgroup] 2024-08-20T21:58:29.1182708Z Prepare all required actions 2024-08-20T21:58:29.1183192Z Getting action download info 2024-08-20T21:58:29.2713062Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-08-20T21:58:29.4492942Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-08-20T21:58:29.4493468Z with: 2024-08-20T21:58:29.4494076Z file-suffix: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824 2024-08-20T21:58:29.4494846Z s3-bucket: gha-artifacts 2024-08-20T21:58:29.4495207Z env: 2024-08-20T21:58:29.4495510Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:29.4496017Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:29.4496844Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:29.4497590Z ##[endgroup] 2024-08-20T21:58:29.4526871Z ##[group]Run # Remove any previous test jsons if they exist 2024-08-20T21:58:29.4527616Z # Remove any previous test jsons if they exist 2024-08-20T21:58:29.4528134Z rm -f test-jsons-*.zip 2024-08-20T21:58:29.4528683Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-08-20T21:58:29.4534290Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:29.4534792Z env: 2024-08-20T21:58:29.4535088Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:29.4535569Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:29.4536353Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:29.4537291Z FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824 2024-08-20T21:58:29.4537969Z ##[endgroup] 2024-08-20T21:58:29.4864965Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-08-20T21:58:29.4894320Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-08-20T21:58:29.4896387Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-08-20T21:58:29.4900565Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-08-20T21:58:29.4906193Z adding: test/slow_tests.json (deflated 82%) 2024-08-20T21:58:29.4972338Z ##[group]Run # Remove any previous test reports if they exist 2024-08-20T21:58:29.4972982Z # Remove any previous test reports if they exist 2024-08-20T21:58:29.4973499Z rm -f test-reports-*.zip 2024-08-20T21:58:29.4974087Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-08-20T21:58:29.4978923Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:29.4979400Z env: 2024-08-20T21:58:29.4979649Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:29.4980095Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:29.4980846Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:29.4981772Z FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824 2024-08-20T21:58:29.4982442Z ##[endgroup] 2024-08-20T21:58:29.5143679Z zip warning: zip file empty 2024-08-20T21:58:29.5172498Z ##[group]Run # Remove any previous usage logs if they exist 2024-08-20T21:58:29.5173170Z # Remove any previous usage logs if they exist 2024-08-20T21:58:29.5173697Z rm -f logs-*.zip 2024-08-20T21:58:29.5174415Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-08-20T21:58:29.5175344Z # so check to see if the file exists first 2024-08-20T21:58:29.5175829Z if [ -f 'usage_log.txt' ]; then 2024-08-20T21:58:29.5176350Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-08-20T21:58:29.5176836Z fi 2024-08-20T21:58:29.5177166Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-08-20T21:58:29.5177735Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-08-20T21:58:29.5178217Z fi 2024-08-20T21:58:29.5182785Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:29.5183422Z env: 2024-08-20T21:58:29.5183686Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:29.5184118Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:29.5184876Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:29.5186028Z FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824 2024-08-20T21:58:29.5186759Z ##[endgroup] 2024-08-20T21:58:29.5226263Z adding: usage_log.txt (deflated 91%) 2024-08-20T21:58:29.5297704Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-08-20T21:58:29.5298552Z # Remove any previous debugging artifacts if they exist 2024-08-20T21:58:29.5299109Z rm -f debug-*.zip 2024-08-20T21:58:29.5299477Z if [ -d 'test/debug' ]; then 2024-08-20T21:58:29.5299961Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-08-20T21:58:29.5300441Z fi 2024-08-20T21:58:29.5304663Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:29.5305149Z env: 2024-08-20T21:58:29.5305420Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:29.5305866Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:29.5306613Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:29.5307549Z FILE_SUFFIX: test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824 2024-08-20T21:58:29.5308211Z ##[endgroup] 2024-08-20T21:58:29.5396741Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T21:58:29.5397205Z with: 2024-08-20T21:58:29.5397499Z s3-bucket: gha-artifacts 2024-08-20T21:58:29.5398073Z s3-prefix: pytorch/pytorch/10479309237/1/artifact 2024-08-20T21:58:29.5398531Z retention-days: 14 2024-08-20T21:58:29.5398856Z if-no-files-found: warn 2024-08-20T21:58:29.5399202Z path: test-jsons-*.zip 2024-08-20T21:58:29.5399512Z name: artifact 2024-08-20T21:58:29.5399811Z region: us-east-1 2024-08-20T21:58:29.5400112Z env: 2024-08-20T21:58:29.5400360Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:29.5400805Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:29.5401561Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:29.5402208Z ##[endgroup] 2024-08-20T21:58:29.8704344Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T21:58:29.8705042Z With the provided path, there will be 1 file uploaded 2024-08-20T21:58:29.8705735Z Uploading to s3 prefix: pytorch/pytorch/10479309237/1/artifact 2024-08-20T21:58:30.0077803Z Starting upload of test-jsons-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824.zip 2024-08-20T21:58:30.1140289Z Finished upload of test-jsons-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824.zip 2024-08-20T21:58:30.1308330Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T21:58:30.1308789Z with: 2024-08-20T21:58:30.1309088Z s3-bucket: gha-artifacts 2024-08-20T21:58:30.1309565Z s3-prefix: pytorch/pytorch/10479309237/1/artifact 2024-08-20T21:58:30.1310050Z retention-days: 14 2024-08-20T21:58:30.1310395Z if-no-files-found: error 2024-08-20T21:58:30.1310767Z path: test-reports-*.zip 2024-08-20T21:58:30.1311107Z name: artifact 2024-08-20T21:58:30.1311410Z region: us-east-1 2024-08-20T21:58:30.1311713Z env: 2024-08-20T21:58:30.1311967Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:30.1312433Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:30.1313234Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:30.1313919Z ##[endgroup] 2024-08-20T21:58:30.4601708Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T21:58:30.4602343Z With the provided path, there will be 1 file uploaded 2024-08-20T21:58:30.4602979Z Uploading to s3 prefix: pytorch/pytorch/10479309237/1/artifact 2024-08-20T21:58:30.4632307Z Starting upload of test-reports-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824.zip 2024-08-20T21:58:30.5581494Z Finished upload of test-reports-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824.zip 2024-08-20T21:58:30.5742346Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T21:58:30.5742804Z with: 2024-08-20T21:58:30.5743105Z s3-bucket: gha-artifacts 2024-08-20T21:58:30.5743559Z s3-prefix: pytorch/pytorch/10479309237/1/artifact 2024-08-20T21:58:30.5744032Z retention-days: 14 2024-08-20T21:58:30.5744391Z if-no-files-found: ignore 2024-08-20T21:58:30.5744767Z path: logs-*.zip 2024-08-20T21:58:30.5745069Z name: artifact 2024-08-20T21:58:30.5745383Z region: us-east-1 2024-08-20T21:58:30.5745699Z env: 2024-08-20T21:58:30.5745958Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:30.5746434Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:30.5747228Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:30.5747894Z ##[endgroup] 2024-08-20T21:58:30.9016401Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-20T21:58:30.9018108Z With the provided path, there will be 1 file uploaded 2024-08-20T21:58:30.9019860Z Uploading to s3 prefix: pytorch/pytorch/10479309237/1/artifact 2024-08-20T21:58:30.9047467Z Starting upload of logs-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824.zip 2024-08-20T21:58:31.0020928Z Finished upload of logs-test-pr_time_benchmarks-1-1-linux.g4dn.metal.nvidia.gpu_29025840824.zip 2024-08-20T21:58:31.0179665Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-20T21:58:31.0180131Z with: 2024-08-20T21:58:31.0180445Z s3-bucket: gha-artifacts 2024-08-20T21:58:31.0180904Z s3-prefix: pytorch/pytorch/10479309237/1/artifact 2024-08-20T21:58:31.0181386Z retention-days: 14 2024-08-20T21:58:31.0181744Z if-no-files-found: ignore 2024-08-20T21:58:31.0182130Z path: debug-*.zip 2024-08-20T21:58:31.0182437Z name: artifact 2024-08-20T21:58:31.0182762Z region: us-east-1 2024-08-20T21:58:31.0183105Z env: 2024-08-20T21:58:31.0183375Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:31.0183877Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:31.0184670Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:31.0185339Z ##[endgroup] 2024-08-20T21:58:31.3453606Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-08-20T21:58:31.3637724Z ##[group]Run # shellcheck disable=SC2156 2024-08-20T21:58:31.3638207Z # shellcheck disable=SC2156 2024-08-20T21:58:31.3639027Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-08-20T21:58:31.3644579Z shell: /usr/bin/bash -e {0} 2024-08-20T21:58:31.3644920Z env: 2024-08-20T21:58:31.3645183Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:31.3645615Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:31.3646374Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:31.3647052Z ##[endgroup] 2024-08-20T21:58:31.5294485Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-08-20T21:58:31.5295077Z with: 2024-08-20T21:58:31.5295332Z env: 2024-08-20T21:58:31.5295604Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:31.5296074Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:31.5296891Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:31.5297808Z ##[endgroup] 2024-08-20T21:58:31.5317292Z ##[group]Run set -eou pipefail 2024-08-20T21:58:31.5317686Z set -eou pipefail 2024-08-20T21:58:31.5318027Z  2024-08-20T21:58:31.5318541Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-20T21:58:31.5319177Z for _ in $(seq 1440); do 2024-08-20T21:58:31.5319637Z  # Break if no ssh session exists anymore 2024-08-20T21:58:31.5320130Z  if [ "$(who)" = "" ]; then 2024-08-20T21:58:31.5320654Z  break 2024-08-20T21:58:31.5321001Z  fi 2024-08-20T21:58:31.5321274Z  echo "." 2024-08-20T21:58:31.5321581Z  sleep 5 2024-08-20T21:58:31.5321875Z done 2024-08-20T21:58:31.5326988Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:31.5327626Z env: 2024-08-20T21:58:31.5327900Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:31.5328350Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:31.5329146Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:31.5329843Z ##[endgroup] 2024-08-20T21:58:31.5350739Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-20T21:58:31.5427749Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T21:58:31.5428638Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-20T21:58:31.5429316Z # shellcheck disable=SC2046 2024-08-20T21:58:31.5429819Z docker stop $(docker ps -q) || true 2024-08-20T21:58:31.5430361Z # Prune all of the docker images 2024-08-20T21:58:31.5430844Z docker system prune -af 2024-08-20T21:58:31.5436149Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:31.5436691Z env: 2024-08-20T21:58:31.5437084Z GIT_DEFAULT_BRANCH: main 2024-08-20T21:58:31.5437544Z GPU_FLAG: --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all 2024-08-20T21:58:31.5438346Z DOCKER_CONTAINER_ID: 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:31.5439215Z ##[endgroup] 2024-08-20T21:58:32.0488213Z 574b88dd3d61 2024-08-20T21:58:32.3808300Z Deleted Containers: 2024-08-20T21:58:32.3809008Z 574b88dd3d61f4c69b42f92f9849a72428b84f0c716f3fd0e3f35b004a33b904 2024-08-20T21:58:32.3809600Z 2024-08-20T21:58:37.0845957Z Deleted Images: 2024-08-20T21:58:37.0850407Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks:f6d216893d65c7b8ae43df4daaf247db808378e9 2024-08-20T21:58:37.0854308Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-focal-cuda12.1-cudnn9-py3-gcc9-inductor-benchmarks@sha256:3a95d3a177465127ef6cd3b50787d6a050367070fd9063dbb688fad07a96b402 2024-08-20T21:58:37.0856169Z deleted: sha256:8fef7805cec6e829013a3d62f158b75bdc2f02cdfe3428c032ea017b488473bb 2024-08-20T21:58:37.0857158Z deleted: sha256:c2ce10014dd98f6abbfbf2265f9780a8204c2a7a27463e61ee565573a23d141d 2024-08-20T21:58:37.0858174Z deleted: sha256:ae249c0e6e6013bd6ffea2ca0b0160c015c9ebf7c03070bc2f983a9ff2415bf5 2024-08-20T21:58:37.0859159Z deleted: sha256:8a73883c1067c0e29ff128f553518682b47ed9707d2f35e7d5138e2caf029d61 2024-08-20T21:58:37.0860116Z deleted: sha256:9c040db729fa084584aaf5573082408a2196bc64e5952270c79dc610ed4680b6 2024-08-20T21:58:37.0861051Z deleted: sha256:17311eeeb8b71b16699880c0f646e185107496c4d41da5d23370603768ec030c 2024-08-20T21:58:37.0862340Z deleted: sha256:07cc10bece8501b1c8035d4385ad9e9867dd6e92fa32218a4dcb3e42af7e0411 2024-08-20T21:58:37.0863905Z deleted: sha256:f3e32d05099d1a3115a4722bc2e94a48752c3e965446773673808252671bb967 2024-08-20T21:58:37.0864918Z deleted: sha256:be7c3f41475e3e72ffe3ac2f92ab2f4cf49d5496b2aae738942ac3bb687d742c 2024-08-20T21:58:37.0865907Z deleted: sha256:4fcac490be825129b468cf458089f1fcf8fd56afc44ef4ab27c2eff41ab1ac90 2024-08-20T21:58:37.0866897Z deleted: sha256:31c66d80a2a4792897f267d363c0cf84fb821c5d4a275ab1636f778fd0284c08 2024-08-20T21:58:37.0867868Z deleted: sha256:8a8bcb6085e7e438e5533e8a5613e2ae5888543853568d023af3e2623a1593a9 2024-08-20T21:58:37.0868817Z deleted: sha256:2f6cb60029c79d11567b738f5bdbfb9cb1838cc0f194c4a5e6ae685178d2ed34 2024-08-20T21:58:37.0869807Z deleted: sha256:e546391804d3313f558e1ac16e93cb29a417a92e4eccaf0d4bd12af3bbcf39e3 2024-08-20T21:58:37.0870787Z deleted: sha256:1623b2aa16f2bdc6b572f6799498d9a92fa8114d07c440599b17aea72e22f8b1 2024-08-20T21:58:37.0871778Z deleted: sha256:c0386ca58b7cb7afee015b7e58d2f70525eaf73d6da2cc63868b20e14b1f9497 2024-08-20T21:58:37.0872919Z deleted: sha256:dcbf534ff289186e246531925fed90f72516eb3d63663bad234d611cdc025d62 2024-08-20T21:58:37.0873901Z deleted: sha256:0bab537af579f56c9cd51c7073fd53635fffb424b363236e0de38a7dd0e60ae8 2024-08-20T21:58:37.0874884Z deleted: sha256:d85a852ae1ee027e2fc17240ed68b87957b0a6d210c9119752d8979a0dcd55cf 2024-08-20T21:58:37.0875942Z deleted: sha256:f3821d761b555362e44cf9a1447d8fd2d95b37d54aea67c7519cd9e5db0c4d7e 2024-08-20T21:58:37.0876906Z deleted: sha256:c05e84a545db5dfcb0847c73d2b0f4749fa67aabce05705632ff7f76c84d4688 2024-08-20T21:58:37.0877879Z deleted: sha256:27054eae7ca67b2bd5ca0fd3f4488bf5c5f78e95487d8c45616f3d753d48a8b5 2024-08-20T21:58:37.0878827Z deleted: sha256:9804139f6ae97796aaa993fe4b89ea0cf111eb4d30a79f4c87c339c2e1e04fa0 2024-08-20T21:58:37.0879780Z deleted: sha256:ad6ae2fc594aaa359ff4e287323836570454eb24dd162930655e414d1d77c6dd 2024-08-20T21:58:37.0880921Z deleted: sha256:9cfbb36e328af52a248853a46aab88e266c09e2b44a03e0a42194a031b9b9453 2024-08-20T21:58:37.0881927Z deleted: sha256:a8a842bd7f37b8d50b6d12d6f95f46bbba57953db466fcbde9ba522625f024ef 2024-08-20T21:58:37.0882895Z deleted: sha256:da9738654b3c86f89ebeed2560f1bae093f1219f1eff90b0394b7f211ecabd04 2024-08-20T21:58:37.0883892Z deleted: sha256:cc683bf0cb245394e0f568984b2dd4fce1b6a3a7fe7c44734bae1aa1caaa3251 2024-08-20T21:58:37.0884891Z deleted: sha256:965f220e71c7d1ec19aaf41b1529ab287beb9d86eb8482c4c14094485ab34475 2024-08-20T21:58:37.0886041Z deleted: sha256:da32ecec41a73ce7dd29464f90c7951510a18cd378753659a78cd7fabd10dc36 2024-08-20T21:58:37.0887032Z deleted: sha256:d828d187cee9ad48dbc3702fb61d359619dd8a1ed582878680b51686bf117e5a 2024-08-20T21:58:37.0888007Z deleted: sha256:712111f4b12ff8e2787597d5fdcb043bd0824e55ddd97f262ef550506ca195f0 2024-08-20T21:58:37.0888953Z deleted: sha256:a064eea405958ad14dc6c794e5df9fd1d4515424272801ec559d45a59317309a 2024-08-20T21:58:37.0889940Z deleted: sha256:e124382d136bd5e9a8b409ca79c1f1ef76458deaf444b1b2060d3fa99dbeb506 2024-08-20T21:58:37.0890941Z deleted: sha256:6e10fe757cc190a1b31b47010f4f7610e02cb1b4b438f190dcd301aa4fe2278e 2024-08-20T21:58:37.0891921Z deleted: sha256:4cea352e10f46ca4729f96ac6c4600fc53d4c36e7658c2e0f19f4f309cd4a2a7 2024-08-20T21:58:37.0892873Z deleted: sha256:518bba00fe1d0933053066d21cac0235c9fb485abbc41557ec184b293095c924 2024-08-20T21:58:37.0893892Z deleted: sha256:a64f9ca42e9f27ff2690c15a5c84312e6efaccad45668d9b496cb542165cfb5a 2024-08-20T21:58:37.0895011Z deleted: sha256:096ea0fa14a6c420658f5276b8a8f5d264c0de7e18161ceda2cfc2f4a92cd9bf 2024-08-20T21:58:37.0895984Z deleted: sha256:6f91c94ce6e3f8034c91c66ee25c66a3d85dba9d813b749bd6d2000942a99edc 2024-08-20T21:58:37.0896975Z deleted: sha256:8f8d255eeae546cead8f9a94d237fa57a99940c0f5d51bc29a9d41c7df9cffd9 2024-08-20T21:58:37.0897982Z deleted: sha256:fe05276f4a49f91eef56bfbc3da87cfff5eb116a827fa2d30efe42ce1c134b40 2024-08-20T21:58:37.0899030Z deleted: sha256:5f83cd75d0669c813d4f58978c92e14305cd8f6a07eb9a60665a583460fa7b59 2024-08-20T21:58:37.0899957Z deleted: sha256:8f7ab6366169d39d8953129f650f1927d2fb1328b3f11e2fd9076adb5f46b93a 2024-08-20T21:58:37.0901049Z deleted: sha256:4146cfd5dba0f5308954749f98596b14a1d8f6d23bd93f7ad86c6c3d72239328 2024-08-20T21:58:37.0902107Z deleted: sha256:c6d83cb9ccc606ff63bb3c4d5a5e1ff1450c619b5aae494303a94ae25971cca0 2024-08-20T21:58:37.0902994Z deleted: sha256:71e037e0a3e0963c4565534a7387c082afcb04475d3ac629acf7a0ab2f49fadc 2024-08-20T21:58:37.0903877Z deleted: sha256:4b31135c564686bdaf23262b901237880aea635655721cc7e8c95dc42b05e06d 2024-08-20T21:58:37.0904776Z deleted: sha256:d09bd5c2f35cedcb846543941ee64ce1f684b52e4285696c93b3fb2032da8579 2024-08-20T21:58:37.0905674Z deleted: sha256:4de7fb7d4fc22212aae5fc1ceb637526916d0cced240d7c93d5edd6b0ea28013 2024-08-20T21:58:37.0906592Z deleted: sha256:69890e3e82746e10aff2f1084f11afb4b95a4a6c26b30f64b7001bc0a5fe32bf 2024-08-20T21:58:37.0907483Z deleted: sha256:0156df53b3224e645336ea52b4bb816f1e8d8c9b591748cd645e5e5649fa507b 2024-08-20T21:58:37.0908346Z deleted: sha256:0664624cb9cc4a386f31bf49919a8d8a11d9fea428d05585d9e6228f754bc7cd 2024-08-20T21:58:37.0909335Z deleted: sha256:8c2ddd5fa535c768c058a23f5cc4b6c64cdd71bb7458491282aabc7f7bb94d69 2024-08-20T21:58:37.0910247Z deleted: sha256:8dd03dbe0e1c5f47dd333074dff4bd00415f2f63727a65bf17866774e2ebbd0d 2024-08-20T21:58:37.0911156Z deleted: sha256:3c56b63e094bd18fad9da7a541d537210bca3b730c590d3641213259f6908d6f 2024-08-20T21:58:37.0912030Z deleted: sha256:51484fef07bd1266d4d6ff3d767751172660fc4cc6a1ffe883523a63c985e31e 2024-08-20T21:58:37.0912940Z deleted: sha256:03e83c94023982ab7dd8dc65a6df2024e342f1b760c91ec7a680ee45824869c7 2024-08-20T21:58:37.0913831Z deleted: sha256:58440ab3e8175b5de94a76485c8689a6dc186015475ebf4b386ebba309c5da34 2024-08-20T21:58:37.0914705Z deleted: sha256:9a980f3383e8aa511f0ef68982cb6dfc53b38d1ac8c3d673cb3ba3d45158c91e 2024-08-20T21:58:37.0915617Z deleted: sha256:cb0269c9cf1c47b6c4188ca7be4db261b5d3fc4b4a5153629e222dba7b1f9f98 2024-08-20T21:58:37.0916544Z deleted: sha256:41f1ba870cdffc05e0bf8d87b640fb9d4c153d7f4f3b775f37f94e9f3d584aad 2024-08-20T21:58:37.0917440Z deleted: sha256:7b502ab352f48e8b6eb5e6824a29f308952a5ee7c7d987562e1df7e47639d7f1 2024-08-20T21:58:37.0918330Z deleted: sha256:6ba5217e18738660e6ca8b7a7ec88845e70b0fd781301520bf46c71d99df3144 2024-08-20T21:58:37.0919226Z deleted: sha256:dd5a1c233594780163726bdbbf5de00f7b6b8dca1dace8a001340714c54baedb 2024-08-20T21:58:37.0920135Z deleted: sha256:c27f0db27da73e01f67f6cb78d10f355e350d829479ba4351d82055bb29f6597 2024-08-20T21:58:37.0921023Z deleted: sha256:4e3ce3c854f35c08be3dd95e0d6e718512a885e4614291d7d8b7cd23f48b7dd8 2024-08-20T21:58:37.0922149Z deleted: sha256:c2d6fb088bbec16e60cf0ad74b016f7287c92e659ec2db01271bc309b4dc6d83 2024-08-20T21:58:37.0923129Z deleted: sha256:35a033279d5c9bd6b862bfa9331d8fcbf98bbaf778a778fabc882384db9204f8 2024-08-20T21:58:37.0924064Z deleted: sha256:ab9b00c496073d62e69e032178858d3d6d4c4bab9e87065d3785c6da57351d00 2024-08-20T21:58:37.0924999Z deleted: sha256:7ed947299e109c2459de6e240d86f049c30f93f2380659ce441d8737b8cd065f 2024-08-20T21:58:37.0925945Z deleted: sha256:410d5a7f7a9a1cb4551c106b9cc728a9dcff598f9be231a351ce6a0a33f81e64 2024-08-20T21:58:37.0926888Z deleted: sha256:5f0021bb56efa14bb93978c01513e2a1187ba30e69bdb0546d0ef39b30873f88 2024-08-20T21:58:37.0928003Z deleted: sha256:c1601aa97eb84151c14da3aeea351201bd99144d36d66b397f6555d80245d86d 2024-08-20T21:58:37.0928999Z deleted: sha256:72af05a89be22accdc1ca5d66dcbbb33993a9ef5997f849df1d4ba4c48049f25 2024-08-20T21:58:37.0930007Z deleted: sha256:38b90c9663dcaa2bc57a4dd3008298e7ea93e9535fa42312b4dc4246e7491af9 2024-08-20T21:58:37.0930989Z deleted: sha256:bda61b6cefb3ec8eeb74fef1ca1c7f9a5845fe5e8f07b8123323e897425d5c29 2024-08-20T21:58:37.0931997Z deleted: sha256:5a18e1aa877074529a84cbddf19f8d5403787823378ceae6b72fb62f78d43037 2024-08-20T21:58:37.0932986Z deleted: sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9 2024-08-20T21:58:37.0933567Z 2024-08-20T21:58:37.0933727Z Total reclaimed space: 39.87GB 2024-08-20T21:58:37.1012449Z Post job cleanup. 2024-08-20T21:58:37.1067149Z Post job cleanup. 2024-08-20T21:58:37.1912378Z [command]/usr/bin/git version 2024-08-20T21:58:37.1954897Z git version 2.40.1 2024-08-20T21:58:37.1994796Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/1ead8600-0c1a-42c1-8c25-ca93614aaba9' before making global git config changes 2024-08-20T21:58:37.1998608Z Adding repository directory to the temporary git global config as a safe directory 2024-08-20T21:58:37.2001355Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-20T21:58:37.2031182Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-20T21:58:37.2062486Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-20T21:58:37.2355231Z Entering 'android/libs/fbjni' 2024-08-20T21:58:37.2402062Z Entering 'third_party/FP16' 2024-08-20T21:58:37.2448740Z Entering 'third_party/FXdiv' 2024-08-20T21:58:37.2503427Z Entering 'third_party/NNPACK' 2024-08-20T21:58:37.2549846Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T21:58:37.2594754Z Entering 'third_party/XNNPACK' 2024-08-20T21:58:37.2656854Z Entering 'third_party/benchmark' 2024-08-20T21:58:37.2703421Z Entering 'third_party/cpp-httplib' 2024-08-20T21:58:37.2752926Z Entering 'third_party/cpuinfo' 2024-08-20T21:58:37.2805637Z Entering 'third_party/cudnn_frontend' 2024-08-20T21:58:37.2862390Z Entering 'third_party/cutlass' 2024-08-20T21:58:37.2917555Z Entering 'third_party/eigen' 2024-08-20T21:58:37.2963917Z Entering 'third_party/fbgemm' 2024-08-20T21:58:37.3014815Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T21:58:37.3058196Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T21:58:37.3102406Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T21:58:37.3153458Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T21:58:37.3201074Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T21:58:37.3252718Z Entering 'third_party/flatbuffers' 2024-08-20T21:58:37.3302193Z Entering 'third_party/fmt' 2024-08-20T21:58:37.3348238Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T21:58:37.3394741Z Entering 'third_party/gloo' 2024-08-20T21:58:37.3440613Z Entering 'third_party/googletest' 2024-08-20T21:58:37.3486441Z Entering 'third_party/ideep' 2024-08-20T21:58:37.3531145Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T21:58:37.3583157Z Entering 'third_party/ittapi' 2024-08-20T21:58:37.3635215Z Entering 'third_party/kineto' 2024-08-20T21:58:37.3679953Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T21:58:37.3732107Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T21:58:37.3782061Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T21:58:37.3830615Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T21:58:37.3873908Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T21:58:37.3921627Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T21:58:37.3968074Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T21:58:37.4021206Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T21:58:37.4073522Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T21:58:37.4123924Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T21:58:37.4169175Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T21:58:37.4219865Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T21:58:37.4273335Z Entering 'third_party/mimalloc' 2024-08-20T21:58:37.4323195Z Entering 'third_party/nccl/nccl' 2024-08-20T21:58:37.4369121Z Entering 'third_party/nlohmann' 2024-08-20T21:58:37.4416744Z Entering 'third_party/onnx' 2024-08-20T21:58:37.4475647Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T21:58:37.4521288Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T21:58:37.4572211Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T21:58:37.4621270Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T21:58:37.4667000Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T21:58:37.4711498Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T21:58:37.4762394Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T21:58:37.4808241Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T21:58:37.4851761Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T21:58:37.4898147Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T21:58:37.4941889Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T21:58:37.4987888Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T21:58:37.5042479Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T21:58:37.5109196Z Entering 'third_party/pocketfft' 2024-08-20T21:58:37.5153275Z Entering 'third_party/protobuf' 2024-08-20T21:58:37.5205321Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T21:58:37.5251441Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T21:58:37.5302308Z Entering 'third_party/psimd' 2024-08-20T21:58:37.5348269Z Entering 'third_party/pthreadpool' 2024-08-20T21:58:37.5393752Z Entering 'third_party/pybind11' 2024-08-20T21:58:37.5439354Z Entering 'third_party/python-peachpy' 2024-08-20T21:58:37.5484614Z Entering 'third_party/sleef' 2024-08-20T21:58:37.5534407Z Entering 'third_party/tensorpipe' 2024-08-20T21:58:37.5578922Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T21:58:37.5622721Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T21:58:37.5667386Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T21:58:37.5711233Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T21:58:37.5755562Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T21:58:37.5820809Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-20T21:58:37.5845283Z http.https://github.com/.extraheader 2024-08-20T21:58:37.5852193Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-20T21:58:37.5887649Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-20T21:58:37.6156680Z Entering 'android/libs/fbjni' 2024-08-20T21:58:37.6189345Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6226047Z Entering 'third_party/FP16' 2024-08-20T21:58:37.6260216Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6295561Z Entering 'third_party/FXdiv' 2024-08-20T21:58:37.6328232Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6360793Z Entering 'third_party/NNPACK' 2024-08-20T21:58:37.6401489Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6438411Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-20T21:58:37.6469642Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6502277Z Entering 'third_party/XNNPACK' 2024-08-20T21:58:37.6538548Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6589402Z Entering 'third_party/benchmark' 2024-08-20T21:58:37.6621513Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6652862Z Entering 'third_party/cpp-httplib' 2024-08-20T21:58:37.6688108Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6722352Z Entering 'third_party/cpuinfo' 2024-08-20T21:58:37.6758956Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6793281Z Entering 'third_party/cudnn_frontend' 2024-08-20T21:58:37.6824160Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6859804Z Entering 'third_party/cutlass' 2024-08-20T21:58:37.6889048Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6926077Z Entering 'third_party/eigen' 2024-08-20T21:58:37.6961753Z http.https://github.com/.extraheader 2024-08-20T21:58:37.6996739Z Entering 'third_party/fbgemm' 2024-08-20T21:58:37.7029751Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7063451Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-20T21:58:37.7098775Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7132330Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-20T21:58:37.7169124Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7199507Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-20T21:58:37.7235849Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7275074Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-20T21:58:37.7309536Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7345692Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-20T21:58:37.7378828Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7410784Z Entering 'third_party/flatbuffers' 2024-08-20T21:58:37.7448579Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7480762Z Entering 'third_party/fmt' 2024-08-20T21:58:37.7513533Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7547574Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-20T21:58:37.7582356Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7615575Z Entering 'third_party/gloo' 2024-08-20T21:58:37.7650662Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7683903Z Entering 'third_party/googletest' 2024-08-20T21:58:37.7721889Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7750575Z Entering 'third_party/ideep' 2024-08-20T21:58:37.7787992Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7824325Z Entering 'third_party/ideep/mkl-dnn' 2024-08-20T21:58:37.7853713Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7895064Z Entering 'third_party/ittapi' 2024-08-20T21:58:37.7927597Z http.https://github.com/.extraheader 2024-08-20T21:58:37.7959094Z Entering 'third_party/kineto' 2024-08-20T21:58:37.7997009Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8029233Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-20T21:58:37.8061608Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8094421Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-20T21:58:37.8124484Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8165930Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-20T21:58:37.8196003Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8228838Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-20T21:58:37.8261278Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8289459Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-20T21:58:37.8323558Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8355741Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-20T21:58:37.8386964Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8426686Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-20T21:58:37.8457750Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8488287Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-20T21:58:37.8521265Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8555794Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-20T21:58:37.8587796Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8619306Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-20T21:58:37.8656707Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8687244Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-20T21:58:37.8718577Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8754268Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-20T21:58:37.8787607Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8823219Z Entering 'third_party/mimalloc' 2024-08-20T21:58:37.8857234Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8888144Z Entering 'third_party/nccl/nccl' 2024-08-20T21:58:37.8921203Z http.https://github.com/.extraheader 2024-08-20T21:58:37.8952802Z Entering 'third_party/nlohmann' 2024-08-20T21:58:37.8987891Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9025122Z Entering 'third_party/onnx' 2024-08-20T21:58:37.9056998Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9104589Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-20T21:58:37.9136179Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9174313Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-20T21:58:37.9206333Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9243340Z Entering 'third_party/opentelemetry-cpp' 2024-08-20T21:58:37.9273965Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9311114Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-20T21:58:37.9340787Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9375968Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-20T21:58:37.9406964Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9441284Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-20T21:58:37.9473115Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9505239Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-20T21:58:37.9535773Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9571339Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-20T21:58:37.9602826Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9637258Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-20T21:58:37.9667161Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9699967Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-20T21:58:37.9730120Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9760301Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-20T21:58:37.9790357Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9823042Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-20T21:58:37.9853036Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9889608Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-20T21:58:37.9922765Z http.https://github.com/.extraheader 2024-08-20T21:58:37.9973816Z Entering 'third_party/pocketfft' 2024-08-20T21:58:38.0006917Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0037909Z Entering 'third_party/protobuf' 2024-08-20T21:58:38.0069401Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0106953Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-20T21:58:38.0137053Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0169527Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-20T21:58:38.0200953Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0238176Z Entering 'third_party/psimd' 2024-08-20T21:58:38.0269239Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0304724Z Entering 'third_party/pthreadpool' 2024-08-20T21:58:38.0335775Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0371793Z Entering 'third_party/pybind11' 2024-08-20T21:58:38.0404887Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0439277Z Entering 'third_party/python-peachpy' 2024-08-20T21:58:38.0470104Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0507072Z Entering 'third_party/sleef' 2024-08-20T21:58:38.0536955Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0578016Z Entering 'third_party/tensorpipe' 2024-08-20T21:58:38.0607327Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0645002Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-20T21:58:38.0680201Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0714286Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-20T21:58:38.0749042Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0784336Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-20T21:58:38.0820281Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0852930Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-20T21:58:38.0889137Z http.https://github.com/.extraheader 2024-08-20T21:58:38.0922382Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-20T21:58:38.0952725Z http.https://github.com/.extraheader 2024-08-20T21:58:38.1087868Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-20T21:58:38.1108567Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-20T21:58:38.1113110Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-20T21:58:38.1113793Z ##[endgroup] 2024-08-20T21:58:44.1492007Z Cleaning up orphan processes