2023-01-11T21:02:11.6121754Z Requested labels: linux.4xlarge.nvidia.gpu 2023-01-11T21:02:11.6121845Z Job defined at: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/pull/91627/merge 2023-01-11T21:02:11.6121951Z Reusable workflow chain: 2023-01-11T21:02:11.6122009Z pytorch/pytorch/.github/workflows/pull.yml@refs/pull/91627/merge (57fc38f02f250896a12b32cfa200a6105a03d09c) 2023-01-11T21:02:11.6122051Z -> pytorch/pytorch/.github/workflows/_linux-test.yml@refs/pull/91627/merge (57fc38f02f250896a12b32cfa200a6105a03d09c) 2023-01-11T21:02:11.6122076Z Waiting for a runner to pick up this job... 2023-01-11T21:02:12.3853747Z Job is about to start running on the runner: i-08fd0b6c01e2fc030 (organization) 2023-01-11T21:02:17.3091016Z Current runner version: '2.300.2' 2023-01-11T21:02:17.3099115Z Runner name: 'i-08fd0b6c01e2fc030' 2023-01-11T21:02:17.3099927Z Runner group name: 'Default' 2023-01-11T21:02:17.3100808Z Machine name: 'ip-10-0-0-97' 2023-01-11T21:02:17.3103656Z ##[group]GITHUB_TOKEN Permissions 2023-01-11T21:02:17.3104777Z Actions: read 2023-01-11T21:02:17.3105318Z Checks: read 2023-01-11T21:02:17.3105779Z Contents: read 2023-01-11T21:02:17.3106188Z Deployments: read 2023-01-11T21:02:17.3106716Z Discussions: read 2023-01-11T21:02:17.3107175Z Issues: read 2023-01-11T21:02:17.3107562Z Metadata: read 2023-01-11T21:02:17.3108043Z Packages: read 2023-01-11T21:02:17.3108493Z Pages: read 2023-01-11T21:02:17.3108953Z PullRequests: read 2023-01-11T21:02:17.3109504Z RepositoryProjects: read 2023-01-11T21:02:17.3110017Z SecurityEvents: read 2023-01-11T21:02:17.3110478Z Statuses: read 2023-01-11T21:02:17.3110879Z ##[endgroup] 2023-01-11T21:02:17.3115628Z Secret source: None 2023-01-11T21:02:17.3116582Z Prepare workflow directory 2023-01-11T21:02:17.6365394Z Prepare all required actions 2023-01-11T21:02:17.6606252Z Getting action download info 2023-01-11T21:02:18.9417604Z Download action repository 'pytorch/test-infra@main' (SHA:2c225610d00fb13c04fcd60389d3e4d8326167c3) 2023-01-11T21:02:19.3938162Z Download action repository 'pytorch/pytorch@master' (SHA:c5836153f5332ca83d5cacde38f2829a4d54793e) 2023-01-11T21:02:22.9542430Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2023-01-11T21:02:23.2714454Z Getting action download info 2023-01-11T21:02:23.4681831Z Download action repository 'malfet/checkout@silent-checkout' (SHA:c7b8fef48edfe1bca0044a44b1f7f7c4318a3076) 2023-01-11T21:02:23.6736501Z Getting action download info 2023-01-11T21:02:23.8556889Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2023-01-11T21:02:24.0898175Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml 2023-01-11T21:02:24.0900909Z ##[group] Inputs 2023-01-11T21:02:24.0901370Z build-environment: linux-bionic-cuda11.6-py3.10-gcc7 2023-01-11T21:02:24.0902676Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 3, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 4, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "distributed", shard: 1, num_shards: 3, runner: "linux.8xlarge.nvidia.gpu" }, { config: "distributed", shard: 2, num_shards: 3, runner: "linux.8xlarge.nvidia.gpu" }, { config: "distributed", shard: 3, num_shards: 3, runner: "linux.8xlarge.nvidia.gpu" }, { config: "functorch", shard: 1, num_shards: 1, runner: "linux.4xlarge.nvidia.gpu" }, { config: "deploy", shard: 1, num_shards: 1, runner: "linux.4xlarge.nvidia.gpu" }, ]} 2023-01-11T21:02:24.0904097Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:02:24.0904650Z sync-tag: 2023-01-11T21:02:24.0905765Z timeout-minutes: 240 2023-01-11T21:02:24.0906089Z use-gha: 2023-01-11T21:02:24.0906404Z ##[endgroup] 2023-01-11T21:02:24.0907245Z Complete job name: linux-bionic-cuda11.6-py3.10-gcc7 / test (deploy, 1, 1, linux.4xlarge.nvidia.gpu) 2023-01-11T21:02:24.1919319Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2023-01-11T21:02:24.1919755Z with: 2023-01-11T21:02:24.1920430Z github-secret: *** 2023-01-11T21:02:24.1920962Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2023-01-11T21:02:24.1921462Z activate-with-label: false 2023-01-11T21:02:24.1921763Z label: with-ssh 2023-01-11T21:02:24.1922093Z remove-existing-keys: true 2023-01-11T21:02:24.1922414Z env: 2023-01-11T21:02:24.1922694Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:02:24.1923186Z ##[endgroup] 2023-01-11T21:02:25.0135718Z Grabbing public ssh keys from https://github.com/LucaLumetti.keys 2023-01-11T21:02:25.0968493Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2023-01-11T21:02:25.0991127Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2023-01-11T21:02:25.1038527Z Login using: ssh ec2-user@ec2-35-153-184-18.compute-1.amazonaws.com 2023-01-11T21:02:25.1039271Z All testing is done inside the container, to start an interactive session run: 2023-01-11T21:02:25.1039716Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2023-01-11T21:02:25.1345651Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@master 2023-01-11T21:02:25.1346032Z with: 2023-01-11T21:02:25.1346277Z submodules: recursive 2023-01-11T21:02:25.1346531Z fetch-depth: 0 2023-01-11T21:02:25.1346770Z env: 2023-01-11T21:02:25.1347006Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:02:25.1347250Z ##[endgroup] 2023-01-11T21:02:25.1641831Z ##[group]Run retry () { 2023-01-11T21:02:25.1642172Z retry () { 2023-01-11T21:02:25.1642487Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2023-01-11T21:02:25.1642762Z } 2023-01-11T21:02:25.1643023Z echo "${GITHUB_WORKSPACE}" 2023-01-11T21:02:25.1643321Z if [ -z "${NO_SUDO}" ]; then 2023-01-11T21:02:25.1643614Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2023-01-11T21:02:25.1643895Z else 2023-01-11T21:02:25.1644178Z  retry rm -rf "${GITHUB_WORKSPACE}" 2023-01-11T21:02:25.1644436Z fi 2023-01-11T21:02:25.1644749Z mkdir "${GITHUB_WORKSPACE}" 2023-01-11T21:02:25.1664720Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:02:25.1665036Z env: 2023-01-11T21:02:25.1665289Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:02:25.1665543Z NO_SUDO: 2023-01-11T21:02:25.1665773Z ##[endgroup] 2023-01-11T21:02:25.1792567Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:02:28.2283453Z ##[group]Run malfet/checkout@silent-checkout 2023-01-11T21:02:28.2284045Z with: 2023-01-11T21:02:28.2284575Z ref: 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:02:28.2285127Z fetch-depth: 0 2023-01-11T21:02:28.2285610Z submodules: recursive 2023-01-11T21:02:28.2286121Z quiet-checkout: true 2023-01-11T21:02:28.2286650Z repository: pytorch/pytorch 2023-01-11T21:02:28.2287381Z token: *** 2023-01-11T21:02:28.2287822Z ssh-strict: true 2023-01-11T21:02:28.2288298Z persist-credentials: true 2023-01-11T21:02:28.2288771Z clean: true 2023-01-11T21:02:28.2289161Z lfs: false 2023-01-11T21:02:28.2289591Z set-safe-directory: true 2023-01-11T21:02:28.2290021Z env: 2023-01-11T21:02:28.2290405Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:02:28.2290843Z ##[endgroup] 2023-01-11T21:02:28.3846579Z Syncing repository: pytorch/pytorch 2023-01-11T21:02:28.3848490Z ##[group]Getting Git version info 2023-01-11T21:02:28.3849043Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2023-01-11T21:02:28.3849655Z [command]/usr/bin/git version 2023-01-11T21:02:28.3849928Z git version 2.38.1 2023-01-11T21:02:28.3864134Z ##[endgroup] 2023-01-11T21:02:28.3885217Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/fdbc477b-c00a-4d3b-ae64-b62bbf5208d5' before making global git config changes 2023-01-11T21:02:28.3886411Z Adding repository directory to the temporary git global config as a safe directory 2023-01-11T21:02:28.3893037Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:02:28.3939663Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2023-01-11T21:02:28.3946970Z ##[group]Initializing the repository 2023-01-11T21:02:28.3951042Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:02:28.3984797Z hint: Using 'master' as the name for the initial branch. This default branch name 2023-01-11T21:02:28.3985583Z hint: is subject to change. To configure the initial branch name to use in all 2023-01-11T21:02:28.3986233Z hint: of your new repositories, which will suppress this warning, call: 2023-01-11T21:02:28.3986557Z hint: 2023-01-11T21:02:28.3986968Z hint: git config --global init.defaultBranch 2023-01-11T21:02:28.3987398Z hint: 2023-01-11T21:02:28.3987814Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-01-11T21:02:28.3988312Z hint: 'development'. The just-created branch can be renamed via this command: 2023-01-11T21:02:28.3988647Z hint: 2023-01-11T21:02:28.3989072Z hint: git branch -m 2023-01-11T21:02:28.3989568Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2023-01-11T21:02:28.4000424Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2023-01-11T21:02:28.4034696Z ##[endgroup] 2023-01-11T21:02:28.4035170Z ##[group]Disabling automatic garbage collection 2023-01-11T21:02:28.4040225Z [command]/usr/bin/git config --local gc.auto 0 2023-01-11T21:02:28.4072392Z ##[endgroup] 2023-01-11T21:02:28.4073379Z ##[group]Setting up auth 2023-01-11T21:02:28.4083394Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-01-11T21:02:28.4118716Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2023-01-11T21:02:28.4429376Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-01-11T21:02:28.4467009Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2023-01-11T21:02:28.4777687Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2023-01-11T21:02:28.4827441Z ##[endgroup] 2023-01-11T21:02:28.4828009Z ##[group]Fetching the repository 2023-01-11T21:02:28.4836890Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --quiet --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2023-01-11T21:03:30.0364910Z [command]/usr/bin/git rev-parse --verify --quiet 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e^{object} 2023-01-11T21:03:30.0396550Z 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:03:30.0404905Z ##[endgroup] 2023-01-11T21:03:30.0405590Z ##[group]Determining the checkout info 2023-01-11T21:03:30.0406323Z ##[endgroup] 2023-01-11T21:03:30.0406992Z ##[group]Checking out the ref 2023-01-11T21:03:30.0410205Z [command]/usr/bin/git checkout --quiet --force 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:03:31.8132430Z ##[endgroup] 2023-01-11T21:03:31.8133253Z ##[group]Setting up auth for fetching submodules 2023-01-11T21:03:31.8138916Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2023-01-11T21:03:31.8195681Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2023-01-11T21:03:31.8229267Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2023-01-11T21:03:31.8262234Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2023-01-11T21:03:31.8293595Z ##[endgroup] 2023-01-11T21:03:31.8294130Z ##[group]Fetching submodules 2023-01-11T21:03:31.8299164Z [command]/usr/bin/git submodule sync --recursive 2023-01-11T21:03:31.8625307Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2023-01-11T21:03:31.8940177Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2023-01-11T21:03:31.8943888Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2023-01-11T21:03:31.8947830Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2023-01-11T21:03:31.8951969Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2023-01-11T21:03:31.8956391Z Submodule 'third_party/QNNPACK' (https://github.com/pytorch/QNNPACK) registered for path 'third_party/QNNPACK' 2023-01-11T21:03:31.8961676Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2023-01-11T21:03:31.8966190Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2023-01-11T21:03:31.8970781Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2023-01-11T21:03:31.8975659Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2023-01-11T21:03:31.8980655Z Submodule 'third_party/cub' (https://github.com/NVlabs/cub.git) registered for path 'third_party/cub' 2023-01-11T21:03:31.8985853Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2023-01-11T21:03:31.8991012Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2023-01-11T21:03:31.8996264Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2023-01-11T21:03:31.9003021Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2023-01-11T21:03:31.9008455Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2023-01-11T21:03:31.9014366Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2023-01-11T21:03:31.9019953Z Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi' 2023-01-11T21:03:31.9025886Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2023-01-11T21:03:31.9031864Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2023-01-11T21:03:31.9038288Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2023-01-11T21:03:31.9045152Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2023-01-11T21:03:31.9051608Z Submodule 'third_party/ios-cmake' (https://github.com/Yangqing/ios-cmake.git) registered for path 'third_party/ios-cmake' 2023-01-11T21:03:31.9058188Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2023-01-11T21:03:31.9065031Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2023-01-11T21:03:31.9071798Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2023-01-11T21:03:31.9078799Z Submodule 'third_party/neon2sse' (https://github.com/intel/ARM_NEON_2_x86_SSE.git) registered for path 'third_party/neon2sse' 2023-01-11T21:03:31.9086394Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2023-01-11T21:03:31.9093470Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2023-01-11T21:03:31.9100902Z Submodule 'third_party/onnx-tensorrt' (https://github.com/onnx/onnx-tensorrt) registered for path 'third_party/onnx-tensorrt' 2023-01-11T21:03:31.9108365Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2023-01-11T21:03:31.9116059Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2023-01-11T21:03:31.9124541Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2023-01-11T21:03:31.9132377Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2023-01-11T21:03:31.9140242Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2023-01-11T21:03:31.9148536Z Submodule 'third_party/python-enum' (https://github.com/PeachPy/enum34.git) registered for path 'third_party/python-enum' 2023-01-11T21:03:31.9156764Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2023-01-11T21:03:31.9166491Z Submodule 'third_party/python-six' (https://github.com/benjaminp/six.git) registered for path 'third_party/python-six' 2023-01-11T21:03:31.9174821Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2023-01-11T21:03:31.9183622Z Submodule 'third_party/tbb' (https://github.com/01org/tbb) registered for path 'third_party/tbb' 2023-01-11T21:03:31.9192602Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2023-01-11T21:03:31.9202123Z Submodule 'third_party/zstd' (https://github.com/facebook/zstd.git) registered for path 'third_party/zstd' 2023-01-11T21:03:31.9234041Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2023-01-11T21:03:32.2350343Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2023-01-11T21:03:32.4758123Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2023-01-11T21:03:32.7196115Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2023-01-11T21:03:33.0474266Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/QNNPACK'... 2023-01-11T21:03:33.3690806Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2023-01-11T21:03:35.6071712Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2023-01-11T21:03:42.2607860Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2023-01-11T21:03:42.7012473Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2023-01-11T21:03:43.3267845Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cub'... 2023-01-11T21:03:44.9466339Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2023-01-11T21:03:47.1799907Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2023-01-11T21:03:48.6068915Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2023-01-11T21:03:55.6956135Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2023-01-11T21:03:56.5414646Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2023-01-11T21:03:58.2297623Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2023-01-11T21:03:59.8991514Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/foxi'... 2023-01-11T21:04:00.1244128Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2023-01-11T21:04:00.6830146Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2023-01-11T21:04:01.1212831Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2023-01-11T21:04:02.6119685Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2023-01-11T21:04:03.6362834Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ios-cmake'... 2023-01-11T21:04:04.1903654Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2023-01-11T21:04:04.4974141Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2023-01-11T21:04:06.2985693Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2023-01-11T21:04:06.7156673Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/neon2sse'... 2023-01-11T21:04:07.1565861Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2023-01-11T21:04:13.8350796Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2023-01-11T21:04:15.8100499Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx-tensorrt'... 2023-01-11T21:04:16.3384194Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2023-01-11T21:04:16.6025578Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2023-01-11T21:04:23.0922572Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2023-01-11T21:04:23.5280871Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2023-01-11T21:04:23.7921207Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2023-01-11T21:04:24.7944736Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-enum'... 2023-01-11T21:04:25.0558704Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2023-01-11T21:04:25.4157250Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-six'... 2023-01-11T21:04:25.7327748Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2023-01-11T21:04:26.3479196Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tbb'... 2023-01-11T21:04:28.6142942Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2023-01-11T21:04:29.1355077Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/zstd'... 2023-01-11T21:04:31.7053047Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2023-01-11T21:04:31.7176540Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2023-01-11T21:04:31.7274182Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2023-01-11T21:04:31.7560328Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2023-01-11T21:04:31.7839764Z Submodule path 'third_party/QNNPACK': checked out '7d2a4e9931a82adc3814275b6219a03e24e36b4c' 2023-01-11T21:04:31.8287054Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2023-01-11T21:04:32.6056753Z Submodule path 'third_party/XNNPACK': checked out 'ae108ef49aa5623b896fc93d4298c49d1750d9ba' 2023-01-11T21:04:32.6308102Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2023-01-11T21:04:32.7536385Z Submodule path 'third_party/cpuinfo': checked out '8ec7bd91ad0470e61cf38f618cc1f270dede599c' 2023-01-11T21:04:32.7958181Z Submodule path 'third_party/cub': checked out 'd106ddb991a56c3df1b6d51b2409e36ba8181ce4' 2023-01-11T21:04:33.1537844Z Submodule path 'third_party/cudnn_frontend': checked out '171a7a986f7fbd9ed71bd0cf3c7ad4f55843d6b3' 2023-01-11T21:04:33.6718246Z Submodule path 'third_party/cutlass': checked out 'b72cbf957df8cf84a6d0ff91c190ad51a9c1d24a' 2023-01-11T21:04:33.9856157Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2023-01-11T21:04:34.0445516Z Submodule path 'third_party/fbgemm': checked out '80d64206c07879fd4683be66873de7cefa1a0a71' 2023-01-11T21:04:34.0464766Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2023-01-11T21:04:34.0467865Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2023-01-11T21:04:34.0471435Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2023-01-11T21:04:34.0475145Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2023-01-11T21:04:34.0503200Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2023-01-11T21:04:35.1221293Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2023-01-11T21:04:35.7548394Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2023-01-11T21:04:36.8394925Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2023-01-11T21:04:37.2040744Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2023-01-11T21:04:37.3310328Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2023-01-11T21:04:37.4023295Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2023-01-11T21:04:37.4145598Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '1840658c184f3eeba787dae0f06c45756c1daaf5' 2023-01-11T21:04:37.5195723Z Submodule path 'third_party/flatbuffers': checked out 'd0cede9c90c5257537c293517a21376408b549fa' 2023-01-11T21:04:37.5644352Z Submodule path 'third_party/fmt': checked out '7bdf0628b1276379886c7f6dda2cef2b3b374f0b' 2023-01-11T21:04:37.5748368Z Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad' 2023-01-11T21:04:37.6235031Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2023-01-11T21:04:37.6536309Z Submodule path 'third_party/gloo': checked out '4a5e339b764261d20fc409071dc7a8b8989aa195' 2023-01-11T21:04:37.7109513Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2023-01-11T21:04:37.7249409Z Submodule path 'third_party/ideep': checked out 'e533c771a1e75a1c225c14b2261eefa62681d9e6' 2023-01-11T21:04:37.7266115Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2023-01-11T21:04:37.7293057Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2023-01-11T21:04:47.3963012Z Submodule path 'third_party/ideep/mkl-dnn': checked out '404ad76ee633c939d705eb583ffe50a806969d5e' 2023-01-11T21:04:47.3983773Z Submodule 'third_party/oneDNN' (https://github.com/oneapi-src/oneDNN.git) registered for path 'third_party/ideep/mkl-dnn/third_party/oneDNN' 2023-01-11T21:04:47.4012367Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn/third_party/oneDNN'... 2023-01-11T21:04:57.1073054Z Submodule path 'third_party/ideep/mkl-dnn/third_party/oneDNN': checked out 'fbec3e25a559ee252022ae066817b204e106a6ba' 2023-01-11T21:04:57.1191846Z Submodule path 'third_party/ios-cmake': checked out '8abaed637d56f1337d6e1d2c4026e25c1eade724' 2023-01-11T21:04:57.1365475Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2023-01-11T21:04:57.2492262Z Submodule path 'third_party/kineto': checked out '6c1629809068efd78a8d56b4aa479c7ec49ae562' 2023-01-11T21:04:57.2511041Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2023-01-11T21:04:57.2513971Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2023-01-11T21:04:57.2542293Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2023-01-11T21:04:58.5853857Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2023-01-11T21:04:59.7220011Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '2591ab91c3898c9f6544fff04660276537d32ffd' 2023-01-11T21:04:59.7893300Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2023-01-11T21:04:59.8149443Z Submodule path 'third_party/nccl/nccl': checked out 'f89fd4777d2ef9229c039ff750ae21da01626f52' 2023-01-11T21:04:59.8309667Z Submodule path 'third_party/neon2sse': checked out '97a126f08ce318023be604d03f88bf0820a9464a' 2023-01-11T21:04:59.9624316Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2023-01-11T21:05:00.2927444Z Submodule path 'third_party/onnx': checked out 'f7ee1ac60d06abe8e26c9b6bbe1e3db5286b614b' 2023-01-11T21:05:00.2960036Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2023-01-11T21:05:00.2964347Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2023-01-11T21:05:00.2993235Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2023-01-11T21:05:01.4384112Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2023-01-11T21:05:02.6116828Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2023-01-11T21:05:02.6499314Z Submodule path 'third_party/onnx/third_party/pybind11': checked out 'ffa346860b306c9bbfb341aed9c14c067751feb8' 2023-01-11T21:05:02.6675661Z Submodule path 'third_party/onnx-tensorrt': checked out 'c153211418a7c57ce071d9ce2a41f8d1c85a878f' 2023-01-11T21:05:02.6692883Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx-tensorrt/third_party/onnx' 2023-01-11T21:05:02.6718289Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx-tensorrt/third_party/onnx'... 2023-01-11T21:05:04.9191281Z Submodule path 'third_party/onnx-tensorrt/third_party/onnx': checked out '765f5ee823a67a866f4bd28a9860e81f3c811ce8' 2023-01-11T21:05:04.9216271Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark' 2023-01-11T21:05:04.9219996Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11' 2023-01-11T21:05:04.9249389Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark'... 2023-01-11T21:05:05.3918262Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11'... 2023-01-11T21:05:06.4023530Z Submodule path 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark': checked out 'e776aa0275e293707b6a0901e0e8d8a8a3679508' 2023-01-11T21:05:06.4844448Z Submodule path 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11': checked out 'a1041190c8b8ff0cd9e2f0752248ad5e3789ea0c' 2023-01-11T21:05:06.4861405Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang' 2023-01-11T21:05:06.4889039Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang'... 2023-01-11T21:05:08.1560909Z Submodule path 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2023-01-11T21:05:08.1665917Z Submodule path 'third_party/pocketfft': checked out 'ea778e37710c07723435b1be58235996d1d43a5a' 2023-01-11T21:05:08.4916965Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2023-01-11T21:05:08.4941308Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2023-01-11T21:05:08.4944726Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2023-01-11T21:05:08.4973539Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2023-01-11T21:05:09.4006043Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2023-01-11T21:05:10.5672073Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2023-01-11T21:05:10.6503993Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2023-01-11T21:05:10.6600013Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2023-01-11T21:05:10.6729270Z Submodule path 'third_party/pthreadpool': checked out 'a134dd5d4cee80cce15db81a72e7f929d71dd413' 2023-01-11T21:05:10.7133001Z Submodule path 'third_party/pybind11': checked out '80dc998efced8ceb2be59756668a7e90e8bef917' 2023-01-11T21:05:10.7233764Z Submodule path 'third_party/python-enum': checked out '4cfedc426c4e2fc52e3f5c2b4297e15ed8d6b8c7' 2023-01-11T21:05:10.7580621Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2023-01-11T21:05:10.7688881Z Submodule path 'third_party/python-six': checked out '15e31431af97e5e64b80af0a3f598d382bcdd49a' 2023-01-11T21:05:10.8225598Z Submodule path 'third_party/sleef': checked out 'e0a003ee838b75d11763aa9c3ef17bf71a725bff' 2023-01-11T21:05:10.9616385Z Submodule path 'third_party/tbb': checked out 'a51a90bc609bb73db8ea13841b5cf7aa4344d4a9' 2023-01-11T21:05:10.9931529Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2023-01-11T21:05:10.9949563Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2023-01-11T21:05:10.9953542Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2023-01-11T21:05:10.9957581Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2023-01-11T21:05:10.9962130Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2023-01-11T21:05:10.9988202Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2023-01-11T21:05:12.1442058Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2023-01-11T21:05:12.4610406Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2023-01-11T21:05:13.8413896Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2023-01-11T21:05:14.8935239Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2023-01-11T21:05:14.9115015Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2023-01-11T21:05:14.9887436Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2023-01-11T21:05:15.0229400Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2023-01-11T21:05:15.0247015Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2023-01-11T21:05:15.0275739Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2023-01-11T21:05:15.2724000Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2023-01-11T21:05:15.4370687Z Submodule path 'third_party/zstd': checked out 'aec56a52fbab207fc639a1937d1e708a282edca8' 2023-01-11T21:05:15.4404790Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2023-01-11T21:05:15.4736976Z Entering 'android/libs/fbjni' 2023-01-11T21:05:15.4781761Z Entering 'third_party/FP16' 2023-01-11T21:05:15.4838079Z Entering 'third_party/FXdiv' 2023-01-11T21:05:15.4894733Z Entering 'third_party/NNPACK' 2023-01-11T21:05:15.4939505Z Entering 'third_party/QNNPACK' 2023-01-11T21:05:15.4985722Z Entering 'third_party/VulkanMemoryAllocator' 2023-01-11T21:05:15.5045986Z Entering 'third_party/XNNPACK' 2023-01-11T21:05:15.5101889Z Entering 'third_party/benchmark' 2023-01-11T21:05:15.5147825Z Entering 'third_party/cpuinfo' 2023-01-11T21:05:15.5192271Z Entering 'third_party/cub' 2023-01-11T21:05:15.5237711Z Entering 'third_party/cudnn_frontend' 2023-01-11T21:05:15.5288939Z Entering 'third_party/cutlass' 2023-01-11T21:05:15.5342304Z Entering 'third_party/eigen' 2023-01-11T21:05:15.5389134Z Entering 'third_party/fbgemm' 2023-01-11T21:05:15.5433846Z Entering 'third_party/fbgemm/third_party/asmjit' 2023-01-11T21:05:15.5476849Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2023-01-11T21:05:15.5520727Z Entering 'third_party/fbgemm/third_party/googletest' 2023-01-11T21:05:15.5563453Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2023-01-11T21:05:15.5607789Z Entering 'third_party/flatbuffers' 2023-01-11T21:05:15.5657054Z Entering 'third_party/fmt' 2023-01-11T21:05:15.5703686Z Entering 'third_party/foxi' 2023-01-11T21:05:15.5751618Z Entering 'third_party/gemmlowp/gemmlowp' 2023-01-11T21:05:15.5799104Z Entering 'third_party/gloo' 2023-01-11T21:05:15.5844933Z Entering 'third_party/googletest' 2023-01-11T21:05:15.5889758Z Entering 'third_party/ideep' 2023-01-11T21:05:15.5932997Z Entering 'third_party/ideep/mkl-dnn' 2023-01-11T21:05:15.5978650Z Entering 'third_party/ideep/mkl-dnn/third_party/oneDNN' 2023-01-11T21:05:15.6033677Z Entering 'third_party/ios-cmake' 2023-01-11T21:05:15.6076819Z Entering 'third_party/ittapi' 2023-01-11T21:05:15.6121521Z Entering 'third_party/kineto' 2023-01-11T21:05:15.6165233Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2023-01-11T21:05:15.6208940Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2023-01-11T21:05:15.6255808Z Entering 'third_party/nccl/nccl' 2023-01-11T21:05:15.6299644Z Entering 'third_party/neon2sse' 2023-01-11T21:05:15.6343763Z Entering 'third_party/nlohmann' 2023-01-11T21:05:15.6389602Z Entering 'third_party/onnx' 2023-01-11T21:05:15.6449208Z Entering 'third_party/onnx/third_party/benchmark' 2023-01-11T21:05:15.6494208Z Entering 'third_party/onnx/third_party/pybind11' 2023-01-11T21:05:15.6539089Z Entering 'third_party/onnx-tensorrt' 2023-01-11T21:05:15.6583062Z Entering 'third_party/onnx-tensorrt/third_party/onnx' 2023-01-11T21:05:15.6632488Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark' 2023-01-11T21:05:15.6677266Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11' 2023-01-11T21:05:15.6722122Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang' 2023-01-11T21:05:15.6770608Z Entering 'third_party/pocketfft' 2023-01-11T21:05:15.6814658Z Entering 'third_party/protobuf' 2023-01-11T21:05:15.6861698Z Entering 'third_party/protobuf/third_party/benchmark' 2023-01-11T21:05:15.6905245Z Entering 'third_party/protobuf/third_party/googletest' 2023-01-11T21:05:15.6951263Z Entering 'third_party/psimd' 2023-01-11T21:05:15.6996160Z Entering 'third_party/pthreadpool' 2023-01-11T21:05:15.7039949Z Entering 'third_party/pybind11' 2023-01-11T21:05:15.7084433Z Entering 'third_party/python-enum' 2023-01-11T21:05:15.7127569Z Entering 'third_party/python-peachpy' 2023-01-11T21:05:15.7171420Z Entering 'third_party/python-six' 2023-01-11T21:05:15.7214272Z Entering 'third_party/sleef' 2023-01-11T21:05:15.7260267Z Entering 'third_party/tbb' 2023-01-11T21:05:15.7306078Z Entering 'third_party/tensorpipe' 2023-01-11T21:05:15.7349947Z Entering 'third_party/tensorpipe/third_party/googletest' 2023-01-11T21:05:15.7393441Z Entering 'third_party/tensorpipe/third_party/libnop' 2023-01-11T21:05:15.7436076Z Entering 'third_party/tensorpipe/third_party/libuv' 2023-01-11T21:05:15.7479834Z Entering 'third_party/tensorpipe/third_party/pybind11' 2023-01-11T21:05:15.7520883Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2023-01-11T21:05:15.7568704Z Entering 'third_party/zstd' 2023-01-11T21:05:15.7628127Z ##[endgroup] 2023-01-11T21:05:15.7630495Z ##[group]Persisting credentials for submodules 2023-01-11T21:05:15.7637891Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || : 2023-01-11T21:05:15.8002703Z Entering 'android/libs/fbjni' 2023-01-11T21:05:15.8045982Z Entering 'third_party/FP16' 2023-01-11T21:05:15.8090017Z Entering 'third_party/FXdiv' 2023-01-11T21:05:15.8135025Z Entering 'third_party/NNPACK' 2023-01-11T21:05:15.8179315Z Entering 'third_party/QNNPACK' 2023-01-11T21:05:15.8224040Z Entering 'third_party/VulkanMemoryAllocator' 2023-01-11T21:05:15.8269207Z Entering 'third_party/XNNPACK' 2023-01-11T21:05:15.8326004Z Entering 'third_party/benchmark' 2023-01-11T21:05:15.8370259Z Entering 'third_party/cpuinfo' 2023-01-11T21:05:15.8415899Z Entering 'third_party/cub' 2023-01-11T21:05:15.8460432Z Entering 'third_party/cudnn_frontend' 2023-01-11T21:05:15.8509986Z Entering 'third_party/cutlass' 2023-01-11T21:05:15.8562303Z Entering 'third_party/eigen' 2023-01-11T21:05:15.8608932Z Entering 'third_party/fbgemm' 2023-01-11T21:05:15.8654134Z Entering 'third_party/fbgemm/third_party/asmjit' 2023-01-11T21:05:15.8696363Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2023-01-11T21:05:15.8739767Z Entering 'third_party/fbgemm/third_party/googletest' 2023-01-11T21:05:15.8784900Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2023-01-11T21:05:15.8828608Z Entering 'third_party/flatbuffers' 2023-01-11T21:05:15.8875368Z Entering 'third_party/fmt' 2023-01-11T21:05:15.8919893Z Entering 'third_party/foxi' 2023-01-11T21:05:15.8964204Z Entering 'third_party/gemmlowp/gemmlowp' 2023-01-11T21:05:15.9008863Z Entering 'third_party/gloo' 2023-01-11T21:05:15.9052508Z Entering 'third_party/googletest' 2023-01-11T21:05:15.9096515Z Entering 'third_party/ideep' 2023-01-11T21:05:15.9139547Z Entering 'third_party/ideep/mkl-dnn' 2023-01-11T21:05:15.9186158Z Entering 'third_party/ideep/mkl-dnn/third_party/oneDNN' 2023-01-11T21:05:15.9236900Z Entering 'third_party/ios-cmake' 2023-01-11T21:05:15.9281223Z Entering 'third_party/ittapi' 2023-01-11T21:05:15.9325169Z Entering 'third_party/kineto' 2023-01-11T21:05:15.9369176Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2023-01-11T21:05:15.9411107Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2023-01-11T21:05:15.9454942Z Entering 'third_party/nccl/nccl' 2023-01-11T21:05:15.9498898Z Entering 'third_party/neon2sse' 2023-01-11T21:05:15.9544112Z Entering 'third_party/nlohmann' 2023-01-11T21:05:15.9589794Z Entering 'third_party/onnx' 2023-01-11T21:05:15.9648401Z Entering 'third_party/onnx/third_party/benchmark' 2023-01-11T21:05:15.9692140Z Entering 'third_party/onnx/third_party/pybind11' 2023-01-11T21:05:15.9738486Z Entering 'third_party/onnx-tensorrt' 2023-01-11T21:05:15.9782059Z Entering 'third_party/onnx-tensorrt/third_party/onnx' 2023-01-11T21:05:15.9830944Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark' 2023-01-11T21:05:15.9875402Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11' 2023-01-11T21:05:15.9918322Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang' 2023-01-11T21:05:15.9967197Z Entering 'third_party/pocketfft' 2023-01-11T21:05:16.0012103Z Entering 'third_party/protobuf' 2023-01-11T21:05:16.0060939Z Entering 'third_party/protobuf/third_party/benchmark' 2023-01-11T21:05:16.0106648Z Entering 'third_party/protobuf/third_party/googletest' 2023-01-11T21:05:16.0156275Z Entering 'third_party/psimd' 2023-01-11T21:05:16.0199779Z Entering 'third_party/pthreadpool' 2023-01-11T21:05:16.0244408Z Entering 'third_party/pybind11' 2023-01-11T21:05:16.0288682Z Entering 'third_party/python-enum' 2023-01-11T21:05:16.0332226Z Entering 'third_party/python-peachpy' 2023-01-11T21:05:16.0376095Z Entering 'third_party/python-six' 2023-01-11T21:05:16.0423558Z Entering 'third_party/sleef' 2023-01-11T21:05:16.0469282Z Entering 'third_party/tbb' 2023-01-11T21:05:16.0515088Z Entering 'third_party/tensorpipe' 2023-01-11T21:05:16.0560623Z Entering 'third_party/tensorpipe/third_party/googletest' 2023-01-11T21:05:16.0604778Z Entering 'third_party/tensorpipe/third_party/libnop' 2023-01-11T21:05:16.0648444Z Entering 'third_party/tensorpipe/third_party/libuv' 2023-01-11T21:05:16.0692288Z Entering 'third_party/tensorpipe/third_party/pybind11' 2023-01-11T21:05:16.0734936Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2023-01-11T21:05:16.0780497Z Entering 'third_party/zstd' 2023-01-11T21:05:16.0841376Z [command]/usr/bin/git submodule foreach --recursive git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url 2023-01-11T21:05:16.1174448Z Entering 'android/libs/fbjni' 2023-01-11T21:05:16.1213595Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2023-01-11T21:05:16.1232493Z Entering 'third_party/FP16' 2023-01-11T21:05:16.1272726Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2023-01-11T21:05:16.1292470Z Entering 'third_party/FXdiv' 2023-01-11T21:05:16.1331912Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2023-01-11T21:05:16.1350047Z Entering 'third_party/NNPACK' 2023-01-11T21:05:16.1391198Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2023-01-11T21:05:16.1411346Z Entering 'third_party/QNNPACK' 2023-01-11T21:05:16.1450976Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/QNNPACK/config remote.origin.url 2023-01-11T21:05:16.1469727Z Entering 'third_party/VulkanMemoryAllocator' 2023-01-11T21:05:16.1509211Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2023-01-11T21:05:16.1529641Z Entering 'third_party/XNNPACK' 2023-01-11T21:05:16.1568951Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2023-01-11T21:05:16.1599549Z Entering 'third_party/benchmark' 2023-01-11T21:05:16.1639688Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2023-01-11T21:05:16.1658599Z Entering 'third_party/cpuinfo' 2023-01-11T21:05:16.1698434Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2023-01-11T21:05:16.1717863Z Entering 'third_party/cub' 2023-01-11T21:05:16.1757443Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cub/config remote.origin.url 2023-01-11T21:05:16.1776495Z Entering 'third_party/cudnn_frontend' 2023-01-11T21:05:16.1815534Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2023-01-11T21:05:16.1840215Z Entering 'third_party/cutlass' 2023-01-11T21:05:16.1879560Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2023-01-11T21:05:16.1905961Z Entering 'third_party/eigen' 2023-01-11T21:05:16.1945817Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2023-01-11T21:05:16.1967724Z Entering 'third_party/fbgemm' 2023-01-11T21:05:16.2007742Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2023-01-11T21:05:16.2026001Z Entering 'third_party/fbgemm/third_party/asmjit' 2023-01-11T21:05:16.2065219Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2023-01-11T21:05:16.2083712Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2023-01-11T21:05:16.2123405Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2023-01-11T21:05:16.2141152Z Entering 'third_party/fbgemm/third_party/googletest' 2023-01-11T21:05:16.2180817Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2023-01-11T21:05:16.2199178Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2023-01-11T21:05:16.2238321Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2023-01-11T21:05:16.2257141Z Entering 'third_party/flatbuffers' 2023-01-11T21:05:16.2295984Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2023-01-11T21:05:16.2316542Z Entering 'third_party/fmt' 2023-01-11T21:05:16.2355463Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2023-01-11T21:05:16.2374552Z Entering 'third_party/foxi' 2023-01-11T21:05:16.2413859Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/foxi/config remote.origin.url 2023-01-11T21:05:16.2432401Z Entering 'third_party/gemmlowp/gemmlowp' 2023-01-11T21:05:16.2470995Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2023-01-11T21:05:16.2489582Z Entering 'third_party/gloo' 2023-01-11T21:05:16.2529838Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2023-01-11T21:05:16.2548570Z Entering 'third_party/googletest' 2023-01-11T21:05:16.2588233Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2023-01-11T21:05:16.2607154Z Entering 'third_party/ideep' 2023-01-11T21:05:16.2646208Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2023-01-11T21:05:16.2663481Z Entering 'third_party/ideep/mkl-dnn' 2023-01-11T21:05:16.2703788Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2023-01-11T21:05:16.2724938Z Entering 'third_party/ideep/mkl-dnn/third_party/oneDNN' 2023-01-11T21:05:16.2766234Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/modules/third_party/oneDNN/config remote.origin.url 2023-01-11T21:05:16.2791586Z Entering 'third_party/ios-cmake' 2023-01-11T21:05:16.2833052Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ios-cmake/config remote.origin.url 2023-01-11T21:05:16.2852041Z Entering 'third_party/ittapi' 2023-01-11T21:05:16.2892665Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2023-01-11T21:05:16.2910868Z Entering 'third_party/kineto' 2023-01-11T21:05:16.2951472Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2023-01-11T21:05:16.2969948Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2023-01-11T21:05:16.3010096Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2023-01-11T21:05:16.3029098Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2023-01-11T21:05:16.3069279Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2023-01-11T21:05:16.3089977Z Entering 'third_party/nccl/nccl' 2023-01-11T21:05:16.3130602Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2023-01-11T21:05:16.3148592Z Entering 'third_party/neon2sse' 2023-01-11T21:05:16.3188525Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/neon2sse/config remote.origin.url 2023-01-11T21:05:16.3207954Z Entering 'third_party/nlohmann' 2023-01-11T21:05:16.3248889Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2023-01-11T21:05:16.3268490Z Entering 'third_party/onnx' 2023-01-11T21:05:16.3307530Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2023-01-11T21:05:16.3339035Z Entering 'third_party/onnx/third_party/benchmark' 2023-01-11T21:05:16.3380370Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2023-01-11T21:05:16.3399312Z Entering 'third_party/onnx/third_party/pybind11' 2023-01-11T21:05:16.3438504Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2023-01-11T21:05:16.3458473Z Entering 'third_party/onnx-tensorrt' 2023-01-11T21:05:16.3499290Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx-tensorrt/config remote.origin.url 2023-01-11T21:05:16.3516428Z Entering 'third_party/onnx-tensorrt/third_party/onnx' 2023-01-11T21:05:16.3556192Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx-tensorrt/modules/third_party/onnx/config remote.origin.url 2023-01-11T21:05:16.3579254Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark' 2023-01-11T21:05:16.3618825Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx-tensorrt/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2023-01-11T21:05:16.3637134Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11' 2023-01-11T21:05:16.3677634Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx-tensorrt/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2023-01-11T21:05:16.3694366Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang' 2023-01-11T21:05:16.3734768Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx-tensorrt/modules/third_party/onnx/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2023-01-11T21:05:16.3758090Z Entering 'third_party/pocketfft' 2023-01-11T21:05:16.3798043Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2023-01-11T21:05:16.3816655Z Entering 'third_party/protobuf' 2023-01-11T21:05:16.3856503Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2023-01-11T21:05:16.3877939Z Entering 'third_party/protobuf/third_party/benchmark' 2023-01-11T21:05:16.3917446Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2023-01-11T21:05:16.3935206Z Entering 'third_party/protobuf/third_party/googletest' 2023-01-11T21:05:16.3976080Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2023-01-11T21:05:16.3995732Z Entering 'third_party/psimd' 2023-01-11T21:05:16.4035630Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2023-01-11T21:05:16.4052893Z Entering 'third_party/pthreadpool' 2023-01-11T21:05:16.4092281Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2023-01-11T21:05:16.4109406Z Entering 'third_party/pybind11' 2023-01-11T21:05:16.4149108Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2023-01-11T21:05:16.4168695Z Entering 'third_party/python-enum' 2023-01-11T21:05:16.4207764Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-enum/config remote.origin.url 2023-01-11T21:05:16.4226089Z Entering 'third_party/python-peachpy' 2023-01-11T21:05:16.4265192Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2023-01-11T21:05:16.4283803Z Entering 'third_party/python-six' 2023-01-11T21:05:16.4323923Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-six/config remote.origin.url 2023-01-11T21:05:16.4341344Z Entering 'third_party/sleef' 2023-01-11T21:05:16.4380844Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2023-01-11T21:05:16.4399734Z Entering 'third_party/tbb' 2023-01-11T21:05:16.4437999Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tbb/config remote.origin.url 2023-01-11T21:05:16.4458568Z Entering 'third_party/tensorpipe' 2023-01-11T21:05:16.4498642Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2023-01-11T21:05:16.4516598Z Entering 'third_party/tensorpipe/third_party/googletest' 2023-01-11T21:05:16.4555212Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2023-01-11T21:05:16.4573520Z Entering 'third_party/tensorpipe/third_party/libnop' 2023-01-11T21:05:16.4612054Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2023-01-11T21:05:16.4629414Z Entering 'third_party/tensorpipe/third_party/libuv' 2023-01-11T21:05:16.4668540Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2023-01-11T21:05:16.4687610Z Entering 'third_party/tensorpipe/third_party/pybind11' 2023-01-11T21:05:16.4726826Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2023-01-11T21:05:16.4743337Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2023-01-11T21:05:16.4783837Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2023-01-11T21:05:16.4806531Z Entering 'third_party/zstd' 2023-01-11T21:05:16.4846592Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/zstd/config remote.origin.url 2023-01-11T21:05:16.5673422Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2023-01-11T21:05:16.6003286Z Entering 'android/libs/fbjni' 2023-01-11T21:05:16.6048028Z Entering 'third_party/FP16' 2023-01-11T21:05:16.6092301Z Entering 'third_party/FXdiv' 2023-01-11T21:05:16.6135657Z Entering 'third_party/NNPACK' 2023-01-11T21:05:16.6180151Z Entering 'third_party/QNNPACK' 2023-01-11T21:05:16.6224704Z Entering 'third_party/VulkanMemoryAllocator' 2023-01-11T21:05:16.6269274Z Entering 'third_party/XNNPACK' 2023-01-11T21:05:16.6327226Z Entering 'third_party/benchmark' 2023-01-11T21:05:16.6370951Z Entering 'third_party/cpuinfo' 2023-01-11T21:05:16.6416212Z Entering 'third_party/cub' 2023-01-11T21:05:16.6459488Z Entering 'third_party/cudnn_frontend' 2023-01-11T21:05:16.6508756Z Entering 'third_party/cutlass' 2023-01-11T21:05:16.6561566Z Entering 'third_party/eigen' 2023-01-11T21:05:16.6606924Z Entering 'third_party/fbgemm' 2023-01-11T21:05:16.6651156Z Entering 'third_party/fbgemm/third_party/asmjit' 2023-01-11T21:05:16.6693858Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2023-01-11T21:05:16.6737348Z Entering 'third_party/fbgemm/third_party/googletest' 2023-01-11T21:05:16.6780894Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2023-01-11T21:05:16.6826695Z Entering 'third_party/flatbuffers' 2023-01-11T21:05:16.6876213Z Entering 'third_party/fmt' 2023-01-11T21:05:16.6921621Z Entering 'third_party/foxi' 2023-01-11T21:05:16.6965257Z Entering 'third_party/gemmlowp/gemmlowp' 2023-01-11T21:05:16.7011064Z Entering 'third_party/gloo' 2023-01-11T21:05:16.7055203Z Entering 'third_party/googletest' 2023-01-11T21:05:16.7100796Z Entering 'third_party/ideep' 2023-01-11T21:05:16.7145201Z Entering 'third_party/ideep/mkl-dnn' 2023-01-11T21:05:16.7192030Z Entering 'third_party/ideep/mkl-dnn/third_party/oneDNN' 2023-01-11T21:05:16.7243254Z Entering 'third_party/ios-cmake' 2023-01-11T21:05:16.7287940Z Entering 'third_party/ittapi' 2023-01-11T21:05:16.7331027Z Entering 'third_party/kineto' 2023-01-11T21:05:16.7373567Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2023-01-11T21:05:16.7416921Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2023-01-11T21:05:16.7462781Z Entering 'third_party/nccl/nccl' 2023-01-11T21:05:16.7507053Z Entering 'third_party/neon2sse' 2023-01-11T21:05:16.7550063Z Entering 'third_party/nlohmann' 2023-01-11T21:05:16.7596219Z Entering 'third_party/onnx' 2023-01-11T21:05:16.7652863Z Entering 'third_party/onnx/third_party/benchmark' 2023-01-11T21:05:16.7696439Z Entering 'third_party/onnx/third_party/pybind11' 2023-01-11T21:05:16.7741721Z Entering 'third_party/onnx-tensorrt' 2023-01-11T21:05:16.7785015Z Entering 'third_party/onnx-tensorrt/third_party/onnx' 2023-01-11T21:05:16.7832962Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark' 2023-01-11T21:05:16.7875947Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11' 2023-01-11T21:05:16.7918190Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang' 2023-01-11T21:05:16.7966681Z Entering 'third_party/pocketfft' 2023-01-11T21:05:16.8011202Z Entering 'third_party/protobuf' 2023-01-11T21:05:16.8057168Z Entering 'third_party/protobuf/third_party/benchmark' 2023-01-11T21:05:16.8100308Z Entering 'third_party/protobuf/third_party/googletest' 2023-01-11T21:05:16.8145544Z Entering 'third_party/psimd' 2023-01-11T21:05:16.8188899Z Entering 'third_party/pthreadpool' 2023-01-11T21:05:16.8232575Z Entering 'third_party/pybind11' 2023-01-11T21:05:16.8275648Z Entering 'third_party/python-enum' 2023-01-11T21:05:16.8319544Z Entering 'third_party/python-peachpy' 2023-01-11T21:05:16.8363888Z Entering 'third_party/python-six' 2023-01-11T21:05:16.8407188Z Entering 'third_party/sleef' 2023-01-11T21:05:16.8451062Z Entering 'third_party/tbb' 2023-01-11T21:05:16.8496245Z Entering 'third_party/tensorpipe' 2023-01-11T21:05:16.8541419Z Entering 'third_party/tensorpipe/third_party/googletest' 2023-01-11T21:05:16.8584012Z Entering 'third_party/tensorpipe/third_party/libnop' 2023-01-11T21:05:16.8628627Z Entering 'third_party/tensorpipe/third_party/libuv' 2023-01-11T21:05:16.8672163Z Entering 'third_party/tensorpipe/third_party/pybind11' 2023-01-11T21:05:16.8714880Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2023-01-11T21:05:16.8763833Z Entering 'third_party/zstd' 2023-01-11T21:05:16.8823101Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2023-01-11T21:05:16.9151760Z Entering 'android/libs/fbjni' 2023-01-11T21:05:16.9195726Z Entering 'third_party/FP16' 2023-01-11T21:05:16.9239876Z Entering 'third_party/FXdiv' 2023-01-11T21:05:16.9283154Z Entering 'third_party/NNPACK' 2023-01-11T21:05:16.9327503Z Entering 'third_party/QNNPACK' 2023-01-11T21:05:16.9371274Z Entering 'third_party/VulkanMemoryAllocator' 2023-01-11T21:05:16.9414112Z Entering 'third_party/XNNPACK' 2023-01-11T21:05:16.9468644Z Entering 'third_party/benchmark' 2023-01-11T21:05:16.9511737Z Entering 'third_party/cpuinfo' 2023-01-11T21:05:16.9555248Z Entering 'third_party/cub' 2023-01-11T21:05:16.9599219Z Entering 'third_party/cudnn_frontend' 2023-01-11T21:05:16.9648623Z Entering 'third_party/cutlass' 2023-01-11T21:05:16.9699536Z Entering 'third_party/eigen' 2023-01-11T21:05:16.9744332Z Entering 'third_party/fbgemm' 2023-01-11T21:05:16.9788146Z Entering 'third_party/fbgemm/third_party/asmjit' 2023-01-11T21:05:16.9830231Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2023-01-11T21:05:16.9873568Z Entering 'third_party/fbgemm/third_party/googletest' 2023-01-11T21:05:16.9916761Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2023-01-11T21:05:16.9960489Z Entering 'third_party/flatbuffers' 2023-01-11T21:05:17.0006220Z Entering 'third_party/fmt' 2023-01-11T21:05:17.0050429Z Entering 'third_party/foxi' 2023-01-11T21:05:17.0092950Z Entering 'third_party/gemmlowp/gemmlowp' 2023-01-11T21:05:17.0135747Z Entering 'third_party/gloo' 2023-01-11T21:05:17.0178608Z Entering 'third_party/googletest' 2023-01-11T21:05:17.0223614Z Entering 'third_party/ideep' 2023-01-11T21:05:17.0266064Z Entering 'third_party/ideep/mkl-dnn' 2023-01-11T21:05:17.0311738Z Entering 'third_party/ideep/mkl-dnn/third_party/oneDNN' 2023-01-11T21:05:17.0362722Z Entering 'third_party/ios-cmake' 2023-01-11T21:05:17.0406793Z Entering 'third_party/ittapi' 2023-01-11T21:05:17.0449293Z Entering 'third_party/kineto' 2023-01-11T21:05:17.0492059Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2023-01-11T21:05:17.0534586Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2023-01-11T21:05:17.0579993Z Entering 'third_party/nccl/nccl' 2023-01-11T21:05:17.0623482Z Entering 'third_party/neon2sse' 2023-01-11T21:05:17.0666652Z Entering 'third_party/nlohmann' 2023-01-11T21:05:17.0711084Z Entering 'third_party/onnx' 2023-01-11T21:05:17.0769844Z Entering 'third_party/onnx/third_party/benchmark' 2023-01-11T21:05:17.0814228Z Entering 'third_party/onnx/third_party/pybind11' 2023-01-11T21:05:17.0860171Z Entering 'third_party/onnx-tensorrt' 2023-01-11T21:05:17.0904781Z Entering 'third_party/onnx-tensorrt/third_party/onnx' 2023-01-11T21:05:17.0954897Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark' 2023-01-11T21:05:17.0999093Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11' 2023-01-11T21:05:17.1044813Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang' 2023-01-11T21:05:17.1094274Z Entering 'third_party/pocketfft' 2023-01-11T21:05:17.1137462Z Entering 'third_party/protobuf' 2023-01-11T21:05:17.1186469Z Entering 'third_party/protobuf/third_party/benchmark' 2023-01-11T21:05:17.1230512Z Entering 'third_party/protobuf/third_party/googletest' 2023-01-11T21:05:17.1275913Z Entering 'third_party/psimd' 2023-01-11T21:05:17.1319920Z Entering 'third_party/pthreadpool' 2023-01-11T21:05:17.1363427Z Entering 'third_party/pybind11' 2023-01-11T21:05:17.1408540Z Entering 'third_party/python-enum' 2023-01-11T21:05:17.1451515Z Entering 'third_party/python-peachpy' 2023-01-11T21:05:17.1495514Z Entering 'third_party/python-six' 2023-01-11T21:05:17.1538807Z Entering 'third_party/sleef' 2023-01-11T21:05:17.1582984Z Entering 'third_party/tbb' 2023-01-11T21:05:17.1628598Z Entering 'third_party/tensorpipe' 2023-01-11T21:05:17.1672105Z Entering 'third_party/tensorpipe/third_party/googletest' 2023-01-11T21:05:17.1715280Z Entering 'third_party/tensorpipe/third_party/libnop' 2023-01-11T21:05:17.1758189Z Entering 'third_party/tensorpipe/third_party/libuv' 2023-01-11T21:05:17.1800872Z Entering 'third_party/tensorpipe/third_party/pybind11' 2023-01-11T21:05:17.1842748Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2023-01-11T21:05:17.1888111Z Entering 'third_party/zstd' 2023-01-11T21:05:17.1944208Z ##[endgroup] 2023-01-11T21:05:17.1990094Z [command]/usr/bin/git log -1 --format='%H' 2023-01-11T21:05:17.2019306Z '8419ddda87c8a47eacc63b54bc7ec98c1f27c26e' 2023-01-11T21:05:17.2166569Z Prepare all required actions 2023-01-11T21:05:17.2200913Z ##[group]Run ./.github/actions/setup-linux 2023-01-11T21:05:17.2201204Z env: 2023-01-11T21:05:17.2201449Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:05:17.2201688Z ##[endgroup] 2023-01-11T21:05:17.2222365Z ##[group]Run set -euo pipefail 2023-01-11T21:05:17.2222683Z set -euo pipefail 2023-01-11T21:05:17.2222976Z function get_ec2_metadata() { 2023-01-11T21:05:17.2223306Z  # Pulled from instance metadata endpoint for EC2 2023-01-11T21:05:17.2223781Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2023-01-11T21:05:17.2224201Z  category=$1 2023-01-11T21:05:17.2224548Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2023-01-11T21:05:17.2224839Z } 2023-01-11T21:05:17.2225118Z echo "ami-id: $(get_ec2_metadata ami-id)" 2023-01-11T21:05:17.2225505Z echo "instance-id: $(get_ec2_metadata instance-id)" 2023-01-11T21:05:17.2225870Z echo "instance-type: $(get_ec2_metadata instance-type)" 2023-01-11T21:05:17.2226210Z echo "system info $(uname -a)" 2023-01-11T21:05:17.2241315Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:05:17.2241601Z env: 2023-01-11T21:05:17.2241844Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:05:17.2242105Z ##[endgroup] 2023-01-11T21:05:17.2344427Z ami-id: ami-096198a0bccc6bad4 2023-01-11T21:05:17.2408946Z instance-id: i-08fd0b6c01e2fc030 2023-01-11T21:05:17.2470259Z instance-type: g3.4xlarge 2023-01-11T21:05:17.2479601Z system info Linux ip-10-0-0-97.ec2.internal 4.14.252-195.483.amzn2.x86_64 #1 SMP Mon Nov 1 20:58:46 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux 2023-01-11T21:05:17.2502702Z ##[group]Run if systemctl is-active --quiet docker; then 2023-01-11T21:05:17.2503098Z if systemctl is-active --quiet docker; then 2023-01-11T21:05:17.2503442Z  echo "Docker daemon is running..."; 2023-01-11T21:05:17.2503711Z else 2023-01-11T21:05:17.2504034Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2023-01-11T21:05:17.2504350Z fi 2023-01-11T21:05:17.2516958Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:05:17.2517269Z env: 2023-01-11T21:05:17.2517526Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:05:17.2517795Z ##[endgroup] 2023-01-11T21:05:17.2570005Z Docker daemon is running... 2023-01-11T21:05:17.2591890Z ##[group]Run AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") 2023-01-11T21:05:17.2592367Z AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") 2023-01-11T21:05:17.2592752Z retry () { "$@" || (sleep 1 && "$@") || (sleep 2 && "$@") } 2023-01-11T21:05:17.2593261Z retry aws ecr get-login*** "$AWS_DEFAULT_REGION" | docker login --username AWS \ 2023-01-11T21:05:17.2593720Z  --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2023-01-11T21:05:17.2606454Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:05:17.2606760Z env: 2023-01-11T21:05:17.2606986Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:05:17.2607260Z AWS_RETRY_MODE: standard 2023-01-11T21:05:17.2607521Z AWS_MAX_ATTEMPTS: 5 2023-01-11T21:05:17.2607770Z AWS_DEFAULT_REGION: us-east-1 2023-01-11T21:05:17.2608034Z ##[endgroup] 2023-01-11T21:05:18.2440720Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2023-01-11T21:05:18.2441239Z Configure a credential helper to remove this warning. See 2023-01-11T21:05:18.2441942Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2023-01-11T21:05:18.2442460Z 2023-01-11T21:05:18.2443198Z Login Succeeded 2023-01-11T21:05:18.2484599Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2023-01-11T21:05:18.2485021Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2023-01-11T21:05:18.2485511Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2023-01-11T21:05:18.2499979Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:05:18.2500287Z env: 2023-01-11T21:05:18.2500551Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:05:18.2500806Z ##[endgroup] 2023-01-11T21:05:18.2595292Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2023-01-11T21:05:18.2595665Z with: 2023-01-11T21:05:18.2596150Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:05:18.2596629Z env: 2023-01-11T21:05:18.2596878Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:05:18.2597121Z ##[endgroup] 2023-01-11T21:05:18.2616400Z ##[group]Run retry () { "$@" || (sleep 1 && "$@") || (sleep 2 && "$@") } 2023-01-11T21:05:18.2616768Z retry () { "$@" || (sleep 1 && "$@") || (sleep 2 && "$@") } 2023-01-11T21:05:18.2617128Z # ignore output since only exit code is used for conditional 2023-01-11T21:05:18.2617507Z # only pull docker image if it's not available locally 2023-01-11T21:05:18.2617919Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2023-01-11T21:05:18.2618322Z  retry docker pull "${DOCKER_IMAGE}" 2023-01-11T21:05:18.2618602Z fi 2023-01-11T21:05:18.2630597Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:05:18.2630901Z env: 2023-01-11T21:05:18.2631142Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:05:18.2631658Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:05:18.2632150Z ##[endgroup] 2023-01-11T21:05:18.5078030Z fd224c2e6c79d7fdec6408da598bf52bc5b201dd: Pulling from pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7 2023-01-11T21:05:18.5079320Z fb668870d8a7: Pulling fs layer 2023-01-11T21:05:18.5079903Z 3dc32ed140fb: Pulling fs layer 2023-01-11T21:05:18.5080396Z 54a1df240516: Pulling fs layer 2023-01-11T21:05:18.5080861Z cf378b3cb3c7: Pulling fs layer 2023-01-11T21:05:18.5081412Z 9b4412378859: Pulling fs layer 2023-01-11T21:05:18.5081915Z 502253a1be21: Pulling fs layer 2023-01-11T21:05:18.5082427Z 5c7dd67e5809: Pulling fs layer 2023-01-11T21:05:18.5082972Z bdfd23ed3f48: Pulling fs layer 2023-01-11T21:05:18.5083449Z aee1dd761bdd: Pulling fs layer 2023-01-11T21:05:18.5083966Z 5feda9af2542: Pulling fs layer 2023-01-11T21:05:18.5105136Z f8371ecb849a: Pulling fs layer 2023-01-11T21:05:18.5106383Z ce4a87d45645: Pulling fs layer 2023-01-11T21:05:18.5107633Z 39629f7269f9: Pulling fs layer 2023-01-11T21:05:18.5107904Z 87d0ffa55850: Pulling fs layer 2023-01-11T21:05:18.5108238Z bdfd23ed3f48: Waiting 2023-01-11T21:05:18.5108720Z aee1dd761bdd: Waiting 2023-01-11T21:05:18.5108999Z 70702f8b5bc4: Pulling fs layer 2023-01-11T21:05:18.5109237Z f8371ecb849a: Waiting 2023-01-11T21:05:18.5109500Z 502253a1be21: Waiting 2023-01-11T21:05:18.5109950Z 5c7dd67e5809: Waiting 2023-01-11T21:05:18.5110211Z ce4a87d45645: Waiting 2023-01-11T21:05:18.5110419Z 39629f7269f9: Waiting 2023-01-11T21:05:18.5110663Z 9b4412378859: Waiting 2023-01-11T21:05:18.5110874Z 87d0ffa55850: Waiting 2023-01-11T21:05:18.5111147Z 0c06be5c20e0: Pulling fs layer 2023-01-11T21:05:18.5113195Z 5feda9af2542: Waiting 2023-01-11T21:05:18.5113936Z b372c2a3bc3f: Pulling fs layer 2023-01-11T21:05:18.5114509Z 582d081a59fa: Pulling fs layer 2023-01-11T21:05:18.5115263Z 70702f8b5bc4: Waiting 2023-01-11T21:05:18.5116127Z 0c06be5c20e0: Waiting 2023-01-11T21:05:18.5116653Z b372c2a3bc3f: Waiting 2023-01-11T21:05:18.5117178Z e1c655e7ec0e: Pulling fs layer 2023-01-11T21:05:18.5118291Z c7726d39d806: Pulling fs layer 2023-01-11T21:05:18.5118590Z 1c22f2f8c01b: Pulling fs layer 2023-01-11T21:05:18.5119279Z b8f759fd0191: Pulling fs layer 2023-01-11T21:05:18.5119575Z e28e73a4bddd: Pulling fs layer 2023-01-11T21:05:18.5119849Z 90d8f9bbe048: Pulling fs layer 2023-01-11T21:05:18.5120133Z b34bd39d0461: Pulling fs layer 2023-01-11T21:05:18.5120386Z 2f2308643d60: Pulling fs layer 2023-01-11T21:05:18.5120689Z 8e3432e5a569: Pulling fs layer 2023-01-11T21:05:18.5120952Z 9ea746919509: Pulling fs layer 2023-01-11T21:05:18.5121204Z c7726d39d806: Waiting 2023-01-11T21:05:18.5121427Z 582d081a59fa: Waiting 2023-01-11T21:05:18.5121828Z 1a2fd7b216d7: Pulling fs layer 2023-01-11T21:05:18.5122122Z 19fde6a723a0: Pulling fs layer 2023-01-11T21:05:18.5122372Z 8e3432e5a569: Waiting 2023-01-11T21:05:18.5122619Z 06369252d749: Pulling fs layer 2023-01-11T21:05:18.5122864Z 2f2308643d60: Waiting 2023-01-11T21:05:18.5123104Z ea4bfeaa0fc7: Pulling fs layer 2023-01-11T21:05:18.5123360Z 1c22f2f8c01b: Waiting 2023-01-11T21:05:18.5123613Z a1d16b6a5070: Pulling fs layer 2023-01-11T21:05:18.5123864Z f550b7ff2470: Pulling fs layer 2023-01-11T21:05:18.5124125Z b8f759fd0191: Waiting 2023-01-11T21:05:18.5124608Z 1a2fd7b216d7: Waiting 2023-01-11T21:05:18.5124837Z 90d8f9bbe048: Waiting 2023-01-11T21:05:18.5125548Z 12ddc57b99eb: Pulling fs layer 2023-01-11T21:05:18.5125966Z 8345085fb0a0: Pulling fs layer 2023-01-11T21:05:18.5126220Z b34bd39d0461: Waiting 2023-01-11T21:05:18.5126472Z 4cc94dbec031: Pulling fs layer 2023-01-11T21:05:18.5126878Z 06369252d749: Waiting 2023-01-11T21:05:18.5127118Z 19fde6a723a0: Waiting 2023-01-11T21:05:18.5127383Z 29a7c0d5fa4c: Pulling fs layer 2023-01-11T21:05:18.5127638Z a1d16b6a5070: Waiting 2023-01-11T21:05:18.5127872Z 25571655d0e1: Pulling fs layer 2023-01-11T21:05:18.5128126Z ea4bfeaa0fc7: Waiting 2023-01-11T21:05:18.5128386Z bdf297d7f88c: Pulling fs layer 2023-01-11T21:05:18.5128627Z 12ddc57b99eb: Waiting 2023-01-11T21:05:18.5128893Z 0b3950af8ae1: Pulling fs layer 2023-01-11T21:05:18.5129174Z 6d68f7da8baa: Pulling fs layer 2023-01-11T21:05:18.5129416Z 4cc94dbec031: Waiting 2023-01-11T21:05:18.5129652Z 8345085fb0a0: Waiting 2023-01-11T21:05:18.5130063Z cca768f96df4: Pulling fs layer 2023-01-11T21:05:18.5130314Z bdf297d7f88c: Waiting 2023-01-11T21:05:18.5130566Z 8c3cf3d5e1c5: Pulling fs layer 2023-01-11T21:05:18.5130841Z 61eecfa8b34e: Pulling fs layer 2023-01-11T21:05:18.5131091Z 29a7c0d5fa4c: Waiting 2023-01-11T21:05:18.5131348Z 95c1ac011645: Pulling fs layer 2023-01-11T21:05:18.5131613Z 3046cc00c4ca: Pulling fs layer 2023-01-11T21:05:18.5131860Z 195d560d8cf6: Pulling fs layer 2023-01-11T21:05:18.5132113Z 25571655d0e1: Waiting 2023-01-11T21:05:18.5132351Z cca768f96df4: Waiting 2023-01-11T21:05:18.5132602Z 77250abd5ca4: Pulling fs layer 2023-01-11T21:05:18.5132872Z 881b24daf9c5: Pulling fs layer 2023-01-11T21:05:18.5133130Z 8c3cf3d5e1c5: Waiting 2023-01-11T21:05:18.5133384Z 9fbf0a18619e: Pulling fs layer 2023-01-11T21:05:18.5133626Z 61eecfa8b34e: Waiting 2023-01-11T21:05:18.5133874Z 02048a597c22: Pulling fs layer 2023-01-11T21:05:18.5134369Z 859052a25d95: Pulling fs layer 2023-01-11T21:05:18.5134653Z 95c1ac011645: Waiting 2023-01-11T21:05:18.5135604Z 3e03143da3c2: Pulling fs layer 2023-01-11T21:05:18.5135968Z 6d68f7da8baa: Waiting 2023-01-11T21:05:18.5136242Z 195d560d8cf6: Waiting 2023-01-11T21:05:18.5136564Z 9fbf0a18619e: Waiting 2023-01-11T21:05:18.5136895Z 02048a597c22: Waiting 2023-01-11T21:05:18.5137198Z 77250abd5ca4: Waiting 2023-01-11T21:05:18.6333729Z 3dc32ed140fb: Verifying Checksum 2023-01-11T21:05:18.6334164Z 3dc32ed140fb: Download complete 2023-01-11T21:05:18.7189106Z cf378b3cb3c7: Download complete 2023-01-11T21:05:18.8043512Z 9b4412378859: Verifying Checksum 2023-01-11T21:05:18.8044501Z 9b4412378859: Download complete 2023-01-11T21:05:18.8350827Z fb668870d8a7: Verifying Checksum 2023-01-11T21:05:18.8351464Z fb668870d8a7: Download complete 2023-01-11T21:05:18.8514611Z 54a1df240516: Verifying Checksum 2023-01-11T21:05:18.8515535Z 54a1df240516: Download complete 2023-01-11T21:05:18.9159833Z 5c7dd67e5809: Download complete 2023-01-11T21:05:18.9320603Z bdfd23ed3f48: Verifying Checksum 2023-01-11T21:05:18.9321163Z bdfd23ed3f48: Download complete 2023-01-11T21:05:19.0096527Z aee1dd761bdd: Download complete 2023-01-11T21:05:19.0771534Z f8371ecb849a: Verifying Checksum 2023-01-11T21:05:19.0771977Z f8371ecb849a: Download complete 2023-01-11T21:05:19.1576822Z ce4a87d45645: Download complete 2023-01-11T21:05:19.6650785Z fb668870d8a7: Pull complete 2023-01-11T21:05:19.9749149Z 3dc32ed140fb: Pull complete 2023-01-11T21:05:20.5430939Z 54a1df240516: Pull complete 2023-01-11T21:05:20.6483748Z cf378b3cb3c7: Pull complete 2023-01-11T21:05:20.7633498Z 9b4412378859: Pull complete 2023-01-11T21:05:21.2052471Z 39629f7269f9: Verifying Checksum 2023-01-11T21:05:21.2052954Z 39629f7269f9: Download complete 2023-01-11T21:05:21.3086104Z 87d0ffa55850: Verifying Checksum 2023-01-11T21:05:21.3086584Z 87d0ffa55850: Download complete 2023-01-11T21:05:21.3898660Z 70702f8b5bc4: Verifying Checksum 2023-01-11T21:05:21.3899223Z 70702f8b5bc4: Download complete 2023-01-11T21:05:21.4723578Z 0c06be5c20e0: Verifying Checksum 2023-01-11T21:05:21.4724144Z 0c06be5c20e0: Download complete 2023-01-11T21:05:22.2002275Z b372c2a3bc3f: Verifying Checksum 2023-01-11T21:05:22.2002986Z b372c2a3bc3f: Download complete 2023-01-11T21:05:22.2784984Z 582d081a59fa: Verifying Checksum 2023-01-11T21:05:22.2785362Z 582d081a59fa: Download complete 2023-01-11T21:05:22.3654065Z e1c655e7ec0e: Verifying Checksum 2023-01-11T21:05:22.3654512Z e1c655e7ec0e: Download complete 2023-01-11T21:05:30.0989199Z 502253a1be21: Verifying Checksum 2023-01-11T21:05:30.0989780Z 502253a1be21: Download complete 2023-01-11T21:05:30.1854221Z 1c22f2f8c01b: Verifying Checksum 2023-01-11T21:05:30.1854705Z 1c22f2f8c01b: Download complete 2023-01-11T21:05:30.2587854Z b8f759fd0191: Download complete 2023-01-11T21:05:30.3696915Z e28e73a4bddd: Verifying Checksum 2023-01-11T21:05:30.3697305Z e28e73a4bddd: Download complete 2023-01-11T21:05:30.4597317Z 90d8f9bbe048: Verifying Checksum 2023-01-11T21:05:30.4597736Z 90d8f9bbe048: Download complete 2023-01-11T21:05:30.5450292Z b34bd39d0461: Verifying Checksum 2023-01-11T21:05:30.5450758Z b34bd39d0461: Download complete 2023-01-11T21:05:30.6283388Z 2f2308643d60: Verifying Checksum 2023-01-11T21:05:30.6283983Z 2f2308643d60: Download complete 2023-01-11T21:05:31.5764608Z 8e3432e5a569: Verifying Checksum 2023-01-11T21:05:31.5765024Z 8e3432e5a569: Download complete 2023-01-11T21:05:31.6645526Z 9ea746919509: Verifying Checksum 2023-01-11T21:05:31.6646018Z 9ea746919509: Download complete 2023-01-11T21:05:31.7469874Z 1a2fd7b216d7: Verifying Checksum 2023-01-11T21:05:31.7470425Z 1a2fd7b216d7: Download complete 2023-01-11T21:05:32.9355203Z 19fde6a723a0: Verifying Checksum 2023-01-11T21:05:32.9355925Z 19fde6a723a0: Download complete 2023-01-11T21:05:33.0154783Z 06369252d749: Verifying Checksum 2023-01-11T21:05:33.0155558Z 06369252d749: Download complete 2023-01-11T21:05:33.0882258Z ea4bfeaa0fc7: Verifying Checksum 2023-01-11T21:05:33.0882985Z ea4bfeaa0fc7: Download complete 2023-01-11T21:05:33.2944353Z 5feda9af2542: Download complete 2023-01-11T21:05:33.3746151Z f550b7ff2470: Verifying Checksum 2023-01-11T21:05:33.3746915Z f550b7ff2470: Download complete 2023-01-11T21:05:33.4605695Z 12ddc57b99eb: Verifying Checksum 2023-01-11T21:05:33.4606414Z 12ddc57b99eb: Download complete 2023-01-11T21:05:33.8769253Z 8345085fb0a0: Verifying Checksum 2023-01-11T21:05:33.8769865Z 8345085fb0a0: Download complete 2023-01-11T21:05:33.9641274Z 4cc94dbec031: Download complete 2023-01-11T21:05:34.0534044Z 29a7c0d5fa4c: Verifying Checksum 2023-01-11T21:05:34.0589300Z 29a7c0d5fa4c: Download complete 2023-01-11T21:05:34.3190280Z 25571655d0e1: Verifying Checksum 2023-01-11T21:05:34.3900764Z bdf297d7f88c: Verifying Checksum 2023-01-11T21:05:34.3901631Z bdf297d7f88c: Download complete 2023-01-11T21:05:34.8921098Z 0b3950af8ae1: Verifying Checksum 2023-01-11T21:05:34.8921519Z 0b3950af8ae1: Download complete 2023-01-11T21:05:34.9575357Z 6d68f7da8baa: Verifying Checksum 2023-01-11T21:05:34.9575844Z 6d68f7da8baa: Download complete 2023-01-11T21:05:35.0413648Z cca768f96df4: Verifying Checksum 2023-01-11T21:05:35.0414284Z cca768f96df4: Download complete 2023-01-11T21:05:35.0785075Z a1d16b6a5070: Verifying Checksum 2023-01-11T21:05:35.0785420Z a1d16b6a5070: Download complete 2023-01-11T21:05:35.1671259Z 61eecfa8b34e: Verifying Checksum 2023-01-11T21:05:35.1671655Z 61eecfa8b34e: Download complete 2023-01-11T21:05:35.2502508Z 95c1ac011645: Download complete 2023-01-11T21:05:35.3363527Z 3046cc00c4ca: Verifying Checksum 2023-01-11T21:05:35.3363914Z 3046cc00c4ca: Download complete 2023-01-11T21:05:35.4276093Z 195d560d8cf6: Verifying Checksum 2023-01-11T21:05:35.6135461Z 77250abd5ca4: Verifying Checksum 2023-01-11T21:05:35.6136430Z 77250abd5ca4: Download complete 2023-01-11T21:05:35.6974049Z 881b24daf9c5: Verifying Checksum 2023-01-11T21:05:35.6974602Z 881b24daf9c5: Download complete 2023-01-11T21:05:36.3062964Z 9fbf0a18619e: Verifying Checksum 2023-01-11T21:05:36.3063606Z 9fbf0a18619e: Download complete 2023-01-11T21:05:36.3925009Z 02048a597c22: Verifying Checksum 2023-01-11T21:05:36.3925382Z 02048a597c22: Download complete 2023-01-11T21:05:37.8238084Z 8c3cf3d5e1c5: Verifying Checksum 2023-01-11T21:05:37.8238445Z 8c3cf3d5e1c5: Download complete 2023-01-11T21:05:37.9072712Z 3e03143da3c2: Download complete 2023-01-11T21:05:45.6562369Z 502253a1be21: Pull complete 2023-01-11T21:05:45.7905933Z 5c7dd67e5809: Pull complete 2023-01-11T21:05:45.8889532Z bdfd23ed3f48: Pull complete 2023-01-11T21:05:46.1847927Z aee1dd761bdd: Pull complete 2023-01-11T21:06:08.8325611Z 5feda9af2542: Pull complete 2023-01-11T21:06:10.6897246Z f8371ecb849a: Pull complete 2023-01-11T21:06:12.5351658Z ce4a87d45645: Pull complete 2023-01-11T21:06:12.5933559Z c7726d39d806: Verifying Checksum 2023-01-11T21:06:12.5935942Z c7726d39d806: Download complete 2023-01-11T21:06:20.8434311Z 39629f7269f9: Pull complete 2023-01-11T21:06:22.8184824Z 87d0ffa55850: Pull complete 2023-01-11T21:06:24.8228471Z 70702f8b5bc4: Pull complete 2023-01-11T21:06:27.5370350Z 0c06be5c20e0: Pull complete 2023-01-11T21:06:31.6457343Z b372c2a3bc3f: Pull complete 2023-01-11T21:06:33.4939614Z 582d081a59fa: Pull complete 2023-01-11T21:06:35.4968862Z e1c655e7ec0e: Pull complete 2023-01-11T21:07:01.8140619Z 859052a25d95: Verifying Checksum 2023-01-11T21:07:01.8143302Z 859052a25d95: Download complete 2023-01-11T21:07:08.9454254Z c7726d39d806: Pull complete 2023-01-11T21:07:10.8937522Z 1c22f2f8c01b: Pull complete 2023-01-11T21:07:12.5537558Z b8f759fd0191: Pull complete 2023-01-11T21:07:14.5247542Z e28e73a4bddd: Pull complete 2023-01-11T21:07:17.3415296Z 90d8f9bbe048: Pull complete 2023-01-11T21:07:19.2218972Z b34bd39d0461: Pull complete 2023-01-11T21:07:21.0850773Z 2f2308643d60: Pull complete 2023-01-11T21:07:25.6248361Z 8e3432e5a569: Pull complete 2023-01-11T21:07:27.4630456Z 9ea746919509: Pull complete 2023-01-11T21:07:29.7411548Z 1a2fd7b216d7: Pull complete 2023-01-11T21:07:33.1812877Z 19fde6a723a0: Pull complete 2023-01-11T21:07:35.8989120Z 06369252d749: Pull complete 2023-01-11T21:07:38.7115358Z ea4bfeaa0fc7: Pull complete 2023-01-11T21:07:47.6867151Z a1d16b6a5070: Pull complete 2023-01-11T21:07:49.5646012Z f550b7ff2470: Pull complete 2023-01-11T21:07:51.4099876Z 12ddc57b99eb: Pull complete 2023-01-11T21:07:54.1184472Z 8345085fb0a0: Pull complete 2023-01-11T21:07:55.5963473Z 4cc94dbec031: Pull complete 2023-01-11T21:07:55.7002351Z 29a7c0d5fa4c: Pull complete 2023-01-11T21:07:56.0821096Z 25571655d0e1: Pull complete 2023-01-11T21:07:56.1846232Z bdf297d7f88c: Pull complete 2023-01-11T21:07:57.6518838Z 0b3950af8ae1: Pull complete 2023-01-11T21:07:57.7436636Z 6d68f7da8baa: Pull complete 2023-01-11T21:07:57.8315486Z cca768f96df4: Pull complete 2023-01-11T21:08:02.9553325Z 8c3cf3d5e1c5: Pull complete 2023-01-11T21:08:03.0567273Z 61eecfa8b34e: Pull complete 2023-01-11T21:08:03.1676663Z 95c1ac011645: Pull complete 2023-01-11T21:08:03.2556517Z 3046cc00c4ca: Pull complete 2023-01-11T21:08:03.3551422Z 195d560d8cf6: Pull complete 2023-01-11T21:08:04.2641689Z 77250abd5ca4: Pull complete 2023-01-11T21:08:05.6526966Z 881b24daf9c5: Pull complete 2023-01-11T21:08:07.6995736Z 9fbf0a18619e: Pull complete 2023-01-11T21:08:07.8076809Z 02048a597c22: Pull complete 2023-01-11T21:08:55.5182755Z 859052a25d95: Pull complete 2023-01-11T21:08:57.3658032Z 3e03143da3c2: Pull complete 2023-01-11T21:08:58.7133118Z Digest: sha256:866df6c1171dbe014496717cf2080d6cc72ca611a4e8146525c9ef09640c8ba4 2023-01-11T21:08:59.2442349Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:08:59.5264248Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:08:59.5374186Z ##[group]Run pytorch/test-infra/.github/actions/setup-nvidia@main 2023-01-11T21:08:59.5374522Z with: 2023-01-11T21:08:59.5374784Z driver-version: 515.76 2023-01-11T21:08:59.5375038Z env: 2023-01-11T21:08:59.5375263Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:08:59.5375529Z ##[endgroup] 2023-01-11T21:08:59.6841821Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2023-01-11T21:08:59.6842146Z with: 2023-01-11T21:08:59.6842365Z timeout_minutes: 10 2023-01-11T21:08:59.6842627Z max_attempts: 3 2023-01-11T21:08:59.6849425Z command: # Is it disgusting to have a full shell script here in this github action? Sure # But is it the best way to make it so that this action relies on nothing else? Absolutely set -eou pipefail DISTRIBUTION=$(. /etc/os-release;echo $ID$VERSION_ID) DRIVER_FN="NVIDIA-Linux-x86_64-${DRIVER_VERSION}.run" YUM_REPO_URL="https://nvidia.github.io/nvidia-docker/${DISTRIBUTION}/nvidia-docker.repo" install_nvidia_docker2_amzn2() { ( set -x # Needed for yum-config-manager sudo yum install -y yum-utils sudo yum-config-manager --add-repo "${YUM_REPO_URL}" sudo yum install -y nvidia-docker2 sudo systemctl restart docker ) } install_nvidia_docker2_ubuntu20() { ( set -x sudo apt-get install -y nvidia-docker2 sudo systemctl restart docker ) } pre_install_nvidia_driver_amzn2() { ( # Purge any nvidia driver installed from RHEL repo sudo yum remove -y nvidia-driver-latest-dkms ) } install_nvidia_driver_common() { ( # Try to gather more information about the runner and its existing NVIDIA driver if any echo "Before installing NVIDIA driver" lspci lsmod modinfo nvidia || true HAS_NVIDIA_DRIVER=0 # Check if NVIDIA driver has already been installed if [ -x "$(command -v nvidia-smi)" ]; then set +e # The driver exists, check its version next. Also check only the first GPU if there are more than one of them # so that the same driver version is not print over multiple lines INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then echo "Failed to get NVIDIA driver version ($INSTALLED_DRIVER_VERSION). Continuing" elif [ "$INSTALLED_DRIVER_VERSION" != "$DRIVER_VERSION" ]; then echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has been installed, but we expect to have $DRIVER_VERSION instead. Continuing" else HAS_NVIDIA_DRIVER=1 echo "NVIDIA driver ($INSTALLED_DRIVER_VERSION) has already been installed. Skipping NVIDIA driver installation" fi set -e fi if [ "$HAS_NVIDIA_DRIVER" -eq 0 ]; then # CAUTION: this may need to be updated in future if [ "${DISTRIBUTION}" != ubuntu20.04 ]; then sudo yum groupinstall -y "Development Tools" # ensure our kernel install is the same as our underlying kernel, # groupinstall "Development Tools" has a habit of mismatching kernel headers sudo yum install -y "kernel-devel-uname-r == $(uname -r)" sudo modprobe backlight fi sudo curl -fsL -o /tmp/nvidia_driver "https://s3.amazonaws.com/ossci-linux/nvidia_driver/$DRIVER_FN" set +e sudo /bin/bash /tmp/nvidia_driver -s --no-drm NVIDIA_INSTALLATION_STATUS=$? RESET_GPU=0 if [ "$NVIDIA_INSTALLATION_STATUS" -ne 0 ]; then sudo cat /var/log/nvidia-installer.log # Fail to install NVIDIA driver, try to reset the GPU RESET_GPU=1 elif [ -x "$(command -v nvidia-smi)" ]; then # Check again if nvidia-smi works even if the driver installation completes successfully INSTALLED_DRIVER_VERSION=$(nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0) NVIDIA_SMI_STATUS=$? if [ "$NVIDIA_SMI_STATUS" -ne 0 ] && [ "$NVIDIA_SMI_STATUS" -ne 14 ]; then RESET_GPU=1 fi fi if [ "$RESET_GPU" -eq 1 ]; then NVIDIA_DEVICES=$(lspci -D | grep -i NVIDIA | cut -d' ' -f1) # The GPU can get stuck in a failure state if somehow the test crashs the GPU microcode. When this # happens, we'll try to reset all NVIDIA devices https://github.com/pytorch/pytorch/issues/88388 for PCI_ID in $NVIDIA_DEVICES; do DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable) echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)" # This requires sudo permission of course echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset sleep 1 done fi sudo rm -fv /tmp/nvidia_driver set -e fi ) } post_install_nvidia_driver_common() { ( sudo modprobe nvidia || true echo "After installing NVIDIA driver" lspci lsmod modinfo nvidia || true ( set +e nvidia-smi NVIDIA_SMI_STATUS=$? # Allowable exit statuses for nvidia-smi, see: https://github.com/NVIDIA/gpu-operator/issues/285 if [ "$NVIDIA_SMI_STATUS" -eq 0 ] || [ "$NVIDIA_SMI_STATUS" -eq 14 ]; then echo "INFO: Ignoring allowed status ${NVIDIA_SMI_STATUS}" else echo "ERROR: nvidia-smi exited with unresolved status ${NVIDIA_SMI_STATUS}" exit ${NVIDIA_SMI_STATUS} fi set -e ) ) } install_nvidia_driver_amzn2() { ( set -x pre_install_nvidia_driver_amzn2 install_nvidia_driver_common post_install_nvidia_driver_common ) } install_nvidia_driver_ubuntu20() { ( set -x install_nvidia_driver_common post_install_nvidia_driver_common ) } echo "== Installing nvidia driver ${DRIVER_FN} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_driver_amzn2 ;; ubuntu20.04) install_nvidia_driver_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac # Install container toolkit based on distribution echo "== Installing nvidia container toolkit for ${DISTRIBUTION} ==" case "${DISTRIBUTION}" in amzn*) install_nvidia_docker2_amzn2 ;; ubuntu20.04) install_nvidia_docker2_ubuntu20 ;; *) echo "ERROR: Unknown distribution ${DISTRIBUTION}" exit 1 ;; esac echo "GPU_FLAG=--gpus all" >> "${GITHUB_ENV}" 2023-01-11T21:08:59.6856427Z retry_wait_seconds: 10 2023-01-11T21:08:59.6856709Z polling_interval_seconds: 1 2023-01-11T21:08:59.6857058Z warning_on_retry: true 2023-01-11T21:08:59.6857325Z continue_on_error: false 2023-01-11T21:08:59.6857551Z env: 2023-01-11T21:08:59.6857802Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:08:59.6858078Z DRIVER_VERSION: 515.76 2023-01-11T21:08:59.6858313Z ##[endgroup] 2023-01-11T21:08:59.7542723Z == Installing nvidia driver NVIDIA-Linux-x86_64-515.76.run == 2023-01-11T21:08:59.7546784Z + pre_install_nvidia_driver_amzn2 2023-01-11T21:08:59.7547929Z + sudo yum remove -y nvidia-driver-latest-dkms 2023-01-11T21:09:00.3096733Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2023-01-11T21:09:00.3701131Z No Match for argument: nvidia-driver-latest-dkms 2023-01-11T21:09:00.4089099Z No Packages marked for removal 2023-01-11T21:09:00.4258312Z + install_nvidia_driver_common 2023-01-11T21:09:00.4262777Z + echo 'Before installing NVIDIA driver' 2023-01-11T21:09:00.4263503Z Before installing NVIDIA driver 2023-01-11T21:09:00.4264759Z + lspci 2023-01-11T21:09:00.4476339Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02) 2023-01-11T21:09:00.4477192Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2023-01-11T21:09:00.4477652Z 00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II] 2023-01-11T21:09:00.4478223Z 00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 01) 2023-01-11T21:09:00.4479367Z 00:02.0 VGA compatible controller: Cirrus Logic GD 5446 2023-01-11T21:09:00.4480190Z 00:03.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2023-01-11T21:09:00.4480628Z 00:1e.0 VGA compatible controller: NVIDIA Corporation GM204GL [Tesla M60] (rev a1) 2023-01-11T21:09:00.4481037Z 00:1f.0 Unassigned class [ff80]: XenSource, Inc. Xen Platform Device (rev 01) 2023-01-11T21:09:00.4483123Z + lsmod 2023-01-11T21:09:00.4499893Z Module Size Used by 2023-01-11T21:09:00.4500209Z nvidia_modeset 1142784 0 2023-01-11T21:09:00.4500490Z nvidia_uvm 1269760 0 2023-01-11T21:09:00.4500785Z veth 16384 0 2023-01-11T21:09:00.4501069Z nvidia 40808448 2 nvidia_uvm,nvidia_modeset 2023-01-11T21:09:00.4501347Z drm 425984 1 nvidia 2023-01-11T21:09:00.4501621Z i2c_core 77824 2 nvidia,drm 2023-01-11T21:09:00.4501896Z backlight 16384 1 nvidia_modeset 2023-01-11T21:09:00.4502192Z xt_conntrack 16384 1 2023-01-11T21:09:00.4502441Z ipt_MASQUERADE 16384 1 2023-01-11T21:09:00.4502780Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2023-01-11T21:09:00.4503085Z nf_conntrack_netlink 49152 0 2023-01-11T21:09:00.4503370Z nfnetlink 16384 2 nf_conntrack_netlink 2023-01-11T21:09:00.4503654Z xfrm_user 45056 1 2023-01-11T21:09:00.4503903Z xfrm_algo 16384 1 xfrm_user 2023-01-11T21:09:00.4504145Z xt_addrtype 16384 2 2023-01-11T21:09:00.4504415Z iptable_filter 16384 1 2023-01-11T21:09:00.4504705Z iptable_nat 16384 1 2023-01-11T21:09:00.4505021Z nf_conntrack_ipv4 16384 3 2023-01-11T21:09:00.4505288Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2023-01-11T21:09:00.4505588Z nf_nat_ipv4 16384 1 iptable_nat 2023-01-11T21:09:00.4505890Z nf_nat 36864 2 nf_nat_masquerade_ipv4,nf_nat_ipv4 2023-01-11T21:09:00.4506338Z nf_conntrack 155648 7 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,nf_conntrack_netlink 2023-01-11T21:09:00.4506766Z br_netfilter 24576 0 2023-01-11T21:09:00.4507055Z bridge 172032 1 br_netfilter 2023-01-11T21:09:00.4507475Z stp 16384 1 bridge 2023-01-11T21:09:00.4507948Z llc 16384 2 bridge,stp 2023-01-11T21:09:00.4508424Z overlay 86016 0 2023-01-11T21:09:00.4508930Z sunrpc 393216 1 2023-01-11T21:09:00.4509465Z dm_mirror 28672 0 2023-01-11T21:09:00.4510011Z dm_region_hash 20480 1 dm_mirror 2023-01-11T21:09:00.4510618Z dm_log 20480 2 dm_region_hash,dm_mirror 2023-01-11T21:09:00.4511286Z dm_mod 143360 2 dm_log,dm_mirror 2023-01-11T21:09:00.4511815Z dax 69632 1 dm_mod 2023-01-11T21:09:00.4512351Z sb_edac 24576 0 2023-01-11T21:09:00.4512924Z crc32_pclmul 16384 0 2023-01-11T21:09:00.4513199Z ghash_clmulni_intel 16384 0 2023-01-11T21:09:00.4513590Z pcbc 16384 0 2023-01-11T21:09:00.4514133Z aesni_intel 188416 0 2023-01-11T21:09:00.4514658Z aes_x86_64 20480 1 aesni_intel 2023-01-11T21:09:00.4515149Z ata_piix 36864 0 2023-01-11T21:09:00.4515592Z crypto_simd 16384 1 aesni_intel 2023-01-11T21:09:00.4515977Z glue_helper 16384 1 aesni_intel 2023-01-11T21:09:00.4516262Z libata 266240 1 ata_piix 2023-01-11T21:09:00.4516562Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2023-01-11T21:09:00.4516996Z mousedev 24576 0 2023-01-11T21:09:00.4517301Z pcc_cpufreq 16384 0 2023-01-11T21:09:00.4517561Z evdev 20480 3 2023-01-11T21:09:00.4517802Z scsi_mod 245760 1 libata 2023-01-11T21:09:00.4518065Z psmouse 32768 0 2023-01-11T21:09:00.4518331Z button 16384 0 2023-01-11T21:09:00.4518565Z ena 114688 0 2023-01-11T21:09:00.4518803Z xen_blkfront 49152 2 2023-01-11T21:09:00.4519645Z crc32c_intel 24576 0 2023-01-11T21:09:00.4519893Z autofs4 49152 2 2023-01-11T21:09:00.4520141Z + modinfo nvidia 2023-01-11T21:09:00.4520693Z filename: /lib/modules/4.14.252-195.483.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2023-01-11T21:09:00.4521046Z firmware: nvidia/515.76/gsp.bin 2023-01-11T21:09:00.4521374Z alias: char-major-195-* 2023-01-11T21:09:00.4521645Z version: 515.76 2023-01-11T21:09:00.4521906Z supported: external 2023-01-11T21:09:00.4522162Z license: NVIDIA 2023-01-11T21:09:00.4522432Z srcversion: 51FD9DD90150B35351AFFBB 2023-01-11T21:09:00.4522743Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2023-01-11T21:09:00.4523038Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2023-01-11T21:09:00.4523346Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2023-01-11T21:09:00.4523686Z depends: i2c-core,drm 2023-01-11T21:09:00.4523954Z retpoline: Y 2023-01-11T21:09:00.4524210Z name: nvidia 2023-01-11T21:09:00.4524631Z vermagic: 4.14.252-195.483.amzn2.x86_64 SMP mod_unload modversions 2023-01-11T21:09:00.4524980Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2023-01-11T21:09:00.4525358Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2023-01-11T21:09:00.4525723Z parm: NVreg_ResmanDebugLevel:int 2023-01-11T21:09:00.4526018Z parm: NVreg_RmLogonRC:int 2023-01-11T21:09:00.4526304Z parm: NVreg_ModifyDeviceFiles:int 2023-01-11T21:09:00.4526618Z parm: NVreg_DeviceFileUID:int 2023-01-11T21:09:00.4526931Z parm: NVreg_DeviceFileGID:int 2023-01-11T21:09:00.4527215Z parm: NVreg_DeviceFileMode:int 2023-01-11T21:09:00.4527574Z parm: NVreg_InitializeSystemMemoryAllocations:int 2023-01-11T21:09:00.4527945Z parm: NVreg_UsePageAttributeTable:int 2023-01-11T21:09:00.4528247Z parm: NVreg_EnablePCIeGen3:int 2023-01-11T21:09:00.4528541Z parm: NVreg_EnableMSI:int 2023-01-11T21:09:00.4528830Z parm: NVreg_TCEBypassMode:int 2023-01-11T21:09:00.4529156Z parm: NVreg_EnableStreamMemOPs:int 2023-01-11T21:09:00.4529504Z parm: NVreg_RestrictProfilingToAdminUsers:int 2023-01-11T21:09:00.4529893Z parm: NVreg_PreserveVideoMemoryAllocations:int 2023-01-11T21:09:00.4530269Z parm: NVreg_EnableS0ixPowerManagement:int 2023-01-11T21:09:00.4530652Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2023-01-11T21:09:00.4531046Z parm: NVreg_DynamicPowerManagement:int 2023-01-11T21:09:00.4531459Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2023-01-11T21:09:00.4531987Z parm: NVreg_EnableGpuFirmware:int 2023-01-11T21:09:00.4532331Z parm: NVreg_EnableGpuFirmwareLogs:int 2023-01-11T21:09:00.4532692Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2023-01-11T21:09:00.4533035Z parm: NVreg_EnableUserNUMAManagement:int 2023-01-11T21:09:00.4533364Z parm: NVreg_MemoryPoolSize:int 2023-01-11T21:09:00.4533676Z parm: NVreg_KMallocHeapMaxSize:int 2023-01-11T21:09:00.4533999Z parm: NVreg_VMallocHeapMaxSize:int 2023-01-11T21:09:00.4534294Z parm: NVreg_IgnoreMMIOCheck:int 2023-01-11T21:09:00.4534608Z parm: NVreg_NvLinkDisable:int 2023-01-11T21:09:00.4534963Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2023-01-11T21:09:00.4535297Z parm: NVreg_RegisterPCIDriver:int 2023-01-11T21:09:00.4535622Z parm: NVreg_EnableDbgBreakpoint:int 2023-01-11T21:09:00.4536020Z parm: NVreg_RegistryDwords:charp 2023-01-11T21:09:00.4536361Z parm: NVreg_RegistryDwordsPerDevice:charp 2023-01-11T21:09:00.4536671Z parm: NVreg_RmMsg:charp 2023-01-11T21:09:00.4536968Z parm: NVreg_GpuBlacklist:charp 2023-01-11T21:09:00.4537280Z parm: NVreg_TemporaryFilePath:charp 2023-01-11T21:09:00.4537596Z parm: NVreg_ExcludedGpus:charp 2023-01-11T21:09:00.4537905Z parm: NVreg_DmaRemapPeerMmio:int 2023-01-11T21:09:00.4538194Z parm: rm_firmware_active:charp 2023-01-11T21:09:00.4538469Z + HAS_NVIDIA_DRIVER=0 2023-01-11T21:09:00.4538786Z ++ command -v nvidia-smi 2023-01-11T21:09:00.4539101Z + '[' -x /usr/bin/nvidia-smi ']' 2023-01-11T21:09:00.4539364Z + set +e 2023-01-11T21:09:00.4539771Z ++ nvidia-smi --query-gpu=driver_version --format=csv,noheader --id=0 2023-01-11T21:09:02.5995749Z + INSTALLED_DRIVER_VERSION=515.76 2023-01-11T21:09:02.5996101Z + NVIDIA_SMI_STATUS=0 2023-01-11T21:09:02.5996509Z + '[' 0 -ne 0 ']' 2023-01-11T21:09:02.5996835Z + '[' 515.76 '!=' 515.76 ']' 2023-01-11T21:09:02.5997059Z + HAS_NVIDIA_DRIVER=1 2023-01-11T21:09:02.5997562Z + echo 'NVIDIA driver (515.76) has already been installed. Skipping NVIDIA driver installation' 2023-01-11T21:09:02.5997974Z + set -e 2023-01-11T21:09:02.5998236Z + '[' 1 -eq 0 ']' 2023-01-11T21:09:02.5998621Z NVIDIA driver (515.76) has already been installed. Skipping NVIDIA driver installation 2023-01-11T21:09:02.5999524Z + post_install_nvidia_driver_common 2023-01-11T21:09:02.6001917Z + sudo modprobe nvidia 2023-01-11T21:09:02.6129705Z + echo 'After installing NVIDIA driver' 2023-01-11T21:09:02.6130154Z + lspci 2023-01-11T21:09:02.6130422Z After installing NVIDIA driver 2023-01-11T21:09:02.6345417Z 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02) 2023-01-11T21:09:02.6346232Z 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] 2023-01-11T21:09:02.6346983Z 00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II] 2023-01-11T21:09:02.6347518Z 00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 01) 2023-01-11T21:09:02.6347887Z 00:02.0 VGA compatible controller: Cirrus Logic GD 5446 2023-01-11T21:09:02.6348255Z 00:03.0 Ethernet controller: Amazon.com, Inc. Elastic Network Adapter (ENA) 2023-01-11T21:09:02.6348692Z 00:1e.0 VGA compatible controller: NVIDIA Corporation GM204GL [Tesla M60] (rev a1) 2023-01-11T21:09:02.6349122Z 00:1f.0 Unassigned class [ff80]: XenSource, Inc. Xen Platform Device (rev 01) 2023-01-11T21:09:02.6349440Z + lsmod 2023-01-11T21:09:02.6368341Z Module Size Used by 2023-01-11T21:09:02.6368969Z nvidia_modeset 1142784 0 2023-01-11T21:09:02.6369460Z nvidia_uvm 1269760 0 2023-01-11T21:09:02.6369884Z veth 16384 0 2023-01-11T21:09:02.6370463Z nvidia 40808448 2 nvidia_uvm,nvidia_modeset 2023-01-11T21:09:02.6370871Z drm 425984 1 nvidia 2023-01-11T21:09:02.6371117Z i2c_core 77824 2 nvidia,drm 2023-01-11T21:09:02.6371405Z backlight 16384 1 nvidia_modeset 2023-01-11T21:09:02.6371922Z xt_conntrack 16384 1 2023-01-11T21:09:02.6372167Z ipt_MASQUERADE 16384 1 2023-01-11T21:09:02.6372516Z nf_nat_masquerade_ipv4 16384 1 ipt_MASQUERADE 2023-01-11T21:09:02.6372941Z nf_conntrack_netlink 49152 0 2023-01-11T21:09:02.6373577Z nfnetlink 16384 2 nf_conntrack_netlink 2023-01-11T21:09:02.6374171Z xfrm_user 45056 1 2023-01-11T21:09:02.6374580Z xfrm_algo 16384 1 xfrm_user 2023-01-11T21:09:02.6374846Z xt_addrtype 16384 2 2023-01-11T21:09:02.6375100Z iptable_filter 16384 1 2023-01-11T21:09:02.6375369Z iptable_nat 16384 1 2023-01-11T21:09:02.6375620Z nf_conntrack_ipv4 16384 3 2023-01-11T21:09:02.6375909Z nf_defrag_ipv4 16384 1 nf_conntrack_ipv4 2023-01-11T21:09:02.6376222Z nf_nat_ipv4 16384 1 iptable_nat 2023-01-11T21:09:02.6376670Z nf_nat 36864 2 nf_nat_masquerade_ipv4,nf_nat_ipv4 2023-01-11T21:09:02.6377164Z nf_conntrack 155648 7 xt_conntrack,nf_nat_masquerade_ipv4,nf_conntrack_ipv4,nf_nat,ipt_MASQUERADE,nf_nat_ipv4,nf_conntrack_netlink 2023-01-11T21:09:02.6377555Z br_netfilter 24576 0 2023-01-11T21:09:02.6377832Z bridge 172032 1 br_netfilter 2023-01-11T21:09:02.6378107Z stp 16384 1 bridge 2023-01-11T21:09:02.6378356Z llc 16384 2 bridge,stp 2023-01-11T21:09:02.6378635Z overlay 86016 0 2023-01-11T21:09:02.6378898Z sunrpc 393216 1 2023-01-11T21:09:02.6379136Z dm_mirror 28672 0 2023-01-11T21:09:02.6379406Z dm_region_hash 20480 1 dm_mirror 2023-01-11T21:09:02.6379714Z dm_log 20480 2 dm_region_hash,dm_mirror 2023-01-11T21:09:02.6380195Z dm_mod 143360 2 dm_log,dm_mirror 2023-01-11T21:09:02.6380769Z dax 69632 1 dm_mod 2023-01-11T21:09:02.6381254Z sb_edac 24576 0 2023-01-11T21:09:02.6381725Z crc32_pclmul 16384 0 2023-01-11T21:09:02.6382104Z ghash_clmulni_intel 16384 0 2023-01-11T21:09:02.6382631Z pcbc 16384 0 2023-01-11T21:09:02.6383048Z aesni_intel 188416 0 2023-01-11T21:09:02.6383287Z aes_x86_64 20480 1 aesni_intel 2023-01-11T21:09:02.6383533Z ata_piix 36864 0 2023-01-11T21:09:02.6383808Z crypto_simd 16384 1 aesni_intel 2023-01-11T21:09:02.6384098Z glue_helper 16384 1 aesni_intel 2023-01-11T21:09:02.6384393Z libata 266240 1 ata_piix 2023-01-11T21:09:02.6384738Z cryptd 28672 3 crypto_simd,ghash_clmulni_intel,aesni_intel 2023-01-11T21:09:02.6385047Z mousedev 24576 0 2023-01-11T21:09:02.6385308Z pcc_cpufreq 16384 0 2023-01-11T21:09:02.6385565Z evdev 20480 3 2023-01-11T21:09:02.6385801Z scsi_mod 245760 1 libata 2023-01-11T21:09:02.6386098Z psmouse 32768 0 2023-01-11T21:09:02.6386369Z button 16384 0 2023-01-11T21:09:02.6386626Z ena 114688 0 2023-01-11T21:09:02.6386864Z xen_blkfront 49152 2 2023-01-11T21:09:02.6387122Z crc32c_intel 24576 0 2023-01-11T21:09:02.6387376Z autofs4 49152 2 2023-01-11T21:09:02.6387607Z + modinfo nvidia 2023-01-11T21:09:02.6388087Z filename: /lib/modules/4.14.252-195.483.amzn2.x86_64/kernel/drivers/video/nvidia.ko 2023-01-11T21:09:02.6388448Z firmware: nvidia/515.76/gsp.bin 2023-01-11T21:09:02.6388779Z alias: char-major-195-* 2023-01-11T21:09:02.6389048Z version: 515.76 2023-01-11T21:09:02.6389306Z supported: external 2023-01-11T21:09:02.6389542Z license: NVIDIA 2023-01-11T21:09:02.6389814Z srcversion: 51FD9DD90150B35351AFFBB 2023-01-11T21:09:02.6390122Z alias: pci:v000010DEd*sv*sd*bc06sc80i00* 2023-01-11T21:09:02.6390429Z alias: pci:v000010DEd*sv*sd*bc03sc02i00* 2023-01-11T21:09:02.6390753Z alias: pci:v000010DEd*sv*sd*bc03sc00i00* 2023-01-11T21:09:02.6391222Z depends: i2c-core,drm 2023-01-11T21:09:02.6391471Z retpoline: Y 2023-01-11T21:09:02.6391714Z name: nvidia 2023-01-11T21:09:02.6392115Z vermagic: 4.14.252-195.483.amzn2.x86_64 SMP mod_unload modversions 2023-01-11T21:09:02.6392495Z parm: NvSwitchRegDwords:NvSwitch regkey (charp) 2023-01-11T21:09:02.6392869Z parm: NvSwitchBlacklist:NvSwitchBlacklist=uuid[,uuid...] (charp) 2023-01-11T21:09:02.6393247Z parm: NVreg_ResmanDebugLevel:int 2023-01-11T21:09:02.6393551Z parm: NVreg_RmLogonRC:int 2023-01-11T21:09:02.6393840Z parm: NVreg_ModifyDeviceFiles:int 2023-01-11T21:09:02.6394145Z parm: NVreg_DeviceFileUID:int 2023-01-11T21:09:02.6394446Z parm: NVreg_DeviceFileGID:int 2023-01-11T21:09:02.6394730Z parm: NVreg_DeviceFileMode:int 2023-01-11T21:09:02.6395088Z parm: NVreg_InitializeSystemMemoryAllocations:int 2023-01-11T21:09:02.6395535Z parm: NVreg_UsePageAttributeTable:int 2023-01-11T21:09:02.6395877Z parm: NVreg_EnablePCIeGen3:int 2023-01-11T21:09:02.6396177Z parm: NVreg_EnableMSI:int 2023-01-11T21:09:02.6396465Z parm: NVreg_TCEBypassMode:int 2023-01-11T21:09:02.6396765Z parm: NVreg_EnableStreamMemOPs:int 2023-01-11T21:09:02.6397125Z parm: NVreg_RestrictProfilingToAdminUsers:int 2023-01-11T21:09:02.6397520Z parm: NVreg_PreserveVideoMemoryAllocations:int 2023-01-11T21:09:02.6397896Z parm: NVreg_EnableS0ixPowerManagement:int 2023-01-11T21:09:02.6398292Z parm: NVreg_S0ixPowerManagementVideoMemoryThreshold:int 2023-01-11T21:09:02.6398754Z parm: NVreg_DynamicPowerManagement:int 2023-01-11T21:09:02.6399646Z parm: NVreg_DynamicPowerManagementVideoMemoryThreshold:int 2023-01-11T21:09:02.6400029Z parm: NVreg_EnableGpuFirmware:int 2023-01-11T21:09:02.6400358Z parm: NVreg_EnableGpuFirmwareLogs:int 2023-01-11T21:09:02.6400723Z parm: NVreg_OpenRmEnableUnsupportedGpus:int 2023-01-11T21:09:02.6401077Z parm: NVreg_EnableUserNUMAManagement:int 2023-01-11T21:09:02.6401418Z parm: NVreg_MemoryPoolSize:int 2023-01-11T21:09:02.6401747Z parm: NVreg_KMallocHeapMaxSize:int 2023-01-11T21:09:02.6402061Z parm: NVreg_VMallocHeapMaxSize:int 2023-01-11T21:09:02.6402380Z parm: NVreg_IgnoreMMIOCheck:int 2023-01-11T21:09:02.6402684Z parm: NVreg_NvLinkDisable:int 2023-01-11T21:09:02.6403031Z parm: NVreg_EnablePCIERelaxedOrderingMode:int 2023-01-11T21:09:02.6403365Z parm: NVreg_RegisterPCIDriver:int 2023-01-11T21:09:02.6403690Z parm: NVreg_EnableDbgBreakpoint:int 2023-01-11T21:09:02.6404028Z parm: NVreg_RegistryDwords:charp 2023-01-11T21:09:02.6404355Z parm: NVreg_RegistryDwordsPerDevice:charp 2023-01-11T21:09:02.6404672Z parm: NVreg_RmMsg:charp 2023-01-11T21:09:02.6404964Z parm: NVreg_GpuBlacklist:charp 2023-01-11T21:09:02.6405269Z parm: NVreg_TemporaryFilePath:charp 2023-01-11T21:09:02.6405589Z parm: NVreg_ExcludedGpus:charp 2023-01-11T21:09:02.6405899Z parm: NVreg_DmaRemapPeerMmio:int 2023-01-11T21:09:02.6406199Z parm: rm_firmware_active:charp 2023-01-11T21:09:02.6406473Z + set +e 2023-01-11T21:09:02.6406756Z + nvidia-smi 2023-01-11T21:09:04.5395001Z Wed Jan 11 21:09:04 2023 2023-01-11T21:09:04.5396065Z +-----------------------------------------------------------------------------+ 2023-01-11T21:09:04.5397035Z | NVIDIA-SMI 515.76 Driver Version: 515.76 CUDA Version: 11.7 | 2023-01-11T21:09:04.5397844Z |-------------------------------+----------------------+----------------------+ 2023-01-11T21:09:04.5398784Z | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | 2023-01-11T21:09:04.5400074Z | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | 2023-01-11T21:09:04.5400783Z | | | MIG M. | 2023-01-11T21:09:04.5401671Z |===============================+======================+======================| 2023-01-11T21:09:04.5447791Z | 0 Tesla M60 Off | 00000000:00:1E.0 Off | 10771301110 | 2023-01-11T21:09:04.5448508Z | N/A 38C P0 38W / 150W | 0MiB / 7680MiB | 99% Default | 2023-01-11T21:09:04.5449125Z | | | N/A | 2023-01-11T21:09:04.5450050Z +-------------------------------+----------------------+----------------------+ 2023-01-11T21:09:04.5450594Z 2023-01-11T21:09:04.5451044Z +-----------------------------------------------------------------------------+ 2023-01-11T21:09:04.5451474Z | Processes: | 2023-01-11T21:09:04.5451809Z | GPU GI CI PID Type Process name GPU Memory | 2023-01-11T21:09:04.5452296Z | ID ID Usage | 2023-01-11T21:09:04.5452640Z |=============================================================================| 2023-01-11T21:09:04.5452974Z | No running processes found | 2023-01-11T21:09:04.5453435Z +-----------------------------------------------------------------------------+ 2023-01-11T21:09:04.5772083Z + NVIDIA_SMI_STATUS=0 2023-01-11T21:09:04.5772477Z + '[' 0 -eq 0 ']' 2023-01-11T21:09:04.5772806Z + echo 'INFO: Ignoring allowed status 0' 2023-01-11T21:09:04.5773078Z + set -e 2023-01-11T21:09:04.5773351Z INFO: Ignoring allowed status 0 2023-01-11T21:09:04.5780175Z == Installing nvidia container toolkit for amzn2 == 2023-01-11T21:09:04.5784322Z + sudo yum install -y yum-utils 2023-01-11T21:09:05.1476746Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2023-01-11T21:09:06.6307450Z Package yum-utils-1.1.31-46.amzn2.0.1.noarch already installed and latest version 2023-01-11T21:09:06.6308102Z Nothing to do 2023-01-11T21:09:06.7110181Z + sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2023-01-11T21:09:07.2597868Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2023-01-11T21:09:07.2952041Z adding repo from: https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo 2023-01-11T21:09:07.2952722Z grabbing file https://nvidia.github.io/nvidia-docker/amzn2/nvidia-docker.repo to /etc/yum.repos.d/nvidia-docker.repo 2023-01-11T21:09:07.2953242Z repo saved to /etc/yum.repos.d/nvidia-docker.repo 2023-01-11T21:09:07.3102744Z + sudo yum install -y nvidia-docker2 2023-01-11T21:09:07.8402679Z Loaded plugins: extras_suggestions, langpacks, priorities, update-motd 2023-01-11T21:09:09.1991343Z Package nvidia-docker2-2.11.0-1.noarch already installed and latest version 2023-01-11T21:09:09.1991875Z Nothing to do 2023-01-11T21:09:09.2809266Z + sudo systemctl restart docker 2023-01-11T21:09:26.7898455Z Command completed after 1 attempt(s). 2023-01-11T21:09:26.7955273Z ##[group]Run python3 -m pip install psutil==5.9.1 2023-01-11T21:09:26.7955688Z python3 -m pip install psutil==5.9.1 2023-01-11T21:09:26.7955999Z python3 -m pip install pynvml==11.4.1 2023-01-11T21:09:26.7956349Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2023-01-11T21:09:26.7956728Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2023-01-11T21:09:26.7970409Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:09:26.7970708Z env: 2023-01-11T21:09:26.7970969Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:09:26.7971225Z GPU_FLAG: --gpus all 2023-01-11T21:09:26.7971471Z ##[endgroup] 2023-01-11T21:09:27.0922734Z Defaulting to user installation because normal site-packages is not writeable 2023-01-11T21:09:27.1150132Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.7/site-packages (5.9.1) 2023-01-11T21:09:27.6866102Z Defaulting to user installation because normal site-packages is not writeable 2023-01-11T21:09:27.7094412Z Requirement already satisfied: pynvml==11.4.1 in /home/ec2-user/.local/lib/python3.7/site-packages (11.4.1) 2023-01-11T21:09:27.9948879Z Prepare all required actions 2023-01-11T21:09:27.9949253Z Getting action download info 2023-01-11T21:09:28.1675540Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:4a8bfae15cc25cc0785c1603ee87a9da8fd442ea) 2023-01-11T21:09:28.6371370Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2023-01-11T21:09:28.7912092Z ##[group]Run ./.github/actions/download-build-artifacts 2023-01-11T21:09:28.7912535Z with: 2023-01-11T21:09:28.7912937Z name: linux-bionic-cuda11.6-py3.10-gcc7 2023-01-11T21:09:28.7913310Z env: 2023-01-11T21:09:28.7913647Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:09:28.7914035Z GPU_FLAG: --gpus all 2023-01-11T21:09:28.7914365Z ##[endgroup] 2023-01-11T21:09:28.7966352Z ##[group]Run seemethere/download-artifact-s3@v4 2023-01-11T21:09:28.7966834Z with: 2023-01-11T21:09:28.7967306Z name: linux-bionic-cuda11.6-py3.10-gcc7 2023-01-11T21:09:28.7967777Z s3-bucket: gha-artifacts 2023-01-11T21:09:28.7968277Z region: us-east-1 2023-01-11T21:09:28.7968636Z env: 2023-01-11T21:09:28.7969020Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:09:28.7969461Z GPU_FLAG: --gpus all 2023-01-11T21:09:28.7969862Z ##[endgroup] 2023-01-11T21:09:29.3555998Z Found 1 objects with prefix pytorch/pytorch/3896099317/linux-bionic-cuda11.6-py3.10-gcc7/ 2023-01-11T21:09:29.3556645Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2023-01-11T21:09:38.2958679Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2023-01-11T21:09:38.2959320Z 2023-01-11T21:09:38.2980098Z ##[warning]The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/ 2023-01-11T21:09:38.2990354Z Artifact download has finished successfully 2023-01-11T21:09:38.3166787Z ##[group]Run unzip -o artifacts.zip 2023-01-11T21:09:38.3167210Z unzip -o artifacts.zip 2023-01-11T21:09:38.3180982Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:09:38.3181368Z env: 2023-01-11T21:09:38.3181696Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:09:38.3182110Z GPU_FLAG: --gpus all 2023-01-11T21:09:38.3182389Z ##[endgroup] 2023-01-11T21:09:38.3317486Z Archive: artifacts.zip 2023-01-11T21:09:38.3319807Z creating: dist/ 2023-01-11T21:09:40.4353236Z inflating: dist/torch-2.0.0a0+git8419ddd-cp310-cp310-linux_x86_64.whl 2023-01-11T21:09:40.4353671Z creating: build/custom_test_artifacts/ 2023-01-11T21:09:40.4354112Z creating: build/custom_test_artifacts/custom-op-build/ 2023-01-11T21:09:40.4354602Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2023-01-11T21:09:40.4361680Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeOutput.log 2023-01-11T21:09:40.4362268Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/ 2023-01-11T21:09:40.4362831Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CMakeSystem.cmake 2023-01-11T21:09:40.4363396Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdC/ 2023-01-11T21:09:40.4363936Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdC/tmp/ 2023-01-11T21:09:40.4366546Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdC/CMakeCCompilerId.c 2023-01-11T21:09:40.4367673Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdC/a.out 2023-01-11T21:09:40.4368251Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCXX/ 2023-01-11T21:09:40.4368797Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCXX/tmp/ 2023-01-11T21:09:40.4371661Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCXX/CMakeCXXCompilerId.cpp 2023-01-11T21:09:40.4372911Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCXX/a.out 2023-01-11T21:09:40.4374670Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_C.bin 2023-01-11T21:09:40.4375683Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CMakeCCompiler.cmake 2023-01-11T21:09:40.4377073Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_CXX.bin 2023-01-11T21:09:40.4378246Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CMakeCXXCompiler.cmake 2023-01-11T21:09:40.4378885Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/ 2023-01-11T21:09:40.4379448Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/ 2023-01-11T21:09:40.4434101Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2023-01-11T21:09:40.4434842Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2023-01-11T21:09:40.4435580Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2023-01-11T21:09:40.4436291Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2023-01-11T21:09:40.4437043Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2023-01-11T21:09:40.4437996Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2023-01-11T21:09:40.4438730Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2023-01-11T21:09:40.4439769Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2023-01-11T21:09:40.4440710Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2023-01-11T21:09:40.4483131Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2023-01-11T21:09:40.4525336Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2023-01-11T21:09:40.4526489Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2023-01-11T21:09:40.4527401Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2023-01-11T21:09:40.4528288Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.reg.c 2023-01-11T21:09:40.4529098Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.fatbin 2023-01-11T21:09:40.4530232Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2023-01-11T21:09:40.4531312Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.o 2023-01-11T21:09:40.4533511Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/CMakeCUDACompilerId.cu 2023-01-11T21:09:40.4606680Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CompilerIdCUDA/a.out 2023-01-11T21:09:40.4679826Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_CUDA.bin 2023-01-11T21:09:40.4680734Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.22.1/CMakeCUDACompiler.cmake 2023-01-11T21:09:40.4681448Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2023-01-11T21:09:40.4682288Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeError.log 2023-01-11T21:09:40.4682854Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2023-01-11T21:09:40.4683399Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2023-01-11T21:09:40.4683979Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2023-01-11T21:09:40.4684805Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2023-01-11T21:09:40.4685457Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2023-01-11T21:09:40.4686044Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2023-01-11T21:09:40.4686704Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2023-01-11T21:09:40.4688080Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2023-01-11T21:09:40.4688827Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2023-01-11T21:09:40.4689554Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2023-01-11T21:09:40.4690152Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2023-01-11T21:09:40.4711518Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2023-01-11T21:09:40.4829336Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2023-01-11T21:09:40.4829910Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2023-01-11T21:09:40.4830509Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2023-01-11T21:09:40.4831139Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2023-01-11T21:09:40.4831753Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2023-01-11T21:09:40.4832352Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2023-01-11T21:09:40.4832969Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2023-01-11T21:09:40.4834257Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2023-01-11T21:09:40.4835024Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2023-01-11T21:09:40.4835807Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2023-01-11T21:09:40.4836429Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2023-01-11T21:09:40.4857828Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2023-01-11T21:09:40.4944984Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2023-01-11T21:09:40.4945608Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2023-01-11T21:09:40.4946428Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2023-01-11T21:09:40.4947034Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2023-01-11T21:09:40.4947868Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2023-01-11T21:09:40.4949612Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2023-01-11T21:09:40.4950334Z inflating: build/custom_test_artifacts/custom-op-build/detect_cuda_version.cc 2023-01-11T21:09:40.4952796Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2023-01-11T21:09:40.4953625Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2023-01-11T21:09:40.4954320Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2023-01-11T21:09:40.5050119Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2023-01-11T21:09:40.5115160Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2023-01-11T21:09:40.5115677Z creating: build/custom_test_artifacts/jit-hook-build/ 2023-01-11T21:09:40.5116091Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2023-01-11T21:09:40.5122976Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeOutput.log 2023-01-11T21:09:40.5123514Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/ 2023-01-11T21:09:40.5124069Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CMakeSystem.cmake 2023-01-11T21:09:40.5124624Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdC/ 2023-01-11T21:09:40.5125188Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdC/tmp/ 2023-01-11T21:09:40.5127510Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdC/CMakeCCompilerId.c 2023-01-11T21:09:40.5128845Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdC/a.out 2023-01-11T21:09:40.5129386Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCXX/ 2023-01-11T21:09:40.5129943Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCXX/tmp/ 2023-01-11T21:09:40.5132427Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCXX/CMakeCXXCompilerId.cpp 2023-01-11T21:09:40.5133664Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCXX/a.out 2023-01-11T21:09:40.5135535Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_C.bin 2023-01-11T21:09:40.5136405Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CMakeCCompiler.cmake 2023-01-11T21:09:40.5137793Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_CXX.bin 2023-01-11T21:09:40.5138979Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CMakeCXXCompiler.cmake 2023-01-11T21:09:40.5139548Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/ 2023-01-11T21:09:40.5140117Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/ 2023-01-11T21:09:40.5194788Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2023-01-11T21:09:40.5195521Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2023-01-11T21:09:40.5196600Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2023-01-11T21:09:40.5197398Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2023-01-11T21:09:40.5198123Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2023-01-11T21:09:40.5199140Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2023-01-11T21:09:40.5200031Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2023-01-11T21:09:40.5200736Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2023-01-11T21:09:40.5201739Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2023-01-11T21:09:40.5243618Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2023-01-11T21:09:40.5284939Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2023-01-11T21:09:40.5286025Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2023-01-11T21:09:40.5286878Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2023-01-11T21:09:40.5287514Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.reg.c 2023-01-11T21:09:40.5288453Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.fatbin 2023-01-11T21:09:40.5289500Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2023-01-11T21:09:40.5290584Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.o 2023-01-11T21:09:40.5292500Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/CMakeCUDACompilerId.cu 2023-01-11T21:09:40.5365961Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CompilerIdCUDA/a.out 2023-01-11T21:09:40.5439055Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_CUDA.bin 2023-01-11T21:09:40.5440235Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.22.1/CMakeCUDACompiler.cmake 2023-01-11T21:09:40.5440776Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2023-01-11T21:09:40.5441519Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeError.log 2023-01-11T21:09:40.5442280Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2023-01-11T21:09:40.5442856Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2023-01-11T21:09:40.5443454Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2023-01-11T21:09:40.5444062Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2023-01-11T21:09:40.5444744Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2023-01-11T21:09:40.5445443Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2023-01-11T21:09:40.5446251Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2023-01-11T21:09:40.5447484Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2023-01-11T21:09:40.5448302Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2023-01-11T21:09:40.5448917Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2023-01-11T21:09:40.5449509Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2023-01-11T21:09:40.5470806Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2023-01-11T21:09:40.5538677Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2023-01-11T21:09:40.5539303Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2023-01-11T21:09:40.5539903Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2023-01-11T21:09:40.5540471Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2023-01-11T21:09:40.5541412Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2023-01-11T21:09:40.5542551Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2023-01-11T21:09:40.5543083Z inflating: build/custom_test_artifacts/jit-hook-build/detect_cuda_version.cc 2023-01-11T21:09:40.5545995Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2023-01-11T21:09:40.5546755Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2023-01-11T21:09:40.5548612Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2023-01-11T21:09:40.5600335Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2023-01-11T21:09:40.5600853Z creating: build/custom_test_artifacts/custom-backend-build/ 2023-01-11T21:09:40.5601340Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2023-01-11T21:09:40.5607952Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeOutput.log 2023-01-11T21:09:40.5608532Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/ 2023-01-11T21:09:40.5609098Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CMakeSystem.cmake 2023-01-11T21:09:40.5609690Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdC/ 2023-01-11T21:09:40.5610264Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdC/tmp/ 2023-01-11T21:09:40.5612463Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdC/CMakeCCompilerId.c 2023-01-11T21:09:40.5613791Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdC/a.out 2023-01-11T21:09:40.5614390Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCXX/ 2023-01-11T21:09:40.5614972Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCXX/tmp/ 2023-01-11T21:09:40.5617422Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCXX/CMakeCXXCompilerId.cpp 2023-01-11T21:09:40.5618703Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCXX/a.out 2023-01-11T21:09:40.5620602Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_C.bin 2023-01-11T21:09:40.5621357Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CMakeCCompiler.cmake 2023-01-11T21:09:40.5623341Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_CXX.bin 2023-01-11T21:09:40.5624247Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CMakeCXXCompiler.cmake 2023-01-11T21:09:40.5624839Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/ 2023-01-11T21:09:40.5625436Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/ 2023-01-11T21:09:40.5680039Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp1.ii 2023-01-11T21:09:40.5680804Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.c 2023-01-11T21:09:40.5681534Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.gpu 2023-01-11T21:09:40.5682464Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.stub.c 2023-01-11T21:09:40.5683221Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.module_id 2023-01-11T21:09:40.5684182Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.ptx 2023-01-11T21:09:40.5685190Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.sm_52.cubin 2023-01-11T21:09:40.5685944Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin 2023-01-11T21:09:40.5686810Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.fatbin.c 2023-01-11T21:09:40.5729113Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cpp4.ii 2023-01-11T21:09:40.5770693Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.cudafe1.cpp 2023-01-11T21:09:40.5771685Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/CMakeCUDACompilerId.o 2023-01-11T21:09:40.5772705Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.sm_52.cubin 2023-01-11T21:09:40.5773362Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.reg.c 2023-01-11T21:09:40.5774153Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.fatbin 2023-01-11T21:09:40.5775272Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.fatbin.c 2023-01-11T21:09:40.5777109Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/tmp/a_dlink.o 2023-01-11T21:09:40.5779070Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/CMakeCUDACompilerId.cu 2023-01-11T21:09:40.5852543Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CompilerIdCUDA/a.out 2023-01-11T21:09:40.5925978Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CMakeDetermineCompilerABI_CUDA.bin 2023-01-11T21:09:40.5926646Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.22.1/CMakeCUDACompiler.cmake 2023-01-11T21:09:40.5927235Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2023-01-11T21:09:40.5927988Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeError.log 2023-01-11T21:09:40.5928564Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2023-01-11T21:09:40.5929126Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2023-01-11T21:09:40.5929756Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2023-01-11T21:09:40.5930592Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2023-01-11T21:09:40.5931246Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2023-01-11T21:09:40.5931876Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2023-01-11T21:09:40.5932679Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2023-01-11T21:09:40.5933828Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2023-01-11T21:09:40.5934601Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2023-01-11T21:09:40.5935464Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2023-01-11T21:09:40.5936120Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2023-01-11T21:09:40.5940829Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2023-01-11T21:09:40.6095616Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2023-01-11T21:09:40.6096251Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2023-01-11T21:09:40.6096890Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2023-01-11T21:09:40.6097558Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2023-01-11T21:09:40.6098204Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2023-01-11T21:09:40.6098845Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2023-01-11T21:09:40.6099479Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2023-01-11T21:09:40.6100387Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2023-01-11T21:09:40.6101176Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2023-01-11T21:09:40.6101906Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2023-01-11T21:09:40.6102550Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2023-01-11T21:09:40.6124256Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2023-01-11T21:09:40.6185897Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2023-01-11T21:09:40.6186593Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2023-01-11T21:09:40.6187247Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2023-01-11T21:09:40.6187823Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2023-01-11T21:09:40.6188576Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2023-01-11T21:09:40.6189889Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2023-01-11T21:09:40.6190595Z inflating: build/custom_test_artifacts/custom-backend-build/detect_cuda_version.cc 2023-01-11T21:09:40.6193545Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2023-01-11T21:09:40.6194365Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2023-01-11T21:09:40.6195234Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2023-01-11T21:09:40.6319027Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2023-01-11T21:09:40.6366856Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2023-01-11T21:09:40.6367225Z creating: build/lib/ 2023-01-11T21:09:40.6367946Z inflating: build/lib/libclog.a 2023-01-11T21:09:40.6437910Z inflating: build/lib/libgtest.a 2023-01-11T21:09:40.6448495Z inflating: build/lib/libpthreadpool.a 2023-01-11T21:09:40.6554916Z inflating: build/lib/libprotobuf-lite.a 2023-01-11T21:09:40.6651859Z inflating: build/lib/libbenchmark.a 2023-01-11T21:09:40.6661365Z inflating: build/lib/libittnotify.a 2023-01-11T21:09:40.6738385Z inflating: build/lib/libasmjit.a 2023-01-11T21:09:40.6770408Z inflating: build/lib/libtensorpipe_uv.a 2023-01-11T21:09:40.7306434Z inflating: build/lib/libprotobuf.a 2023-01-11T21:09:40.7447998Z inflating: build/lib/libgloo.a 2023-01-11T21:09:40.7480894Z inflating: build/lib/libfmt.a 2023-01-11T21:09:40.7482831Z inflating: build/lib/libcaffe2_nvrtc.so 2023-01-11T21:09:40.7483621Z inflating: build/lib/libfoxi_loader.a 2023-01-11T21:09:40.7566918Z inflating: build/lib/libc10.so 2023-01-11T21:09:40.7568661Z inflating: build/lib/libtorch_global_deps.so 2023-01-11T21:09:40.7578369Z inflating: build/lib/libcpuinfo.a 2023-01-11T21:09:40.7587332Z inflating: build/lib/libcpuinfo_internals.a 2023-01-11T21:09:40.8160229Z inflating: build/lib/libprotoc.a 2023-01-11T21:09:40.8176015Z inflating: build/lib/libqnnpack.a 2023-01-11T21:09:40.8199111Z inflating: build/lib/libpytorch_qnnpack.a 2023-01-11T21:09:40.8202038Z inflating: build/lib/libnnpack_reference_layers.a 2023-01-11T21:09:40.8224270Z inflating: build/lib/libnnpack.a 2023-01-11T21:09:40.8242277Z inflating: build/lib/libgmock.a 2023-01-11T21:09:40.8242992Z inflating: build/lib/libgtest_main.a 2023-01-11T21:09:40.8244109Z inflating: build/lib/libbenchmark_main.a 2023-01-11T21:09:40.8386765Z inflating: build/lib/libXNNPACK.a 2023-01-11T21:09:41.8206434Z inflating: build/lib/libdnnl.a 2023-01-11T21:09:41.8863876Z inflating: build/lib/libtensorpipe.a 2023-01-11T21:09:41.8918695Z inflating: build/lib/libc10_cuda.so 2023-01-11T21:09:42.0466927Z inflating: build/lib/libfbgemm.a 2023-01-11T21:09:42.0467640Z inflating: build/lib/libgmock_main.a 2023-01-11T21:09:42.1627633Z inflating: build/lib/libdnnl_graph.a 2023-01-11T21:09:42.2145225Z inflating: build/lib/libkineto.a 2023-01-11T21:09:42.2436313Z inflating: build/lib/libtensorpipe_cuda.a 2023-01-11T21:09:42.2481617Z inflating: build/lib/libcaffe2_protos.a 2023-01-11T21:09:42.2531124Z inflating: build/lib/libonnx_proto.a 2023-01-11T21:09:42.3211794Z inflating: build/lib/libonnx.a 2023-01-11T21:09:42.3645544Z inflating: build/lib/libgloo_cuda.a 2023-01-11T21:09:44.7525598Z inflating: build/lib/libtorch_cpu.so 2023-01-11T21:09:44.7536504Z inflating: build/lib/libunbox_lib.a 2023-01-11T21:09:46.9013033Z inflating: build/lib/libtorch_cuda.so 2023-01-11T21:09:46.9014005Z inflating: build/lib/libtorch.so 2023-01-11T21:09:46.9017076Z inflating: build/lib/libc10d_cuda_test.so 2023-01-11T21:09:47.8943753Z inflating: build/lib/libtorch_cuda_linalg.so 2023-01-11T21:09:47.8968302Z inflating: build/lib/libjitbackend_test.so 2023-01-11T21:09:47.8999233Z inflating: build/lib/libbackend_with_compiler.so 2023-01-11T21:09:47.9061725Z inflating: build/lib/libtorchbind_test.so 2023-01-11T21:09:47.9066680Z inflating: build/lib/libshm.so 2023-01-11T21:09:48.0925991Z inflating: build/lib/libtorch_python.so 2023-01-11T21:09:48.0966310Z inflating: build/lib/libnnapi_backend.so 2023-01-11T21:09:48.0966609Z creating: build/bin/ 2023-01-11T21:09:48.1021222Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2023-01-11T21:09:48.1078965Z inflating: build/bin/c10_DeviceGuard_test 2023-01-11T21:09:48.1135644Z inflating: build/bin/c10_Device_test 2023-01-11T21:09:48.1200546Z inflating: build/bin/c10_DispatchKeySet_test 2023-01-11T21:09:48.1254366Z inflating: build/bin/c10_StreamGuard_test 2023-01-11T21:09:48.1309140Z inflating: build/bin/c10_SymInt_test 2023-01-11T21:09:48.1371214Z inflating: build/bin/c10_InlineDeviceGuard_test 2023-01-11T21:09:48.1433240Z inflating: build/bin/c10_InlineStreamGuard_test 2023-01-11T21:09:48.1497377Z inflating: build/bin/c10_SizesAndStrides_test 2023-01-11T21:09:48.1550851Z inflating: build/bin/c10_Array_test 2023-01-11T21:09:48.1610063Z inflating: build/bin/c10_Bitset_test 2023-01-11T21:09:48.1667162Z inflating: build/bin/c10_C++17_test 2023-01-11T21:09:48.1720742Z inflating: build/bin/c10_ConstexprCrc_test 2023-01-11T21:09:48.1775572Z inflating: build/bin/c10_DeadlockDetection_test 2023-01-11T21:09:48.1830674Z inflating: build/bin/c10_Half_test 2023-01-11T21:09:48.1893880Z inflating: build/bin/c10_LeftRight_test 2023-01-11T21:09:48.1963333Z inflating: build/bin/c10_Metaprogramming_test 2023-01-11T21:09:48.2124668Z inflating: build/bin/c10_SmallVectorTest 2023-01-11T21:09:48.2180287Z inflating: build/bin/c10_Synchronized_test 2023-01-11T21:09:48.2243678Z inflating: build/bin/c10_ThreadLocal_test 2023-01-11T21:09:48.2302467Z inflating: build/bin/c10_TypeIndex_test 2023-01-11T21:09:48.2358606Z inflating: build/bin/c10_TypeList_test 2023-01-11T21:09:48.2412218Z inflating: build/bin/c10_TypeTraits_test 2023-01-11T21:09:48.2470442Z inflating: build/bin/c10_accumulate_test 2023-01-11T21:09:48.2533124Z inflating: build/bin/c10_bfloat16_test 2023-01-11T21:09:48.2594641Z inflating: build/bin/c10_complex_math_test 2023-01-11T21:09:48.2656276Z inflating: build/bin/c10_complex_test 2023-01-11T21:09:48.2776535Z inflating: build/bin/c10_either_test 2023-01-11T21:09:48.2835141Z inflating: build/bin/c10_exception_test 2023-01-11T21:09:48.2890959Z inflating: build/bin/c10_flags_test 2023-01-11T21:09:48.3076147Z inflating: build/bin/c10_intrusive_ptr_test 2023-01-11T21:09:48.3132472Z inflating: build/bin/c10_irange_test 2023-01-11T21:09:48.3195699Z inflating: build/bin/c10_logging_test 2023-01-11T21:09:48.3277556Z inflating: build/bin/c10_optional_test 2023-01-11T21:09:48.3346505Z inflating: build/bin/c10_ordered_preserving_dict_test 2023-01-11T21:09:48.3407719Z inflating: build/bin/c10_registry_test 2023-01-11T21:09:48.3472237Z inflating: build/bin/c10_string_view_test 2023-01-11T21:09:48.3529989Z inflating: build/bin/c10_tempfile_test 2023-01-11T21:09:48.3591831Z inflating: build/bin/c10_typeid_test 2023-01-11T21:09:48.3653480Z inflating: build/bin/c10_intrusive_ptr_benchmark 2023-01-11T21:09:48.4177863Z inflating: build/bin/protoc-3.13.0.0 2023-01-11T21:09:48.4701355Z inflating: build/bin/protoc 2023-01-11T21:09:48.4760705Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_1_var_test 2023-01-11T21:09:48.4820240Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_stream 2023-01-11T21:09:48.4879502Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_catches_thread_and_block_and_device 2023-01-11T21:09:48.4937814Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_from_2_processes 2023-01-11T21:09:48.4996957Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_blocks_and_threads 2023-01-11T21:09:48.5051155Z inflating: build/bin/c10_cuda_CUDATest 2023-01-11T21:09:48.5110530Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_multiple_blocks 2023-01-11T21:09:48.5169733Z inflating: build/bin/c10_cuda_CUDAAssertionsTest_multiple_writes_from_same_block 2023-01-11T21:09:48.5495477Z inflating: build/bin/vec_test_all_types_DEFAULT 2023-01-11T21:09:48.5857387Z inflating: build/bin/vec_test_all_types_AVX2 2023-01-11T21:09:48.5917264Z inflating: build/bin/FileStoreTest 2023-01-11T21:09:48.5983751Z inflating: build/bin/TCPStoreTest 2023-01-11T21:09:48.6043835Z inflating: build/bin/HashStoreTest 2023-01-11T21:09:48.6060128Z inflating: build/bin/ProcessGroupMPITest 2023-01-11T21:09:48.6123769Z inflating: build/bin/test_edge_op_registration 2023-01-11T21:09:48.6127044Z inflating: build/bin/example_allreduce 2023-01-11T21:09:48.6186025Z inflating: build/bin/Dimname_test 2023-01-11T21:09:48.6266888Z inflating: build/bin/Dict_test 2023-01-11T21:09:48.6338053Z inflating: build/bin/MaybeOwned_test 2023-01-11T21:09:48.6401532Z inflating: build/bin/NamedTensor_test 2023-01-11T21:09:48.6467259Z inflating: build/bin/apply_utils_test 2023-01-11T21:09:48.6532595Z inflating: build/bin/atest 2023-01-11T21:09:48.6600118Z inflating: build/bin/basic 2023-01-11T21:09:48.6660468Z inflating: build/bin/broadcast_test 2023-01-11T21:09:48.6724939Z inflating: build/bin/cpu_generator_test 2023-01-11T21:09:48.6780323Z inflating: build/bin/dispatch_key_set_test 2023-01-11T21:09:48.6839042Z inflating: build/bin/cpu_profiling_allocator_test 2023-01-11T21:09:48.6894401Z inflating: build/bin/dlconvertor_test 2023-01-11T21:09:48.6959073Z inflating: build/bin/extension_backend_test 2023-01-11T21:09:48.7020971Z inflating: build/bin/half_test 2023-01-11T21:09:48.7077242Z inflating: build/bin/lazy_tensor_test 2023-01-11T21:09:48.7137850Z inflating: build/bin/math_kernel_test 2023-01-11T21:09:48.7197992Z inflating: build/bin/memory_format_test 2023-01-11T21:09:48.7258101Z inflating: build/bin/memory_overlapping_test 2023-01-11T21:09:48.7314673Z inflating: build/bin/operator_name_test 2023-01-11T21:09:48.7377180Z inflating: build/bin/native_test 2023-01-11T21:09:48.7432892Z inflating: build/bin/operators_test 2023-01-11T21:09:48.7492014Z inflating: build/bin/packedtensoraccessor_test 2023-01-11T21:09:48.7555914Z inflating: build/bin/quantized_test 2023-01-11T21:09:48.7613005Z inflating: build/bin/reportMemoryUsage_test 2023-01-11T21:09:48.7675950Z inflating: build/bin/scalar_tensor_test 2023-01-11T21:09:48.7739868Z inflating: build/bin/scalar_test 2023-01-11T21:09:48.7798377Z inflating: build/bin/stride_properties_test 2023-01-11T21:09:48.7886656Z inflating: build/bin/tensor_iterator_test 2023-01-11T21:09:48.7941620Z inflating: build/bin/reduce_ops_test 2023-01-11T21:09:48.8015213Z inflating: build/bin/pow_test 2023-01-11T21:09:48.8018523Z inflating: build/bin/thread_init_test 2023-01-11T21:09:48.8081440Z inflating: build/bin/test_parallel 2023-01-11T21:09:48.8142753Z inflating: build/bin/type_ptr_test 2023-01-11T21:09:48.8198035Z inflating: build/bin/variant_test 2023-01-11T21:09:48.8257272Z inflating: build/bin/undefined_tensor_test 2023-01-11T21:09:48.8315627Z inflating: build/bin/mobile_memory_cleanup 2023-01-11T21:09:48.8317011Z inflating: build/bin/verify_api_visibility 2023-01-11T21:09:48.8393860Z inflating: build/bin/legacy_vmap_test 2023-01-11T21:09:48.8451057Z inflating: build/bin/weakref_test 2023-01-11T21:09:48.8508003Z inflating: build/bin/wrapdim_test 2023-01-11T21:09:48.8562533Z inflating: build/bin/xla_tensor_test 2023-01-11T21:09:48.8629286Z inflating: build/bin/IListRef_test 2023-01-11T21:09:48.8750187Z inflating: build/bin/List_test 2023-01-11T21:09:48.8822375Z inflating: build/bin/KernelFunction_test 2023-01-11T21:09:48.8956605Z inflating: build/bin/kernel_function_legacy_test 2023-01-11T21:09:48.9062869Z inflating: build/bin/kernel_function_test 2023-01-11T21:09:48.9160271Z inflating: build/bin/cpu_rng_test 2023-01-11T21:09:48.9301702Z inflating: build/bin/kernel_lambda_legacy_test 2023-01-11T21:09:48.9406053Z inflating: build/bin/ivalue_test 2023-01-11T21:09:48.9520408Z inflating: build/bin/kernel_lambda_test 2023-01-11T21:09:48.9587479Z inflating: build/bin/kernel_stackbased_test 2023-01-11T21:09:48.9644880Z inflating: build/bin/CppSignature_test 2023-01-11T21:09:48.9750077Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2023-01-11T21:09:48.9803656Z inflating: build/bin/op_allowlist_test 2023-01-11T21:09:48.9870995Z inflating: build/bin/type_test 2023-01-11T21:09:48.9934040Z inflating: build/bin/backend_fallback_test 2023-01-11T21:09:49.0250929Z inflating: build/bin/op_registration_test 2023-01-11T21:09:49.0311219Z inflating: build/bin/inline_container_test 2023-01-11T21:09:49.0369789Z inflating: build/bin/cuda_apply_test 2023-01-11T21:09:49.0436358Z inflating: build/bin/cuda_atomic_ops_test 2023-01-11T21:09:49.0496413Z inflating: build/bin/cuda_caching_host_allocator_test 2023-01-11T21:09:49.0575067Z inflating: build/bin/cuda_complex_math_test 2023-01-11T21:09:49.0639976Z inflating: build/bin/cuda_complex_test 2023-01-11T21:09:49.0694524Z inflating: build/bin/cuda_device_test 2023-01-11T21:09:49.0760496Z inflating: build/bin/cuda_cub_test 2023-01-11T21:09:49.0816161Z inflating: build/bin/cuda_dlconvertor_test 2023-01-11T21:09:49.0890585Z inflating: build/bin/cuda_distributions_test 2023-01-11T21:09:49.0946632Z inflating: build/bin/cuda_integer_divider_test 2023-01-11T21:09:49.1011986Z inflating: build/bin/cuda_generator_test 2023-01-11T21:09:49.1066590Z inflating: build/bin/cuda_half_test 2023-01-11T21:09:49.1134006Z inflating: build/bin/cuda_stream_test 2023-01-11T21:09:49.1192738Z inflating: build/bin/cuda_reportMemoryUsage_test 2023-01-11T21:09:49.1247075Z inflating: build/bin/cuda_optional_test 2023-01-11T21:09:49.1304132Z inflating: build/bin/cuda_packedtensoraccessor_test 2023-01-11T21:09:49.1358144Z inflating: build/bin/cuda_cudnn_test 2023-01-11T21:09:49.1416702Z inflating: build/bin/cuda_vectorized_test 2023-01-11T21:09:49.1434669Z inflating: build/bin/tutorial_tensorexpr 2023-01-11T21:09:49.1507241Z inflating: build/bin/ProcessGroupGlooTest 2023-01-11T21:09:49.1572818Z inflating: build/bin/ProcessGroupGlooAsyncTest 2023-01-11T21:09:49.1641345Z inflating: build/bin/ProcessGroupNCCLTest 2023-01-11T21:09:49.1705639Z inflating: build/bin/ProcessGroupNCCLErrorsTest 2023-01-11T21:09:49.1764991Z inflating: build/bin/ProcessGroupUCCTest 2023-01-11T21:09:49.1824915Z inflating: build/bin/test_dist_autograd 2023-01-11T21:09:49.1902320Z inflating: build/bin/test_cpp_rpc 2023-01-11T21:09:49.1905188Z inflating: build/bin/parallel_benchmark 2023-01-11T21:09:49.1981194Z inflating: build/bin/test_mobile_nnc 2023-01-11T21:09:49.1992660Z inflating: build/bin/aot_model_compiler_test 2023-01-11T21:09:49.2905107Z inflating: build/bin/test_tensorexpr 2023-01-11T21:09:49.2911077Z inflating: build/bin/torch_shm_manager 2023-01-11T21:09:49.3301691Z inflating: build/bin/test_lazy 2023-01-11T21:09:49.4626713Z inflating: build/bin/test_api 2023-01-11T21:09:49.5834535Z inflating: build/bin/test_jit 2023-01-11T21:09:49.5836731Z inflating: .pytorch-test-times.json 2023-01-11T21:09:49.5869428Z ##[group]Run df -H 2023-01-11T21:09:49.5869672Z df -H 2023-01-11T21:09:49.5883742Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:09:49.5884068Z env: 2023-01-11T21:09:49.5884326Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:09:49.5884606Z GPU_FLAG: --gpus all 2023-01-11T21:09:49.5884872Z ##[endgroup] 2023-01-11T21:09:49.5924828Z Filesystem Size Used Avail Use% Mounted on 2023-01-11T21:09:49.5925211Z devtmpfs 65G 0 65G 0% /dev 2023-01-11T21:09:49.5925466Z tmpfs 65G 0 65G 0% /dev/shm 2023-01-11T21:09:49.5925728Z tmpfs 65G 541k 65G 1% /run 2023-01-11T21:09:49.5928230Z tmpfs 65G 0 65G 0% /sys/fs/cgroup 2023-01-11T21:09:49.5928603Z /dev/xvda1 162G 29G 133G 18% / 2023-01-11T21:09:49.5928920Z tmpfs 13G 0 13G 0% /run/user/0 2023-01-11T21:09:49.5953997Z ##[group]Run .github/scripts/parse_ref.py 2023-01-11T21:09:49.5954370Z .github/scripts/parse_ref.py 2023-01-11T21:09:49.5967045Z shell: /usr/bin/bash -e {0} 2023-01-11T21:09:49.5967301Z env: 2023-01-11T21:09:49.5967530Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:09:49.5967803Z GPU_FLAG: --gpus all 2023-01-11T21:09:49.5968061Z ##[endgroup] 2023-01-11T21:09:49.6272088Z ##[group]Run set -x 2023-01-11T21:09:49.6272503Z set -x 2023-01-11T21:09:49.6272742Z  2023-01-11T21:09:49.6272998Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2023-01-11T21:09:49.6273347Z  TEST_COMMAND=.jenkins/pytorch/multigpu-test.sh 2023-01-11T21:09:49.6273700Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2023-01-11T21:09:49.6274022Z  TEST_COMMAND=.jenkins/onnx/test.sh 2023-01-11T21:09:49.6274271Z else 2023-01-11T21:09:49.6274554Z  TEST_COMMAND=.jenkins/pytorch/test.sh 2023-01-11T21:09:49.6274839Z fi 2023-01-11T21:09:49.6275048Z  2023-01-11T21:09:49.6275369Z COMMIT_MESSAGES=$(git cherry -v "origin/${GIT_DEFAULT_BRANCH:-master}") 2023-01-11T21:09:49.6275688Z  2023-01-11T21:09:49.6275969Z # sanitize the input commit message and PR body here: 2023-01-11T21:09:49.6276264Z # 2023-01-11T21:09:49.6276647Z # trim all new lines from commit messages + PR_BODY to avoid issues with batch environment 2023-01-11T21:09:49.6277274Z # variable copying. see https://github.com/pytorch/pytorch/pull/80043#issuecomment-1167796028 2023-01-11T21:09:49.6277710Z COMMIT_MESSAGES="${COMMIT_MESSAGES//[$'\n\r']}" 2023-01-11T21:09:49.6278023Z PR_BODY="${PR_BODY//[$'\n\r']}" 2023-01-11T21:09:49.6278278Z  2023-01-11T21:09:49.6278615Z # then trim all special characters like single and double quotes to avoid unescaped inputs to 2023-01-11T21:09:49.6279663Z # wreak havoc internally 2023-01-11T21:09:49.6279997Z export COMMIT_MESSAGES="${COMMIT_MESSAGES//[\'\"]}" 2023-01-11T21:09:49.6280321Z export PR_BODY="${PR_BODY//[\'\"]}" 2023-01-11T21:09:49.6280591Z  2023-01-11T21:09:49.6280908Z # detached container should get cleaned up by teardown_ec2_linux 2023-01-11T21:09:49.6281299Z # TODO: Stop building test binaries as part of the build phase 2023-01-11T21:09:49.6281682Z # Used for GPU_FLAG since that doesn't play nice 2023-01-11T21:09:49.6282010Z # shellcheck disable=SC2086,SC2090 2023-01-11T21:09:49.6282312Z container_name=$(docker run \ 2023-01-11T21:09:49.6282571Z  ${GPU_FLAG:-} \ 2023-01-11T21:09:49.6282859Z  -e BUILD_ENVIRONMENT \ 2023-01-11T21:09:49.6283139Z  -e PR_NUMBER \ 2023-01-11T21:09:49.6283390Z  -e GITHUB_ACTIONS \ 2023-01-11T21:09:49.6283650Z  -e BASE_SHA \ 2023-01-11T21:09:49.6283897Z  -e BRANCH \ 2023-01-11T21:09:49.6284122Z  -e SHA1 \ 2023-01-11T21:09:49.6284379Z  -e AWS_DEFAULT_REGION \ 2023-01-11T21:09:49.6284657Z  -e IN_WHEEL_TEST \ 2023-01-11T21:09:49.6284914Z  -e SHARD_NUMBER \ 2023-01-11T21:09:49.6285183Z  -e TEST_CONFIG \ 2023-01-11T21:09:49.6285445Z  -e NUM_TEST_SHARDS \ 2023-01-11T21:09:49.6285702Z  -e PR_BODY \ 2023-01-11T21:09:49.6285957Z  -e COMMIT_MESSAGES \ 2023-01-11T21:09:49.6286240Z  -e CONTINUE_THROUGH_ERROR \ 2023-01-11T21:09:49.6286538Z  -e PYTORCH_RETRY_TEST_CASES \ 2023-01-11T21:09:49.6286846Z  -e PYTORCH_OVERRIDE_FLAKY_SIGNAL \ 2023-01-11T21:09:49.6287141Z  -e PR_LABELS \ 2023-01-11T21:09:49.6287431Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2023-01-11T21:09:49.6287725Z  -e SCCACHE_BUCKET \ 2023-01-11T21:09:49.6288003Z  -e SCCACHE_S3_KEY_PREFIX \ 2023-01-11T21:09:49.6288274Z  -e XLA_CUDA \ 2023-01-11T21:09:49.6288543Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2023-01-11T21:09:49.6288871Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2023-01-11T21:09:49.6289214Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2023-01-11T21:09:49.6289566Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2023-01-11T21:09:49.6289871Z  --ulimit stack=10485760:83886080 \ 2023-01-11T21:09:49.6290302Z  --security-opt seccomp=unconfined \ 2023-01-11T21:09:49.6290633Z  --cap-add=SYS_PTRACE \ 2023-01-11T21:09:49.6290886Z  --ipc=host \ 2023-01-11T21:09:49.6291152Z  --shm-size="${SHM_SIZE}" \ 2023-01-11T21:09:49.6291424Z  --tty \ 2023-01-11T21:09:49.6291655Z  --detach \ 2023-01-11T21:09:49.6291924Z  --name="${container_name}" \ 2023-01-11T21:09:49.6292198Z  --user jenkins \ 2023-01-11T21:09:49.6292502Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2023-01-11T21:09:49.6292846Z  -w /var/lib/jenkins/workspace \ 2023-01-11T21:09:49.6293126Z  "${DOCKER_IMAGE}" 2023-01-11T21:09:49.6293370Z ) 2023-01-11T21:09:49.6293672Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2023-01-11T21:09:49.6294115Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2023-01-11T21:09:49.6306057Z shell: /usr/bin/bash -e {0} 2023-01-11T21:09:49.6306301Z env: 2023-01-11T21:09:49.6306546Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:09:49.6306814Z GPU_FLAG: --gpus all 2023-01-11T21:09:49.6307147Z BUILD_ENVIRONMENT: linux-bionic-cuda11.6-py3.10-gcc7 2023-01-11T21:09:49.6307470Z PR_NUMBER: 91627 2023-01-11T21:09:49.6307717Z BRANCH: pull/91627 2023-01-11T21:09:49.6307997Z SHA1: 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:09:49.6308330Z BASE_SHA: db2a237763eb8693a20788be94f8c192e762baa8 2023-01-11T21:09:49.6308634Z PYTORCH_RETRY_TEST_CASES: 1 2023-01-11T21:09:49.6308908Z PYTORCH_OVERRIDE_FLAKY_SIGNAL: 1 2023-01-11T21:09:49.6309189Z TEST_CONFIG: deploy 2023-01-11T21:09:49.6309447Z SHARD_NUMBER: 1 2023-01-11T21:09:49.6309670Z NUM_TEST_SHARDS: 1 2023-01-11T21:09:49.6309954Z PR_BODY: Fixes #91003 cc @ezyang @gchanan 2023-01-11T21:09:49.6310247Z CONTINUE_THROUGH_ERROR: False 2023-01-11T21:09:49.6310579Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2023-01-11T21:09:49.6310906Z SCCACHE_S3_KEY_PREFIX: pull 2023-01-11T21:09:49.6311163Z SHM_SIZE: 2g 2023-01-11T21:09:49.6311672Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:09:49.6312141Z XLA_CUDA: 2023-01-11T21:09:49.6312495Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2023-01-11T21:09:49.6312879Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2023-01-11T21:09:49.6313184Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2023-01-11T21:09:49.6313437Z ##[endgroup] 2023-01-11T21:09:49.6341858Z + [[ deploy == \m\u\l\t\i\g\p\u ]] 2023-01-11T21:09:49.6342397Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *onnx* ]] 2023-01-11T21:09:49.6342721Z + TEST_COMMAND=.jenkins/pytorch/test.sh 2023-01-11T21:09:49.6345682Z ++ git cherry -v origin/master 2023-01-11T21:09:49.6885429Z + COMMIT_MESSAGES='+ 52a16ce42647731c772e14e7175afa40fda07b3d make torchgen rename also Number arguments into '\''input'\'' 2023-01-11T21:09:49.6885944Z + 87db01a53ecb702267ec36787654e418a52f8e93 fix torch.where signature mismatch 2023-01-11T21:09:49.6886521Z + 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e '\''other'\'' instead of '\''output'\'' in documentation' 2023-01-11T21:09:49.6888011Z + COMMIT_MESSAGES='+ 52a16ce42647731c772e14e7175afa40fda07b3d make torchgen rename also Number arguments into '\''input'\''+ 87db01a53ecb702267ec36787654e418a52f8e93 fix torch.where signature mismatch+ 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e '\''other'\'' instead of '\''output'\'' in documentation' 2023-01-11T21:09:49.6888763Z + PR_BODY='Fixes #91003 cc @ezyang @gchanan' 2023-01-11T21:09:49.6889861Z + export 'COMMIT_MESSAGES=+ 52a16ce42647731c772e14e7175afa40fda07b3d make torchgen rename also Number arguments into input+ 87db01a53ecb702267ec36787654e418a52f8e93 fix torch.where signature mismatch+ 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e other instead of output in documentation' 2023-01-11T21:09:49.6891189Z + COMMIT_MESSAGES='+ 52a16ce42647731c772e14e7175afa40fda07b3d make torchgen rename also Number arguments into input+ 87db01a53ecb702267ec36787654e418a52f8e93 fix torch.where signature mismatch+ 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e other instead of output in documentation' 2023-01-11T21:09:49.6891914Z + export 'PR_BODY=Fixes #91003 cc @ezyang @gchanan' 2023-01-11T21:09:49.6892297Z + PR_BODY='Fixes #91003 cc @ezyang @gchanan' 2023-01-11T21:09:49.6899197Z +++ nproc --ignore=2 2023-01-11T21:09:49.6911431Z ++ docker run --gpus all -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e PR_BODY -e COMMIT_MESSAGES -e CONTINUE_THROUGH_ERROR -e PYTORCH_RETRY_TEST_CASES -e PYTORCH_OVERRIDE_FLAKY_SIGNAL -e PR_LABELS -e MAX_JOBS=14 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS --env-file=/tmp/github_env_3896099317 --ulimit stack=10485760:83886080 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=2g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:10:03.9180144Z + container_name=dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:10:03.9180882Z + echo DOCKER_CONTAINER_ID=dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:10:03.9187104Z ++ echo dist/torch-2.0.0a0+git8419ddd-cp310-cp310-linux_x86_64.whl 2023-01-11T21:10:03.9188815Z + docker exec -t dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 sh -c 'pip install dist/torch-2.0.0a0+git8419ddd-cp310-cp310-linux_x86_64.whl[opt-einsum] && .jenkins/pytorch/test.sh' 2023-01-11T21:10:04.4720364Z Processing ./dist/torch-2.0.0a0+git8419ddd-cp310-cp310-linux_x86_64.whl 2023-01-11T21:10:05.4479448Z Requirement already satisfied: typing-extensions in /opt/conda/lib/python3.10/site-packages (from torch==2.0.0a0+git8419ddd) (4.4.0) 2023-01-11T21:10:05.4482758Z Requirement already satisfied: sympy in /opt/conda/lib/python3.10/site-packages (from torch==2.0.0a0+git8419ddd) (1.11.1) 2023-01-11T21:10:05.4487795Z Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch==2.0.0a0+git8419ddd) (2.6.3) 2023-01-11T21:10:05.4505188Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/lib/python3.10/site-packages (from torch==2.0.0a0+git8419ddd) (3.3.0) 2023-01-11T21:10:05.4583595Z Requirement already satisfied: numpy>=1.7 in /opt/conda/lib/python3.10/site-packages (from opt-einsum>=3.3->torch==2.0.0a0+git8419ddd) (1.21.2) 2023-01-11T21:10:05.4801367Z Requirement already satisfied: mpmath>=0.19 in /opt/conda/lib/python3.10/site-packages (from sympy->torch==2.0.0a0+git8419ddd) (1.2.1) 2023-01-11T21:10:06.4019534Z Installing collected packages: torch 2023-01-11T21:10:15.9660700Z Successfully installed torch-2.0.0a0+git8419ddd 2023-01-11T21:10:16.1360063Z + echo 'Environment variables:' 2023-01-11T21:10:16.1360377Z Environment variables: 2023-01-11T21:10:16.1360634Z + env 2023-01-11T21:10:16.1369194Z SHARD_NUMBER=1 2023-01-11T21:10:16.1370538Z NV_LIBCUBLAS_DEV_VERSION=11.9.2.110-1 2023-01-11T21:10:16.1371154Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-11-6 2023-01-11T21:10:16.1371506Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2023-01-11T21:10:16.1371955Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.12.10-1+cuda11.6 2023-01-11T21:10:16.1374475Z UCC_HOME=/usr 2023-01-11T21:10:16.1375039Z BUILD_ENVIRONMENT=linux-bionic-cuda11.6-py3.10-gcc7 2023-01-11T21:10:16.1375418Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2023-01-11T21:10:16.1375816Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-11-6=11.6.3.124-1 2023-01-11T21:10:16.1376075Z INSTALLED_DB=yes 2023-01-11T21:10:16.1376329Z HOSTNAME=dd5ee451bcc5 2023-01-11T21:10:16.1376617Z GITHUB_REF_NAME=91627/merge 2023-01-11T21:10:16.1377148Z GITHUB_API_URL=https://api.github.com 2023-01-11T21:10:16.1377492Z GITHUB_REPOSITORY_OWNER_ID=21003710 2023-01-11T21:10:16.1377773Z OPENSSL_DIR=/opt/openssl 2023-01-11T21:10:16.1378081Z UCC_COMMIT=1c7a7127186e7836f73aafbd7697bbc274a77eee 2023-01-11T21:10:16.1378678Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1380223Z CUDA_PATH=/usr/local/cuda 2023-01-11T21:10:16.1381477Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2023-01-11T21:10:16.1382177Z GITHUB_RUN_ATTEMPT=2 2023-01-11T21:10:16.1382445Z TEST_CONFIG=deploy 2023-01-11T21:10:16.1382755Z NV_LIBNPP_VERSION=11.6.3.124-1 2023-01-11T21:10:16.1383133Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-11-6=11.6.124-1 2023-01-11T21:10:16.1383445Z GITHUB_REPOSITORY_OWNER=pytorch 2023-01-11T21:10:16.1383698Z GITHUB_ACTIONS=true 2023-01-11T21:10:16.1383972Z NVIDIA_VISIBLE_DEVICES=all 2023-01-11T21:10:16.1384526Z NV_NVPROF_VERSION=11.6.124-1 2023-01-11T21:10:16.1384821Z NV_LIBCUSPARSE_VERSION=11.7.2.124-1 2023-01-11T21:10:16.1385377Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/91627/merge 2023-01-11T21:10:16.1386119Z NVIDIA_PRODUCT_NAME=CUDA 2023-01-11T21:10:16.1386551Z CI=true 2023-01-11T21:10:16.1387045Z PYTORCH_OVERRIDE_FLAKY_SIGNAL=1 2023-01-11T21:10:16.1388036Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-11-6=11.9.2.110-1 2023-01-11T21:10:16.1388333Z BRANCH=pull/91627 2023-01-11T21:10:16.1388590Z GITHUB_HEAD_REF=master 2023-01-11T21:10:16.1388917Z UCX_COMMIT=31e74cac7bee0ef66bef2af72e7d86d9c282e5ab 2023-01-11T21:10:16.1389238Z GITHUB_ACTOR=LucaLumetti 2023-01-11T21:10:16.1389547Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2023-01-11T21:10:16.1389824Z GITHUB_ACTION_REF= 2023-01-11T21:10:16.1390104Z NCCL_VERSION=2.12.10-1 2023-01-11T21:10:16.1390359Z GITHUB_ACTION=__self 2023-01-11T21:10:16.1390614Z GITHUB_REF_PROTECTED=false 2023-01-11T21:10:16.1391091Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2023-01-11T21:10:16.1391482Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2023-01-11T21:10:16.1393877Z *** 2023-01-11T21:10:16.1394148Z INSTALLED_VISION=yes 2023-01-11T21:10:16.1394399Z NVARCH=x86_64 2023-01-11T21:10:16.1394712Z NV_LIBCUSPARSE_DEV_VERSION=11.7.2.124-1 2023-01-11T21:10:16.1394998Z HOME=/var/lib/jenkins 2023-01-11T21:10:16.1395558Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1395962Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2023-01-11T21:10:16.1396245Z GITHUB_ACTION_REPOSITORY= 2023-01-11T21:10:16.1396512Z GITHUB_REF_TYPE=branch 2023-01-11T21:10:16.1396824Z NV_LIBNCCL_PACKAGE_VERSION=2.12.10-1 2023-01-11T21:10:16.1397091Z GITHUB_RETENTION_DAYS=90 2023-01-11T21:10:16.1397475Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2023-01-11T21:10:16.1397900Z NV_LIBNCCL_PACKAGE=libnccl2=2.12.10-1+cuda11.6 2023-01-11T21:10:16.1398458Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1399216Z DEBIAN_FRONTEND=noninteractive 2023-01-11T21:10:16.1399660Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2023-01-11T21:10:16.1399948Z GITHUB_REF=refs/pull/91627/merge 2023-01-11T21:10:16.1400264Z NV_CUDA_LIB_VERSION=11.6.2-1 2023-01-11T21:10:16.1400590Z GITHUB_SHA=57fc38f02f250896a12b32cfa200a6105a03d09c 2023-01-11T21:10:16.1400882Z INSTALLED_PROTOBUF=yes 2023-01-11T21:10:16.1401182Z GITHUB_REPOSITORY_ID=65600975 2023-01-11T21:10:16.1401467Z GITHUB_RUN_ID=3896099317 2023-01-11T21:10:16.1401825Z NV_LIBNPP_PACKAGE=libnpp-11-6=11.6.3.124-1 2023-01-11T21:10:16.1402147Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2023-01-11T21:10:16.1402462Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2023-01-11T21:10:16.1402772Z NV_NVTX_VERSION=11.6.124-1 2023-01-11T21:10:16.1403061Z CONTINUE_THROUGH_ERROR=False 2023-01-11T21:10:16.1403389Z GITHUB_SERVER_URL=https://github.com 2023-01-11T21:10:16.1403665Z MAX_JOBS=14 2023-01-11T21:10:16.1404071Z GITHUB_ACTOR_ID=7543386 2023-01-11T21:10:16.1404417Z NV_LIBCUBLAS_VERSION=11.9.2.110-1 2023-01-11T21:10:16.1404820Z NV_LIBCUBLAS_PACKAGE=libcublas-11-6=11.9.2.110-1 2023-01-11T21:10:16.1405321Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2023-01-11T21:10:16.1405679Z UCX_HOME=/usr 2023-01-11T21:10:16.1405945Z PYTORCH_RETRY_TEST_CASES=1 2023-01-11T21:10:16.1406288Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2023-01-11T21:10:16.1406660Z BASE_SHA=db2a237763eb8693a20788be94f8c192e762baa8 2023-01-11T21:10:16.1407068Z NV_CUDA_CUDART_DEV_VERSION=11.6.55-1 2023-01-11T21:10:16.1407365Z PR_BODY=Fixes #91003 cc @ezyang @gchanan 2023-01-11T21:10:16.1407651Z GITHUB_BASE_REF=master 2023-01-11T21:10:16.1407904Z TERM=xterm 2023-01-11T21:10:16.1408118Z XLA_CUDA= 2023-01-11T21:10:16.1408414Z NV_NVML_DEV_VERSION=11.6.55-1 2023-01-11T21:10:16.1408713Z TORCH_CUDA_ARCH_LIST=Maxwell 2023-01-11T21:10:16.1408968Z CUDA_VERSION=11.6.2 2023-01-11T21:10:16.1409440Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-11-6 2023-01-11T21:10:16.1409760Z OPENSSL_ROOT_DIR=/opt/openssl 2023-01-11T21:10:16.1410323Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1410733Z GITHUB_JOB=test 2023-01-11T21:10:16.1411000Z SCCACHE_S3_KEY_PREFIX=pull 2023-01-11T21:10:16.1411646Z COMMIT_MESSAGES=+ 52a16ce42647731c772e14e7175afa40fda07b3d make torchgen rename also Number arguments into input+ 87db01a53ecb702267ec36787654e418a52f8e93 fix torch.where signature mismatch+ 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e other instead of output in documentation 2023-01-11T21:10:16.1412365Z NVIDIA_DRIVER_CAPABILITIES=compute,utility 2023-01-11T21:10:16.1412648Z NUM_TEST_SHARDS=1 2023-01-11T21:10:16.1412900Z PR_NUMBER=91627 2023-01-11T21:10:16.1413470Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1413853Z SHLVL=1 2023-01-11T21:10:16.1414228Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-11-6 2023-01-11T21:10:16.1414579Z GITHUB_REPOSITORY=pytorch/pytorch 2023-01-11T21:10:16.1415437Z NVIDIA_REQUIRE_CUDA=cuda>=11.6 brand=tesla,driver>=418,driver<419 brand=tesla,driver>=450,driver<451 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 2023-01-11T21:10:16.1416279Z NV_LIBNPP_DEV_VERSION=11.6.3.124-1 2023-01-11T21:10:16.1416607Z SHA1=8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:10:16.1416926Z GITHUB_EVENT_NAME=pull_request 2023-01-11T21:10:16.1417239Z NV_CUDA_CUDART_VERSION=11.6.55-1 2023-01-11T21:10:16.1417612Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2023-01-11T21:10:16.1417915Z GITHUB_RUN_NUMBER=77928 2023-01-11T21:10:16.1418186Z GITHUB_WORKFLOW=pull 2023-01-11T21:10:16.1418631Z PATH=/opt/cache/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2023-01-11T21:10:16.1419110Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.12.10-1 2023-01-11T21:10:16.1419453Z GITHUB_WORKFLOW_SHA=57fc38f02f250896a12b32cfa200a6105a03d09c 2023-01-11T21:10:16.1419940Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:10:16.1420311Z GITHUB_TRIGGERING_ACTOR=albanD 2023-01-11T21:10:16.1420579Z _=/usr/bin/env 2023-01-11T21:10:16.1420972Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2023-01-11T21:10:16.1604142Z + TORCH_INSTALL_DIR=/opt/conda/lib/python3.10/site-packages/torch 2023-01-11T21:10:16.1605116Z + TORCH_BIN_DIR=/opt/conda/lib/python3.10/site-packages/torch/bin 2023-01-11T21:10:16.1605715Z + TORCH_LIB_DIR=/opt/conda/lib/python3.10/site-packages/torch/lib 2023-01-11T21:10:16.1606344Z + TORCH_TEST_DIR=/opt/conda/lib/python3.10/site-packages/torch/test 2023-01-11T21:10:16.1606825Z + BUILD_DIR=build 2023-01-11T21:10:16.1607150Z + BUILD_RENAMED_DIR=build_renamed 2023-01-11T21:10:16.1607402Z + BUILD_BIN_DIR=build/bin 2023-01-11T21:10:16.1607651Z + export VALGRIND=ON 2023-01-11T21:10:16.1607904Z + VALGRIND=ON 2023-01-11T21:10:16.1608156Z + export TORCH_INDUCTOR_INSTALL_GXX=ON 2023-01-11T21:10:16.1608451Z + TORCH_INDUCTOR_INSTALL_GXX=ON 2023-01-11T21:10:16.1608881Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *clang9* ]] 2023-01-11T21:10:16.1609304Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 != *bazel* ]] 2023-01-11T21:10:16.1611480Z ++ realpath build/custom_test_artifacts 2023-01-11T21:10:16.1619388Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2023-01-11T21:10:16.1623011Z ++ dirname .jenkins/pytorch/test.sh 2023-01-11T21:10:16.1629524Z + source .jenkins/pytorch/common.sh 2023-01-11T21:10:16.1633576Z +++ dirname .jenkins/pytorch/common.sh 2023-01-11T21:10:16.1645285Z ++ source .jenkins/pytorch/common_utils.sh 2023-01-11T21:10:16.1647581Z +++ declare -f -t trap_add 2023-01-11T21:10:16.1655158Z ++ set -ex 2023-01-11T21:10:16.1655573Z ++ [[ linux-bionic-cuda11.6-py3.10-gcc7 == *rocm* ]] 2023-01-11T21:10:16.1655894Z ++ BUILD_TEST_LIBTORCH=0 2023-01-11T21:10:16.1656232Z + echo 'Environment variables' 2023-01-11T21:10:16.1656490Z Environment variables 2023-01-11T21:10:16.1656730Z + env 2023-01-11T21:10:16.1664256Z SHARD_NUMBER=1 2023-01-11T21:10:16.1664676Z NV_LIBCUBLAS_DEV_VERSION=11.9.2.110-1 2023-01-11T21:10:16.1665399Z NV_CUDA_COMPAT_PACKAGE=cuda-compat-11-6 2023-01-11T21:10:16.1666227Z LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 2023-01-11T21:10:16.1667082Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.12.10-1+cuda11.6 2023-01-11T21:10:16.1667683Z UCC_HOME=/usr 2023-01-11T21:10:16.1668460Z BUILD_ENVIRONMENT=linux-bionic-cuda11.6-py3.10-gcc7 2023-01-11T21:10:16.1669172Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2023-01-11T21:10:16.1669936Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-11-6=11.6.3.124-1 2023-01-11T21:10:16.1670599Z INSTALLED_DB=yes 2023-01-11T21:10:16.1671137Z HOSTNAME=dd5ee451bcc5 2023-01-11T21:10:16.1671524Z GITHUB_REF_NAME=91627/merge 2023-01-11T21:10:16.1671848Z GITHUB_API_URL=https://api.github.com 2023-01-11T21:10:16.1672148Z GITHUB_REPOSITORY_OWNER_ID=21003710 2023-01-11T21:10:16.1672445Z OPENSSL_DIR=/opt/openssl 2023-01-11T21:10:16.1672742Z UCC_COMMIT=1c7a7127186e7836f73aafbd7697bbc274a77eee 2023-01-11T21:10:16.1673509Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1674326Z CUDA_PATH=/usr/local/cuda 2023-01-11T21:10:16.1675410Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2023-01-11T21:10:16.1676314Z GITHUB_RUN_ATTEMPT=2 2023-01-11T21:10:16.1676773Z TEST_CONFIG=deploy 2023-01-11T21:10:16.1677435Z NV_LIBNPP_VERSION=11.6.3.124-1 2023-01-11T21:10:16.1678044Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-11-6=11.6.124-1 2023-01-11T21:10:16.1678367Z GITHUB_REPOSITORY_OWNER=pytorch 2023-01-11T21:10:16.1678642Z GITHUB_ACTIONS=true 2023-01-11T21:10:16.1679396Z NVIDIA_VISIBLE_DEVICES=all 2023-01-11T21:10:16.1679732Z NV_NVPROF_VERSION=11.6.124-1 2023-01-11T21:10:16.1680061Z NV_LIBCUSPARSE_VERSION=11.7.2.124-1 2023-01-11T21:10:16.1680446Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/91627/merge 2023-01-11T21:10:16.1680791Z NVIDIA_PRODUCT_NAME=CUDA 2023-01-11T21:10:16.1681039Z CI=true 2023-01-11T21:10:16.1681291Z PYTORCH_OVERRIDE_FLAKY_SIGNAL=1 2023-01-11T21:10:16.1681686Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-11-6=11.9.2.110-1 2023-01-11T21:10:16.1681998Z BRANCH=pull/91627 2023-01-11T21:10:16.1682261Z GITHUB_HEAD_REF=master 2023-01-11T21:10:16.1682563Z UCX_COMMIT=31e74cac7bee0ef66bef2af72e7d86d9c282e5ab 2023-01-11T21:10:16.1682879Z GITHUB_ACTOR=LucaLumetti 2023-01-11T21:10:16.1683186Z CMAKE_CUDA_COMPILER_LAUNCHER=/opt/cache/bin/sccache 2023-01-11T21:10:16.1683479Z GITHUB_ACTION_REF= 2023-01-11T21:10:16.1683753Z NCCL_VERSION=2.12.10-1 2023-01-11T21:10:16.1684213Z GITHUB_ACTION=__self 2023-01-11T21:10:16.1684497Z VALGRIND=ON 2023-01-11T21:10:16.1684741Z GITHUB_REF_PROTECTED=false 2023-01-11T21:10:16.1685201Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2023-01-11T21:10:16.1685582Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2023-01-11T21:10:16.1685940Z *** 2023-01-11T21:10:16.1686176Z INSTALLED_VISION=yes 2023-01-11T21:10:16.1686428Z NVARCH=x86_64 2023-01-11T21:10:16.1686731Z NV_LIBCUSPARSE_DEV_VERSION=11.7.2.124-1 2023-01-11T21:10:16.1687019Z HOME=/var/lib/jenkins 2023-01-11T21:10:16.1687559Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1687958Z CARGO_NET_GIT_FETCH_WITH_CLI=true 2023-01-11T21:10:16.1688241Z GITHUB_ACTION_REPOSITORY= 2023-01-11T21:10:16.1688507Z GITHUB_REF_TYPE=branch 2023-01-11T21:10:16.1688821Z NV_LIBNCCL_PACKAGE_VERSION=2.12.10-1 2023-01-11T21:10:16.1689087Z GITHUB_RETENTION_DAYS=90 2023-01-11T21:10:16.1689644Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2023-01-11T21:10:16.1690078Z NV_LIBNCCL_PACKAGE=libnccl2=2.12.10-1+cuda11.6 2023-01-11T21:10:16.1690619Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1691029Z DEBIAN_FRONTEND=noninteractive 2023-01-11T21:10:16.1691380Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev 2023-01-11T21:10:16.1691663Z GITHUB_REF=refs/pull/91627/merge 2023-01-11T21:10:16.1691975Z NV_CUDA_LIB_VERSION=11.6.2-1 2023-01-11T21:10:16.1692293Z GITHUB_SHA=57fc38f02f250896a12b32cfa200a6105a03d09c 2023-01-11T21:10:16.1692580Z INSTALLED_PROTOBUF=yes 2023-01-11T21:10:16.1692856Z GITHUB_REPOSITORY_ID=65600975 2023-01-11T21:10:16.1693123Z GITHUB_RUN_ID=3896099317 2023-01-11T21:10:16.1693466Z NV_LIBNPP_PACKAGE=libnpp-11-6=11.6.3.124-1 2023-01-11T21:10:16.1693773Z NV_LIBNCCL_PACKAGE_NAME=libnccl2 2023-01-11T21:10:16.1694074Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs 2023-01-11T21:10:16.1694381Z NV_NVTX_VERSION=11.6.124-1 2023-01-11T21:10:16.1694683Z CONTINUE_THROUGH_ERROR=False 2023-01-11T21:10:16.1694997Z GITHUB_SERVER_URL=https://github.com 2023-01-11T21:10:16.1695258Z MAX_JOBS=14 2023-01-11T21:10:16.1695538Z GITHUB_ACTOR_ID=7543386 2023-01-11T21:10:16.1695852Z NV_LIBCUBLAS_VERSION=11.9.2.110-1 2023-01-11T21:10:16.1696234Z NV_LIBCUBLAS_PACKAGE=libcublas-11-6=11.9.2.110-1 2023-01-11T21:10:16.1696706Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2023-01-11T21:10:16.1697053Z UCX_HOME=/usr 2023-01-11T21:10:16.1697320Z PYTORCH_RETRY_TEST_CASES=1 2023-01-11T21:10:16.1697637Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2023-01-11T21:10:16.1697990Z BASE_SHA=db2a237763eb8693a20788be94f8c192e762baa8 2023-01-11T21:10:16.1698336Z NV_CUDA_CUDART_DEV_VERSION=11.6.55-1 2023-01-11T21:10:16.1698621Z PR_BODY=Fixes #91003 cc @ezyang @gchanan 2023-01-11T21:10:16.1698900Z GITHUB_BASE_REF=master 2023-01-11T21:10:16.1699146Z TERM=xterm 2023-01-11T21:10:16.1699396Z TORCH_INDUCTOR_INSTALL_GXX=ON 2023-01-11T21:10:16.1699673Z XLA_CUDA= 2023-01-11T21:10:16.1699953Z NV_NVML_DEV_VERSION=11.6.55-1 2023-01-11T21:10:16.1700227Z TORCH_CUDA_ARCH_LIST=Maxwell 2023-01-11T21:10:16.1700476Z CUDA_VERSION=11.6.2 2023-01-11T21:10:16.1700826Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-11-6 2023-01-11T21:10:16.1701129Z OPENSSL_ROOT_DIR=/opt/openssl 2023-01-11T21:10:16.1701669Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1702072Z GITHUB_JOB=test 2023-01-11T21:10:16.1702332Z SCCACHE_S3_KEY_PREFIX=pull 2023-01-11T21:10:16.1702922Z COMMIT_MESSAGES=+ 52a16ce42647731c772e14e7175afa40fda07b3d make torchgen rename also Number arguments into input+ 87db01a53ecb702267ec36787654e418a52f8e93 fix torch.where signature mismatch+ 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e other instead of output in documentation 2023-01-11T21:10:16.1703524Z NVIDIA_DRIVER_CAPABILITIES=compute,utility 2023-01-11T21:10:16.1703811Z NUM_TEST_SHARDS=1 2023-01-11T21:10:16.1704114Z PR_NUMBER=91627 2023-01-11T21:10:16.1704675Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_6aca591f-1ad6-4fe2-ba22-d742a029dfca 2023-01-11T21:10:16.1705068Z SHLVL=1 2023-01-11T21:10:16.1705419Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-11-6 2023-01-11T21:10:16.1705731Z GITHUB_REPOSITORY=pytorch/pytorch 2023-01-11T21:10:16.1706522Z NVIDIA_REQUIRE_CUDA=cuda>=11.6 brand=tesla,driver>=418,driver<419 brand=tesla,driver>=450,driver<451 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 2023-01-11T21:10:16.1707358Z NV_LIBNPP_DEV_VERSION=11.6.3.124-1 2023-01-11T21:10:16.1707679Z SHA1=8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:10:16.1708061Z GITHUB_EVENT_NAME=pull_request 2023-01-11T21:10:16.1708390Z NV_CUDA_CUDART_VERSION=11.6.55-1 2023-01-11T21:10:16.1708752Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2023-01-11T21:10:16.1709030Z GITHUB_RUN_NUMBER=77928 2023-01-11T21:10:16.1709336Z GITHUB_WORKFLOW=pull 2023-01-11T21:10:16.1709757Z PATH=/opt/cache/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2023-01-11T21:10:16.1710203Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.12.10-1 2023-01-11T21:10:16.1710553Z GITHUB_WORKFLOW_SHA=57fc38f02f250896a12b32cfa200a6105a03d09c 2023-01-11T21:10:16.1711018Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:10:16.1711380Z GITHUB_TRIGGERING_ACTOR=albanD 2023-01-11T21:10:16.1711631Z _=/usr/bin/env 2023-01-11T21:10:16.1711927Z + echo 'Testing pytorch' 2023-01-11T21:10:16.1712185Z Testing pytorch 2023-01-11T21:10:16.1712455Z + export LANG=C.UTF-8 2023-01-11T21:10:16.1712745Z + LANG=C.UTF-8 2023-01-11T21:10:16.1713010Z + PR_NUMBER=91627 2023-01-11T21:10:16.1713278Z + [[ deploy == \d\e\f\a\u\l\t ]] 2023-01-11T21:10:16.1713581Z + [[ deploy == \d\i\s\t\r\i\b\u\t\e\d ]] 2023-01-11T21:10:16.1713878Z + [[ deploy == \s\l\o\w ]] 2023-01-11T21:10:16.1714298Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *slow-gradcheck* ]] 2023-01-11T21:10:16.1714773Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *cuda* ]] 2023-01-11T21:10:16.1715147Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2023-01-11T21:10:16.1715467Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2023-01-11T21:10:16.1715774Z + [[ deploy == *crossref* ]] 2023-01-11T21:10:16.1716063Z + [[ deploy == *dynamo* ]] 2023-01-11T21:10:16.1716331Z + [[ deploy == *inductor* ]] 2023-01-11T21:10:16.1716749Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *rocm* ]] 2023-01-11T21:10:16.1717215Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 != *-bazel-* ]] 2023-01-11T21:10:16.1717605Z + pip_install --user ninja==1.10.2 2023-01-11T21:10:16.1718027Z + pip install --progress-bar off --user ninja==1.10.2 2023-01-11T21:10:16.7038879Z Collecting ninja==1.10.2 2023-01-11T21:10:16.7278898Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2023-01-11T21:10:17.6352316Z Installing collected packages: ninja 2023-01-11T21:10:17.6456184Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2023-01-11T21:10:17.6456861Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2023-01-11T21:10:17.6506852Z Successfully installed ninja-1.10.2 2023-01-11T21:10:17.7161828Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2023-01-11T21:10:17.7162480Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2023-01-11T21:10:17.7164196Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *asan* ]] 2023-01-11T21:10:17.7164694Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *-tsan* ]] 2023-01-11T21:10:17.7165032Z + [[ deploy == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2023-01-11T21:10:17.7165337Z + [[ deploy == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2023-01-11T21:10:17.7174470Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *tbb* ]] 2023-01-11T21:10:17.7191064Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *libtorch* ]] 2023-01-11T21:10:17.7191593Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *-bazel-* ]] 2023-01-11T21:10:17.7192260Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *-tsan* ]] 2023-01-11T21:10:17.7193004Z + cd test 2023-01-11T21:10:17.7193560Z + python -c 'import torch; print(torch.__config__.show())' 2023-01-11T21:10:19.3649849Z PyTorch built with: 2023-01-11T21:10:19.3650595Z - GCC 7.5 2023-01-11T21:10:19.3651295Z - C++ Version: 201703 2023-01-11T21:10:19.3652295Z - Intel(R) oneAPI Math Kernel Library Version 2022.0-Product Build 20211112 for Intel(R) 64 architecture applications 2023-01-11T21:10:19.3653199Z - Intel(R) MKL-DNN v2.7.2 (Git Hash fbec3e25a559ee252022ae066817b204e106a6ba) 2023-01-11T21:10:19.3653608Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2023-01-11T21:10:19.3653991Z - LAPACK is enabled (usually provided by MKL) 2023-01-11T21:10:19.3654323Z - NNPACK is enabled 2023-01-11T21:10:19.3654624Z - CPU capability usage: AVX2 2023-01-11T21:10:19.3654934Z - CUDA Runtime 11.6 2023-01-11T21:10:19.3655334Z - NVCC architecture flags: -gencode;arch=compute_52,code=sm_52 2023-01-11T21:10:19.3655721Z - CuDNN 8.3.2 (built against CUDA 11.5) 2023-01-11T21:10:19.3656038Z - Magma 2.6.1 2023-01-11T21:10:19.3659163Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.6, CUDNN_VERSION=8.3.2, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wunused-local-typedefs -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_DISABLE_GPU_ASSERTS=ON, TORCH_VERSION=2.0.0, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, 2023-01-11T21:10:19.3661475Z 2023-01-11T21:10:19.6010401Z + cd test 2023-01-11T21:10:19.6011004Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2023-01-11T21:10:21.1834668Z ATen/Parallel: 2023-01-11T21:10:21.1850964Z at::get_num_threads() : 8 2023-01-11T21:10:21.1851316Z at::get_num_interop_threads() : 8 2023-01-11T21:10:21.1851625Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2023-01-11T21:10:21.1851888Z omp_get_max_threads() : 8 2023-01-11T21:10:21.1852561Z Intel(R) oneAPI Math Kernel Library Version 2022.0-Product Build 20211112 for Intel(R) 64 architecture applications 2023-01-11T21:10:21.1852957Z mkl_get_max_threads() : 8 2023-01-11T21:10:21.1853382Z Intel(R) MKL-DNN v2.7.2 (Git Hash fbec3e25a559ee252022ae066817b204e106a6ba) 2023-01-11T21:10:21.1853755Z std::thread::hardware_concurrency() : 16 2023-01-11T21:10:21.1854054Z Environment variables: 2023-01-11T21:10:21.1854335Z OMP_NUM_THREADS : [not set] 2023-01-11T21:10:21.1854593Z MKL_NUM_THREADS : [not set] 2023-01-11T21:10:21.1854874Z ATen parallel backend: OpenMP 2023-01-11T21:10:21.1855057Z 2023-01-11T21:10:21.4157308Z + [[ deploy == *backward* ]] 2023-01-11T21:10:21.4157652Z + [[ deploy == *xla* ]] 2023-01-11T21:10:21.4157918Z + [[ deploy == \j\i\t\_\l\e\g\a\c\y ]] 2023-01-11T21:10:21.4158443Z + [[ linux-bionic-cuda11.6-py3.10-gcc7 == *libtorch* ]] 2023-01-11T21:10:21.4158784Z + [[ deploy == distributed ]] 2023-01-11T21:10:21.4159523Z + [[ deploy == deploy ]] 2023-01-11T21:10:21.4159789Z + checkout_install_torchdeploy 2023-01-11T21:10:21.4160022Z + local commit 2023-01-11T21:10:21.4162360Z ++ get_pinned_commit multipy 2023-01-11T21:10:21.4162666Z ++ cat .github/ci_commit_pins/multipy.txt 2023-01-11T21:10:21.4176662Z + commit=7dd29931fa8e9bb7c970f05f8c0dc13b69e17494 2023-01-11T21:10:21.4176988Z + setup_torchdeploy_deps 2023-01-11T21:10:21.4177347Z + conda install -y cmake 2023-01-11T21:10:22.0516429Z Retrieving notices: ...working... done 2023-01-11T21:10:24.1413038Z Collecting package metadata (current_repodata.json): \ | / - \ | / - \ | / - \ | / - done 2023-01-11T21:10:25.2097683Z Solving environment: | / - \ | / - \ | / done 2023-01-11T21:10:25.3002943Z 2023-01-11T21:10:25.3003547Z # All requested packages already installed. 2023-01-11T21:10:25.3003784Z 2023-01-11T21:10:25.5000294Z + conda install -y -c conda-forge libpython-static=3.10 2023-01-11T21:10:42.3859663Z Collecting package metadata (current_repodata.json): - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / done 2023-01-11T21:10:44.1693436Z Solving environment: \ | / - \ | / - \ | / - \ | / done 2023-01-11T21:10:44.2873114Z 2023-01-11T21:10:44.2873363Z ## Package Plan ## 2023-01-11T21:10:44.2877729Z 2023-01-11T21:10:44.2878227Z environment location: /opt/conda 2023-01-11T21:10:44.2878621Z 2023-01-11T21:10:44.2879153Z added / updated specs: 2023-01-11T21:10:44.2879679Z - libpython-static=3.10 2023-01-11T21:10:44.2879874Z 2023-01-11T21:10:44.2879896Z 2023-01-11T21:10:44.2880060Z The following packages will be downloaded: 2023-01-11T21:10:44.2881770Z 2023-01-11T21:10:44.2882102Z package | build 2023-01-11T21:10:44.2882564Z ---------------------------|----------------- 2023-01-11T21:10:44.2883055Z ca-certificates-2022.12.7 | ha878542_0 143 KB conda-forge 2023-01-11T21:10:44.2883538Z certifi-2022.12.7 | pyhd8ed1ab_0 147 KB conda-forge 2023-01-11T21:10:44.2883978Z conda-22.11.1 | py310hff52083_1 913 KB conda-forge 2023-01-11T21:10:44.2884615Z libpython-static-3.10.8 | h6a678d5_1 54.4 MB 2023-01-11T21:10:44.2885556Z python_abi-3.10 | 2_cp310 4 KB conda-forge 2023-01-11T21:10:44.2886469Z ------------------------------------------------------------ 2023-01-11T21:10:44.2887013Z Total: 55.6 MB 2023-01-11T21:10:44.2887203Z 2023-01-11T21:10:44.2887377Z The following NEW packages will be INSTALLED: 2023-01-11T21:10:44.2887570Z 2023-01-11T21:10:44.2888258Z libpython-static pkgs/main/linux-64::libpython-static-3.10.8-h6a678d5_1 2023-01-11T21:10:44.2889071Z python_abi conda-forge/linux-64::python_abi-3.10-2_cp310 2023-01-11T21:10:44.2889293Z 2023-01-11T21:10:44.2889597Z The following packages will be UPDATED: 2023-01-11T21:10:44.2889830Z 2023-01-11T21:10:44.2890332Z ca-certificates pkgs/main::ca-certificates-2022.10.11~ --> conda-forge::ca-certificates-2022.12.7-ha878542_0 2023-01-11T21:10:44.2890612Z 2023-01-11T21:10:44.2891307Z The following packages will be SUPERSEDED by a higher-priority channel: 2023-01-11T21:10:44.2891625Z 2023-01-11T21:10:44.2892049Z certifi pkgs/main/linux-64::certifi-2022.12.7~ --> conda-forge/noarch::certifi-2022.12.7-pyhd8ed1ab_0 2023-01-11T21:10:44.2892846Z conda pkgs/main::conda-22.11.1-py310h06a430~ --> conda-forge::conda-22.11.1-py310hff52083_1 2023-01-11T21:10:44.2893151Z 2023-01-11T21:10:44.2893156Z 2023-01-11T21:10:44.2893179Z 2023-01-11T21:10:44.2893467Z Downloading and Extracting Packages 2023-01-11T21:10:44.2893728Z 2023-01-11T21:10:44.2893967Z conda-22.11.1 | 913 KB | : 0% 0/1 [00:00 2023-01-11T21:10:54.4545879Z 2023-01-11T21:10:54.4546049Z HEAD is now at 7dd2993 multipy: relink against gtest (#280) 2023-01-11T21:10:54.4546379Z + python multipy/runtime/example/generate_examples.py 2023-01-11T21:10:56.7985446Z /opt/conda/lib/python3.10/site-packages/torch/package/package_exporter.py:900: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2023-01-11T21:10:56.7987256Z storage_type_str = obj.pickle_storage_type() 2023-01-11T21:10:56.7988318Z /opt/conda/lib/python3.10/site-packages/torch/package/package_exporter.py:903: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2023-01-11T21:10:56.7989048Z storage_numel = obj.size() 2023-01-11T21:10:57.2156736Z + pip install -e . --install-option=--cudatests 2023-01-11T21:10:57.6791282Z WARNING: Implying --no-binary=:all: due to the presence of --build-option / --global-option / --install-option. Consider using --config-settings for more flexibility. 2023-01-11T21:10:57.6794371Z DEPRECATION: --install-option is deprecated because it forces pip to use the 'setup.py install' command which is itself deprecated. pip 23.1 will enforce this behaviour change. A possible replacement is to use --config-settings. Discussion can be found at https://github.com/pypa/pip/issues/11358 2023-01-11T21:10:57.6799450Z DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-01-11T21:10:57.6874918Z Obtaining file:///var/lib/jenkins/multipy 2023-01-11T21:10:58.0561104Z Preparing metadata (setup.py) ... [?25l- done 2023-01-11T21:10:58.9729205Z [?25hInstalling collected packages: torchdeploy 2023-01-11T21:10:58.9734743Z Running setup.py develop for torchdeploy 2023-01-11T21:13:19.6276686Z Successfully installed torchdeploy-0.2.0.dev0 2023-01-11T21:13:19.6927955Z + popd 2023-01-11T21:13:19.6931194Z ~ ~/workspace 2023-01-11T21:13:19.6931833Z + popd 2023-01-11T21:13:19.6932103Z ~/workspace 2023-01-11T21:13:19.6932364Z + test_torch_deploy 2023-01-11T21:13:19.6936885Z + pushd .. 2023-01-11T21:13:19.6937367Z ~ ~/workspace 2023-01-11T21:13:19.6937726Z + pushd multipy 2023-01-11T21:13:19.6937980Z ~/multipy ~ ~/workspace 2023-01-11T21:13:19.6938245Z + ./multipy/runtime/build/test_deploy 2023-01-11T21:13:20.1722347Z Current working directory: /var/lib/jenkins/multipy 2023-01-11T21:13:20.1723084Z [==========] Running 22 tests from 2 test suites. 2023-01-11T21:13:20.1723604Z [----------] Global test environment set-up. 2023-01-11T21:13:20.1723965Z [----------] 20 tests from TorchpyTest 2023-01-11T21:13:20.1724624Z [ RUN ] TorchpyTest.InitManagerBasic 2023-01-11T21:13:20.1773004Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:20.1773737Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:20.1774132Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:20.1774491Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:22.6763212Z [ OK ] TorchpyTest.InitManagerBasic (2504 ms) 2023-01-11T21:13:22.6763695Z [ RUN ] TorchpyTest.InitTwice 2023-01-11T21:13:22.6828555Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:22.6829023Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:22.6829436Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:22.6829828Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:23.6487917Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:23.6488821Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:23.6489281Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:23.6489690Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:23.6901013Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:23.6901993Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:23.6902443Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:23.6902792Z dispatch key: (catch all) 2023-01-11T21:13:23.6903209Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:23.6903780Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:24.8432534Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:24.8433174Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:24.8433587Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:24.8434002Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:25.9965196Z [ OK ] TorchpyTest.InitTwice (3320 ms) 2023-01-11T21:13:25.9965693Z [ RUN ] TorchpyTest.DifferentInterps 2023-01-11T21:13:26.0045136Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:26.0045721Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:26.0046186Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:26.0046605Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:27.0245966Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:27.0246440Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:27.0246854Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:27.0247256Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:27.0654956Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:27.0655661Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:27.0656083Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:27.0656447Z dispatch key: (catch all) 2023-01-11T21:13:27.0656876Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:27.0657970Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:28.2246042Z [ OK ] TorchpyTest.DifferentInterps (2228 ms) 2023-01-11T21:13:28.2246529Z [ RUN ] TorchpyTest.SimpleModel 2023-01-11T21:13:28.2321825Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:28.2322236Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:28.2322644Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:28.2323081Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:29.2586563Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:29.2587275Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:29.2587684Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:29.2588104Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:29.2996068Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:29.2997246Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:29.2997704Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:29.2998065Z dispatch key: (catch all) 2023-01-11T21:13:29.2998485Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:29.2999409Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:30.5132144Z [ OK ] TorchpyTest.SimpleModel (2288 ms) 2023-01-11T21:13:30.5132877Z [ RUN ] TorchpyTest.ResNet 2023-01-11T21:13:30.5206902Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:30.5208123Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:30.5208535Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:30.5208956Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:31.5557716Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:31.5558603Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:31.5559370Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:31.5559790Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:31.5968659Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:31.5970037Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:31.5970495Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:31.5970880Z dispatch key: (catch all) 2023-01-11T21:13:31.5971278Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:31.5971845Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:33.1068400Z [ OK ] TorchpyTest.ResNet (2594 ms) 2023-01-11T21:13:33.1069084Z [ RUN ] TorchpyTest.Movable 2023-01-11T21:13:33.1147392Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:33.1148304Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:33.1148867Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:33.1149261Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:34.3045886Z [ OK ] TorchpyTest.Movable (1198 ms) 2023-01-11T21:13:34.3046430Z [ RUN ] TorchpyTest.MultiSerialSimpleModel 2023-01-11T21:13:34.3169272Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:34.3169722Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:34.3170110Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:34.3170493Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:35.3346343Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:35.3347225Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:35.3348065Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:35.3348892Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:35.3766378Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:35.3767959Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:35.3768865Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:35.3769583Z dispatch key: (catch all) 2023-01-11T21:13:35.3770381Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:35.3771508Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:36.2740782Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:36.2741630Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:36.2742451Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:36.2743277Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:36.3166972Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:36.3168539Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:36.3169454Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:36.3170180Z dispatch key: (catch all) 2023-01-11T21:13:36.3170991Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:36.3172087Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:37.6286270Z [ OK ] TorchpyTest.MultiSerialSimpleModel (3324 ms) 2023-01-11T21:13:37.6286858Z [ RUN ] TorchpyTest.ThreadedSimpleModel 2023-01-11T21:13:37.6364587Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:37.6365297Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:37.6365671Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:37.6366083Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:38.6894914Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:38.6895613Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:38.6896030Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:38.6896445Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:38.7320199Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:38.7321590Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:38.7322019Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:38.7322412Z dispatch key: (catch all) 2023-01-11T21:13:38.7322834Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:38.7323400Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:39.6346721Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:39.6347598Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:39.6348015Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:39.6348412Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:39.6779578Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:39.6780886Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:39.6781554Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:39.6781925Z dispatch key: (catch all) 2023-01-11T21:13:39.6782360Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:39.6782935Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:41.0274478Z [ OK ] TorchpyTest.ThreadedSimpleModel (3398 ms) 2023-01-11T21:13:41.0275090Z [ RUN ] TorchpyTest.ErrorsReplicatingObj 2023-01-11T21:13:41.0357286Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:41.0358232Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:41.0358773Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:41.0359463Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:42.0921282Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:42.0921731Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:42.0922138Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:42.0922533Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:42.1351636Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:42.1352351Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:42.1352811Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:42.1353161Z dispatch key: (catch all) 2023-01-11T21:13:42.1353579Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:42.1354197Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:43.0342533Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:43.0342994Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:43.0343366Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:43.0343780Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:43.0782317Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:43.0783292Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:43.0783722Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:43.0784051Z dispatch key: (catch all) 2023-01-11T21:13:43.0784476Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:43.0785030Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:43.9856267Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:43.9856721Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:43.9857135Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:43.9857497Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:44.0295478Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:44.0296574Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:44.0296983Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:44.0297562Z dispatch key: (catch all) 2023-01-11T21:13:44.0298006Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:44.0298575Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:45.5393614Z [ OK ] TorchpyTest.ErrorsReplicatingObj (4512 ms) 2023-01-11T21:13:45.5394128Z [ RUN ] TorchpyTest.ThrowsSafely 2023-01-11T21:13:45.5472580Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:45.5473065Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:45.5473422Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:45.5473839Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:46.5886439Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:46.5887131Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:46.5887549Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:46.5887988Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:46.6317187Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:46.6317967Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:46.6318370Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:46.6318735Z dispatch key: (catch all) 2023-01-11T21:13:46.6319567Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:46.6320149Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:47.5119896Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:47.5120383Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:47.5120741Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:47.5121160Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:47.5550266Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:47.5550967Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:47.5551390Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:47.5551764Z dispatch key: (catch all) 2023-01-11T21:13:47.5552156Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:47.5552743Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:48.9189368Z [ OK ] TorchpyTest.ThrowsSafely (3380 ms) 2023-01-11T21:13:48.9189956Z [ RUN ] TorchpyTest.AcquireMultipleSessionsInTheSamePackage 2023-01-11T21:13:48.9287942Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:48.9288427Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:48.9288857Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:48.9289228Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:50.1416045Z [ OK ] TorchpyTest.AcquireMultipleSessionsInTheSamePackage (1223 ms) 2023-01-11T21:13:50.1416704Z [ RUN ] TorchpyTest.AcquireMultipleSessionsInDifferentPackages 2023-01-11T21:13:50.1542188Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:50.1542673Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:50.1543075Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:50.1543471Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:51.3508638Z [ OK ] TorchpyTest.AcquireMultipleSessionsInDifferentPackages (1209 ms) 2023-01-11T21:13:51.3509685Z [ RUN ] TorchpyTest.TensorSharingNotAllowed 2023-01-11T21:13:51.3618640Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:51.3619059Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:51.3619449Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:51.3619866Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:52.3765762Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:52.3766433Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:52.3766799Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:52.3767212Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:52.4205285Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:52.4206011Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:52.4206399Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:52.4206780Z dispatch key: (catch all) 2023-01-11T21:13:52.4207186Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:52.4207765Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:53.6299738Z [ OK ] TorchpyTest.TensorSharingNotAllowed (2279 ms) 2023-01-11T21:13:53.6300227Z [ RUN ] TorchpyTest.TaggingRace 2023-01-11T21:13:53.6389960Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:53.6390425Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:53.6390834Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:53.6391241Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:54.6578926Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:54.6579364Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:54.6579760Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:54.6580199Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:54.7020251Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:54.7021097Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:54.7021524Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:54.7021842Z dispatch key: (catch all) 2023-01-11T21:13:54.7022253Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:54.7022813Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:55.5872472Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:55.5872941Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:55.5873344Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:55.5874008Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:55.6319953Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:55.6320959Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:55.6321381Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:55.6321740Z dispatch key: (catch all) 2023-01-11T21:13:55.6322166Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:55.6322716Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:56.5167360Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:56.5167812Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:56.5168528Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:56.5168945Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:56.5624086Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:56.5625084Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:56.5625601Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:56.5625962Z dispatch key: (catch all) 2023-01-11T21:13:56.5626374Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:56.5626917Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:57.4582693Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:57.4583191Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:57.4583614Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:57.4584012Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:57.5038046Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:57.5039154Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:57.5039643Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:57.5039967Z dispatch key: (catch all) 2023-01-11T21:13:57.5040379Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:57.5040964Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:58.4087563Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:58.4088429Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:58.4089250Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:58.4090046Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:58.4538629Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:58.4539978Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:58.4540886Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:58.4541604Z dispatch key: (catch all) 2023-01-11T21:13:58.4542445Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:58.4543857Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:13:59.3436686Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:13:59.3437547Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:13:59.3438348Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:13:59.3439652Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:13:59.3893975Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:13:59.3895303Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:13:59.3896201Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:13:59.3896938Z dispatch key: (catch all) 2023-01-11T21:13:59.3897797Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:13:59.3899177Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:00.2815050Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:00.2815998Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:00.2816808Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:00.2817582Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:00.3271445Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:00.3272796Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:00.3273654Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:00.3274438Z dispatch key: (catch all) 2023-01-11T21:14:00.3275272Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:00.3276372Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:01.2203947Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:01.2204794Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:01.2205606Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:01.2206361Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:01.2661080Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:01.2662430Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:01.2663353Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:01.2664063Z dispatch key: (catch all) 2023-01-11T21:14:01.2664896Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:01.2666004Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:02.1534749Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:02.1535625Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:02.1536460Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:02.1537286Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:02.1992286Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:02.1993659Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:02.1994544Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:02.1995282Z dispatch key: (catch all) 2023-01-11T21:14:02.1996092Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:02.1997196Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:03.0906674Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:03.0907572Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:03.0908389Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:03.0909213Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:03.1367305Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:03.1368651Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:03.1369548Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:03.1370289Z dispatch key: (catch all) 2023-01-11T21:14:03.1371102Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:03.1372232Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:04.0392436Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:04.0392910Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:04.0393316Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:04.0393762Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:04.0860353Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:04.0861156Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:04.0861599Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:04.0861960Z dispatch key: (catch all) 2023-01-11T21:14:04.0862374Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:04.0862921Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:04.9634705Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:04.9635295Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:04.9635749Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:04.9636167Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:05.0109049Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:05.0110068Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:05.0110520Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:05.0110889Z dispatch key: (catch all) 2023-01-11T21:14:05.0111288Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:05.0111856Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:05.8939891Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:05.8940632Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:05.8941107Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:05.8941514Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:05.9400268Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:05.9401662Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:05.9402117Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:05.9402465Z dispatch key: (catch all) 2023-01-11T21:14:05.9402878Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:05.9403467Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:06.8223504Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:06.8224478Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:06.8224972Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:06.8225372Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:06.8689014Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:06.8690378Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:06.8690851Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:06.8691208Z dispatch key: (catch all) 2023-01-11T21:14:06.8691627Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:06.8692224Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:07.7600892Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:07.7601438Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:07.7601860Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:07.7602278Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:07.8060409Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:07.8061749Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:07.8062591Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:07.8084722Z dispatch key: (catch all) 2023-01-11T21:14:07.8085253Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:07.8085829Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:10.9953499Z [ OK ] TorchpyTest.TaggingRace (17365 ms) 2023-01-11T21:14:10.9954147Z [ RUN ] TorchpyTest.DisarmHook 2023-01-11T21:14:11.0033218Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:11.0034174Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:11.0034604Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:11.0035030Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:12.2537198Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:12.2538229Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:12.2538994Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:12.2539446Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:13.5559542Z [ OK ] TorchpyTest.DisarmHook (2561 ms) 2023-01-11T21:14:13.5560081Z [ RUN ] TorchpyTest.RegisterModule 2023-01-11T21:14:13.5683980Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:13.5684553Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:13.5685147Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:13.5685577Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:14.5639578Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:14.5640124Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:14.5640532Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:14.5641264Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:14.6105153Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:14.6106186Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:14.6106613Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:14.6106980Z dispatch key: (catch all) 2023-01-11T21:14:14.6107398Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:14.6107967Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:15.8532475Z [ OK ] TorchpyTest.RegisterModule (2297 ms) 2023-01-11T21:14:15.8533054Z [ RUN ] TorchpyTest.TensorSerializationSharing 2023-01-11T21:14:15.8612475Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:15.8613398Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:15.8613977Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:15.8614379Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:16.8602284Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:16.8603233Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:16.8604051Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:16.8604868Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:16.9071947Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:16.9073364Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:16.9074263Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:16.9074983Z dispatch key: (catch all) 2023-01-11T21:14:16.9075805Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:16.9076934Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:18.1515812Z [ OK ] TorchpyTest.TensorSerializationSharing (2298 ms) 2023-01-11T21:14:18.1516895Z [ RUN ] TorchpyTest.UsesDistributed 2023-01-11T21:14:18.1641979Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:18.1642849Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:18.1643714Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:18.1644914Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:19.4320933Z [ OK ] TorchpyTest.UsesDistributed (1281 ms) 2023-01-11T21:14:19.4321924Z [ RUN ] TorchpyTest.Autograd 2023-01-11T21:14:19.4431485Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:19.4432376Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:19.4433211Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:19.4434093Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:20.4840613Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:20.4841479Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:20.4842286Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:20.4843120Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:20.5317169Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:20.5318482Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:20.5319740Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:20.5320481Z dispatch key: (catch all) 2023-01-11T21:14:20.5321294Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:20.5322375Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:21.7817559Z [ OK ] TorchpyTest.Autograd (2350 ms) 2023-01-11T21:14:21.7818428Z [ RUN ] TorchpyTest.PrintInstruction 2023-01-11T21:14:21.7831121Z 1.7711 -0.7362 -1.3647 2023-01-11T21:14:21.7831830Z 2.4364 -1.3522 1.8467 2023-01-11T21:14:21.7832398Z [ CPUFloatType{2,3} ] 2023-01-11T21:14:21.7950422Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:21.7951262Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:21.7952070Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:21.7952867Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:22.8210911Z 1.7711 -0.7362 -1.3647 2023-01-11T21:14:22.8211308Z 2.4364 -1.3522 1.8467 2023-01-11T21:14:22.8211575Z [ CPUFloatType{2,3} ] 2023-01-11T21:14:23.0547647Z 1.7711 -0.7362 -1.3647 2023-01-11T21:14:23.0548294Z 2.4364 -1.3522 1.8467 2023-01-11T21:14:23.0548747Z [ CPUFloatType{2,3} ] 2023-01-11T21:14:23.0552154Z [ OK ] TorchpyTest.PrintInstruction (1273 ms) 2023-01-11T21:14:23.0553182Z [----------] 20 tests from TorchpyTest (62883 ms total) 2023-01-11T21:14:23.0553629Z 2023-01-11T21:14:23.0554217Z [----------] 2 tests from MultiPyException 2023-01-11T21:14:23.0554983Z [ RUN ] MultiPyException.Assert 2023-01-11T21:14:23.0555829Z [ OK ] MultiPyException.Assert (0 ms) 2023-01-11T21:14:23.0556631Z [ RUN ] MultiPyException.Check 2023-01-11T21:14:23.0557376Z [ OK ] MultiPyException.Check (0 ms) 2023-01-11T21:14:23.0558250Z [----------] 2 tests from MultiPyException (1 ms total) 2023-01-11T21:14:23.0558702Z 2023-01-11T21:14:23.0559548Z [----------] Global test environment tear-down 2023-01-11T21:14:23.0560303Z [==========] 22 tests from 2 test suites ran. (62884 ms total) 2023-01-11T21:14:23.0560969Z [ PASSED ] 22 tests. 2023-01-11T21:14:23.0561566Z Current working directory: /var/lib/jenkins/multipy 2023-01-11T21:14:23.4794409Z + ./multipy/runtime/build/test_deploy_gpu 2023-01-11T21:14:23.9524786Z [==========] Running 3 tests from 1 test suite. 2023-01-11T21:14:23.9525749Z [----------] Global test environment set-up. 2023-01-11T21:14:23.9526332Z [----------] 3 tests from TorchDeployGPUTest 2023-01-11T21:14:23.9526765Z [ RUN ] TorchDeployGPUTest.SimpleModel 2023-01-11T21:14:23.9717424Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:23.9717881Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:23.9718284Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:23.9718704Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:26.4006639Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:26.4007095Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:26.4007519Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:26.4007923Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:26.4417924Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:26.4418626Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:26.4419075Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:26.4419422Z dispatch key: (catch all) 2023-01-11T21:14:26.4419838Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:26.4420420Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:27.6358232Z [ OK ] TorchDeployGPUTest.SimpleModel (3683 ms) 2023-01-11T21:14:27.6358770Z [ RUN ] TorchDeployGPUTest.UsesDistributed 2023-01-11T21:14:27.6425595Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:27.6426039Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:27.6426474Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:27.6426855Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:28.6723534Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:28.6724181Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:28.6724605Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:28.6724999Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:28.7136117Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:28.7137138Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:28.7137602Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:28.7137978Z dispatch key: (catch all) 2023-01-11T21:14:28.7138405Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:28.7138977Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:29.8940167Z [ OK ] TorchDeployGPUTest.UsesDistributed (2258 ms) 2023-01-11T21:14:29.8940707Z [ RUN ] TorchDeployGPUTest.UsesCuda 2023-01-11T21:14:29.9017690Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:29.9018105Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:29.9018514Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:29.9018938Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:30.9132578Z Registering torch::deploy builtin library tensorrt (idx 0) with 0 builtin modules 2023-01-11T21:14:30.9133092Z torch::deploy builtin tensorrt contains 0 modules 2023-01-11T21:14:30.9133505Z Registering torch::deploy builtin library cpython_internal (idx 1) with 0 builtin modules 2023-01-11T21:14:30.9133907Z torch::deploy builtin cpython_internal contains 6 modules 2023-01-11T21:14:30.9534168Z [W OperatorEntry.cpp:159] Warning: Overriding a previously registered kernel for the same operator and the same dispatch key 2023-01-11T21:14:30.9534876Z operator: aten::get_gradients(int context_id) -> Dict(Tensor, Tensor) 2023-01-11T21:14:30.9535328Z registered at /var/lib/jenkins/workspace/build/aten/src/ATen/RegisterSchema.cpp:6 2023-01-11T21:14:30.9535721Z dispatch key: (catch all) 2023-01-11T21:14:30.9536138Z previous kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 2023-01-11T21:14:30.9536717Z new kernel: registered at /var/lib/jenkins/workspace/torch/csrc/jit/runtime/register_distributed_ops.cpp:278 (function registerKernel) 2023-01-11T21:14:32.0800260Z [ OK ] TorchDeployGPUTest.UsesCuda (2186 ms) 2023-01-11T21:14:32.0800915Z [----------] 3 tests from TorchDeployGPUTest (8127 ms total) 2023-01-11T21:14:32.0801178Z 2023-01-11T21:14:32.0801437Z [----------] Global test environment tear-down 2023-01-11T21:14:32.0801886Z [==========] 3 tests from 1 test suite ran. (8128 ms total) 2023-01-11T21:14:32.0802251Z [ PASSED ] 3 tests. 2023-01-11T21:14:32.2943613Z + popd 2023-01-11T21:14:32.2944092Z ~ ~/workspace 2023-01-11T21:14:32.2944352Z + popd 2023-01-11T21:14:32.2944557Z ~/workspace 2023-01-11T21:14:32.3015689Z ##[group]Run cat test/**/*.log || true 2023-01-11T21:14:32.3016000Z cat test/**/*.log || true 2023-01-11T21:14:32.3029432Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:32.3029742Z env: 2023-01-11T21:14:32.3029974Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:32.3030257Z GPU_FLAG: --gpus all 2023-01-11T21:14:32.3030626Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:32.3030969Z ##[endgroup] 2023-01-11T21:14:32.3076789Z cat: test/**/*.log: No such file or directory 2023-01-11T21:14:32.3109150Z Prepare all required actions 2023-01-11T21:14:32.3109602Z Getting action download info 2023-01-11T21:14:32.5259366Z ##[group]Run ./.github/actions/get-workflow-job-id 2023-01-11T21:14:32.5259649Z with: 2023-01-11T21:14:32.5260102Z github-token: *** 2023-01-11T21:14:32.5260364Z env: 2023-01-11T21:14:32.5260588Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:32.5260853Z GPU_FLAG: --gpus all 2023-01-11T21:14:32.5261220Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:32.5261557Z ##[endgroup] 2023-01-11T21:14:32.5298034Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2023-01-11T21:14:32.5298369Z with: 2023-01-11T21:14:32.5298593Z shell: bash 2023-01-11T21:14:32.5298834Z timeout_minutes: 10 2023-01-11T21:14:32.5299084Z max_attempts: 5 2023-01-11T21:14:32.5299348Z retry_wait_seconds: 30 2023-01-11T21:14:32.5299882Z command: set -eux python3 -m pip install requests==2.26.0 GHA_WORKFLOW_JOB_ID=$(python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}") echo "job-id=${GHA_WORKFLOW_JOB_ID}" >> "${GITHUB_OUTPUT}" 2023-01-11T21:14:32.5300398Z polling_interval_seconds: 1 2023-01-11T21:14:32.5300651Z warning_on_retry: true 2023-01-11T21:14:32.5300912Z continue_on_error: false 2023-01-11T21:14:32.5301154Z env: 2023-01-11T21:14:32.5301372Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:32.5301645Z GPU_FLAG: --gpus all 2023-01-11T21:14:32.5302028Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:32.5302548Z GITHUB_TOKEN: *** 2023-01-11T21:14:32.5302787Z ##[endgroup] 2023-01-11T21:14:32.5983483Z + python3 -m pip install requests==2.26.0 2023-01-11T21:14:32.8893236Z Defaulting to user installation because normal site-packages is not writeable 2023-01-11T21:14:32.9121294Z Requirement already satisfied: requests==2.26.0 in /home/ec2-user/.local/lib/python3.7/site-packages (2.26.0) 2023-01-11T21:14:32.9303631Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (1.26.14) 2023-01-11T21:14:32.9523686Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2022.12.7) 2023-01-11T21:14:32.9536159Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2.0.12) 2023-01-11T21:14:32.9563078Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (3.4) 2023-01-11T21:14:33.2007061Z ++ python3 .github/scripts/get_workflow_job_id.py 3896099317 i-08fd0b6c01e2fc030 2023-01-11T21:14:37.2291316Z + GHA_WORKFLOW_JOB_ID=10589292569 2023-01-11T21:14:37.2292266Z + echo job-id=10589292569 2023-01-11T21:14:37.6007493Z Command completed after 1 attempt(s). 2023-01-11T21:14:37.6145676Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2023-01-11T21:14:37.6146005Z kill "$MONITOR_SCRIPT_PID" 2023-01-11T21:14:37.6159713Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:37.6160016Z env: 2023-01-11T21:14:37.6160243Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:37.6160519Z GPU_FLAG: --gpus all 2023-01-11T21:14:37.6160901Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:37.6161279Z MONITOR_SCRIPT_PID: 65317 2023-01-11T21:14:37.6161521Z ##[endgroup] 2023-01-11T21:14:37.6280752Z Prepare all required actions 2023-01-11T21:14:37.6281182Z Getting action download info 2023-01-11T21:14:37.7966164Z Download action repository 'actions/upload-artifact@v3' (SHA:0b7f8abb1508181956e8e162db84b466c27e18ce) 2023-01-11T21:14:37.9606995Z ##[group]Run ./.github/actions/upload-test-artifacts 2023-01-11T21:14:37.9607285Z with: 2023-01-11T21:14:37.9607635Z file-suffix: test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569 2023-01-11T21:14:37.9607976Z env: 2023-01-11T21:14:37.9608201Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:37.9608469Z GPU_FLAG: --gpus all 2023-01-11T21:14:37.9608841Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:37.9609198Z ##[endgroup] 2023-01-11T21:14:37.9638193Z ##[group]Run # Remove any previous test jsons if they exist 2023-01-11T21:14:37.9638559Z # Remove any previous test jsons if they exist 2023-01-11T21:14:37.9639200Z rm -f test-jsons-*.zip 2023-01-11T21:14:37.9639694Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2023-01-11T21:14:37.9652050Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:37.9652364Z env: 2023-01-11T21:14:37.9652621Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:37.9652896Z GPU_FLAG: --gpus all 2023-01-11T21:14:37.9653272Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:37.9653742Z FILE_SUFFIX: test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569 2023-01-11T21:14:37.9654067Z ##[endgroup] 2023-01-11T21:14:37.9749589Z adding: test/allowlist_for_publicAPI.json (deflated 78%) 2023-01-11T21:14:37.9784677Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2023-01-11T21:14:37.9791653Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2023-01-11T21:14:37.9818770Z ##[group]Run # Remove any previous test reports if they exist 2023-01-11T21:14:37.9819152Z # Remove any previous test reports if they exist 2023-01-11T21:14:37.9819480Z rm -f test-reports-*.zip 2023-01-11T21:14:37.9819837Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2023-01-11T21:14:37.9831816Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:37.9832136Z env: 2023-01-11T21:14:37.9832385Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:37.9832639Z GPU_FLAG: --gpus all 2023-01-11T21:14:37.9833012Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:37.9833479Z FILE_SUFFIX: test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569 2023-01-11T21:14:37.9833802Z ##[endgroup] 2023-01-11T21:14:37.9917273Z zip warning: zip file empty 2023-01-11T21:14:37.9967139Z ##[group]Run # Remove any previous test reports if they exist 2023-01-11T21:14:37.9967536Z # Remove any previous test reports if they exist 2023-01-11T21:14:37.9967841Z rm -f usage-log-*.zip 2023-01-11T21:14:37.9968228Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2023-01-11T21:14:37.9968623Z # so check to see if the file exists first 2023-01-11T21:14:37.9968936Z if [ -f 'usage_log.txt' ]; then 2023-01-11T21:14:37.9969403Z  zip "usage-log-${FILE_SUFFIX}.zip" 'usage_log.txt' 2023-01-11T21:14:37.9969705Z fi 2023-01-11T21:14:37.9981361Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:37.9981648Z env: 2023-01-11T21:14:37.9981892Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:37.9982164Z GPU_FLAG: --gpus all 2023-01-11T21:14:37.9982518Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:37.9983000Z FILE_SUFFIX: test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569 2023-01-11T21:14:37.9983348Z ##[endgroup] 2023-01-11T21:14:38.0050365Z adding: usage_log.txt (deflated 98%) 2023-01-11T21:14:38.0099894Z ##[group]Run seemethere/upload-artifact-s3@v5 2023-01-11T21:14:38.0100313Z with: 2023-01-11T21:14:38.0100598Z s3-prefix: pytorch/pytorch/3896099317/2/artifact 2023-01-11T21:14:38.0100899Z retention-days: 14 2023-01-11T21:14:38.0101165Z if-no-files-found: warn 2023-01-11T21:14:38.0101433Z path: test-jsons-*.zip 2023-01-11T21:14:38.0101685Z name: artifact 2023-01-11T21:14:38.0101945Z s3-bucket: gha-artifacts 2023-01-11T21:14:38.0102203Z region: us-east-1 2023-01-11T21:14:38.0102416Z env: 2023-01-11T21:14:38.0102651Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:38.0102912Z GPU_FLAG: --gpus all 2023-01-11T21:14:38.0103261Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:38.0103618Z ##[endgroup] 2023-01-11T21:14:38.4540198Z NOTE: s3-prefix specified, ignoring name parameter 2023-01-11T21:14:38.4541006Z With the provided path, there will be 1 file uploaded 2023-01-11T21:14:38.4541384Z Uploading to s3 prefix: pytorch/pytorch/3896099317/2/artifact 2023-01-11T21:14:38.4552334Z Starting upload of test-jsons-test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569.zip 2023-01-11T21:14:38.6447812Z Finished upload of test-jsons-test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569.zip 2023-01-11T21:14:38.6606944Z ##[group]Run seemethere/upload-artifact-s3@v5 2023-01-11T21:14:38.6607268Z with: 2023-01-11T21:14:38.6607543Z s3-prefix: pytorch/pytorch/3896099317/2/artifact 2023-01-11T21:14:38.6607865Z retention-days: 14 2023-01-11T21:14:38.6608152Z if-no-files-found: error 2023-01-11T21:14:38.6608428Z path: test-reports-*.zip 2023-01-11T21:14:38.6608702Z name: artifact 2023-01-11T21:14:38.6608964Z s3-bucket: gha-artifacts 2023-01-11T21:14:38.6609218Z region: us-east-1 2023-01-11T21:14:38.6609491Z env: 2023-01-11T21:14:38.6609714Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:38.6609981Z GPU_FLAG: --gpus all 2023-01-11T21:14:38.6610367Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:38.6610736Z ##[endgroup] 2023-01-11T21:14:39.1131361Z NOTE: s3-prefix specified, ignoring name parameter 2023-01-11T21:14:39.1132119Z With the provided path, there will be 1 file uploaded 2023-01-11T21:14:39.1132503Z Uploading to s3 prefix: pytorch/pytorch/3896099317/2/artifact 2023-01-11T21:14:39.1144469Z Starting upload of test-reports-test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569.zip 2023-01-11T21:14:39.2353115Z Finished upload of test-reports-test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569.zip 2023-01-11T21:14:39.2511687Z ##[group]Run seemethere/upload-artifact-s3@v5 2023-01-11T21:14:39.2511981Z with: 2023-01-11T21:14:39.2512244Z s3-prefix: pytorch/pytorch/3896099317/2/artifact 2023-01-11T21:14:39.2512548Z retention-days: 14 2023-01-11T21:14:39.2512830Z if-no-files-found: ignore 2023-01-11T21:14:39.2513093Z path: usage-log-*.zip 2023-01-11T21:14:39.2513347Z name: artifact 2023-01-11T21:14:39.2513599Z s3-bucket: gha-artifacts 2023-01-11T21:14:39.2513846Z region: us-east-1 2023-01-11T21:14:39.2514077Z env: 2023-01-11T21:14:39.2514321Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:39.2514577Z GPU_FLAG: --gpus all 2023-01-11T21:14:39.2514958Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:39.2515319Z ##[endgroup] 2023-01-11T21:14:39.6956031Z NOTE: s3-prefix specified, ignoring name parameter 2023-01-11T21:14:39.6956736Z With the provided path, there will be 1 file uploaded 2023-01-11T21:14:39.6957125Z Uploading to s3 prefix: pytorch/pytorch/3896099317/2/artifact 2023-01-11T21:14:39.6968511Z Starting upload of usage-log-test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569.zip 2023-01-11T21:14:39.8555401Z Finished upload of usage-log-test-deploy-1-1-linux.4xlarge.nvidia.gpu_10589292569.zip 2023-01-11T21:14:39.8715726Z ##[group]Run # shellcheck disable=SC2156 2023-01-11T21:14:39.8716097Z # shellcheck disable=SC2156 2023-01-11T21:14:39.8716515Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2023-01-11T21:14:39.8730793Z shell: /usr/bin/bash -e {0} 2023-01-11T21:14:39.8731045Z env: 2023-01-11T21:14:39.8731302Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:39.8731577Z GPU_FLAG: --gpus all 2023-01-11T21:14:39.8731930Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:39.8732348Z ##[endgroup] 2023-01-11T21:14:40.1990737Z ##[group]Run set -x 2023-01-11T21:14:40.1991037Z set -x 2023-01-11T21:14:40.1991324Z python3 -m pip install -r requirements.txt 2023-01-11T21:14:40.1991664Z python3 -m pip install boto3==1.19.12 2023-01-11T21:14:40.1992068Z python3 -m tools.stats.print_test_stats --upload-to-s3 --compare-with-s3 test 2023-01-11T21:14:40.2004991Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:40.2005270Z env: 2023-01-11T21:14:40.2005512Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:40.2005778Z GPU_FLAG: --gpus all 2023-01-11T21:14:40.2006128Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:40.2006499Z AWS_DEFAULT_REGION: us-east-1 2023-01-11T21:14:40.2006779Z BRANCH: pull/91627 2023-01-11T21:14:40.2007018Z TEST_CONFIG: deploy 2023-01-11T21:14:40.2007264Z SHARD_NUMBER: 1 2023-01-11T21:14:40.2007592Z BUILD_ENVIRONMENT: linux-bionic-cuda11.6-py3.10-gcc7 2023-01-11T21:14:40.2007932Z PR_NUMBER: 91627 2023-01-11T21:14:40.2008181Z PYTORCH_RETRY_TEST_CASES: 1 2023-01-11T21:14:40.2008469Z PYTORCH_OVERRIDE_FLAKY_SIGNAL: 1 2023-01-11T21:14:40.2008792Z SHA1: 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:14:40.2009077Z TAG: 2023-01-11T21:14:40.2009295Z WORKFLOW_ID: 3896099317 2023-01-11T21:14:40.2009718Z GITHUB_TOKEN: *** 2023-01-11T21:14:40.2009985Z GHA_WORKFLOW_JOB_ID: 10589292569 2023-01-11T21:14:40.2010226Z ##[endgroup] 2023-01-11T21:14:40.2040469Z + python3 -m pip install -r requirements.txt 2023-01-11T21:14:40.5000642Z Defaulting to user installation because normal site-packages is not writeable 2023-01-11T21:14:40.5360000Z Requirement already satisfied: astunparse in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 2)) (1.6.3) 2023-01-11T21:14:40.5398298Z Requirement already satisfied: expecttest in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 3)) (0.1.4) 2023-01-11T21:14:40.5409962Z Requirement already satisfied: future in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 4)) (0.18.2) 2023-01-11T21:14:40.5421547Z Requirement already satisfied: hypothesis in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 5)) (6.62.0) 2023-01-11T21:14:40.5961460Z Requirement already satisfied: numpy in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 6)) (1.21.6) 2023-01-11T21:14:40.5973412Z Requirement already satisfied: psutil in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 7)) (5.9.1) 2023-01-11T21:14:40.6084365Z Requirement already satisfied: pyyaml in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 8)) (6.0) 2023-01-11T21:14:40.6095280Z Requirement already satisfied: requests in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 9)) (2.26.0) 2023-01-11T21:14:40.6347775Z Requirement already satisfied: setuptools in /usr/lib/python3.7/site-packages (from -r requirements.txt (line 10)) (49.1.3) 2023-01-11T21:14:40.6592860Z Requirement already satisfied: six in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 11)) (1.16.0) 2023-01-11T21:14:40.6604904Z Requirement already satisfied: types-dataclasses in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 12)) (0.6.6) 2023-01-11T21:14:40.6613037Z Requirement already satisfied: typing_extensions in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 13)) (4.4.0) 2023-01-11T21:14:40.6626784Z Requirement already satisfied: sympy in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 14)) (1.10.1) 2023-01-11T21:14:40.6653512Z Requirement already satisfied: filelock in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 15)) (3.9.0) 2023-01-11T21:14:40.6758606Z Requirement already satisfied: networkx in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 16)) (2.6.3) 2023-01-11T21:14:40.6987785Z Requirement already satisfied: jinja2 in /home/ec2-user/.local/lib/python3.7/site-packages (from -r requirements.txt (line 17)) (3.1.2) 2023-01-11T21:14:40.7024133Z Requirement already satisfied: wheel<1.0,>=0.23.0 in /home/ec2-user/.local/lib/python3.7/site-packages (from astunparse->-r requirements.txt (line 2)) (0.38.4) 2023-01-11T21:14:40.7046593Z Requirement already satisfied: attrs>=19.2.0 in /home/ec2-user/.local/lib/python3.7/site-packages (from hypothesis->-r requirements.txt (line 5)) (22.2.0) 2023-01-11T21:14:40.7420811Z Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in /home/ec2-user/.local/lib/python3.7/site-packages (from hypothesis->-r requirements.txt (line 5)) (2.4.0) 2023-01-11T21:14:40.7435456Z Requirement already satisfied: exceptiongroup>=1.0.0; python_version < "3.11" in /home/ec2-user/.local/lib/python3.7/site-packages (from hypothesis->-r requirements.txt (line 5)) (1.1.0) 2023-01-11T21:14:40.7459817Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests->-r requirements.txt (line 9)) (2.0.12) 2023-01-11T21:14:40.7488911Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests->-r requirements.txt (line 9)) (1.26.14) 2023-01-11T21:14:40.7710680Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests->-r requirements.txt (line 9)) (2022.12.7) 2023-01-11T21:14:40.7723312Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests->-r requirements.txt (line 9)) (3.4) 2023-01-11T21:14:40.7739028Z Requirement already satisfied: mpmath>=0.19 in /home/ec2-user/.local/lib/python3.7/site-packages (from sympy->-r requirements.txt (line 14)) (1.2.1) 2023-01-11T21:14:40.7819447Z Requirement already satisfied: MarkupSafe>=2.0 in /home/ec2-user/.local/lib/python3.7/site-packages (from jinja2->-r requirements.txt (line 17)) (2.1.1) 2023-01-11T21:14:40.8510986Z + python3 -m pip install boto3==1.19.12 2023-01-11T21:14:41.1546360Z Defaulting to user installation because normal site-packages is not writeable 2023-01-11T21:14:41.1789160Z Requirement already satisfied: boto3==1.19.12 in /home/ec2-user/.local/lib/python3.7/site-packages (1.19.12) 2023-01-11T21:14:41.1862833Z Requirement already satisfied: botocore<1.23.0,>=1.22.12 in /home/ec2-user/.local/lib/python3.7/site-packages (from boto3==1.19.12) (1.22.12) 2023-01-11T21:14:41.1927210Z Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from boto3==1.19.12) (0.10.0) 2023-01-11T21:14:41.1954969Z Requirement already satisfied: s3transfer<0.6.0,>=0.5.0 in /home/ec2-user/.local/lib/python3.7/site-packages (from boto3==1.19.12) (0.5.2) 2023-01-11T21:14:41.1992097Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /home/ec2-user/.local/lib/python3.7/site-packages (from botocore<1.23.0,>=1.22.12->boto3==1.19.12) (1.26.14) 2023-01-11T21:14:41.2222896Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from botocore<1.23.0,>=1.22.12->boto3==1.19.12) (2.8.2) 2023-01-11T21:14:41.2250318Z Requirement already satisfied: six>=1.5 in /home/ec2-user/.local/lib/python3.7/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.23.0,>=1.22.12->boto3==1.19.12) (1.16.0) 2023-01-11T21:14:41.4854433Z + python3 -m tools.stats.print_test_stats --upload-to-s3 --compare-with-s3 test 2023-01-11T21:14:41.7688874Z No tests in reports found in test 2023-01-11T21:14:41.8151451Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2023-01-11T21:14:41.8151802Z with: 2023-01-11T21:14:41.8152015Z env: 2023-01-11T21:14:41.8152237Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:41.8152529Z GPU_FLAG: --gpus all 2023-01-11T21:14:41.8152914Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:41.8153257Z ##[endgroup] 2023-01-11T21:14:41.8173659Z ##[group]Run set -eou pipefail 2023-01-11T21:14:41.8173966Z set -eou pipefail 2023-01-11T21:14:41.8174216Z  2023-01-11T21:14:41.8174546Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2023-01-11T21:14:41.8174874Z for _ in $(seq 1440); do 2023-01-11T21:14:41.8175174Z  # Break if no ssh session exists anymore 2023-01-11T21:14:41.8175469Z  if [ "$(who)" = "" ]; then 2023-01-11T21:14:41.8175704Z  break 2023-01-11T21:14:41.8175983Z  fi 2023-01-11T21:14:41.8176202Z  echo "." 2023-01-11T21:14:41.8176443Z  sleep 5 2023-01-11T21:14:41.8176691Z done 2023-01-11T21:14:41.8189868Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:41.8190174Z env: 2023-01-11T21:14:41.8190421Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:41.8190675Z GPU_FLAG: --gpus all 2023-01-11T21:14:41.8191048Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:41.8191418Z ##[endgroup] 2023-01-11T21:14:41.8221143Z Holding runner for 2 hours until all ssh sessions have logged out 2023-01-11T21:14:41.8271828Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2023-01-11T21:14:41.8272243Z # ignore expansion of "docker ps -q" since it could be empty 2023-01-11T21:14:41.8272593Z # shellcheck disable=SC2046 2023-01-11T21:14:41.8272905Z docker stop $(docker ps -q) || true 2023-01-11T21:14:41.8273209Z # Prune all of the docker images 2023-01-11T21:14:41.8273510Z docker system prune -af 2023-01-11T21:14:41.8286436Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:41.8286747Z env: 2023-01-11T21:14:41.8287006Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:41.8287278Z GPU_FLAG: --gpus all 2023-01-11T21:14:41.8287662Z DOCKER_CONTAINER_ID: dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:41.8288004Z ##[endgroup] 2023-01-11T21:14:42.2537802Z dd5ee451bcc5 2023-01-11T21:14:42.9262475Z Deleted Containers: 2023-01-11T21:14:42.9262918Z dd5ee451bcc5b7d25f4f81d00d1ac07d41e715e3408d79d99b3796e9e1b0b949 2023-01-11T21:14:42.9263190Z 2023-01-11T21:14:47.9398427Z Deleted Images: 2023-01-11T21:14:47.9400040Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:14:47.9402115Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7@sha256:866df6c1171dbe014496717cf2080d6cc72ca611a4e8146525c9ef09640c8ba4 2023-01-11T21:14:47.9402969Z deleted: sha256:09e297797cd8c095524ba49e041c45e57bf05ba16719f01e7240e8549da5beba 2023-01-11T21:14:47.9403656Z deleted: sha256:6d5f0082fbf8c3b01e49961283f44105a5bb12616f0073762021db97f20a16a5 2023-01-11T21:14:47.9404099Z deleted: sha256:19c574c96e47e3d16cc51cc088fed6cef16eaa2174e667ba0b395ac0e3b989bb 2023-01-11T21:14:47.9404572Z deleted: sha256:4fa7af758c23581dbcc2bd92defdc5fea97c8671fa67bbc30888ffbbf96c49a6 2023-01-11T21:14:47.9405035Z deleted: sha256:e68331e1b0f863bbdbd445ed8475d59d2234c9659264a4e49b7b096311445aee 2023-01-11T21:14:47.9405493Z deleted: sha256:69d886418998cd8758c555ed219fca3a457539e9d6f62c41c9664a80c82c4036 2023-01-11T21:14:47.9405963Z deleted: sha256:2368b1fdf0235d155eaa47e75ff379cff06cc82d63e03886a57363b8092d3c83 2023-01-11T21:14:47.9406389Z deleted: sha256:651c1e1b625aeaf8fa65e96ef11487e650a7a6d00ba8ec9fdfe7e89e762dc5c4 2023-01-11T21:14:47.9406931Z deleted: sha256:7b73f298df08c4b3aa849b55bb5e73ded619cb5b786fddcc21ece3c0b3887038 2023-01-11T21:14:47.9407388Z deleted: sha256:716f28b4b433958e5d1b9839a20dd22f9986f9c1b42fb95552f13d6bfd291efe 2023-01-11T21:14:47.9407815Z deleted: sha256:e4495993276176c504228e66b2fd6f348523c5af66f9292b2f7ea12acefcd606 2023-01-11T21:14:47.9408252Z deleted: sha256:d6f5fbd8782783697c73f4bcbce91a05e126575f72f0f58e1e9465aa57640a92 2023-01-11T21:14:47.9408702Z deleted: sha256:0b7725c897ee2681e3b1ff00aea6c14805c8050758cfa1010f561c9713934014 2023-01-11T21:14:47.9409150Z deleted: sha256:fdd864c6750bdd24f8cfb131673c6f04087e3cbecac2c1a9b3c30fefbd6d3070 2023-01-11T21:14:47.9409611Z deleted: sha256:bfaeaf77f180f62f3994ccdc2be80dd2ef7f4d25ffc8c9497dc51e6cff69711e 2023-01-11T21:14:47.9410074Z deleted: sha256:02f5a9d8be5a1bdd5a350d4c47147fd3dd46bfcedc7637f53a8a692720381fc2 2023-01-11T21:14:47.9410535Z deleted: sha256:e22cc66e4fd2e491fb4ae8194c35d6b1789f9f5d01e1dfbedf1c266c3a1537de 2023-01-11T21:14:47.9410971Z deleted: sha256:1536d02ae84ab410916541408cf2935f122735cc5d128324f6f82fbbeb913e80 2023-01-11T21:14:47.9411405Z deleted: sha256:a8374bc83a4bf3a838aaf8ee71b4a8281ac4eef801473b007f88b2f0efadc6c6 2023-01-11T21:14:47.9411835Z deleted: sha256:9381921b1e612b2d23517d24662a39f00be43efe2412e440ef41b487a48cb389 2023-01-11T21:14:47.9412290Z deleted: sha256:ae063d6cbeae3688a5a7bb8694d431dbb9792bfb7ff2908d3b25842f9586fc8e 2023-01-11T21:14:47.9412747Z deleted: sha256:595397ba048a351c7b09c25b5eba4cbb916c2db40dd80bde4d95c2b51b766045 2023-01-11T21:14:47.9413197Z deleted: sha256:7a2da4ffb8ea2b858fcdfc92f6e640dbb6a083b39dfa5e7aa87cd1296f9314e1 2023-01-11T21:14:47.9413683Z deleted: sha256:eddd66bfdbb5913f133ffda8d967ee0235f9f121434112ea8da4cfdf5f9ebbf4 2023-01-11T21:14:47.9414145Z deleted: sha256:c9392d92ee837d52b35b41e4de67d213886d844cecd9e769d9284dc21070aee8 2023-01-11T21:14:47.9414610Z deleted: sha256:fba16b8beafe9efa854d93f0e92718750ec97ced755ace0f6f51bbd5d1964f91 2023-01-11T21:14:47.9415090Z deleted: sha256:a09592e27d2e6896b9029f31e269787c92761fd19a48528851c48d85221cd4bc 2023-01-11T21:14:47.9415730Z deleted: sha256:8b2e3a8416af60625ccb9a8562891c1b9e85c2ee05f103b190ad5040313bf1f1 2023-01-11T21:14:47.9416197Z deleted: sha256:135caddb443044601f433d421e5c0f5d8ab02dff69cf2df9024a8ecb97c8948c 2023-01-11T21:14:47.9416848Z deleted: sha256:112b60db47585e101175390e102a66908f0f1175510c5e5d5f10b7e4e0c9769b 2023-01-11T21:14:47.9417578Z deleted: sha256:d9e5dd4e760b68190c010a9042c842afb0bcf3d4477a334d0e9c2d9c302ecb3c 2023-01-11T21:14:47.9418154Z deleted: sha256:7d37673dfb91518db6e68e9637f3db142a4eaccb9f548ab99d14ac52b3672325 2023-01-11T21:14:47.9418593Z deleted: sha256:12784d32c23b63941ebc8adf713d7167158c38c771d3b5f94506e036b6273dbd 2023-01-11T21:14:47.9419009Z deleted: sha256:395db4c8bde7e390accfa81ff84376004b78566423bd0a3bd7559e12e66759bc 2023-01-11T21:14:47.9419473Z deleted: sha256:a7aa04ee64333d427277f47b8e07dee6cc566b132a18ee166c305c890d4fd3bb 2023-01-11T21:14:47.9419911Z deleted: sha256:10a0e8d138614f29a13aecd15175039c7f86ca04fc588b439f56284b3c0e292a 2023-01-11T21:14:47.9420342Z deleted: sha256:68d97ecc8d2ec5f756b4a1b7e7451a413ed19f3d7c3ce52c81b30dc00fd96185 2023-01-11T21:14:47.9420789Z deleted: sha256:e833f7b95e0efaaf775293760365243991395e796d587deffe588e50fe7a9f1e 2023-01-11T21:14:47.9421337Z deleted: sha256:cbcd1e7502e949614d05d5d0a34316fd62665c3e030b3656d9c488cfee1eca34 2023-01-11T21:14:47.9421772Z deleted: sha256:a90ce4a75d9d408df6349607788566125c2662c603dc8f84c767b2256273ff12 2023-01-11T21:14:47.9422185Z deleted: sha256:bdee06da46fd67ff14bbc7286b40ef15174551b6452ca633be8576376a3dbddb 2023-01-11T21:14:47.9422646Z deleted: sha256:2cafe83ace87d1a83f30f8d458001f3a315a606d5251c20543cbd6604499aa73 2023-01-11T21:14:47.9423109Z deleted: sha256:cc1f7fb1208e7b05b48d3b3b2648946adaa723b10df2574c7db87ed9112b1510 2023-01-11T21:14:47.9423541Z deleted: sha256:9027ec66ecfd6490ecf157cdf665428dad438f54565d9d85263211da30e6684d 2023-01-11T21:14:47.9423990Z deleted: sha256:a27541cda46a9ede5932b1a1807360e2f6ada5bb0c30bfa3aa953d59dcc1bc5c 2023-01-11T21:14:47.9424520Z deleted: sha256:7b927de6f9fdeb74acee54e7654d04e2614a112cafb477b2433db34dcc7ebe28 2023-01-11T21:14:47.9424970Z deleted: sha256:8298c8753925ad5124b0611c4101e92ec1f877252f8320f5503ebf3e4e7e1314 2023-01-11T21:14:47.9425370Z deleted: sha256:0b741a2d83533cb3b47b912506d486fd477d8c8a1c520a0f9d7d62edfc55487d 2023-01-11T21:14:47.9425812Z deleted: sha256:9412a0a6fd6057a9939fed5beadf64568de1d230c0325a628e396f5b76444bbb 2023-01-11T21:14:47.9426293Z deleted: sha256:0a294dad6a5df3fab407cd28b31eadaf9f65a5bdbf8c7a0db349d3401b537cef 2023-01-11T21:14:47.9426753Z deleted: sha256:b42ee7d4f5715886c70d5cfef4724e889f773a20741ebc4ed9c1771eb09ad634 2023-01-11T21:14:47.9427197Z deleted: sha256:a68106c7b0e03f1e0fa9ad405ce403e2931174825bdcd8e259522ef40ec8a617 2023-01-11T21:14:47.9427631Z deleted: sha256:ad403ee05a64f55c765e665bd3f25a71650857123282dc1bad2af81f5665cda5 2023-01-11T21:14:47.9428058Z deleted: sha256:eb731dc1382c6cc80193d0454f740fc55f441c32f08cd0ce1b8784e7840e53df 2023-01-11T21:14:47.9428466Z deleted: sha256:45bbe3d22998589317c7f6c4dd591475423bb37ca9b922529c5878653483b18d 2023-01-11T21:14:47.9428700Z 2023-01-11T21:14:47.9428852Z Total reclaimed space: 19.3GB 2023-01-11T21:14:47.9485217Z Post job cleanup. 2023-01-11T21:14:47.9525883Z Post job cleanup. 2023-01-11T21:14:48.0907422Z [command]/usr/bin/git version 2023-01-11T21:14:48.0966666Z git version 2.38.1 2023-01-11T21:14:48.1033853Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/027cca16-3a33-4754-9e2f-26f733506cbb' before making global git config changes 2023-01-11T21:14:48.1035637Z Adding repository directory to the temporary git global config as a safe directory 2023-01-11T21:14:48.1042711Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:14:48.1085833Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-01-11T21:14:48.1125097Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2023-01-11T21:14:48.1452463Z Entering 'android/libs/fbjni' 2023-01-11T21:14:48.1496083Z Entering 'third_party/FP16' 2023-01-11T21:14:48.1539065Z Entering 'third_party/FXdiv' 2023-01-11T21:14:48.1581443Z Entering 'third_party/NNPACK' 2023-01-11T21:14:48.1623659Z Entering 'third_party/QNNPACK' 2023-01-11T21:14:48.1667172Z Entering 'third_party/VulkanMemoryAllocator' 2023-01-11T21:14:48.1709480Z Entering 'third_party/XNNPACK' 2023-01-11T21:14:48.1763956Z Entering 'third_party/benchmark' 2023-01-11T21:14:48.1805396Z Entering 'third_party/cpuinfo' 2023-01-11T21:14:48.1848615Z Entering 'third_party/cub' 2023-01-11T21:14:48.1890744Z Entering 'third_party/cudnn_frontend' 2023-01-11T21:14:48.1937993Z Entering 'third_party/cutlass' 2023-01-11T21:14:48.1990138Z Entering 'third_party/eigen' 2023-01-11T21:14:48.2034216Z Entering 'third_party/fbgemm' 2023-01-11T21:14:48.2076187Z Entering 'third_party/fbgemm/third_party/asmjit' 2023-01-11T21:14:48.2117131Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2023-01-11T21:14:48.2161696Z Entering 'third_party/fbgemm/third_party/googletest' 2023-01-11T21:14:48.2203828Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2023-01-11T21:14:48.2246946Z Entering 'third_party/flatbuffers' 2023-01-11T21:14:48.2291945Z Entering 'third_party/fmt' 2023-01-11T21:14:48.2334080Z Entering 'third_party/foxi' 2023-01-11T21:14:48.2376432Z Entering 'third_party/gemmlowp/gemmlowp' 2023-01-11T21:14:48.2419346Z Entering 'third_party/gloo' 2023-01-11T21:14:48.2462312Z Entering 'third_party/googletest' 2023-01-11T21:14:48.2504993Z Entering 'third_party/ideep' 2023-01-11T21:14:48.2545976Z Entering 'third_party/ideep/mkl-dnn' 2023-01-11T21:14:48.2590292Z Entering 'third_party/ideep/mkl-dnn/third_party/oneDNN' 2023-01-11T21:14:48.2641823Z Entering 'third_party/ios-cmake' 2023-01-11T21:14:48.2685070Z Entering 'third_party/ittapi' 2023-01-11T21:14:48.2727164Z Entering 'third_party/kineto' 2023-01-11T21:14:48.2769910Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2023-01-11T21:14:48.2812090Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2023-01-11T21:14:48.2856184Z Entering 'third_party/nccl/nccl' 2023-01-11T21:14:48.2898461Z Entering 'third_party/neon2sse' 2023-01-11T21:14:48.2943187Z Entering 'third_party/nlohmann' 2023-01-11T21:14:48.2986965Z Entering 'third_party/onnx' 2023-01-11T21:14:48.3044819Z Entering 'third_party/onnx/third_party/benchmark' 2023-01-11T21:14:48.3088187Z Entering 'third_party/onnx/third_party/pybind11' 2023-01-11T21:14:48.3133642Z Entering 'third_party/onnx-tensorrt' 2023-01-11T21:14:48.3175127Z Entering 'third_party/onnx-tensorrt/third_party/onnx' 2023-01-11T21:14:48.3221970Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark' 2023-01-11T21:14:48.3265682Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11' 2023-01-11T21:14:48.3307881Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang' 2023-01-11T21:14:48.3355345Z Entering 'third_party/pocketfft' 2023-01-11T21:14:48.3398389Z Entering 'third_party/protobuf' 2023-01-11T21:14:48.3443872Z Entering 'third_party/protobuf/third_party/benchmark' 2023-01-11T21:14:48.3486575Z Entering 'third_party/protobuf/third_party/googletest' 2023-01-11T21:14:48.3529545Z Entering 'third_party/psimd' 2023-01-11T21:14:48.3571371Z Entering 'third_party/pthreadpool' 2023-01-11T21:14:48.3613893Z Entering 'third_party/pybind11' 2023-01-11T21:14:48.3656134Z Entering 'third_party/python-enum' 2023-01-11T21:14:48.3697527Z Entering 'third_party/python-peachpy' 2023-01-11T21:14:48.3739473Z Entering 'third_party/python-six' 2023-01-11T21:14:48.3781074Z Entering 'third_party/sleef' 2023-01-11T21:14:48.3823551Z Entering 'third_party/tbb' 2023-01-11T21:14:48.3867832Z Entering 'third_party/tensorpipe' 2023-01-11T21:14:48.3910004Z Entering 'third_party/tensorpipe/third_party/googletest' 2023-01-11T21:14:48.3951309Z Entering 'third_party/tensorpipe/third_party/libnop' 2023-01-11T21:14:48.3992892Z Entering 'third_party/tensorpipe/third_party/libuv' 2023-01-11T21:14:48.4034575Z Entering 'third_party/tensorpipe/third_party/pybind11' 2023-01-11T21:14:48.4075361Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2023-01-11T21:14:48.4120033Z Entering 'third_party/zstd' 2023-01-11T21:14:48.4178521Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-01-11T21:14:48.4212251Z http.https://github.com/.extraheader 2023-01-11T21:14:48.4222353Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2023-01-11T21:14:48.4258593Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2023-01-11T21:14:48.4574797Z Entering 'android/libs/fbjni' 2023-01-11T21:14:48.4599326Z http.https://github.com/.extraheader 2023-01-11T21:14:48.4632443Z Entering 'third_party/FP16' 2023-01-11T21:14:48.4658031Z http.https://github.com/.extraheader 2023-01-11T21:14:48.4691054Z Entering 'third_party/FXdiv' 2023-01-11T21:14:48.4715534Z http.https://github.com/.extraheader 2023-01-11T21:14:48.4749426Z Entering 'third_party/NNPACK' 2023-01-11T21:14:48.4774720Z http.https://github.com/.extraheader 2023-01-11T21:14:48.4808245Z Entering 'third_party/QNNPACK' 2023-01-11T21:14:48.4832071Z http.https://github.com/.extraheader 2023-01-11T21:14:48.4865322Z Entering 'third_party/VulkanMemoryAllocator' 2023-01-11T21:14:48.4890581Z http.https://github.com/.extraheader 2023-01-11T21:14:48.4923799Z Entering 'third_party/XNNPACK' 2023-01-11T21:14:48.4949733Z http.https://github.com/.extraheader 2023-01-11T21:14:48.4994336Z Entering 'third_party/benchmark' 2023-01-11T21:14:48.5019447Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5052871Z Entering 'third_party/cpuinfo' 2023-01-11T21:14:48.5077353Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5110317Z Entering 'third_party/cub' 2023-01-11T21:14:48.5136378Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5168712Z Entering 'third_party/cudnn_frontend' 2023-01-11T21:14:48.5193224Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5232122Z Entering 'third_party/cutlass' 2023-01-11T21:14:48.5257211Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5298206Z Entering 'third_party/eigen' 2023-01-11T21:14:48.5323054Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5357636Z Entering 'third_party/fbgemm' 2023-01-11T21:14:48.5382698Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5415575Z Entering 'third_party/fbgemm/third_party/asmjit' 2023-01-11T21:14:48.5440252Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5472862Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2023-01-11T21:14:48.5496978Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5530868Z Entering 'third_party/fbgemm/third_party/googletest' 2023-01-11T21:14:48.5555578Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5588309Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2023-01-11T21:14:48.5612122Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5646799Z Entering 'third_party/flatbuffers' 2023-01-11T21:14:48.5671723Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5706743Z Entering 'third_party/fmt' 2023-01-11T21:14:48.5731038Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5764318Z Entering 'third_party/foxi' 2023-01-11T21:14:48.5788402Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5821912Z Entering 'third_party/gemmlowp/gemmlowp' 2023-01-11T21:14:48.5847730Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5879648Z Entering 'third_party/gloo' 2023-01-11T21:14:48.5904194Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5936926Z Entering 'third_party/googletest' 2023-01-11T21:14:48.5962002Z http.https://github.com/.extraheader 2023-01-11T21:14:48.5994844Z Entering 'third_party/ideep' 2023-01-11T21:14:48.6019604Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6051438Z Entering 'third_party/ideep/mkl-dnn' 2023-01-11T21:14:48.6074687Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6110092Z Entering 'third_party/ideep/mkl-dnn/third_party/oneDNN' 2023-01-11T21:14:48.6135104Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6174853Z Entering 'third_party/ios-cmake' 2023-01-11T21:14:48.6199410Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6232426Z Entering 'third_party/ittapi' 2023-01-11T21:14:48.6257797Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6291181Z Entering 'third_party/kineto' 2023-01-11T21:14:48.6315512Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6348265Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2023-01-11T21:14:48.6373822Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6406413Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2023-01-11T21:14:48.6430223Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6464246Z Entering 'third_party/nccl/nccl' 2023-01-11T21:14:48.6489647Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6523860Z Entering 'third_party/neon2sse' 2023-01-11T21:14:48.6548621Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6581136Z Entering 'third_party/nlohmann' 2023-01-11T21:14:48.6606305Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6641311Z Entering 'third_party/onnx' 2023-01-11T21:14:48.6666051Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6712854Z Entering 'third_party/onnx/third_party/benchmark' 2023-01-11T21:14:48.6737753Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6771164Z Entering 'third_party/onnx/third_party/pybind11' 2023-01-11T21:14:48.6795217Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6830442Z Entering 'third_party/onnx-tensorrt' 2023-01-11T21:14:48.6855767Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6888256Z Entering 'third_party/onnx-tensorrt/third_party/onnx' 2023-01-11T21:14:48.6912097Z http.https://github.com/.extraheader 2023-01-11T21:14:48.6951338Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/benchmark' 2023-01-11T21:14:48.6976746Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7010450Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11' 2023-01-11T21:14:48.7035021Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7068664Z Entering 'third_party/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang' 2023-01-11T21:14:48.7094421Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7133106Z Entering 'third_party/pocketfft' 2023-01-11T21:14:48.7157669Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7190127Z Entering 'third_party/protobuf' 2023-01-11T21:14:48.7215890Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7252835Z Entering 'third_party/protobuf/third_party/benchmark' 2023-01-11T21:14:48.7276693Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7310670Z Entering 'third_party/protobuf/third_party/googletest' 2023-01-11T21:14:48.7334888Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7370067Z Entering 'third_party/psimd' 2023-01-11T21:14:48.7395307Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7427659Z Entering 'third_party/pthreadpool' 2023-01-11T21:14:48.7453839Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7487395Z Entering 'third_party/pybind11' 2023-01-11T21:14:48.7512440Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7546066Z Entering 'third_party/python-enum' 2023-01-11T21:14:48.7571370Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7604088Z Entering 'third_party/python-peachpy' 2023-01-11T21:14:48.7628665Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7662043Z Entering 'third_party/python-six' 2023-01-11T21:14:48.7687995Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7721189Z Entering 'third_party/sleef' 2023-01-11T21:14:48.7745718Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7780332Z Entering 'third_party/tbb' 2023-01-11T21:14:48.7805319Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7839500Z Entering 'third_party/tensorpipe' 2023-01-11T21:14:48.7864210Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7897036Z Entering 'third_party/tensorpipe/third_party/googletest' 2023-01-11T21:14:48.7922015Z http.https://github.com/.extraheader 2023-01-11T21:14:48.7954079Z Entering 'third_party/tensorpipe/third_party/libnop' 2023-01-11T21:14:48.7979174Z http.https://github.com/.extraheader 2023-01-11T21:14:48.8012002Z Entering 'third_party/tensorpipe/third_party/libuv' 2023-01-11T21:14:48.8036259Z http.https://github.com/.extraheader 2023-01-11T21:14:48.8069362Z Entering 'third_party/tensorpipe/third_party/pybind11' 2023-01-11T21:14:48.8094939Z http.https://github.com/.extraheader 2023-01-11T21:14:48.8127897Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2023-01-11T21:14:48.8152144Z http.https://github.com/.extraheader 2023-01-11T21:14:48.8188503Z Entering 'third_party/zstd' 2023-01-11T21:14:48.8214465Z http.https://github.com/.extraheader 2023-01-11T21:14:48.8513773Z Cleaning up orphan processes