2025-07-02T07:56:23.0924764Z Current runner version: '2.325.0'
2025-07-02T07:56:23.0952636Z ##[group]Operating System
2025-07-02T07:56:23.0953346Z Microsoft Windows Server 2022
2025-07-02T07:56:23.0953867Z 10.0.20348
2025-07-02T07:56:23.0954256Z Datacenter
2025-07-02T07:56:23.0954709Z ##[endgroup]
2025-07-02T07:56:23.0955128Z ##[group]Runner Image
2025-07-02T07:56:23.0955603Z Image: windows-2022
2025-07-02T07:56:23.0956078Z Version: 20250623.1.0
2025-07-02T07:56:23.0957020Z Included Software: https://github.com/actions/runner-images/blob/win22/20250623.1/images/windows/Windows2022-Readme.md
2025-07-02T07:56:23.0958347Z Image Release: https://github.com/actions/runner-images/releases/tag/win22%2F20250623.1
2025-07-02T07:56:23.0959138Z ##[endgroup]
2025-07-02T07:56:23.0959578Z ##[group]Runner Image Provisioner
2025-07-02T07:56:23.0960070Z 2.0.449.1
2025-07-02T07:56:23.0960467Z ##[endgroup]
2025-07-02T07:56:23.0961348Z ##[group]GITHUB_TOKEN Permissions
2025-07-02T07:56:23.0963698Z Contents: read
2025-07-02T07:56:23.0964219Z Metadata: read
2025-07-02T07:56:23.0964651Z ##[endgroup]
2025-07-02T07:56:23.0966795Z Secret source: Actions
2025-07-02T07:56:23.0967408Z Prepare workflow directory
2025-07-02T07:56:23.1338099Z Prepare all required actions
2025-07-02T07:56:23.1373641Z Getting action download info
2025-07-02T07:56:23.3973347Z ##[group]Download immutable action package 'actions/setup-python@v2'
2025-07-02T07:56:23.3974331Z Version: 2.3.4
2025-07-02T07:56:23.3975146Z Digest: sha256:ce653221798e6b321c1dc17af334e0a1f5f5523f5e7820aa165716f185e981c9
2025-07-02T07:56:23.3976197Z Source commit SHA: e9aba2c848f5ebd159c070c61ea2c4e2b122355e
2025-07-02T07:56:23.3976890Z ##[endgroup]
2025-07-02T07:56:23.9451006Z ##[group]Download immutable action package 'actions/checkout@v4'
2025-07-02T07:56:23.9451788Z Version: 4.2.2
2025-07-02T07:56:23.9452520Z Digest: sha256:ccb2698953eaebd21c7bf6268a94f9c26518a7e38e27e0b83c1fe1ad049819b1
2025-07-02T07:56:23.9453531Z Source commit SHA: 11bd71901bbe5b1630ceea73d27597364c9af683
2025-07-02T07:56:23.9454195Z ##[endgroup]
2025-07-02T07:56:24.0792216Z ##[group]Download immutable action package 'actions/upload-artifact@v4'
2025-07-02T07:56:24.0793036Z Version: 4.6.2
2025-07-02T07:56:24.0793759Z Digest: sha256:290722aa3281d5caf23d0acdc3dbeb3424786a1a01a9cc97e72f147225e37c38
2025-07-02T07:56:24.0794697Z Source commit SHA: ea165f8d65b6e75b540449e92b4886f43607fa02
2025-07-02T07:56:24.0795399Z ##[endgroup]
2025-07-02T07:56:24.4679163Z Complete job name: build-wheel-windows (3.12, 3.12)
2025-07-02T07:56:24.5604232Z ##[group]Run actions/setup-python@v2
2025-07-02T07:56:24.5605200Z with:
2025-07-02T07:56:24.5605569Z   python-version: 3.12
2025-07-02T07:56:24.5606178Z   token: ***
2025-07-02T07:56:24.5606714Z ##[endgroup]
2025-07-02T07:56:25.6995263Z Successfully setup CPython (3.12.10)
2025-07-02T07:56:25.7386741Z ##[group]Run actions/checkout@v4
2025-07-02T07:56:25.7387795Z with:
2025-07-02T07:56:25.7388527Z   repository: pytorch/rl
2025-07-02T07:56:25.7389648Z   token: ***
2025-07-02T07:56:25.7390406Z   ssh-strict: true
2025-07-02T07:56:25.7391174Z   ssh-user: git
2025-07-02T07:56:25.7391997Z   persist-credentials: true
2025-07-02T07:56:25.7392894Z   clean: true
2025-07-02T07:56:25.7393686Z   sparse-checkout-cone-mode: true
2025-07-02T07:56:25.7394677Z   fetch-depth: 1
2025-07-02T07:56:25.7395449Z   fetch-tags: false
2025-07-02T07:56:25.7396233Z   show-progress: true
2025-07-02T07:56:25.7397047Z   lfs: false
2025-07-02T07:56:25.7397805Z   submodules: false
2025-07-02T07:56:25.7398604Z   set-safe-directory: true
2025-07-02T07:56:25.7399459Z env:
2025-07-02T07:56:25.7400442Z   pythonLocation: C:\hostedtoolcache\windows\Python\3.12.10\x64
2025-07-02T07:56:25.7401716Z ##[endgroup]
2025-07-02T07:56:26.0353330Z Syncing repository: pytorch/rl
2025-07-02T07:56:26.0355815Z ##[group]Getting Git version info
2025-07-02T07:56:26.0356411Z Working directory is 'D:\a\rl\rl'
2025-07-02T07:56:26.1760982Z [command]"C:\Program Files\Git\bin\git.exe" version
2025-07-02T07:56:26.1975326Z git version 2.50.0.windows.1
2025-07-02T07:56:26.2389329Z ##[endgroup]
2025-07-02T07:56:26.2491533Z Temporarily overriding HOME='D:\a\_temp\3d40f6d5-ccac-47fa-a313-5b6c7a431bbc' before making global git config changes
2025-07-02T07:56:26.2492872Z Adding repository directory to the temporary git global config as a safe directory
2025-07-02T07:56:26.2504264Z [command]"C:\Program Files\Git\bin\git.exe" config --global --add safe.directory D:\a\rl\rl
2025-07-02T07:56:26.3436816Z Deleting the contents of 'D:\a\rl\rl'
2025-07-02T07:56:26.3442094Z ##[group]Initializing the repository
2025-07-02T07:56:26.3451618Z [command]"C:\Program Files\Git\bin\git.exe" init D:\a\rl\rl
2025-07-02T07:56:26.4398086Z Initialized empty Git repository in D:/a/rl/rl/.git/
2025-07-02T07:56:26.4431323Z [command]"C:\Program Files\Git\bin\git.exe" remote add origin https://github.com/pytorch/rl
2025-07-02T07:56:26.5160097Z ##[endgroup]
2025-07-02T07:56:26.5160796Z ##[group]Disabling automatic garbage collection
2025-07-02T07:56:26.5175212Z [command]"C:\Program Files\Git\bin\git.exe" config --local gc.auto 0
2025-07-02T07:56:26.5391075Z ##[endgroup]
2025-07-02T07:56:26.5391730Z ##[group]Setting up auth
2025-07-02T07:56:26.5405408Z [command]"C:\Program Files\Git\bin\git.exe" config --local --name-only --get-regexp core\.sshCommand
2025-07-02T07:56:26.5644527Z [command]"C:\Program Files\Git\bin\git.exe" submodule foreach --recursive "sh -c \"git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :\""
2025-07-02T07:56:28.4492217Z [command]"C:\Program Files\Git\bin\git.exe" config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-07-02T07:56:28.4717682Z [command]"C:\Program Files\Git\bin\git.exe" submodule foreach --recursive "sh -c \"git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :\""
2025-07-02T07:56:28.8782110Z [command]"C:\Program Files\Git\bin\git.exe" config --local http.https://github.com/.extraheader "AUTHORIZATION: basic ***"
2025-07-02T07:56:28.9014676Z ##[endgroup]
2025-07-02T07:56:28.9015052Z ##[group]Fetching the repository
2025-07-02T07:56:28.9028223Z [command]"C:\Program Files\Git\bin\git.exe" -c protocol.version=2 fetch --no-tags --prune --no-recurse-submodules --depth=1 origin +2e8d943922590c2356bc44a7af6da18a8d68787e:refs/remotes/pull/3030/merge
2025-07-02T07:56:30.6596013Z From https://github.com/pytorch/rl
2025-07-02T07:56:30.6597115Z  * [new ref]         2e8d943922590c2356bc44a7af6da18a8d68787e -> pull/3030/merge
2025-07-02T07:56:30.6984784Z ##[endgroup]
2025-07-02T07:56:30.6985724Z ##[group]Determining the checkout info
2025-07-02T07:56:30.6988980Z ##[endgroup]
2025-07-02T07:56:30.7001580Z [command]"C:\Program Files\Git\bin\git.exe" sparse-checkout disable
2025-07-02T07:56:30.7788659Z [command]"C:\Program Files\Git\bin\git.exe" config --local --unset-all extensions.worktreeConfig
2025-07-02T07:56:30.8046641Z ##[group]Checking out the ref
2025-07-02T07:56:30.8060273Z [command]"C:\Program Files\Git\bin\git.exe" checkout --progress --force refs/remotes/pull/3030/merge
2025-07-02T07:56:31.1079680Z Note: switching to 'refs/remotes/pull/3030/merge'.
2025-07-02T07:56:31.1080133Z 
2025-07-02T07:56:31.1080500Z You are in 'detached HEAD' state. You can look around, make experimental
2025-07-02T07:56:31.1081367Z changes and commit them, and you can discard any commits you make in this
2025-07-02T07:56:31.1082178Z state without impacting any branches by switching back to a branch.
2025-07-02T07:56:31.1082642Z 
2025-07-02T07:56:31.1082934Z If you want to create a new branch to retain commits you create, you may
2025-07-02T07:56:31.1083665Z do so (now or later) by using -c with the switch command. Example:
2025-07-02T07:56:31.1084060Z 
2025-07-02T07:56:31.1084236Z   git switch -c <new-branch-name>
2025-07-02T07:56:31.1084524Z 
2025-07-02T07:56:31.1084662Z Or undo this operation with:
2025-07-02T07:56:31.1086275Z 
2025-07-02T07:56:31.1086413Z   git switch -
2025-07-02T07:56:31.1086641Z 
2025-07-02T07:56:31.1087133Z Turn off this advice by setting config variable advice.detachedHead to false
2025-07-02T07:56:31.1087652Z 
2025-07-02T07:56:31.1088215Z HEAD is now at 2e8d943 Merge 995ff0d9fa6d4cdbe0120a55642106276bf80342 into 773c366c7b29f5ea26de0215119fb15055714525
2025-07-02T07:56:31.1127995Z ##[endgroup]
2025-07-02T07:56:31.1557965Z [command]"C:\Program Files\Git\bin\git.exe" log -1 --format=%H
2025-07-02T07:56:31.1792126Z 2e8d943922590c2356bc44a7af6da18a8d68787e
2025-07-02T07:56:31.2052690Z ##[group]Run python3 -mpip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cpu -U
2025-07-02T07:56:31.2053712Z python3 -mpip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cpu -U
2025-07-02T07:56:31.2069341Z shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
2025-07-02T07:56:31.2069689Z env:
2025-07-02T07:56:31.2069951Z   pythonLocation: C:\hostedtoolcache\windows\Python\3.12.10\x64
2025-07-02T07:56:31.2070233Z ##[endgroup]
2025-07-02T07:56:53.0345046Z Looking in indexes: https://download.pytorch.org/whl/nightly/cpu
2025-07-02T07:56:53.5468317Z Collecting torch
2025-07-02T07:56:53.5543555Z   Downloading https://download.pytorch.org/whl/nightly/cpu/torch-2.9.0.dev20250701%2Bcpu-cp312-cp312-win_amd64.whl.metadata (29 kB)
2025-07-02T07:56:53.6066157Z Collecting filelock (from torch)
2025-07-02T07:56:53.6123094Z   Downloading https://download.pytorch.org/whl/nightly/filelock-3.18.0-py3-none-any.whl.metadata (2.9 kB)
2025-07-02T07:56:53.6600329Z Collecting typing-extensions>=4.10.0 (from torch)
2025-07-02T07:56:53.6655339Z   Downloading https://download.pytorch.org/whl/nightly/typing_extensions-4.14.0-py3-none-any.whl.metadata (3.0 kB)
2025-07-02T07:56:53.7325641Z Collecting sympy>=1.13.3 (from torch)
2025-07-02T07:56:53.7380788Z   Downloading https://download.pytorch.org/whl/nightly/sympy-1.14.0-py3-none-any.whl.metadata (12 kB)
2025-07-02T07:56:53.8087567Z Collecting networkx (from torch)
2025-07-02T07:56:53.8144369Z   Downloading https://download.pytorch.org/whl/nightly/networkx-3.5-py3-none-any.whl.metadata (6.3 kB)
2025-07-02T07:56:53.9226421Z Collecting jinja2 (from torch)
2025-07-02T07:56:53.9356476Z   Downloading https://download.pytorch.org/whl/nightly/jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB)
2025-07-02T07:56:53.9897859Z Collecting fsspec (from torch)
2025-07-02T07:56:54.0033721Z   Downloading https://download.pytorch.org/whl/nightly/fsspec-2025.5.1-py3-none-any.whl.metadata (11 kB)
2025-07-02T07:56:54.0890128Z Collecting setuptools (from torch)
2025-07-02T07:56:54.0947764Z   Downloading https://download.pytorch.org/whl/nightly/setuptools-78.1.0-py3-none-any.whl.metadata (6.6 kB)
2025-07-02T07:56:54.1428486Z Collecting mpmath<1.4,>=1.1.0 (from sympy>=1.13.3->torch)
2025-07-02T07:56:54.1488363Z   Downloading https://download.pytorch.org/whl/nightly/mpmath-1.3.0-py3-none-any.whl (536 kB)
2025-07-02T07:56:54.1660138Z      ------------------------------------- 536.2/536.2 kB 17.1 MB/s eta 0:00:00
2025-07-02T07:56:54.2226841Z Collecting MarkupSafe>=2.0 (from jinja2->torch)
2025-07-02T07:56:54.2294463Z   Downloading https://download.pytorch.org/whl/nightly/MarkupSafe-2.1.5-cp312-cp312-win_amd64.whl (17 kB)
2025-07-02T07:56:54.2522052Z Downloading https://download.pytorch.org/whl/nightly/cpu/torch-2.9.0.dev20250701%2Bcpu-cp312-cp312-win_amd64.whl (619.5 MB)
2025-07-02T07:57:03.9951332Z    --------------------------------------- 619.5/619.5 MB 30.1 MB/s eta 0:00:00
2025-07-02T07:57:04.0689390Z Downloading https://download.pytorch.org/whl/nightly/sympy-1.14.0-py3-none-any.whl (6.3 MB)
2025-07-02T07:57:04.4644664Z    ---------------------------------------- 6.3/6.3 MB 15.4 MB/s eta 0:00:00
2025-07-02T07:57:04.4700953Z Downloading https://download.pytorch.org/whl/nightly/typing_extensions-4.14.0-py3-none-any.whl (43 kB)
2025-07-02T07:57:04.9925021Z Downloading https://download.pytorch.org/whl/nightly/filelock-3.18.0-py3-none-any.whl (16 kB)
2025-07-02T07:57:05.0414656Z Downloading https://download.pytorch.org/whl/nightly/fsspec-2025.5.1-py3-none-any.whl (199 kB)
2025-07-02T07:57:05.0748415Z Downloading https://download.pytorch.org/whl/nightly/jinja2-3.1.6-py3-none-any.whl (134 kB)
2025-07-02T07:57:05.1009581Z Downloading https://download.pytorch.org/whl/nightly/networkx-3.5-py3-none-any.whl (2.0 MB)
2025-07-02T07:57:05.1243098Z    ---------------------------------------- 2.0/2.0 MB 118.2 MB/s eta 0:00:00
2025-07-02T07:57:05.1305564Z Downloading https://download.pytorch.org/whl/nightly/setuptools-78.1.0-py3-none-any.whl (1.3 MB)
2025-07-02T07:57:05.1529659Z    ---------------------------------------- 1.3/1.3 MB 66.3 MB/s eta 0:00:00
2025-07-02T07:57:05.9848657Z Installing collected packages: mpmath, typing-extensions, sympy, setuptools, networkx, MarkupSafe, fsspec, filelock, jinja2, torch
2025-07-02T07:58:44.4283295Z 
2025-07-02T07:58:44.4302737Z Successfully installed MarkupSafe-2.1.5 filelock-3.18.0 fsspec-2025.5.1 jinja2-3.1.6 mpmath-1.3.0 networkx-3.5 setuptools-78.1.0 sympy-1.14.0 torch-2.9.0.dev20250701+cpu typing-extensions-4.14.0
2025-07-02T07:58:44.6229184Z ##[group]Run rm -r dist || true
2025-07-02T07:58:44.6229579Z rm -r dist || true
2025-07-02T07:58:44.6229843Z python3 -mpip install wheel
2025-07-02T07:58:44.6230144Z python3 setup.py bdist_wheel \
2025-07-02T07:58:44.6230428Z   --package_name torchrl-nightly \
2025-07-02T07:58:44.6230723Z   --python-tag=
2025-07-02T07:58:44.6243145Z shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
2025-07-02T07:58:44.6243531Z env:
2025-07-02T07:58:44.6243798Z   pythonLocation: C:\hostedtoolcache\windows\Python\3.12.10\x64
2025-07-02T07:58:44.6244145Z ##[endgroup]
2025-07-02T07:58:44.6727774Z rm: cannot remove 'dist': No such file or directory
2025-07-02T07:58:46.1577710Z Collecting wheel
2025-07-02T07:58:46.1786247Z   Downloading wheel-0.45.1-py3-none-any.whl.metadata (2.3 kB)
2025-07-02T07:58:46.1965167Z Downloading wheel-0.45.1-py3-none-any.whl (72 kB)
2025-07-02T07:58:46.2632424Z Installing collected packages: wheel
2025-07-02T07:58:46.3811742Z Successfully installed wheel-0.45.1
2025-07-02T07:58:49.2563397Z C:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\torch\_subclasses\functional_tensor.py:279: UserWarning: Failed to initialize NumPy: No module named 'numpy' (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\torch\csrc\utils\tensor_numpy.cpp:81.)
2025-07-02T07:58:49.2565629Z   cpu = _conversion_method_template(device=torch.device("cpu"))
2025-07-02T07:58:50.2553827Z C:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\setuptools\dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
2025-07-02T07:58:50.2555201Z !!
2025-07-02T07:58:50.2555736Z 
2025-07-02T07:58:50.2556055Z         ********************************************************************************
2025-07-02T07:58:50.2557088Z         Please consider removing the following classifiers in favor of a SPDX license expression:
2025-07-02T07:58:50.2557712Z 
2025-07-02T07:58:50.2558180Z         License :: OSI Approved :: MIT License
2025-07-02T07:58:50.2558721Z         License :: OSI Approved :: BSD License
2025-07-02T07:58:50.2558960Z 
2025-07-02T07:58:50.2559295Z         See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-07-02T07:58:50.2559820Z         ********************************************************************************
2025-07-02T07:58:50.2560022Z 
2025-07-02T07:58:50.2560100Z !!
2025-07-02T07:58:50.2560329Z   self._finalize_license_expression()
2025-07-02T07:58:50.2872213Z INFO:root:running bdist_wheel
2025-07-02T07:58:50.5011603Z INFO:root:running build
2025-07-02T07:58:50.5012225Z INFO:root:running build_py
2025-07-02T07:58:50.5062257Z INFO:root:creating build\lib.win-amd64-cpython-312\build_tools
2025-07-02T07:58:50.5067227Z INFO:root:copying build_tools\__init__.py -> build\lib.win-amd64-cpython-312\build_tools
2025-07-02T07:58:50.5073202Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl
2025-07-02T07:58:50.5075768Z INFO:root:copying torchrl\version.py -> build\lib.win-amd64-cpython-312\torchrl
2025-07-02T07:58:50.5080437Z INFO:root:copying torchrl\_extension.py -> build\lib.win-amd64-cpython-312\torchrl
2025-07-02T07:58:50.5085208Z INFO:root:copying torchrl\_utils.py -> build\lib.win-amd64-cpython-312\torchrl
2025-07-02T07:58:50.5090775Z INFO:root:copying torchrl\__init__.py -> build\lib.win-amd64-cpython-312\torchrl
2025-07-02T07:58:50.5096402Z INFO:root:creating build\lib.win-amd64-cpython-312\build_tools\setup_helpers
2025-07-02T07:58:50.5099116Z INFO:root:copying build_tools\setup_helpers\extension.py -> build\lib.win-amd64-cpython-312\build_tools\setup_helpers
2025-07-02T07:58:50.5103860Z INFO:root:copying build_tools\setup_helpers\__init__.py -> build\lib.win-amd64-cpython-312\build_tools\setup_helpers
2025-07-02T07:58:50.5109263Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\collectors
2025-07-02T07:58:50.5113706Z INFO:root:copying torchrl\collectors\collectors.py -> build\lib.win-amd64-cpython-312\torchrl\collectors
2025-07-02T07:58:50.5118685Z INFO:root:copying torchrl\collectors\utils.py -> build\lib.win-amd64-cpython-312\torchrl\collectors
2025-07-02T07:58:50.5123294Z INFO:root:copying torchrl\collectors\weight_update.py -> build\lib.win-amd64-cpython-312\torchrl\collectors
2025-07-02T07:58:50.5128204Z INFO:root:copying torchrl\collectors\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\collectors
2025-07-02T07:58:50.5133884Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\data
2025-07-02T07:58:50.5136482Z INFO:root:copying torchrl\data\rlhf.py -> build\lib.win-amd64-cpython-312\torchrl\data
2025-07-02T07:58:50.5141210Z INFO:root:copying torchrl\data\tensor_specs.py -> build\lib.win-amd64-cpython-312\torchrl\data
2025-07-02T07:58:50.5147846Z INFO:root:copying torchrl\data\utils.py -> build\lib.win-amd64-cpython-312\torchrl\data
2025-07-02T07:58:50.5152565Z INFO:root:copying torchrl\data\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\data
2025-07-02T07:58:50.5158995Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5164766Z INFO:root:copying torchrl\envs\async_envs.py -> build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5169982Z INFO:root:copying torchrl\envs\batched_envs.py -> build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5175860Z INFO:root:copying torchrl\envs\common.py -> build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5181946Z INFO:root:copying torchrl\envs\env_creator.py -> build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5186624Z INFO:root:copying torchrl\envs\gym_like.py -> build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5191639Z INFO:root:copying torchrl\envs\utils.py -> build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5196995Z INFO:root:copying torchrl\envs\vec_envs.py -> build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5204553Z INFO:root:copying torchrl\envs\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs
2025-07-02T07:58:50.5210135Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules
2025-07-02T07:58:50.5212711Z INFO:root:copying torchrl\modules\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules
2025-07-02T07:58:50.5219508Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5222005Z INFO:root:copying torchrl\objectives\a2c.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5227150Z INFO:root:copying torchrl\objectives\common.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5232528Z INFO:root:copying torchrl\objectives\cql.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5237862Z INFO:root:copying torchrl\objectives\crossq.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5242964Z INFO:root:copying torchrl\objectives\ddpg.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5248260Z INFO:root:copying torchrl\objectives\decision_transformer.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5252892Z INFO:root:copying torchrl\objectives\deprecated.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5260748Z INFO:root:copying torchrl\objectives\dqn.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5265853Z INFO:root:copying torchrl\objectives\dreamer.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5270828Z INFO:root:copying torchrl\objectives\functional.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5275455Z INFO:root:copying torchrl\objectives\gail.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5280124Z INFO:root:copying torchrl\objectives\iql.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5287347Z INFO:root:copying torchrl\objectives\ppo.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5292090Z INFO:root:copying torchrl\objectives\redq.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5297012Z INFO:root:copying torchrl\objectives\reinforce.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5301945Z INFO:root:copying torchrl\objectives\sac.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5307335Z INFO:root:copying torchrl\objectives\td3.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5312691Z INFO:root:copying torchrl\objectives\td3_bc.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5317709Z INFO:root:copying torchrl\objectives\utils.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5322630Z INFO:root:copying torchrl\objectives\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\objectives
2025-07-02T07:58:50.5328169Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\record
2025-07-02T07:58:50.5330810Z INFO:root:copying torchrl\record\recorder.py -> build\lib.win-amd64-cpython-312\torchrl\record
2025-07-02T07:58:50.5335784Z INFO:root:copying torchrl\record\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\record
2025-07-02T07:58:50.5341067Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\trainers
2025-07-02T07:58:50.5343726Z INFO:root:copying torchrl\trainers\trainers.py -> build\lib.win-amd64-cpython-312\torchrl\trainers
2025-07-02T07:58:50.5349078Z INFO:root:copying torchrl\trainers\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\trainers
2025-07-02T07:58:50.5354990Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\collectors\distributed
2025-07-02T07:58:50.5357721Z INFO:root:copying torchrl\collectors\distributed\default_configs.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\distributed
2025-07-02T07:58:50.5362502Z INFO:root:copying torchrl\collectors\distributed\generic.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\distributed
2025-07-02T07:58:50.5367556Z INFO:root:copying torchrl\collectors\distributed\ray.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\distributed
2025-07-02T07:58:50.5372603Z INFO:root:copying torchrl\collectors\distributed\rpc.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\distributed
2025-07-02T07:58:50.5377652Z INFO:root:copying torchrl\collectors\distributed\sync.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\distributed
2025-07-02T07:58:50.5382677Z INFO:root:copying torchrl\collectors\distributed\utils.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\distributed
2025-07-02T07:58:50.5387256Z INFO:root:copying torchrl\collectors\distributed\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\distributed
2025-07-02T07:58:50.5396412Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\collectors\llm
2025-07-02T07:58:50.5399026Z INFO:root:copying torchrl\collectors\llm\base.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\llm
2025-07-02T07:58:50.5404424Z INFO:root:copying torchrl\collectors\llm\ray_collector.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\llm
2025-07-02T07:58:50.5409071Z INFO:root:copying torchrl\collectors\llm\utils.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\llm
2025-07-02T07:58:50.5413651Z INFO:root:copying torchrl\collectors\llm\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\llm
2025-07-02T07:58:50.5418969Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\collectors\llm\weight_update
2025-07-02T07:58:50.5421643Z INFO:root:copying torchrl\collectors\llm\weight_update\vllm.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\llm\weight_update
2025-07-02T07:58:50.5426377Z INFO:root:copying torchrl\collectors\llm\weight_update\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\collectors\llm\weight_update
2025-07-02T07:58:50.5432177Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5434873Z INFO:root:copying torchrl\data\datasets\atari_dqn.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5440001Z INFO:root:copying torchrl\data\datasets\common.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5444687Z INFO:root:copying torchrl\data\datasets\d4rl.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5449681Z INFO:root:copying torchrl\data\datasets\d4rl_infos.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5454623Z INFO:root:copying torchrl\data\datasets\gen_dgrl.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5459364Z INFO:root:copying torchrl\data\datasets\minari_data.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5464331Z INFO:root:copying torchrl\data\datasets\openml.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5473909Z INFO:root:copying torchrl\data\datasets\openx.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5479104Z INFO:root:copying torchrl\data\datasets\roboset.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5484013Z INFO:root:copying torchrl\data\datasets\utils.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5488481Z INFO:root:copying torchrl\data\datasets\vd4rl.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5493445Z INFO:root:copying torchrl\data\datasets\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\data\datasets
2025-07-02T07:58:50.5499886Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5502427Z INFO:root:copying torchrl\data\llm\chat.py -> build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5507886Z INFO:root:copying torchrl\data\llm\common.py -> build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5512500Z INFO:root:copying torchrl\data\llm\dataset.py -> build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5517483Z INFO:root:copying torchrl\data\llm\prompt.py -> build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5522155Z INFO:root:copying torchrl\data\llm\reward.py -> build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5526795Z INFO:root:copying torchrl\data\llm\topk.py -> build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5531431Z INFO:root:copying torchrl\data\llm\utils.py -> build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5550768Z INFO:root:copying torchrl\data\llm\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\data\llm
2025-07-02T07:58:50.5556519Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\data\map
2025-07-02T07:58:50.5562056Z INFO:root:copying torchrl\data\map\hash.py -> build\lib.win-amd64-cpython-312\torchrl\data\map
2025-07-02T07:58:50.5566806Z INFO:root:copying torchrl\data\map\query.py -> build\lib.win-amd64-cpython-312\torchrl\data\map
2025-07-02T07:58:50.5571421Z INFO:root:copying torchrl\data\map\tdstorage.py -> build\lib.win-amd64-cpython-312\torchrl\data\map
2025-07-02T07:58:50.5577121Z INFO:root:copying torchrl\data\map\tree.py -> build\lib.win-amd64-cpython-312\torchrl\data\map
2025-07-02T07:58:50.5582476Z INFO:root:copying torchrl\data\map\utils.py -> build\lib.win-amd64-cpython-312\torchrl\data\map
2025-07-02T07:58:50.5587066Z INFO:root:copying torchrl\data\map\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\data\map
2025-07-02T07:58:50.5592442Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\data\postprocs
2025-07-02T07:58:50.5595115Z INFO:root:copying torchrl\data\postprocs\postprocs.py -> build\lib.win-amd64-cpython-312\torchrl\data\postprocs
2025-07-02T07:58:50.5599841Z INFO:root:copying torchrl\data\postprocs\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\data\postprocs
2025-07-02T07:58:50.5605785Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5608336Z INFO:root:copying torchrl\data\replay_buffers\checkpointers.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5613141Z INFO:root:copying torchrl\data\replay_buffers\ray_buffer.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5617880Z INFO:root:copying torchrl\data\replay_buffers\replay_buffers.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5623445Z INFO:root:copying torchrl\data\replay_buffers\samplers.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5630117Z INFO:root:copying torchrl\data\replay_buffers\scheduler.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5634668Z INFO:root:copying torchrl\data\replay_buffers\storages.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5643290Z INFO:root:copying torchrl\data\replay_buffers\utils.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5648344Z INFO:root:copying torchrl\data\replay_buffers\writers.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5653324Z INFO:root:copying torchrl\data\replay_buffers\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers
2025-07-02T07:58:50.5659006Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\custom
2025-07-02T07:58:50.5661639Z INFO:root:copying torchrl\envs\custom\chess.py -> build\lib.win-amd64-cpython-312\torchrl\envs\custom
2025-07-02T07:58:50.5666661Z INFO:root:copying torchrl\envs\custom\llm.py -> build\lib.win-amd64-cpython-312\torchrl\envs\custom
2025-07-02T07:58:50.5671386Z INFO:root:copying torchrl\envs\custom\pendulum.py -> build\lib.win-amd64-cpython-312\torchrl\envs\custom
2025-07-02T07:58:50.5676409Z INFO:root:copying torchrl\envs\custom\tictactoeenv.py -> build\lib.win-amd64-cpython-312\torchrl\envs\custom
2025-07-02T07:58:50.5681992Z INFO:root:copying torchrl\envs\custom\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\custom
2025-07-02T07:58:50.5688498Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5690976Z INFO:root:copying torchrl\envs\libs\brax.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5696080Z INFO:root:copying torchrl\envs\libs\dm_control.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5701105Z INFO:root:copying torchrl\envs\libs\envpool.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5705975Z INFO:root:copying torchrl\envs\libs\gym.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5711533Z INFO:root:copying torchrl\envs\libs\habitat.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5716536Z INFO:root:copying torchrl\envs\libs\isaacgym.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5721292Z INFO:root:copying torchrl\envs\libs\isaac_lab.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5730456Z INFO:root:copying torchrl\envs\libs\jax_utils.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5734974Z INFO:root:copying torchrl\envs\libs\jumanji.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5740268Z INFO:root:copying torchrl\envs\libs\meltingpot.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5745292Z INFO:root:copying torchrl\envs\libs\openml.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5749888Z INFO:root:copying torchrl\envs\libs\openspiel.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5754869Z INFO:root:copying torchrl\envs\libs\pettingzoo.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5760011Z INFO:root:copying torchrl\envs\libs\robohive.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5765198Z INFO:root:copying torchrl\envs\libs\smacv2.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5769817Z INFO:root:copying torchrl\envs\libs\unity_mlagents.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5775001Z INFO:root:copying torchrl\envs\libs\utils.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5779611Z INFO:root:copying torchrl\envs\libs\vmas.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5785778Z INFO:root:copying torchrl\envs\libs\_gym_utils.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5790358Z INFO:root:copying torchrl\envs\libs\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\libs
2025-07-02T07:58:50.5795980Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\llm
2025-07-02T07:58:50.5798587Z INFO:root:copying torchrl\envs\llm\chat.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm
2025-07-02T07:58:50.5803567Z INFO:root:copying torchrl\envs\llm\envs.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm
2025-07-02T07:58:50.5808595Z INFO:root:copying torchrl\envs\llm\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm
2025-07-02T07:58:50.5814153Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\model_based
2025-07-02T07:58:50.5816787Z INFO:root:copying torchrl\envs\model_based\common.py -> build\lib.win-amd64-cpython-312\torchrl\envs\model_based
2025-07-02T07:58:50.5821507Z INFO:root:copying torchrl\envs\model_based\dreamer.py -> build\lib.win-amd64-cpython-312\torchrl\envs\model_based
2025-07-02T07:58:50.5826173Z INFO:root:copying torchrl\envs\model_based\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\model_based
2025-07-02T07:58:50.5832037Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5834612Z INFO:root:copying torchrl\envs\transforms\functional.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5839335Z INFO:root:copying torchrl\envs\transforms\gym_transforms.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5843847Z INFO:root:copying torchrl\envs\transforms\llm.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5849143Z INFO:root:copying torchrl\envs\transforms\r3m.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5854179Z INFO:root:copying torchrl\envs\transforms\rb_transforms.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5858749Z INFO:root:copying torchrl\envs\transforms\rlhf.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5863191Z INFO:root:copying torchrl\envs\transforms\transforms.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5874991Z INFO:root:copying torchrl\envs\transforms\utils.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5879752Z INFO:root:copying torchrl\envs\transforms\vc1.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5884277Z INFO:root:copying torchrl\envs\transforms\vecnorm.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5889373Z INFO:root:copying torchrl\envs\transforms\vip.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5894036Z INFO:root:copying torchrl\envs\transforms\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\transforms
2025-07-02T07:58:50.5899682Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\llm\datasets
2025-07-02T07:58:50.5902260Z INFO:root:copying torchrl\envs\llm\datasets\gsm8k.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\datasets
2025-07-02T07:58:50.5906985Z INFO:root:copying torchrl\envs\llm\datasets\ifeval.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\datasets
2025-07-02T07:58:50.5912082Z INFO:root:copying torchrl\envs\llm\datasets\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\datasets
2025-07-02T07:58:50.5917046Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\llm\libs
2025-07-02T07:58:50.5919613Z INFO:root:copying torchrl\envs\llm\libs\mlgym.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\libs
2025-07-02T07:58:50.5924690Z INFO:root:copying torchrl\envs\llm\libs\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\libs
2025-07-02T07:58:50.5929975Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward
2025-07-02T07:58:50.5932550Z INFO:root:copying torchrl\envs\llm\reward\gsm8k.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward
2025-07-02T07:58:50.5937525Z INFO:root:copying torchrl\envs\llm\reward\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward
2025-07-02T07:58:50.5943437Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5949013Z INFO:root:copying torchrl\envs\llm\transforms\browser.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5954504Z INFO:root:copying torchrl\envs\llm\transforms\dataloading.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5959607Z INFO:root:copying torchrl\envs\llm\transforms\format.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5964242Z INFO:root:copying torchrl\envs\llm\transforms\kl.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5969652Z INFO:root:copying torchrl\envs\llm\transforms\policy_version.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5974303Z INFO:root:copying torchrl\envs\llm\transforms\reason.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5979073Z INFO:root:copying torchrl\envs\llm\transforms\tokenizer.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5986593Z INFO:root:copying torchrl\envs\llm\transforms\tools.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5991650Z INFO:root:copying torchrl\envs\llm\transforms\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms
2025-07-02T07:58:50.5997615Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval
2025-07-02T07:58:50.6000343Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_instructions.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval
2025-07-02T07:58:50.6005782Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_instructions_main.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval
2025-07-02T07:58:50.6010626Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_instructions_registry.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval
2025-07-02T07:58:50.6015331Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_instructions_util.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval
2025-07-02T07:58:50.6020387Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_scorer.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval
2025-07-02T07:58:50.6025141Z INFO:root:copying torchrl\envs\llm\reward\ifeval\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval
2025-07-02T07:58:50.6033227Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules\distributions
2025-07-02T07:58:50.6035948Z INFO:root:copying torchrl\modules\distributions\continuous.py -> build\lib.win-amd64-cpython-312\torchrl\modules\distributions
2025-07-02T07:58:50.6041057Z INFO:root:copying torchrl\modules\distributions\discrete.py -> build\lib.win-amd64-cpython-312\torchrl\modules\distributions
2025-07-02T07:58:50.6046130Z INFO:root:copying torchrl\modules\distributions\truncated_normal.py -> build\lib.win-amd64-cpython-312\torchrl\modules\distributions
2025-07-02T07:58:50.6051140Z INFO:root:copying torchrl\modules\distributions\utils.py -> build\lib.win-amd64-cpython-312\torchrl\modules\distributions
2025-07-02T07:58:50.6055474Z INFO:root:copying torchrl\modules\distributions\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules\distributions
2025-07-02T07:58:50.6060820Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules\llm
2025-07-02T07:58:50.6063371Z INFO:root:copying torchrl\modules\llm\utils.py -> build\lib.win-amd64-cpython-312\torchrl\modules\llm
2025-07-02T07:58:50.6068023Z INFO:root:copying torchrl\modules\llm\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules\llm
2025-07-02T07:58:50.6074063Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6076721Z INFO:root:copying torchrl\modules\models\batchrenorm.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6081472Z INFO:root:copying torchrl\modules\models\decision_transformer.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6086034Z INFO:root:copying torchrl\modules\models\exploration.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6091029Z INFO:root:copying torchrl\modules\models\llm.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6096555Z INFO:root:copying torchrl\modules\models\models.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6103549Z INFO:root:copying torchrl\modules\models\model_based.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6108496Z INFO:root:copying torchrl\modules\models\multiagent.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6116415Z INFO:root:copying torchrl\modules\models\rlhf.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6120815Z INFO:root:copying torchrl\modules\models\utils.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6125404Z INFO:root:copying torchrl\modules\models\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules\models
2025-07-02T07:58:50.6131989Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules\planners
2025-07-02T07:58:50.6134647Z INFO:root:copying torchrl\modules\planners\cem.py -> build\lib.win-amd64-cpython-312\torchrl\modules\planners
2025-07-02T07:58:50.6141871Z INFO:root:copying torchrl\modules\planners\common.py -> build\lib.win-amd64-cpython-312\torchrl\modules\planners
2025-07-02T07:58:50.6144425Z INFO:root:copying torchrl\modules\planners\mppi.py -> build\lib.win-amd64-cpython-312\torchrl\modules\planners
2025-07-02T07:58:50.6149049Z INFO:root:copying torchrl\modules\planners\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules\planners
2025-07-02T07:58:50.6154842Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6157496Z INFO:root:copying torchrl\modules\tensordict_module\actors.py -> build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6163190Z INFO:root:copying torchrl\modules\tensordict_module\common.py -> build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6168163Z INFO:root:copying torchrl\modules\tensordict_module\exploration.py -> build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6184802Z INFO:root:copying torchrl\modules\tensordict_module\probabilistic.py -> build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6189764Z INFO:root:copying torchrl\modules\tensordict_module\rnn.py -> build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6195172Z INFO:root:copying torchrl\modules\tensordict_module\sequence.py -> build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6199935Z INFO:root:copying torchrl\modules\tensordict_module\world_models.py -> build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6207937Z INFO:root:copying torchrl\modules\tensordict_module\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module
2025-07-02T07:58:50.6213081Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules\utils
2025-07-02T07:58:50.6217871Z INFO:root:copying torchrl\modules\utils\mappings.py -> build\lib.win-amd64-cpython-312\torchrl\modules\utils
2025-07-02T07:58:50.6222324Z INFO:root:copying torchrl\modules\utils\utils.py -> build\lib.win-amd64-cpython-312\torchrl\modules\utils
2025-07-02T07:58:50.6226972Z INFO:root:copying torchrl\modules\utils\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules\utils
2025-07-02T07:58:50.6232532Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules\llm\backends
2025-07-02T07:58:50.6235139Z INFO:root:copying torchrl\modules\llm\backends\vllm.py -> build\lib.win-amd64-cpython-312\torchrl\modules\llm\backends
2025-07-02T07:58:50.6239883Z INFO:root:copying torchrl\modules\llm\backends\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules\llm\backends
2025-07-02T07:58:50.6245397Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies
2025-07-02T07:58:50.6248249Z INFO:root:copying torchrl\modules\llm\policies\common.py -> build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies
2025-07-02T07:58:50.6254770Z INFO:root:copying torchrl\modules\llm\policies\transformers_wrapper.py -> build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies
2025-07-02T07:58:50.6260392Z INFO:root:copying torchrl\modules\llm\policies\vllm_wrapper.py -> build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies
2025-07-02T07:58:50.6265912Z INFO:root:copying torchrl\modules\llm\policies\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies
2025-07-02T07:58:50.6271133Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\objectives\llm
2025-07-02T07:58:50.6273730Z INFO:root:copying torchrl\objectives\llm\grpo.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\llm
2025-07-02T07:58:50.6278863Z INFO:root:copying torchrl\objectives\llm\sft.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\llm
2025-07-02T07:58:50.6283840Z INFO:root:copying torchrl\objectives\llm\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\llm
2025-07-02T07:58:50.6289159Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\objectives\multiagent
2025-07-02T07:58:50.6291753Z INFO:root:copying torchrl\objectives\multiagent\qmixer.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\multiagent
2025-07-02T07:58:50.6296804Z INFO:root:copying torchrl\objectives\multiagent\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\multiagent
2025-07-02T07:58:50.6302203Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\objectives\value
2025-07-02T07:58:50.6304890Z INFO:root:copying torchrl\objectives\value\advantages.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\value
2025-07-02T07:58:50.6310548Z INFO:root:copying torchrl\objectives\value\functional.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\value
2025-07-02T07:58:50.6315741Z INFO:root:copying torchrl\objectives\value\utils.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\value
2025-07-02T07:58:50.6320412Z INFO:root:copying torchrl\objectives\value\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\objectives\value
2025-07-02T07:58:50.6326094Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\record\loggers
2025-07-02T07:58:50.6328611Z INFO:root:copying torchrl\record\loggers\common.py -> build\lib.win-amd64-cpython-312\torchrl\record\loggers
2025-07-02T07:58:50.6333272Z INFO:root:copying torchrl\record\loggers\csv.py -> build\lib.win-amd64-cpython-312\torchrl\record\loggers
2025-07-02T07:58:50.6337986Z INFO:root:copying torchrl\record\loggers\mlflow.py -> build\lib.win-amd64-cpython-312\torchrl\record\loggers
2025-07-02T07:58:50.6342830Z INFO:root:copying torchrl\record\loggers\tensorboard.py -> build\lib.win-amd64-cpython-312\torchrl\record\loggers
2025-07-02T07:58:50.6347954Z INFO:root:copying torchrl\record\loggers\utils.py -> build\lib.win-amd64-cpython-312\torchrl\record\loggers
2025-07-02T07:58:50.6352140Z INFO:root:copying torchrl\record\loggers\wandb.py -> build\lib.win-amd64-cpython-312\torchrl\record\loggers
2025-07-02T07:58:50.6356649Z INFO:root:copying torchrl\record\loggers\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\record\loggers
2025-07-02T07:58:50.6365378Z INFO:root:creating build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6368009Z INFO:root:copying torchrl\trainers\helpers\collectors.py -> build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6373007Z INFO:root:copying torchrl\trainers\helpers\envs.py -> build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6378058Z INFO:root:copying torchrl\trainers\helpers\logger.py -> build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6382615Z INFO:root:copying torchrl\trainers\helpers\losses.py -> build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6387228Z INFO:root:copying torchrl\trainers\helpers\models.py -> build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6392255Z INFO:root:copying torchrl\trainers\helpers\replay_buffer.py -> build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6396809Z INFO:root:copying torchrl\trainers\helpers\trainers.py -> build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6408457Z INFO:root:copying torchrl\trainers\helpers\__init__.py -> build\lib.win-amd64-cpython-312\torchrl\trainers\helpers
2025-07-02T07:58:50.6509237Z INFO:root:running build_ext
2025-07-02T07:58:50.6540358Z W0702 07:58:50.640000 2132 site-packages\torch\utils\cpp_extension.py:466] Error checking compiler version for cl: [WinError 2] The system cannot find the file specified
2025-07-02T07:58:50.6546838Z INFO:root:building 'torchrl._torchrl' extension
2025-07-02T07:58:56.0836030Z INFO:root:creating D:\a\rl\rl\build\temp.win-amd64-cpython-312\Release\a\rl\rl\torchrl\csrc
2025-07-02T07:58:56.1153023Z W0702 07:58:56.102000 2132 site-packages\torch\utils\cpp_extension.py:466] Error checking compiler version for cl: [WinError 2] The system cannot find the file specified
2025-07-02T07:58:56.1159782Z C:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\setuptools\_distutils\_msvccompiler.py:12: UserWarning: _get_vc_env is private; find an alternative (pypa/distutils#340)
2025-07-02T07:58:56.1160505Z   warnings.warn(
2025-07-02T07:59:24.0037180Z [1/2] cl /showIncludes /nologo /O2 /W3 /GL /DNDEBUG /MD -ID:\a\rl\rl -IC:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\torch\include -IC:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\hostedtoolcache\windows\Python\3.12.10\x64\include -IC:\hostedtoolcache\windows\Python\3.12.10\x64\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Auxiliary\VS\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.26100.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\um" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\shared" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\winrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\cppwinrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\include\um" /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /wd4624 /wd4067 /wd4068 /EHsc -c D:\a\rl\rl\torchrl\csrc\utils.cpp /FoD:\a\rl\rl\build\temp.win-amd64-cpython-312\Release\a\rl\rl\torchrl\csrc\utils.obj -O3 -std=c++17 -fdiagnostics-color=always -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_torchrl /std:c++17
2025-07-02T07:59:24.0042853Z cl : Command line warning D9002 : ignoring unknown option '-O3'
2025-07-02T07:59:24.0043490Z cl : Command line warning D9002 : ignoring unknown option '-std=c++17'
2025-07-02T07:59:24.0044053Z cl : Command line warning D9002 : ignoring unknown option '-fdiagnostics-color=always'
2025-07-02T07:59:24.0389904Z [2/2] cl /showIncludes /nologo /O2 /W3 /GL /DNDEBUG /MD -ID:\a\rl\rl -IC:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\torch\include -IC:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\hostedtoolcache\windows\Python\3.12.10\x64\include -IC:\hostedtoolcache\windows\Python\3.12.10\x64\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Auxiliary\VS\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.26100.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\um" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\shared" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\winrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\cppwinrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\include\um" /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /wd4624 /wd4067 /wd4068 /EHsc -c D:\a\rl\rl\torchrl\csrc\pybind.cpp /FoD:\a\rl\rl\build\temp.win-amd64-cpython-312\Release\a\rl\rl\torchrl\csrc\pybind.obj -O3 -std=c++17 -fdiagnostics-color=always -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_torchrl /std:c++17
2025-07-02T07:59:24.0395802Z cl : Command line warning D9002 : ignoring unknown option '-O3'
2025-07-02T07:59:24.0396361Z cl : Command line warning D9002 : ignoring unknown option '-std=c++17'
2025-07-02T07:59:24.0397071Z cl : Command line warning D9002 : ignoring unknown option '-fdiagnostics-color=always'
2025-07-02T07:59:24.0439720Z INFO:root:"C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\bin\HostX86\x64\link.exe" /nologo /INCREMENTAL:NO /LTCG /DLL /MANIFEST:EMBED,ID=2 /MANIFESTUAC:NO /LIBPATH:C:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\torch\lib /LIBPATH:C:\hostedtoolcache\windows\Python\3.12.10\x64\libs /LIBPATH:C:\hostedtoolcache\windows\Python\3.12.10\x64 /LIBPATH:C:\hostedtoolcache\windows\Python\3.12.10\x64\PCbuild\amd64 "/LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\ATLMFC\lib\x64" "/LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\lib\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\lib\um\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.26100.0\ucrt\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\\lib\10.0.26100.0\\um\x64" c10.lib torch.lib torch_cpu.lib torch_python.lib sleef.lib /EXPORT:PyInit__torchrl D:\a\rl\rl\build\temp.win-amd64-cpython-312\Release\a\rl\rl\torchrl\csrc\pybind.obj D:\a\rl\rl\build\temp.win-amd64-cpython-312\Release\a\rl\rl\torchrl\csrc\utils.obj /OUT:build\lib.win-amd64-cpython-312\torchrl\_torchrl.cp312-win_amd64.pyd /IMPLIB:D:\a\rl\rl\build\temp.win-amd64-cpython-312\Release\a\rl\rl\torchrl\csrc\_torchrl.cp312-win_amd64.lib
2025-07-02T07:59:28.8000798Z    Creating library D:\a\rl\rl\build\temp.win-amd64-cpython-312\Release\a\rl\rl\torchrl\csrc\_torchrl.cp312-win_amd64.lib and object D:\a\rl\rl\build\temp.win-amd64-cpython-312\Release\a\rl\rl\torchrl\csrc\_torchrl.cp312-win_amd64.exp
2025-07-02T07:59:28.8263645Z Generating code
2025-07-02T07:59:36.6521148Z Finished generating code
2025-07-02T07:59:37.4632816Z C:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\setuptools\_distutils\cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-07-02T07:59:37.4633699Z !!
2025-07-02T07:59:37.4633830Z 
2025-07-02T07:59:37.4633963Z         ********************************************************************************
2025-07-02T07:59:37.4634451Z         Please avoid running ``setup.py`` directly.
2025-07-02T07:59:37.4635140Z         Instead, use pypa/build, pypa/installer or other
2025-07-02T07:59:37.4635562Z         standards-based tools.
2025-07-02T07:59:37.4635755Z 
2025-07-02T07:59:37.4636129Z         See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-07-02T07:59:37.4636637Z         ********************************************************************************
2025-07-02T07:59:37.4636901Z 
2025-07-02T07:59:37.4636986Z !!
2025-07-02T07:59:37.4637207Z   self.initialize_options()
2025-07-02T07:59:37.4673065Z INFO:root:installing to build\bdist.win-amd64\wheel
2025-07-02T07:59:37.4673599Z INFO:root:running install
2025-07-02T07:59:37.4686195Z INFO:root:running install_lib
2025-07-02T07:59:37.4729481Z INFO:root:creating build\bdist.win-amd64\wheel
2025-07-02T07:59:37.4733733Z INFO:root:creating build\bdist.win-amd64\wheel\build_tools
2025-07-02T07:59:37.4736969Z INFO:root:creating build\bdist.win-amd64\wheel\build_tools\setup_helpers
2025-07-02T07:59:37.4739958Z INFO:root:copying build\lib.win-amd64-cpython-312\build_tools\setup_helpers\extension.py -> build\bdist.win-amd64\wheel\.\build_tools\setup_helpers
2025-07-02T07:59:37.4744516Z INFO:root:copying build\lib.win-amd64-cpython-312\build_tools\setup_helpers\__init__.py -> build\bdist.win-amd64\wheel\.\build_tools\setup_helpers
2025-07-02T07:59:37.4748816Z INFO:root:copying build\lib.win-amd64-cpython-312\build_tools\__init__.py -> build\bdist.win-amd64\wheel\.\build_tools
2025-07-02T07:59:37.4753786Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl
2025-07-02T07:59:37.4756910Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\collectors
2025-07-02T07:59:37.4759783Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\collectors.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors
2025-07-02T07:59:37.4766603Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\collectors\distributed
2025-07-02T07:59:37.4769601Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\distributed\default_configs.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed
2025-07-02T07:59:37.4774093Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\distributed\generic.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed
2025-07-02T07:59:37.4779004Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\distributed\ray.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed
2025-07-02T07:59:37.4784097Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\distributed\rpc.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed
2025-07-02T07:59:37.4789263Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\distributed\sync.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed
2025-07-02T07:59:37.4795165Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\distributed\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed
2025-07-02T07:59:37.4800068Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\distributed\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed
2025-07-02T07:59:37.4807249Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\collectors\llm
2025-07-02T07:59:37.4810081Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\llm\base.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm
2025-07-02T07:59:37.4815518Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\llm\ray_collector.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm
2025-07-02T07:59:37.4820199Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\llm\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm
2025-07-02T07:59:37.4825119Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\collectors\llm\weight_update
2025-07-02T07:59:37.4828050Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\llm\weight_update\vllm.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm\weight_update
2025-07-02T07:59:37.4832434Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\llm\weight_update\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm\weight_update
2025-07-02T07:59:37.4836493Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm
2025-07-02T07:59:37.4840625Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors
2025-07-02T07:59:37.4845075Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\weight_update.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors
2025-07-02T07:59:37.4849729Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\collectors\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors
2025-07-02T07:59:37.4854852Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data
2025-07-02T07:59:37.4858059Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\datasets
2025-07-02T07:59:37.4860840Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\atari_dqn.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4865811Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\common.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4870401Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\d4rl.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4875220Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\d4rl_infos.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4879951Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\gen_dgrl.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4884317Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\minari_data.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4888953Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\openml.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4899634Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\openx.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4904377Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\roboset.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4909062Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4913275Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\vd4rl.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4918017Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\datasets\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets
2025-07-02T07:59:37.4922615Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\llm
2025-07-02T07:59:37.4925381Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\llm\chat.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm
2025-07-02T07:59:37.4930461Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\llm\common.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm
2025-07-02T07:59:37.4934879Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\llm\dataset.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm
2025-07-02T07:59:37.4939544Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\llm\prompt.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm
2025-07-02T07:59:37.4943844Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\llm\reward.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm
2025-07-02T07:59:37.4948940Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\llm\topk.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm
2025-07-02T07:59:37.4953151Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\llm\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm
2025-07-02T07:59:37.4959892Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm
2025-07-02T07:59:37.4964671Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\map
2025-07-02T07:59:37.4967485Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\map\hash.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map
2025-07-02T07:59:37.4971822Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\map\query.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map
2025-07-02T07:59:37.4976169Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\map\tdstorage.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map
2025-07-02T07:59:37.4980485Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\map\tree.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map
2025-07-02T07:59:37.4985595Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\map\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map
2025-07-02T07:59:37.4989869Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\map\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map
2025-07-02T07:59:37.4994516Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\postprocs
2025-07-02T07:59:37.4997361Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\postprocs\postprocs.py -> build\bdist.win-amd64\wheel\.\torchrl\data\postprocs
2025-07-02T07:59:37.5001786Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\postprocs\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\postprocs
2025-07-02T07:59:37.5006486Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\replay_buffers
2025-07-02T07:59:37.5009361Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\checkpointers.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5013834Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\ray_buffer.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5018273Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\replay_buffers.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5023486Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\samplers.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5028978Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\scheduler.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5033766Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\storages.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5041548Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5046129Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\writers.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5050911Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\replay_buffers\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers
2025-07-02T07:59:37.5055073Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\rlhf.py -> build\bdist.win-amd64\wheel\.\torchrl\data
2025-07-02T07:59:37.5059598Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\tensor_specs.py -> build\bdist.win-amd64\wheel\.\torchrl\data
2025-07-02T07:59:37.5067867Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data
2025-07-02T07:59:37.5072321Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\data\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data
2025-07-02T07:59:37.5077133Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs
2025-07-02T07:59:37.5079976Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\async_envs.py -> build\bdist.win-amd64\wheel\.\torchrl\envs
2025-07-02T07:59:37.5084841Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\batched_envs.py -> build\bdist.win-amd64\wheel\.\torchrl\envs
2025-07-02T07:59:37.5090314Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\common.py -> build\bdist.win-amd64\wheel\.\torchrl\envs
2025-07-02T07:59:37.5099152Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\custom
2025-07-02T07:59:37.5100794Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\custom\chess.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom
2025-07-02T07:59:37.5105908Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\custom\llm.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom
2025-07-02T07:59:37.5111664Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\custom\pendulum.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom
2025-07-02T07:59:37.5116403Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\custom\tictactoeenv.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom
2025-07-02T07:59:37.5123582Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\custom\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom
2025-07-02T07:59:37.5129128Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\env_creator.py -> build\bdist.win-amd64\wheel\.\torchrl\envs
2025-07-02T07:59:37.5133868Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\gym_like.py -> build\bdist.win-amd64\wheel\.\torchrl\envs
2025-07-02T07:59:37.5139741Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\libs
2025-07-02T07:59:37.5144323Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\brax.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5148890Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\dm_control.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5153292Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\envpool.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5157577Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\gym.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5162568Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\habitat.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5166565Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\isaacgym.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5170706Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\isaac_lab.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5176546Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\jax_utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5180564Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\jumanji.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5185512Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\meltingpot.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5189955Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\openml.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5193929Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\openspiel.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5198290Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\pettingzoo.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5202724Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\robohive.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5207882Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\smacv2.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5214632Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\unity_mlagents.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5220697Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5225475Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\vmas.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5234145Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\_gym_utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5238313Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\libs\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs
2025-07-02T07:59:37.5245151Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm
2025-07-02T07:59:37.5248705Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\chat.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm
2025-07-02T07:59:37.5254810Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\datasets
2025-07-02T07:59:37.5257396Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\datasets\gsm8k.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\datasets
2025-07-02T07:59:37.5263341Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\datasets\ifeval.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\datasets
2025-07-02T07:59:37.5268172Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\datasets\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\datasets
2025-07-02T07:59:37.5273057Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\envs.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm
2025-07-02T07:59:37.5279226Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\libs
2025-07-02T07:59:37.5282077Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\libs\mlgym.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\libs
2025-07-02T07:59:37.5289071Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\libs\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\libs
2025-07-02T07:59:37.5293952Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\reward
2025-07-02T07:59:37.5297487Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\gsm8k.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward
2025-07-02T07:59:37.5305701Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\reward\ifeval
2025-07-02T07:59:37.5308231Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval\_instructions.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval
2025-07-02T07:59:37.5316939Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval\_instructions_main.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval
2025-07-02T07:59:37.5321932Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval\_instructions_registry.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval
2025-07-02T07:59:37.5327983Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval\_instructions_util.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval
2025-07-02T07:59:37.5334875Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval\_scorer.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval
2025-07-02T07:59:37.5341738Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\ifeval\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval
2025-07-02T07:59:37.5350745Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\reward\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward
2025-07-02T07:59:37.5358290Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5362786Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\browser.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5370218Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\dataloading.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5377043Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\format.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5383761Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\kl.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5391481Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\policy_version.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5397136Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\reason.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5402696Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\tokenizer.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5411912Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\tools.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5417893Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\transforms\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms
2025-07-02T07:59:37.5422749Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm
2025-07-02T07:59:37.5430650Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\model_based
2025-07-02T07:59:37.5434078Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\model_based\common.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\model_based
2025-07-02T07:59:37.5439421Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\model_based\dreamer.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\model_based
2025-07-02T07:59:37.5444050Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\model_based\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\model_based
2025-07-02T07:59:37.5449501Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\transforms
2025-07-02T07:59:37.5452903Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\functional.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5458040Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\gym_transforms.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5463586Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\llm.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5469299Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\r3m.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5475444Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\rb_transforms.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5479820Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\rlhf.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5484164Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\transforms.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5495718Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5499752Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\vc1.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5504165Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\vecnorm.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5508960Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\vip.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5513343Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\transforms\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms
2025-07-02T07:59:37.5517621Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs
2025-07-02T07:59:37.5522811Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\vec_envs.py -> build\bdist.win-amd64\wheel\.\torchrl\envs
2025-07-02T07:59:37.5526949Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\envs\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs
2025-07-02T07:59:37.5531925Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules
2025-07-02T07:59:37.5535211Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\distributions
2025-07-02T07:59:37.5538330Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\distributions\continuous.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions
2025-07-02T07:59:37.5543195Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\distributions\discrete.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions
2025-07-02T07:59:37.5547934Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\distributions\truncated_normal.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions
2025-07-02T07:59:37.5552196Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\distributions\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions
2025-07-02T07:59:37.5557709Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\distributions\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions
2025-07-02T07:59:37.5563222Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\llm
2025-07-02T07:59:37.5566992Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\llm\backends
2025-07-02T07:59:37.5571389Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\llm\backends\vllm.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\backends
2025-07-02T07:59:37.5577220Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\llm\backends\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\backends
2025-07-02T07:59:37.5581793Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\llm\policies
2025-07-02T07:59:37.5584937Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies\common.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\policies
2025-07-02T07:59:37.5589875Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies\transformers_wrapper.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\policies
2025-07-02T07:59:37.5596466Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies\vllm_wrapper.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\policies
2025-07-02T07:59:37.5603240Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\llm\policies\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\policies
2025-07-02T07:59:37.5608539Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\llm\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm
2025-07-02T07:59:37.5613874Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm
2025-07-02T07:59:37.5618865Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\models
2025-07-02T07:59:37.5621842Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\batchrenorm.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5627496Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\decision_transformer.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5632220Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\exploration.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5637612Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\llm.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5669372Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\models.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5670870Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\model_based.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5672376Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\multiagent.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5673640Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\rlhf.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5674458Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5676093Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\models\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models
2025-07-02T07:59:37.5678136Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\planners
2025-07-02T07:59:37.5680943Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\planners\cem.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\planners
2025-07-02T07:59:37.5686017Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\planners\common.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\planners
2025-07-02T07:59:37.5691520Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\planners\mppi.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\planners
2025-07-02T07:59:37.5696055Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\planners\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\planners
2025-07-02T07:59:37.5701688Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5704767Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module\actors.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5712137Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module\common.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5717119Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module\exploration.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5723357Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module\probabilistic.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5728259Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module\rnn.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5734722Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module\sequence.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5739103Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module\world_models.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5748291Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\tensordict_module\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module
2025-07-02T07:59:37.5753354Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\utils
2025-07-02T07:59:37.5756866Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\utils\mappings.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\utils
2025-07-02T07:59:37.5761218Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\utils\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\utils
2025-07-02T07:59:37.5766127Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\utils\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\utils
2025-07-02T07:59:37.5771252Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\modules\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules
2025-07-02T07:59:37.5779512Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\objectives
2025-07-02T07:59:37.5782171Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\a2c.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5789312Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\common.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5794565Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\cql.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5801555Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\crossq.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5806988Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\ddpg.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5811941Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\decision_transformer.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5818866Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\deprecated.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5829503Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\dqn.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5835742Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\dreamer.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5840990Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\functional.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5846648Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\gail.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5852170Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\iql.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5857721Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\objectives\llm
2025-07-02T07:59:37.5861359Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\llm\grpo.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\llm
2025-07-02T07:59:37.5869356Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\llm\sft.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\llm
2025-07-02T07:59:37.5874206Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\llm
2025-07-02T07:59:37.5880864Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\objectives\multiagent
2025-07-02T07:59:37.5883913Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\multiagent\qmixer.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\multiagent
2025-07-02T07:59:37.5891268Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\multiagent\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\multiagent
2025-07-02T07:59:37.5897159Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\ppo.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5904034Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\redq.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5909731Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\reinforce.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5915767Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\sac.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5922519Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\td3.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5927563Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\td3_bc.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5932698Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5938407Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\objectives\value
2025-07-02T07:59:37.5941012Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\value\advantages.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\value
2025-07-02T07:59:37.5945993Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\value\functional.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\value
2025-07-02T07:59:37.5951369Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\value\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\value
2025-07-02T07:59:37.5955404Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\value\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\value
2025-07-02T07:59:37.5959242Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\objectives\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives
2025-07-02T07:59:37.5964994Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\record
2025-07-02T07:59:37.5967792Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\record\loggers
2025-07-02T07:59:37.5970194Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\loggers\common.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers
2025-07-02T07:59:37.5974287Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\loggers\csv.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers
2025-07-02T07:59:37.5978582Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\loggers\mlflow.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers
2025-07-02T07:59:37.5982598Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\loggers\tensorboard.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers
2025-07-02T07:59:37.5986502Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\loggers\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers
2025-07-02T07:59:37.5990896Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\loggers\wandb.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers
2025-07-02T07:59:37.5995649Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\loggers\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers
2025-07-02T07:59:37.6002724Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\recorder.py -> build\bdist.win-amd64\wheel\.\torchrl\record
2025-07-02T07:59:37.6007057Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\record\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\record
2025-07-02T07:59:37.6011416Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\trainers
2025-07-02T07:59:37.6016087Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\trainers\helpers
2025-07-02T07:59:37.6018666Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\helpers\collectors.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers
2025-07-02T07:59:37.6023286Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\helpers\envs.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers
2025-07-02T07:59:37.6027520Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\helpers\logger.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers
2025-07-02T07:59:37.6031612Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\helpers\losses.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers
2025-07-02T07:59:37.6035613Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\helpers\models.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers
2025-07-02T07:59:37.6040148Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\helpers\replay_buffer.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers
2025-07-02T07:59:37.6046135Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\helpers\trainers.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers
2025-07-02T07:59:37.6054566Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\helpers\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers
2025-07-02T07:59:37.6059874Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\trainers.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers
2025-07-02T07:59:37.6065923Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\trainers\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers
2025-07-02T07:59:37.6070405Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\version.py -> build\bdist.win-amd64\wheel\.\torchrl
2025-07-02T07:59:37.6075772Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\_extension.py -> build\bdist.win-amd64\wheel\.\torchrl
2025-07-02T07:59:37.6080978Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\_torchrl.cp312-win_amd64.pyd -> build\bdist.win-amd64\wheel\.\torchrl
2025-07-02T07:59:37.6096178Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\_utils.py -> build\bdist.win-amd64\wheel\.\torchrl
2025-07-02T07:59:37.6101823Z INFO:root:copying build\lib.win-amd64-cpython-312\torchrl\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl
2025-07-02T07:59:37.6106371Z INFO:root:running install_egg_info
2025-07-02T07:59:37.6167072Z INFO:root:running egg_info
2025-07-02T07:59:37.6201928Z INFO:root:creating torchrl_nightly.egg-info
2025-07-02T07:59:37.6204537Z INFO:root:writing torchrl_nightly.egg-info\PKG-INFO
2025-07-02T07:59:37.6294267Z INFO:root:writing dependency_links to torchrl_nightly.egg-info\dependency_links.txt
2025-07-02T07:59:37.6334432Z INFO:root:writing requirements to torchrl_nightly.egg-info\requires.txt
2025-07-02T07:59:37.6336844Z INFO:root:writing top-level names to torchrl_nightly.egg-info\top_level.txt
2025-07-02T07:59:37.6339260Z INFO:root:writing manifest file 'torchrl_nightly.egg-info\SOURCES.txt'
2025-07-02T07:59:37.6542675Z INFO:root:reading manifest file 'torchrl_nightly.egg-info\SOURCES.txt'
2025-07-02T07:59:37.6547705Z INFO:root:adding license file 'LICENSE'
2025-07-02T07:59:37.6599462Z INFO:root:writing manifest file 'torchrl_nightly.egg-info\SOURCES.txt'
2025-07-02T07:59:37.6603013Z INFO:root:Copying torchrl_nightly.egg-info to build\bdist.win-amd64\wheel\.\torchrl_nightly-2025.7.2-py3.12.egg-info
2025-07-02T07:59:37.6651018Z INFO:root:running install_scripts
2025-07-02T07:59:37.6655048Z C:\hostedtoolcache\windows\Python\3.12.10\x64\Lib\site-packages\setuptools\command\bdist_wheel.py:103: RuntimeWarning: Config variable 'Py_DEBUG' is unset, Python ABI tag may be incorrect
2025-07-02T07:59:37.6655956Z   if get_flag("Py_DEBUG", hasattr(sys, "gettotalrefcount"), warn=(impl == "cp")):
2025-07-02T07:59:37.6689854Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl_nightly-2025.7.2.dist-info\WHEEL
2025-07-02T07:59:37.6695417Z INFO:wheel:creating 'dist\torchrl_nightly-2025.7.2-cp312-cp312-win_amd64.whl' and adding 'build\bdist.win-amd64\wheel' to it
2025-07-02T07:59:37.6700665Z INFO:wheel:adding 'build_tools/__init__.py'
2025-07-02T07:59:37.6704915Z INFO:wheel:adding 'build_tools/setup_helpers/__init__.py'
2025-07-02T07:59:37.6712149Z INFO:wheel:adding 'build_tools/setup_helpers/extension.py'
2025-07-02T07:59:37.6716092Z INFO:wheel:adding 'torchrl/__init__.py'
2025-07-02T07:59:37.6720330Z INFO:wheel:adding 'torchrl/_extension.py'
2025-07-02T07:59:37.6955894Z INFO:wheel:adding 'torchrl/_torchrl.cp312-win_amd64.pyd'
2025-07-02T07:59:37.6976519Z INFO:wheel:adding 'torchrl/_utils.py'
2025-07-02T07:59:37.6980169Z INFO:wheel:adding 'torchrl/version.py'
2025-07-02T07:59:37.6985620Z INFO:wheel:adding 'torchrl/collectors/__init__.py'
2025-07-02T07:59:37.7051523Z INFO:wheel:adding 'torchrl/collectors/collectors.py'
2025-07-02T07:59:37.7059390Z INFO:wheel:adding 'torchrl/collectors/utils.py'
2025-07-02T07:59:37.7067765Z INFO:wheel:adding 'torchrl/collectors/weight_update.py'
2025-07-02T07:59:37.7071944Z INFO:wheel:adding 'torchrl/collectors/distributed/__init__.py'
2025-07-02T07:59:37.7074850Z INFO:wheel:adding 'torchrl/collectors/distributed/default_configs.py'
2025-07-02T07:59:37.7089935Z INFO:wheel:adding 'torchrl/collectors/distributed/generic.py'
2025-07-02T07:59:37.7102893Z INFO:wheel:adding 'torchrl/collectors/distributed/ray.py'
2025-07-02T07:59:37.7116524Z INFO:wheel:adding 'torchrl/collectors/distributed/rpc.py'
2025-07-02T07:59:37.7126315Z INFO:wheel:adding 'torchrl/collectors/distributed/sync.py'
2025-07-02T07:59:37.7130913Z INFO:wheel:adding 'torchrl/collectors/distributed/utils.py'
2025-07-02T07:59:37.7135040Z INFO:wheel:adding 'torchrl/collectors/llm/__init__.py'
2025-07-02T07:59:37.7143462Z INFO:wheel:adding 'torchrl/collectors/llm/base.py'
2025-07-02T07:59:37.7150185Z INFO:wheel:adding 'torchrl/collectors/llm/ray_collector.py'
2025-07-02T07:59:37.7154984Z INFO:wheel:adding 'torchrl/collectors/llm/utils.py'
2025-07-02T07:59:37.7158983Z INFO:wheel:adding 'torchrl/collectors/llm/weight_update/__init__.py'
2025-07-02T07:59:37.7166337Z INFO:wheel:adding 'torchrl/collectors/llm/weight_update/vllm.py'
2025-07-02T07:59:37.7171606Z INFO:wheel:adding 'torchrl/data/__init__.py'
2025-07-02T07:59:37.7174727Z INFO:wheel:adding 'torchrl/data/rlhf.py'
2025-07-02T07:59:37.7262001Z INFO:wheel:adding 'torchrl/data/tensor_specs.py'
2025-07-02T07:59:37.7270951Z INFO:wheel:adding 'torchrl/data/utils.py'
2025-07-02T07:59:37.7277156Z INFO:wheel:adding 'torchrl/data/datasets/__init__.py'
2025-07-02T07:59:37.7291382Z INFO:wheel:adding 'torchrl/data/datasets/atari_dqn.py'
2025-07-02T07:59:37.7297714Z INFO:wheel:adding 'torchrl/data/datasets/common.py'
2025-07-02T07:59:37.7305627Z INFO:wheel:adding 'torchrl/data/datasets/d4rl.py'
2025-07-02T07:59:37.7311587Z INFO:wheel:adding 'torchrl/data/datasets/d4rl_infos.py'
2025-07-02T07:59:37.7317912Z INFO:wheel:adding 'torchrl/data/datasets/gen_dgrl.py'
2025-07-02T07:59:37.7325832Z INFO:wheel:adding 'torchrl/data/datasets/minari_data.py'
2025-07-02T07:59:37.7330232Z INFO:wheel:adding 'torchrl/data/datasets/openml.py'
2025-07-02T07:59:37.7342239Z INFO:wheel:adding 'torchrl/data/datasets/openx.py'
2025-07-02T07:59:37.7349156Z INFO:wheel:adding 'torchrl/data/datasets/roboset.py'
2025-07-02T07:59:37.7352445Z INFO:wheel:adding 'torchrl/data/datasets/utils.py'
2025-07-02T07:59:37.7359666Z INFO:wheel:adding 'torchrl/data/datasets/vd4rl.py'
2025-07-02T07:59:37.7363165Z INFO:wheel:adding 'torchrl/data/llm/__init__.py'
2025-07-02T07:59:37.7379948Z INFO:wheel:adding 'torchrl/data/llm/chat.py'
2025-07-02T07:59:37.7383463Z INFO:wheel:adding 'torchrl/data/llm/common.py'
2025-07-02T07:59:37.7391186Z INFO:wheel:adding 'torchrl/data/llm/dataset.py'
2025-07-02T07:59:37.7395976Z INFO:wheel:adding 'torchrl/data/llm/prompt.py'
2025-07-02T07:59:37.7400420Z INFO:wheel:adding 'torchrl/data/llm/reward.py'
2025-07-02T07:59:37.7405002Z INFO:wheel:adding 'torchrl/data/llm/topk.py'
2025-07-02T07:59:37.7413886Z INFO:wheel:adding 'torchrl/data/llm/utils.py'
2025-07-02T07:59:37.7417300Z INFO:wheel:adding 'torchrl/data/map/__init__.py'
2025-07-02T07:59:37.7421732Z INFO:wheel:adding 'torchrl/data/map/hash.py'
2025-07-02T07:59:37.7427024Z INFO:wheel:adding 'torchrl/data/map/query.py'
2025-07-02T07:59:37.7433269Z INFO:wheel:adding 'torchrl/data/map/tdstorage.py'
2025-07-02T07:59:37.7454852Z INFO:wheel:adding 'torchrl/data/map/tree.py'
2025-07-02T07:59:37.7458743Z INFO:wheel:adding 'torchrl/data/map/utils.py'
2025-07-02T07:59:37.7461914Z INFO:wheel:adding 'torchrl/data/postprocs/__init__.py'
2025-07-02T07:59:37.7468751Z INFO:wheel:adding 'torchrl/data/postprocs/postprocs.py'
2025-07-02T07:59:37.7472482Z INFO:wheel:adding 'torchrl/data/replay_buffers/__init__.py'
2025-07-02T07:59:37.7478494Z INFO:wheel:adding 'torchrl/data/replay_buffers/checkpointers.py'
2025-07-02T07:59:37.7483537Z INFO:wheel:adding 'torchrl/data/replay_buffers/ray_buffer.py'
2025-07-02T07:59:37.7512523Z INFO:wheel:adding 'torchrl/data/replay_buffers/replay_buffers.py'
2025-07-02T07:59:37.7551533Z INFO:wheel:adding 'torchrl/data/replay_buffers/samplers.py'
2025-07-02T07:59:37.7557105Z INFO:wheel:adding 'torchrl/data/replay_buffers/scheduler.py'
2025-07-02T07:59:37.7576092Z INFO:wheel:adding 'torchrl/data/replay_buffers/storages.py'
2025-07-02T07:59:37.7589635Z INFO:wheel:adding 'torchrl/data/replay_buffers/utils.py'
2025-07-02T07:59:37.7601922Z INFO:wheel:adding 'torchrl/data/replay_buffers/writers.py'
2025-07-02T07:59:37.7606499Z INFO:wheel:adding 'torchrl/envs/__init__.py'
2025-07-02T07:59:37.7618813Z INFO:wheel:adding 'torchrl/envs/async_envs.py'
2025-07-02T07:59:37.7659041Z INFO:wheel:adding 'torchrl/envs/batched_envs.py'
2025-07-02T07:59:37.7715153Z INFO:wheel:adding 'torchrl/envs/common.py'
2025-07-02T07:59:37.7722140Z INFO:wheel:adding 'torchrl/envs/env_creator.py'
2025-07-02T07:59:37.7735316Z INFO:wheel:adding 'torchrl/envs/gym_like.py'
2025-07-02T07:59:37.7763581Z INFO:wheel:adding 'torchrl/envs/utils.py'
2025-07-02T07:59:37.7766987Z INFO:wheel:adding 'torchrl/envs/vec_envs.py'
2025-07-02T07:59:37.7771852Z INFO:wheel:adding 'torchrl/envs/custom/__init__.py'
2025-07-02T07:59:37.7780213Z INFO:wheel:adding 'torchrl/envs/custom/chess.py'
2025-07-02T07:59:37.7785266Z INFO:wheel:adding 'torchrl/envs/custom/llm.py'
2025-07-02T07:59:37.7791134Z INFO:wheel:adding 'torchrl/envs/custom/pendulum.py'
2025-07-02T07:59:37.7796084Z INFO:wheel:adding 'torchrl/envs/custom/tictactoeenv.py'
2025-07-02T07:59:37.7799801Z INFO:wheel:adding 'torchrl/envs/libs/__init__.py'
2025-07-02T07:59:37.7804367Z INFO:wheel:adding 'torchrl/envs/libs/_gym_utils.py'
2025-07-02T07:59:37.7812270Z INFO:wheel:adding 'torchrl/envs/libs/brax.py'
2025-07-02T07:59:37.7819762Z INFO:wheel:adding 'torchrl/envs/libs/dm_control.py'
2025-07-02T07:59:37.7826266Z INFO:wheel:adding 'torchrl/envs/libs/envpool.py'
2025-07-02T07:59:37.7853622Z INFO:wheel:adding 'torchrl/envs/libs/gym.py'
2025-07-02T07:59:37.7858215Z INFO:wheel:adding 'torchrl/envs/libs/habitat.py'
2025-07-02T07:59:37.7861793Z INFO:wheel:adding 'torchrl/envs/libs/isaac_lab.py'
2025-07-02T07:59:37.7866319Z INFO:wheel:adding 'torchrl/envs/libs/isaacgym.py'
2025-07-02T07:59:37.7870228Z INFO:wheel:adding 'torchrl/envs/libs/jax_utils.py'
2025-07-02T07:59:37.7881038Z INFO:wheel:adding 'torchrl/envs/libs/jumanji.py'
2025-07-02T07:59:37.7888747Z INFO:wheel:adding 'torchrl/envs/libs/meltingpot.py'
2025-07-02T07:59:37.7892836Z INFO:wheel:adding 'torchrl/envs/libs/openml.py'
2025-07-02T07:59:37.7900758Z INFO:wheel:adding 'torchrl/envs/libs/openspiel.py'
2025-07-02T07:59:37.7916439Z INFO:wheel:adding 'torchrl/envs/libs/pettingzoo.py'
2025-07-02T07:59:37.7923453Z INFO:wheel:adding 'torchrl/envs/libs/robohive.py'
2025-07-02T07:59:37.7930817Z INFO:wheel:adding 'torchrl/envs/libs/smacv2.py'
2025-07-02T07:59:37.7941168Z INFO:wheel:adding 'torchrl/envs/libs/unity_mlagents.py'
2025-07-02T07:59:37.7945318Z INFO:wheel:adding 'torchrl/envs/libs/utils.py'
2025-07-02T07:59:37.7955926Z INFO:wheel:adding 'torchrl/envs/libs/vmas.py'
2025-07-02T07:59:37.7959691Z INFO:wheel:adding 'torchrl/envs/llm/__init__.py'
2025-07-02T07:59:37.7966849Z INFO:wheel:adding 'torchrl/envs/llm/chat.py'
2025-07-02T07:59:37.7978895Z INFO:wheel:adding 'torchrl/envs/llm/envs.py'
2025-07-02T07:59:37.7983371Z INFO:wheel:adding 'torchrl/envs/llm/datasets/__init__.py'
2025-07-02T07:59:37.7989097Z INFO:wheel:adding 'torchrl/envs/llm/datasets/gsm8k.py'
2025-07-02T07:59:37.7993699Z INFO:wheel:adding 'torchrl/envs/llm/datasets/ifeval.py'
2025-07-02T07:59:37.7997041Z INFO:wheel:adding 'torchrl/envs/llm/libs/__init__.py'
2025-07-02T07:59:37.8008306Z INFO:wheel:adding 'torchrl/envs/llm/libs/mlgym.py'
2025-07-02T07:59:37.8011686Z INFO:wheel:adding 'torchrl/envs/llm/reward/__init__.py'
2025-07-02T07:59:37.8017103Z INFO:wheel:adding 'torchrl/envs/llm/reward/gsm8k.py'
2025-07-02T07:59:37.8020691Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/__init__.py'
2025-07-02T07:59:37.8036765Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_instructions.py'
2025-07-02T07:59:37.8040811Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_instructions_main.py'
2025-07-02T07:59:37.8044321Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_instructions_registry.py'
2025-07-02T07:59:37.8054211Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_instructions_util.py'
2025-07-02T07:59:37.8060494Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_scorer.py'
2025-07-02T07:59:37.8064030Z INFO:wheel:adding 'torchrl/envs/llm/transforms/__init__.py'
2025-07-02T07:59:37.8069249Z INFO:wheel:adding 'torchrl/envs/llm/transforms/browser.py'
2025-07-02T07:59:37.8078403Z INFO:wheel:adding 'torchrl/envs/llm/transforms/dataloading.py'
2025-07-02T07:59:37.8081796Z INFO:wheel:adding 'torchrl/envs/llm/transforms/format.py'
2025-07-02T07:59:37.8097576Z INFO:wheel:adding 'torchrl/envs/llm/transforms/kl.py'
2025-07-02T07:59:37.8102323Z INFO:wheel:adding 'torchrl/envs/llm/transforms/policy_version.py'
2025-07-02T07:59:37.8107744Z INFO:wheel:adding 'torchrl/envs/llm/transforms/reason.py'
2025-07-02T07:59:37.8113444Z INFO:wheel:adding 'torchrl/envs/llm/transforms/tokenizer.py'
2025-07-02T07:59:37.8123000Z INFO:wheel:adding 'torchrl/envs/llm/transforms/tools.py'
2025-07-02T07:59:37.8126334Z INFO:wheel:adding 'torchrl/envs/model_based/__init__.py'
2025-07-02T07:59:37.8130587Z INFO:wheel:adding 'torchrl/envs/model_based/common.py'
2025-07-02T07:59:37.8133938Z INFO:wheel:adding 'torchrl/envs/model_based/dreamer.py'
2025-07-02T07:59:37.8137802Z INFO:wheel:adding 'torchrl/envs/transforms/__init__.py'
2025-07-02T07:59:37.8141491Z INFO:wheel:adding 'torchrl/envs/transforms/functional.py'
2025-07-02T07:59:37.8146070Z INFO:wheel:adding 'torchrl/envs/transforms/gym_transforms.py'
2025-07-02T07:59:37.8152272Z INFO:wheel:adding 'torchrl/envs/transforms/llm.py'
2025-07-02T07:59:37.8158624Z INFO:wheel:adding 'torchrl/envs/transforms/r3m.py'
2025-07-02T07:59:37.8163063Z INFO:wheel:adding 'torchrl/envs/transforms/rb_transforms.py'
2025-07-02T07:59:37.8165866Z INFO:wheel:adding 'torchrl/envs/transforms/rlhf.py'
2025-07-02T07:59:37.8332201Z INFO:wheel:adding 'torchrl/envs/transforms/transforms.py'
2025-07-02T07:59:37.8338876Z INFO:wheel:adding 'torchrl/envs/transforms/utils.py'
2025-07-02T07:59:37.8344261Z INFO:wheel:adding 'torchrl/envs/transforms/vc1.py'
2025-07-02T07:59:37.8356128Z INFO:wheel:adding 'torchrl/envs/transforms/vecnorm.py'
2025-07-02T07:59:37.8362703Z INFO:wheel:adding 'torchrl/envs/transforms/vip.py'
2025-07-02T07:59:37.8366897Z INFO:wheel:adding 'torchrl/modules/__init__.py'
2025-07-02T07:59:37.8371963Z INFO:wheel:adding 'torchrl/modules/distributions/__init__.py'
2025-07-02T07:59:37.8380948Z INFO:wheel:adding 'torchrl/modules/distributions/continuous.py'
2025-07-02T07:59:37.8389451Z INFO:wheel:adding 'torchrl/modules/distributions/discrete.py'
2025-07-02T07:59:37.8393588Z INFO:wheel:adding 'torchrl/modules/distributions/truncated_normal.py'
2025-07-02T07:59:37.8397609Z INFO:wheel:adding 'torchrl/modules/distributions/utils.py'
2025-07-02T07:59:37.8400873Z INFO:wheel:adding 'torchrl/modules/llm/__init__.py'
2025-07-02T07:59:37.8403602Z INFO:wheel:adding 'torchrl/modules/llm/utils.py'
2025-07-02T07:59:37.8407424Z INFO:wheel:adding 'torchrl/modules/llm/backends/__init__.py'
2025-07-02T07:59:37.8412327Z INFO:wheel:adding 'torchrl/modules/llm/backends/vllm.py'
2025-07-02T07:59:37.8415500Z INFO:wheel:adding 'torchrl/modules/llm/policies/__init__.py'
2025-07-02T07:59:37.8424863Z INFO:wheel:adding 'torchrl/modules/llm/policies/common.py'
2025-07-02T07:59:37.8445535Z INFO:wheel:adding 'torchrl/modules/llm/policies/transformers_wrapper.py'
2025-07-02T07:59:37.8467909Z INFO:wheel:adding 'torchrl/modules/llm/policies/vllm_wrapper.py'
2025-07-02T07:59:37.8472116Z INFO:wheel:adding 'torchrl/modules/models/__init__.py'
2025-07-02T07:59:37.8475921Z INFO:wheel:adding 'torchrl/modules/models/batchrenorm.py'
2025-07-02T07:59:37.8480101Z INFO:wheel:adding 'torchrl/modules/models/decision_transformer.py'
2025-07-02T07:59:37.8490704Z INFO:wheel:adding 'torchrl/modules/models/exploration.py'
2025-07-02T07:59:37.8495123Z INFO:wheel:adding 'torchrl/modules/models/llm.py'
2025-07-02T07:59:37.8500939Z INFO:wheel:adding 'torchrl/modules/models/model_based.py'
2025-07-02T07:59:37.8517179Z INFO:wheel:adding 'torchrl/modules/models/models.py'
2025-07-02T07:59:37.8529318Z INFO:wheel:adding 'torchrl/modules/models/multiagent.py'
2025-07-02T07:59:37.8532333Z INFO:wheel:adding 'torchrl/modules/models/rlhf.py'
2025-07-02T07:59:37.8536532Z INFO:wheel:adding 'torchrl/modules/models/utils.py'
2025-07-02T07:59:37.8539778Z INFO:wheel:adding 'torchrl/modules/planners/__init__.py'
2025-07-02T07:59:37.8544413Z INFO:wheel:adding 'torchrl/modules/planners/cem.py'
2025-07-02T07:59:37.8547680Z INFO:wheel:adding 'torchrl/modules/planners/common.py'
2025-07-02T07:59:37.8552517Z INFO:wheel:adding 'torchrl/modules/planners/mppi.py'
2025-07-02T07:59:37.8556170Z INFO:wheel:adding 'torchrl/modules/tensordict_module/__init__.py'
2025-07-02T07:59:37.8587016Z INFO:wheel:adding 'torchrl/modules/tensordict_module/actors.py'
2025-07-02T07:59:37.8596550Z INFO:wheel:adding 'torchrl/modules/tensordict_module/common.py'
2025-07-02T07:59:37.8606561Z INFO:wheel:adding 'torchrl/modules/tensordict_module/exploration.py'
2025-07-02T07:59:37.8613753Z INFO:wheel:adding 'torchrl/modules/tensordict_module/probabilistic.py'
2025-07-02T07:59:37.8633472Z INFO:wheel:adding 'torchrl/modules/tensordict_module/rnn.py'
2025-07-02T07:59:37.8637949Z INFO:wheel:adding 'torchrl/modules/tensordict_module/sequence.py'
2025-07-02T07:59:37.8640826Z INFO:wheel:adding 'torchrl/modules/tensordict_module/world_models.py'
2025-07-02T07:59:37.8644117Z INFO:wheel:adding 'torchrl/modules/utils/__init__.py'
2025-07-02T07:59:37.8646744Z INFO:wheel:adding 'torchrl/modules/utils/mappings.py'
2025-07-02T07:59:37.8649949Z INFO:wheel:adding 'torchrl/modules/utils/utils.py'
2025-07-02T07:59:37.8653578Z INFO:wheel:adding 'torchrl/objectives/__init__.py'
2025-07-02T07:59:37.8663250Z INFO:wheel:adding 'torchrl/objectives/a2c.py'
2025-07-02T07:59:37.8674472Z INFO:wheel:adding 'torchrl/objectives/common.py'
2025-07-02T07:59:37.8693489Z INFO:wheel:adding 'torchrl/objectives/cql.py'
2025-07-02T07:59:37.8704451Z INFO:wheel:adding 'torchrl/objectives/crossq.py'
2025-07-02T07:59:37.8711471Z INFO:wheel:adding 'torchrl/objectives/ddpg.py'
2025-07-02T07:59:37.8716861Z INFO:wheel:adding 'torchrl/objectives/decision_transformer.py'
2025-07-02T07:59:37.8724670Z INFO:wheel:adding 'torchrl/objectives/deprecated.py'
2025-07-02T07:59:37.8734170Z INFO:wheel:adding 'torchrl/objectives/dqn.py'
2025-07-02T07:59:37.8740938Z INFO:wheel:adding 'torchrl/objectives/dreamer.py'
2025-07-02T07:59:37.8744174Z INFO:wheel:adding 'torchrl/objectives/functional.py'
2025-07-02T07:59:37.8748873Z INFO:wheel:adding 'torchrl/objectives/gail.py'
2025-07-02T07:59:37.8759532Z INFO:wheel:adding 'torchrl/objectives/iql.py'
2025-07-02T07:59:37.8782816Z INFO:wheel:adding 'torchrl/objectives/ppo.py'
2025-07-02T07:59:37.8793262Z INFO:wheel:adding 'torchrl/objectives/redq.py'
2025-07-02T07:59:37.8801489Z INFO:wheel:adding 'torchrl/objectives/reinforce.py'
2025-07-02T07:59:37.8822661Z INFO:wheel:adding 'torchrl/objectives/sac.py'
2025-07-02T07:59:37.8831555Z INFO:wheel:adding 'torchrl/objectives/td3.py'
2025-07-02T07:59:37.8840833Z INFO:wheel:adding 'torchrl/objectives/td3_bc.py'
2025-07-02T07:59:37.8851522Z INFO:wheel:adding 'torchrl/objectives/utils.py'
2025-07-02T07:59:37.8855743Z INFO:wheel:adding 'torchrl/objectives/llm/__init__.py'
2025-07-02T07:59:37.8864379Z INFO:wheel:adding 'torchrl/objectives/llm/grpo.py'
2025-07-02T07:59:37.8872079Z INFO:wheel:adding 'torchrl/objectives/llm/sft.py'
2025-07-02T07:59:37.8875357Z INFO:wheel:adding 'torchrl/objectives/multiagent/__init__.py'
2025-07-02T07:59:37.8881844Z INFO:wheel:adding 'torchrl/objectives/multiagent/qmixer.py'
2025-07-02T07:59:37.8885121Z INFO:wheel:adding 'torchrl/objectives/value/__init__.py'
2025-07-02T07:59:37.8904417Z INFO:wheel:adding 'torchrl/objectives/value/advantages.py'
2025-07-02T07:59:37.8917681Z INFO:wheel:adding 'torchrl/objectives/value/functional.py'
2025-07-02T07:59:37.8924375Z INFO:wheel:adding 'torchrl/objectives/value/utils.py'
2025-07-02T07:59:37.8927711Z INFO:wheel:adding 'torchrl/record/__init__.py'
2025-07-02T07:59:37.8935839Z INFO:wheel:adding 'torchrl/record/recorder.py'
2025-07-02T07:59:37.8939578Z INFO:wheel:adding 'torchrl/record/loggers/__init__.py'
2025-07-02T07:59:37.8942451Z INFO:wheel:adding 'torchrl/record/loggers/common.py'
2025-07-02T07:59:37.8947225Z INFO:wheel:adding 'torchrl/record/loggers/csv.py'
2025-07-02T07:59:37.8951101Z INFO:wheel:adding 'torchrl/record/loggers/mlflow.py'
2025-07-02T07:59:37.8954895Z INFO:wheel:adding 'torchrl/record/loggers/tensorboard.py'
2025-07-02T07:59:37.8957980Z INFO:wheel:adding 'torchrl/record/loggers/utils.py'
2025-07-02T07:59:37.8962674Z INFO:wheel:adding 'torchrl/record/loggers/wandb.py'
2025-07-02T07:59:37.8965943Z INFO:wheel:adding 'torchrl/trainers/__init__.py'
2025-07-02T07:59:37.8983481Z INFO:wheel:adding 'torchrl/trainers/trainers.py'
2025-07-02T07:59:37.8987533Z INFO:wheel:adding 'torchrl/trainers/helpers/__init__.py'
2025-07-02T07:59:37.8994206Z INFO:wheel:adding 'torchrl/trainers/helpers/collectors.py'
2025-07-02T07:59:37.9003357Z INFO:wheel:adding 'torchrl/trainers/helpers/envs.py'
2025-07-02T07:59:37.9006807Z INFO:wheel:adding 'torchrl/trainers/helpers/logger.py'
2025-07-02T07:59:37.9010674Z INFO:wheel:adding 'torchrl/trainers/helpers/losses.py'
2025-07-02T07:59:37.9018278Z INFO:wheel:adding 'torchrl/trainers/helpers/models.py'
2025-07-02T07:59:37.9021610Z INFO:wheel:adding 'torchrl/trainers/helpers/replay_buffer.py'
2025-07-02T07:59:37.9027075Z INFO:wheel:adding 'torchrl/trainers/helpers/trainers.py'
2025-07-02T07:59:37.9032558Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/licenses/LICENSE'
2025-07-02T07:59:37.9046529Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/METADATA'
2025-07-02T07:59:37.9048846Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/WHEEL'
2025-07-02T07:59:37.9050793Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/top_level.txt'
2025-07-02T07:59:37.9061227Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/RECORD'
2025-07-02T07:59:37.9066586Z INFO:root:removing build\bdist.win-amd64\wheel
2025-07-02T07:59:38.2393533Z ##[group]Run actions/upload-artifact@v4
2025-07-02T07:59:38.2393826Z with:
2025-07-02T07:59:38.2393995Z   name: torchrl-win-3.12.whl
2025-07-02T07:59:38.2394191Z   path: dist/*.whl
2025-07-02T07:59:38.2394365Z   if-no-files-found: warn
2025-07-02T07:59:38.2394544Z   compression-level: 6
2025-07-02T07:59:38.2394717Z   overwrite: false
2025-07-02T07:59:38.2394890Z   include-hidden-files: false
2025-07-02T07:59:38.2395071Z env:
2025-07-02T07:59:38.2395291Z   pythonLocation: C:\hostedtoolcache\windows\Python\3.12.10\x64
2025-07-02T07:59:38.2395570Z ##[endgroup]
2025-07-02T07:59:38.5122020Z With the provided path, there will be 1 file uploaded
2025-07-02T07:59:38.5127739Z Artifact name is valid!
2025-07-02T07:59:38.5130375Z Root directory input is valid!
2025-07-02T07:59:38.8833438Z Beginning upload of artifact content to blob storage
2025-07-02T07:59:39.1294252Z Uploaded bytes 1334002
2025-07-02T07:59:39.1556137Z Finished uploading artifact content to blob storage!
2025-07-02T07:59:39.1561067Z SHA256 digest of uploaded artifact zip is b29f3a03ccd50e0a60df2132ff1695ac845489a7f8003302996b7de40168eaa8
2025-07-02T07:59:39.1563925Z Finalizing artifact upload
2025-07-02T07:59:39.2336123Z Artifact torchrl-win-3.12.whl.zip successfully finalized. Artifact ID 3447227727
2025-07-02T07:59:39.2336998Z Artifact torchrl-win-3.12.whl has been successfully uploaded! Final size is 1334002 bytes. Artifact ID is 3447227727
2025-07-02T07:59:39.2348003Z Artifact download URL: https://github.com/pytorch/rl/actions/runs/16019399355/artifacts/3447227727
2025-07-02T07:59:39.2592945Z Post job cleanup.
2025-07-02T07:59:39.4724347Z [command]"C:\Program Files\Git\bin\git.exe" version
2025-07-02T07:59:39.4995355Z git version 2.50.0.windows.1
2025-07-02T07:59:39.5069690Z Temporarily overriding HOME='D:\a\_temp\4120539a-6726-400b-b3ea-a80eefa9c97a' before making global git config changes
2025-07-02T07:59:39.5070907Z Adding repository directory to the temporary git global config as a safe directory
2025-07-02T07:59:39.5081653Z [command]"C:\Program Files\Git\bin\git.exe" config --global --add safe.directory D:\a\rl\rl
2025-07-02T07:59:39.5313959Z [command]"C:\Program Files\Git\bin\git.exe" config --local --name-only --get-regexp core\.sshCommand
2025-07-02T07:59:39.5551319Z [command]"C:\Program Files\Git\bin\git.exe" submodule foreach --recursive "sh -c \"git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :\""
2025-07-02T07:59:39.9727773Z [command]"C:\Program Files\Git\bin\git.exe" config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-07-02T07:59:39.9918911Z http.https://github.com/.extraheader
2025-07-02T07:59:39.9950858Z [command]"C:\Program Files\Git\bin\git.exe" config --local --unset-all http.https://github.com/.extraheader
2025-07-02T07:59:40.0169769Z [command]"C:\Program Files\Git\bin\git.exe" submodule foreach --recursive "sh -c \"git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :\""
2025-07-02T07:59:40.4688717Z Post job cleanup.
2025-07-02T07:59:40.6095594Z Cleaning up orphan processes
2025-07-02T07:59:40.6334562Z Terminate orphan process: pid (2984) (vctip)