2025-07-02T07:56:23.7926089Z Current runner version: '2.325.0' 2025-07-02T07:56:23.7949945Z ##[group]Operating System 2025-07-02T07:56:23.7950725Z Microsoft Windows Server 2022 2025-07-02T07:56:23.7951232Z 10.0.20348 2025-07-02T07:56:23.7951668Z Datacenter 2025-07-02T07:56:23.7952117Z ##[endgroup] 2025-07-02T07:56:23.7952552Z ##[group]Runner Image 2025-07-02T07:56:23.7953070Z Image: windows-2022 2025-07-02T07:56:23.7953532Z Version: 20250623.1.0 2025-07-02T07:56:23.7954489Z Included Software: https://github.com/actions/runner-images/blob/win22/20250623.1/images/windows/Windows2022-Readme.md 2025-07-02T07:56:23.7955773Z Image Release: https://github.com/actions/runner-images/releases/tag/win22%2F20250623.1 2025-07-02T07:56:23.7956583Z ##[endgroup] 2025-07-02T07:56:23.7957030Z ##[group]Runner Image Provisioner 2025-07-02T07:56:23.7957526Z 2.0.449.1 2025-07-02T07:56:23.7957954Z ##[endgroup] 2025-07-02T07:56:23.7958825Z ##[group]GITHUB_TOKEN Permissions 2025-07-02T07:56:23.7961014Z Contents: read 2025-07-02T07:56:23.7961570Z Metadata: read 2025-07-02T07:56:23.7962035Z ##[endgroup] 2025-07-02T07:56:23.7963945Z Secret source: Actions 2025-07-02T07:56:23.7964523Z Prepare workflow directory 2025-07-02T07:56:23.8292717Z Prepare all required actions 2025-07-02T07:56:23.8330561Z Getting action download info 2025-07-02T07:56:24.1013466Z ##[group]Download immutable action package 'actions/setup-python@v2' 2025-07-02T07:56:24.1014776Z Version: 2.3.4 2025-07-02T07:56:24.1016217Z Digest: sha256:ce653221798e6b321c1dc17af334e0a1f5f5523f5e7820aa165716f185e981c9 2025-07-02T07:56:24.1017642Z Source commit SHA: e9aba2c848f5ebd159c070c61ea2c4e2b122355e 2025-07-02T07:56:24.1018397Z ##[endgroup] 2025-07-02T07:56:24.5569219Z ##[group]Download immutable action package 'actions/checkout@v4' 2025-07-02T07:56:24.5570024Z Version: 4.2.2 2025-07-02T07:56:24.5570776Z Digest: sha256:ccb2698953eaebd21c7bf6268a94f9c26518a7e38e27e0b83c1fe1ad049819b1 2025-07-02T07:56:24.5571737Z Source commit SHA: 11bd71901bbe5b1630ceea73d27597364c9af683 2025-07-02T07:56:24.5572429Z ##[endgroup] 2025-07-02T07:56:24.6779352Z ##[group]Download immutable action package 'actions/upload-artifact@v4' 2025-07-02T07:56:24.6780277Z Version: 4.6.2 2025-07-02T07:56:24.6781018Z Digest: sha256:290722aa3281d5caf23d0acdc3dbeb3424786a1a01a9cc97e72f147225e37c38 2025-07-02T07:56:24.6781941Z Source commit SHA: ea165f8d65b6e75b540449e92b4886f43607fa02 2025-07-02T07:56:24.6782619Z ##[endgroup] 2025-07-02T07:56:25.0673053Z Complete job name: build-wheel-windows (3.13, 3.13) 2025-07-02T07:56:25.1606976Z ##[group]Run actions/setup-python@v2 2025-07-02T07:56:25.1608001Z with: 2025-07-02T07:56:25.1608379Z python-version: 3.13 2025-07-02T07:56:25.1608991Z token: *** 2025-07-02T07:56:25.1609642Z ##[endgroup] 2025-07-02T07:56:26.1582198Z Successfully setup CPython (3.13.5) 2025-07-02T07:56:26.2098261Z ##[group]Run actions/checkout@v4 2025-07-02T07:56:26.2099341Z with: 2025-07-02T07:56:26.2100102Z repository: pytorch/rl 2025-07-02T07:56:26.2101231Z token: *** 2025-07-02T07:56:26.2102026Z ssh-strict: true 2025-07-02T07:56:26.2102817Z ssh-user: git 2025-07-02T07:56:26.2103625Z persist-credentials: true 2025-07-02T07:56:26.2104545Z clean: true 2025-07-02T07:56:26.2105362Z sparse-checkout-cone-mode: true 2025-07-02T07:56:26.2106366Z fetch-depth: 1 2025-07-02T07:56:26.2107151Z fetch-tags: false 2025-07-02T07:56:26.2107971Z show-progress: true 2025-07-02T07:56:26.2108790Z lfs: false 2025-07-02T07:56:26.2109570Z submodules: false 2025-07-02T07:56:26.2110393Z set-safe-directory: true 2025-07-02T07:56:26.2111266Z env: 2025-07-02T07:56:26.2112264Z pythonLocation: C:\hostedtoolcache\windows\Python\3.13.5\x64 2025-07-02T07:56:26.2113552Z ##[endgroup] 2025-07-02T07:56:26.5071430Z Syncing repository: pytorch/rl 2025-07-02T07:56:26.5074999Z ##[group]Getting Git version info 2025-07-02T07:56:26.5076571Z Working directory is 'D:\a\rl\rl' 2025-07-02T07:56:26.6244048Z [command]"C:\Program Files\Git\bin\git.exe" version 2025-07-02T07:56:26.6469873Z git version 2.50.0.windows.1 2025-07-02T07:56:26.6842092Z ##[endgroup] 2025-07-02T07:56:26.6944752Z Temporarily overriding HOME='D:\a\_temp\b25c19b3-c64c-4c6d-a5f4-830a427c9eec' before making global git config changes 2025-07-02T07:56:26.6947739Z Adding repository directory to the temporary git global config as a safe directory 2025-07-02T07:56:26.6956573Z [command]"C:\Program Files\Git\bin\git.exe" config --global --add safe.directory D:\a\rl\rl 2025-07-02T07:56:26.7680401Z Deleting the contents of 'D:\a\rl\rl' 2025-07-02T07:56:26.7685729Z ##[group]Initializing the repository 2025-07-02T07:56:26.7695860Z [command]"C:\Program Files\Git\bin\git.exe" init D:\a\rl\rl 2025-07-02T07:56:26.9239787Z Initialized empty Git repository in D:/a/rl/rl/.git/ 2025-07-02T07:56:26.9284966Z [command]"C:\Program Files\Git\bin\git.exe" remote add origin https://github.com/pytorch/rl 2025-07-02T07:56:26.9937207Z ##[endgroup] 2025-07-02T07:56:26.9938321Z ##[group]Disabling automatic garbage collection 2025-07-02T07:56:26.9951544Z [command]"C:\Program Files\Git\bin\git.exe" config --local gc.auto 0 2025-07-02T07:56:27.0173856Z ##[endgroup] 2025-07-02T07:56:27.0175251Z ##[group]Setting up auth 2025-07-02T07:56:27.0187316Z [command]"C:\Program Files\Git\bin\git.exe" config --local --name-only --get-regexp core\.sshCommand 2025-07-02T07:56:27.0411677Z [command]"C:\Program Files\Git\bin\git.exe" submodule foreach --recursive "sh -c \"git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :\"" 2025-07-02T07:56:28.8750843Z [command]"C:\Program Files\Git\bin\git.exe" config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-07-02T07:56:28.8989442Z [command]"C:\Program Files\Git\bin\git.exe" submodule foreach --recursive "sh -c \"git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :\"" 2025-07-02T07:56:29.2993490Z [command]"C:\Program Files\Git\bin\git.exe" config --local http.https://github.com/.extraheader "AUTHORIZATION: basic ***" 2025-07-02T07:56:29.3218544Z ##[endgroup] 2025-07-02T07:56:29.3219201Z ##[group]Fetching the repository 2025-07-02T07:56:29.3232619Z [command]"C:\Program Files\Git\bin\git.exe" -c protocol.version=2 fetch --no-tags --prune --no-recurse-submodules --depth=1 origin +2e8d943922590c2356bc44a7af6da18a8d68787e:refs/remotes/pull/3030/merge 2025-07-02T07:56:30.7226792Z From https://github.com/pytorch/rl 2025-07-02T07:56:30.7227488Z * [new ref] 2e8d943922590c2356bc44a7af6da18a8d68787e -> pull/3030/merge 2025-07-02T07:56:30.7458780Z ##[endgroup] 2025-07-02T07:56:30.7459206Z ##[group]Determining the checkout info 2025-07-02T07:56:30.7461354Z ##[endgroup] 2025-07-02T07:56:30.7473591Z [command]"C:\Program Files\Git\bin\git.exe" sparse-checkout disable 2025-07-02T07:56:30.7892632Z [command]"C:\Program Files\Git\bin\git.exe" config --local --unset-all extensions.worktreeConfig 2025-07-02T07:56:30.8103047Z ##[group]Checking out the ref 2025-07-02T07:56:30.8114877Z [command]"C:\Program Files\Git\bin\git.exe" checkout --progress --force refs/remotes/pull/3030/merge 2025-07-02T07:56:31.0764316Z Note: switching to 'refs/remotes/pull/3030/merge'. 2025-07-02T07:56:31.0764798Z 2025-07-02T07:56:31.0765096Z You are in 'detached HEAD' state. You can look around, make experimental 2025-07-02T07:56:31.0765927Z changes and commit them, and you can discard any commits you make in this 2025-07-02T07:56:31.0766448Z state without impacting any branches by switching back to a branch. 2025-07-02T07:56:31.0766787Z 2025-07-02T07:56:31.0766988Z If you want to create a new branch to retain commits you create, you may 2025-07-02T07:56:31.0767475Z do so (now or later) by using -c with the switch command. Example: 2025-07-02T07:56:31.0767758Z 2025-07-02T07:56:31.0767865Z git switch -c 2025-07-02T07:56:31.0768057Z 2025-07-02T07:56:31.0768163Z Or undo this operation with: 2025-07-02T07:56:31.0769242Z 2025-07-02T07:56:31.0769314Z git switch - 2025-07-02T07:56:31.0769484Z 2025-07-02T07:56:31.0769686Z Turn off this advice by setting config variable advice.detachedHead to false 2025-07-02T07:56:31.0769989Z 2025-07-02T07:56:31.0770317Z HEAD is now at 2e8d943 Merge 995ff0d9fa6d4cdbe0120a55642106276bf80342 into 773c366c7b29f5ea26de0215119fb15055714525 2025-07-02T07:56:31.0816088Z ##[endgroup] 2025-07-02T07:56:31.1181062Z [command]"C:\Program Files\Git\bin\git.exe" log -1 --format=%H 2025-07-02T07:56:31.1380640Z 2e8d943922590c2356bc44a7af6da18a8d68787e 2025-07-02T07:56:31.1650066Z ##[group]Run python3 -mpip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cpu -U 2025-07-02T07:56:31.1650874Z python3 -mpip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cpu -U 2025-07-02T07:56:31.1666615Z shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0} 2025-07-02T07:56:31.1666956Z env: 2025-07-02T07:56:31.1667208Z pythonLocation: C:\hostedtoolcache\windows\Python\3.13.5\x64 2025-07-02T07:56:31.1667487Z ##[endgroup] 2025-07-02T07:56:42.9274914Z Looking in indexes: https://download.pytorch.org/whl/nightly/cpu 2025-07-02T07:56:43.3787640Z Collecting torch 2025-07-02T07:56:43.4000325Z Downloading https://download.pytorch.org/whl/nightly/cpu/torch-2.9.0.dev20250701%2Bcpu-cp313-cp313-win_amd64.whl.metadata (29 kB) 2025-07-02T07:56:43.4516708Z Collecting filelock (from torch) 2025-07-02T07:56:43.4567493Z Downloading https://download.pytorch.org/whl/nightly/filelock-3.18.0-py3-none-any.whl.metadata (2.9 kB) 2025-07-02T07:56:43.5037814Z Collecting typing-extensions>=4.10.0 (from torch) 2025-07-02T07:56:43.5094075Z Downloading https://download.pytorch.org/whl/nightly/typing_extensions-4.14.0-py3-none-any.whl.metadata (3.0 kB) 2025-07-02T07:56:43.5672502Z Collecting sympy>=1.13.3 (from torch) 2025-07-02T07:56:43.5725708Z Downloading https://download.pytorch.org/whl/nightly/sympy-1.14.0-py3-none-any.whl.metadata (12 kB) 2025-07-02T07:56:43.6467683Z Collecting networkx (from torch) 2025-07-02T07:56:43.6526304Z Downloading https://download.pytorch.org/whl/nightly/networkx-3.5-py3-none-any.whl.metadata (6.3 kB) 2025-07-02T07:56:43.7493108Z Collecting jinja2 (from torch) 2025-07-02T07:56:43.7622030Z Downloading https://download.pytorch.org/whl/nightly/jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB) 2025-07-02T07:56:43.8207223Z Collecting fsspec (from torch) 2025-07-02T07:56:43.8347473Z Downloading https://download.pytorch.org/whl/nightly/fsspec-2025.5.1-py3-none-any.whl.metadata (11 kB) 2025-07-02T07:56:43.9078067Z Collecting setuptools (from torch) 2025-07-02T07:56:43.9137181Z Downloading https://download.pytorch.org/whl/nightly/setuptools-78.1.0-py3-none-any.whl.metadata (6.6 kB) 2025-07-02T07:56:43.9706993Z Collecting mpmath<1.4,>=1.1.0 (from sympy>=1.13.3->torch) 2025-07-02T07:56:43.9772315Z Downloading https://download.pytorch.org/whl/nightly/mpmath-1.3.0-py3-none-any.whl (536 kB) 2025-07-02T07:56:44.0125610Z ------------------------------------- 536.2/536.2 kB 20.4 MB/s eta 0:00:00 2025-07-02T07:56:44.0981829Z Collecting MarkupSafe>=2.0 (from jinja2->torch) 2025-07-02T07:56:44.1046673Z Downloading https://download.pytorch.org/whl/nightly/MarkupSafe-2.1.5.tar.gz (19 kB) 2025-07-02T07:56:44.2374677Z Installing build dependencies: started 2025-07-02T07:56:47.2786681Z Installing build dependencies: finished with status 'done' 2025-07-02T07:56:47.2803137Z Getting requirements to build wheel: started 2025-07-02T07:56:48.3282552Z Getting requirements to build wheel: finished with status 'done' 2025-07-02T07:56:48.3309726Z Preparing metadata (pyproject.toml): started 2025-07-02T07:56:48.7190407Z Preparing metadata (pyproject.toml): finished with status 'done' 2025-07-02T07:56:48.7315587Z Downloading https://download.pytorch.org/whl/nightly/cpu/torch-2.9.0.dev20250701%2Bcpu-cp313-cp313-win_amd64.whl (619.5 MB) 2025-07-02T07:56:59.2286989Z --------------------------------------- 619.5/619.5 MB 27.9 MB/s eta 0:00:00 2025-07-02T07:56:59.3692822Z Downloading https://download.pytorch.org/whl/nightly/sympy-1.14.0-py3-none-any.whl (6.3 MB) 2025-07-02T07:57:00.0202803Z ---------------------------------------- 6.3/6.3 MB 9.3 MB/s eta 0:00:00 2025-07-02T07:57:00.0265869Z Downloading https://download.pytorch.org/whl/nightly/typing_extensions-4.14.0-py3-none-any.whl (43 kB) 2025-07-02T07:57:00.0870813Z Downloading https://download.pytorch.org/whl/nightly/filelock-3.18.0-py3-none-any.whl (16 kB) 2025-07-02T07:57:00.1205962Z Downloading https://download.pytorch.org/whl/nightly/fsspec-2025.5.1-py3-none-any.whl (199 kB) 2025-07-02T07:57:00.1362492Z Downloading https://download.pytorch.org/whl/nightly/jinja2-3.1.6-py3-none-any.whl (134 kB) 2025-07-02T07:57:00.1937768Z Downloading https://download.pytorch.org/whl/nightly/networkx-3.5-py3-none-any.whl (2.0 MB) 2025-07-02T07:57:00.2220180Z ---------------------------------------- 2.0/2.0 MB 69.3 MB/s eta 0:00:00 2025-07-02T07:57:00.2346793Z Using cached https://download.pytorch.org/whl/nightly/setuptools-78.1.0-py3-none-any.whl (1.3 MB) 2025-07-02T07:57:00.8929072Z Building wheels for collected packages: MarkupSafe 2025-07-02T07:57:00.9340316Z Building wheel for MarkupSafe (pyproject.toml): started 2025-07-02T07:57:33.1747386Z Building wheel for MarkupSafe (pyproject.toml): finished with status 'done' 2025-07-02T07:57:33.1768564Z Created wheel for MarkupSafe: filename=markupsafe-2.1.5-cp313-cp313-win_amd64.whl size=17245 sha256=2c564d93125a2ffcf4015bd17c9d820b50e65bf4626d723e2fbb0cf011a5833f 2025-07-02T07:57:33.1770757Z Stored in directory: c:\users\runneradmin\appdata\local\pip\cache\wheels\3a\21\87\28c44597225fd0c28d6ffa365f1c2c9dd0ab763711aa4957c6 2025-07-02T07:57:33.1961950Z Successfully built MarkupSafe 2025-07-02T07:57:33.2781043Z Installing collected packages: mpmath, typing-extensions, sympy, setuptools, networkx, MarkupSafe, fsspec, filelock, jinja2, torch 2025-07-02T07:59:16.7976599Z 2025-07-02T07:59:16.7998564Z Successfully installed MarkupSafe-2.1.5 filelock-3.18.0 fsspec-2025.5.1 jinja2-3.1.6 mpmath-1.3.0 networkx-3.5 setuptools-78.1.0 sympy-1.14.0 torch-2.9.0.dev20250701+cpu typing-extensions-4.14.0 2025-07-02T07:59:17.2001316Z ##[group]Run rm -r dist || true 2025-07-02T07:59:17.2001656Z rm -r dist || true 2025-07-02T07:59:17.2001938Z python3 -mpip install wheel 2025-07-02T07:59:17.2002212Z python3 setup.py bdist_wheel \ 2025-07-02T07:59:17.2002531Z  --package_name torchrl-nightly \ 2025-07-02T07:59:17.2002829Z  --python-tag= 2025-07-02T07:59:17.2015195Z shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0} 2025-07-02T07:59:17.2015572Z env: 2025-07-02T07:59:17.2015877Z pythonLocation: C:\hostedtoolcache\windows\Python\3.13.5\x64 2025-07-02T07:59:17.2016203Z ##[endgroup] 2025-07-02T07:59:17.2516099Z rm: cannot remove 'dist': No such file or directory 2025-07-02T07:59:18.8092830Z Collecting wheel 2025-07-02T07:59:18.8376370Z Downloading wheel-0.45.1-py3-none-any.whl.metadata (2.3 kB) 2025-07-02T07:59:18.8579772Z Downloading wheel-0.45.1-py3-none-any.whl (72 kB) 2025-07-02T07:59:18.9275743Z Installing collected packages: wheel 2025-07-02T07:59:19.0238713Z Successfully installed wheel-0.45.1 2025-07-02T07:59:20.5721821Z C:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\torch\_subclasses\functional_tensor.py:279: UserWarning: Failed to initialize NumPy: No module named 'numpy' (Triggered internally at C:\actions-runner\_work\pytorch\pytorch\pytorch\torch\csrc\utils\tensor_numpy.cpp:81.) 2025-07-02T07:59:20.5724045Z cpu = _conversion_method_template(device=torch.device("cpu")) 2025-07-02T07:59:21.4627710Z C:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\setuptools\dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-07-02T07:59:21.4628678Z !! 2025-07-02T07:59:21.4628850Z 2025-07-02T07:59:21.4628987Z ******************************************************************************** 2025-07-02T07:59:21.4629901Z Please consider removing the following classifiers in favor of a SPDX license expression: 2025-07-02T07:59:21.4630358Z 2025-07-02T07:59:21.4630872Z License :: OSI Approved :: MIT License 2025-07-02T07:59:21.4631572Z License :: OSI Approved :: BSD License 2025-07-02T07:59:21.4631929Z 2025-07-02T07:59:21.4632566Z See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-07-02T07:59:21.4633493Z ******************************************************************************** 2025-07-02T07:59:21.4633871Z 2025-07-02T07:59:21.4634049Z !! 2025-07-02T07:59:21.4634423Z self._finalize_license_expression() 2025-07-02T07:59:21.4728997Z INFO:root:running bdist_wheel 2025-07-02T07:59:21.7111519Z INFO:root:running build 2025-07-02T07:59:21.7111894Z INFO:root:running build_py 2025-07-02T07:59:21.7164834Z INFO:root:creating build\lib.win-amd64-cpython-313\build_tools 2025-07-02T07:59:21.7169900Z INFO:root:copying build_tools\__init__.py -> build\lib.win-amd64-cpython-313\build_tools 2025-07-02T07:59:21.7175894Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl 2025-07-02T07:59:21.7178379Z INFO:root:copying torchrl\version.py -> build\lib.win-amd64-cpython-313\torchrl 2025-07-02T07:59:21.7182893Z INFO:root:copying torchrl\_extension.py -> build\lib.win-amd64-cpython-313\torchrl 2025-07-02T07:59:21.7187791Z INFO:root:copying torchrl\_utils.py -> build\lib.win-amd64-cpython-313\torchrl 2025-07-02T07:59:21.7193123Z INFO:root:copying torchrl\__init__.py -> build\lib.win-amd64-cpython-313\torchrl 2025-07-02T07:59:21.7198599Z INFO:root:creating build\lib.win-amd64-cpython-313\build_tools\setup_helpers 2025-07-02T07:59:21.7201227Z INFO:root:copying build_tools\setup_helpers\extension.py -> build\lib.win-amd64-cpython-313\build_tools\setup_helpers 2025-07-02T07:59:21.7205867Z INFO:root:copying build_tools\setup_helpers\__init__.py -> build\lib.win-amd64-cpython-313\build_tools\setup_helpers 2025-07-02T07:59:21.7211098Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\collectors 2025-07-02T07:59:21.7215774Z INFO:root:copying torchrl\collectors\collectors.py -> build\lib.win-amd64-cpython-313\torchrl\collectors 2025-07-02T07:59:21.7220731Z INFO:root:copying torchrl\collectors\utils.py -> build\lib.win-amd64-cpython-313\torchrl\collectors 2025-07-02T07:59:21.7225223Z INFO:root:copying torchrl\collectors\weight_update.py -> build\lib.win-amd64-cpython-313\torchrl\collectors 2025-07-02T07:59:21.7230095Z INFO:root:copying torchrl\collectors\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\collectors 2025-07-02T07:59:21.7235496Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\data 2025-07-02T07:59:21.7237980Z INFO:root:copying torchrl\data\rlhf.py -> build\lib.win-amd64-cpython-313\torchrl\data 2025-07-02T07:59:21.7242516Z INFO:root:copying torchrl\data\tensor_specs.py -> build\lib.win-amd64-cpython-313\torchrl\data 2025-07-02T07:59:21.7250489Z INFO:root:copying torchrl\data\utils.py -> build\lib.win-amd64-cpython-313\torchrl\data 2025-07-02T07:59:21.7255630Z INFO:root:copying torchrl\data\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\data 2025-07-02T07:59:21.7261690Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7267772Z INFO:root:copying torchrl\envs\async_envs.py -> build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7273352Z INFO:root:copying torchrl\envs\batched_envs.py -> build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7280195Z INFO:root:copying torchrl\envs\common.py -> build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7286821Z INFO:root:copying torchrl\envs\env_creator.py -> build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7291894Z INFO:root:copying torchrl\envs\gym_like.py -> build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7297268Z INFO:root:copying torchrl\envs\utils.py -> build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7303428Z INFO:root:copying torchrl\envs\vec_envs.py -> build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7310998Z INFO:root:copying torchrl\envs\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs 2025-07-02T07:59:21.7316941Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules 2025-07-02T07:59:21.7319718Z INFO:root:copying torchrl\modules\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules 2025-07-02T07:59:21.7326606Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7329435Z INFO:root:copying torchrl\objectives\a2c.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7334989Z INFO:root:copying torchrl\objectives\common.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7340410Z INFO:root:copying torchrl\objectives\cql.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7346222Z INFO:root:copying torchrl\objectives\crossq.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7351607Z INFO:root:copying torchrl\objectives\ddpg.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7357096Z INFO:root:copying torchrl\objectives\decision_transformer.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7362064Z INFO:root:copying torchrl\objectives\deprecated.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7369744Z INFO:root:copying torchrl\objectives\dqn.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7374625Z INFO:root:copying torchrl\objectives\dreamer.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7379462Z INFO:root:copying torchrl\objectives\functional.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7383949Z INFO:root:copying torchrl\objectives\gail.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7388406Z INFO:root:copying torchrl\objectives\iql.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7394198Z INFO:root:copying torchrl\objectives\ppo.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7398861Z INFO:root:copying torchrl\objectives\redq.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7403673Z INFO:root:copying torchrl\objectives\reinforce.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7409201Z INFO:root:copying torchrl\objectives\sac.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7414503Z INFO:root:copying torchrl\objectives\td3.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7419323Z INFO:root:copying torchrl\objectives\td3_bc.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7424229Z INFO:root:copying torchrl\objectives\utils.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7429098Z INFO:root:copying torchrl\objectives\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\objectives 2025-07-02T07:59:21.7434475Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\record 2025-07-02T07:59:21.7436907Z INFO:root:copying torchrl\record\recorder.py -> build\lib.win-amd64-cpython-313\torchrl\record 2025-07-02T07:59:21.7441912Z INFO:root:copying torchrl\record\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\record 2025-07-02T07:59:21.7447016Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\trainers 2025-07-02T07:59:21.7449566Z INFO:root:copying torchrl\trainers\trainers.py -> build\lib.win-amd64-cpython-313\torchrl\trainers 2025-07-02T07:59:21.7454826Z INFO:root:copying torchrl\trainers\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\trainers 2025-07-02T07:59:21.7460450Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\collectors\distributed 2025-07-02T07:59:21.7462986Z INFO:root:copying torchrl\collectors\distributed\default_configs.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\distributed 2025-07-02T07:59:21.7467690Z INFO:root:copying torchrl\collectors\distributed\generic.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\distributed 2025-07-02T07:59:21.7472552Z INFO:root:copying torchrl\collectors\distributed\ray.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\distributed 2025-07-02T07:59:21.7477501Z INFO:root:copying torchrl\collectors\distributed\rpc.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\distributed 2025-07-02T07:59:21.7482507Z INFO:root:copying torchrl\collectors\distributed\sync.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\distributed 2025-07-02T07:59:21.7487455Z INFO:root:copying torchrl\collectors\distributed\utils.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\distributed 2025-07-02T07:59:21.7492008Z INFO:root:copying torchrl\collectors\distributed\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\distributed 2025-07-02T07:59:21.7500140Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\collectors\llm 2025-07-02T07:59:21.7502532Z INFO:root:copying torchrl\collectors\llm\base.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\llm 2025-07-02T07:59:21.7507624Z INFO:root:copying torchrl\collectors\llm\ray_collector.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\llm 2025-07-02T07:59:21.7512182Z INFO:root:copying torchrl\collectors\llm\utils.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\llm 2025-07-02T07:59:21.7516693Z INFO:root:copying torchrl\collectors\llm\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\llm 2025-07-02T07:59:21.7521843Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\collectors\llm\weight_update 2025-07-02T07:59:21.7524401Z INFO:root:copying torchrl\collectors\llm\weight_update\vllm.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\llm\weight_update 2025-07-02T07:59:21.7528999Z INFO:root:copying torchrl\collectors\llm\weight_update\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\collectors\llm\weight_update 2025-07-02T07:59:21.7534454Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7537004Z INFO:root:copying torchrl\data\datasets\atari_dqn.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7542036Z INFO:root:copying torchrl\data\datasets\common.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7546552Z INFO:root:copying torchrl\data\datasets\d4rl.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7551466Z INFO:root:copying torchrl\data\datasets\d4rl_infos.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7556318Z INFO:root:copying torchrl\data\datasets\gen_dgrl.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7560891Z INFO:root:copying torchrl\data\datasets\minari_data.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7566185Z INFO:root:copying torchrl\data\datasets\openml.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7574428Z INFO:root:copying torchrl\data\datasets\openx.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7579527Z INFO:root:copying torchrl\data\datasets\roboset.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7584658Z INFO:root:copying torchrl\data\datasets\utils.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7588940Z INFO:root:copying torchrl\data\datasets\vd4rl.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7593681Z INFO:root:copying torchrl\data\datasets\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\data\datasets 2025-07-02T07:59:21.7599221Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7601599Z INFO:root:copying torchrl\data\llm\chat.py -> build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7608178Z INFO:root:copying torchrl\data\llm\common.py -> build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7612722Z INFO:root:copying torchrl\data\llm\dataset.py -> build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7617523Z INFO:root:copying torchrl\data\llm\prompt.py -> build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7622093Z INFO:root:copying torchrl\data\llm\reward.py -> build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7626446Z INFO:root:copying torchrl\data\llm\topk.py -> build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7630925Z INFO:root:copying torchrl\data\llm\utils.py -> build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7638357Z INFO:root:copying torchrl\data\llm\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\data\llm 2025-07-02T07:59:21.7643909Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\data\map 2025-07-02T07:59:21.7660526Z INFO:root:copying torchrl\data\map\hash.py -> build\lib.win-amd64-cpython-313\torchrl\data\map 2025-07-02T07:59:21.7665199Z INFO:root:copying torchrl\data\map\query.py -> build\lib.win-amd64-cpython-313\torchrl\data\map 2025-07-02T07:59:21.7669722Z INFO:root:copying torchrl\data\map\tdstorage.py -> build\lib.win-amd64-cpython-313\torchrl\data\map 2025-07-02T07:59:21.7674285Z INFO:root:copying torchrl\data\map\tree.py -> build\lib.win-amd64-cpython-313\torchrl\data\map 2025-07-02T07:59:21.7679574Z INFO:root:copying torchrl\data\map\utils.py -> build\lib.win-amd64-cpython-313\torchrl\data\map 2025-07-02T07:59:21.7684124Z INFO:root:copying torchrl\data\map\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\data\map 2025-07-02T07:59:21.7689266Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\data\postprocs 2025-07-02T07:59:21.7691742Z INFO:root:copying torchrl\data\postprocs\postprocs.py -> build\lib.win-amd64-cpython-313\torchrl\data\postprocs 2025-07-02T07:59:21.7696333Z INFO:root:copying torchrl\data\postprocs\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\data\postprocs 2025-07-02T07:59:21.7701986Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7704368Z INFO:root:copying torchrl\data\replay_buffers\checkpointers.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7709043Z INFO:root:copying torchrl\data\replay_buffers\ray_buffer.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7713668Z INFO:root:copying torchrl\data\replay_buffers\replay_buffers.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7719628Z INFO:root:copying torchrl\data\replay_buffers\samplers.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7725186Z INFO:root:copying torchrl\data\replay_buffers\scheduler.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7729706Z INFO:root:copying torchrl\data\replay_buffers\storages.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7737851Z INFO:root:copying torchrl\data\replay_buffers\utils.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7742948Z INFO:root:copying torchrl\data\replay_buffers\writers.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7747697Z INFO:root:copying torchrl\data\replay_buffers\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers 2025-07-02T07:59:21.7753150Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\custom 2025-07-02T07:59:21.7755605Z INFO:root:copying torchrl\envs\custom\chess.py -> build\lib.win-amd64-cpython-313\torchrl\envs\custom 2025-07-02T07:59:21.7760624Z INFO:root:copying torchrl\envs\custom\llm.py -> build\lib.win-amd64-cpython-313\torchrl\envs\custom 2025-07-02T07:59:21.7765206Z INFO:root:copying torchrl\envs\custom\pendulum.py -> build\lib.win-amd64-cpython-313\torchrl\envs\custom 2025-07-02T07:59:21.7770145Z INFO:root:copying torchrl\envs\custom\tictactoeenv.py -> build\lib.win-amd64-cpython-313\torchrl\envs\custom 2025-07-02T07:59:21.7774604Z INFO:root:copying torchrl\envs\custom\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\custom 2025-07-02T07:59:21.7780647Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7783044Z INFO:root:copying torchrl\envs\libs\brax.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7787987Z INFO:root:copying torchrl\envs\libs\dm_control.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7792826Z INFO:root:copying torchrl\envs\libs\envpool.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7797532Z INFO:root:copying torchrl\envs\libs\gym.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7802927Z INFO:root:copying torchrl\envs\libs\habitat.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7807526Z INFO:root:copying torchrl\envs\libs\isaacgym.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7812063Z INFO:root:copying torchrl\envs\libs\isaac_lab.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7819447Z INFO:root:copying torchrl\envs\libs\jax_utils.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7823967Z INFO:root:copying torchrl\envs\libs\jumanji.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7828987Z INFO:root:copying torchrl\envs\libs\meltingpot.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7833834Z INFO:root:copying torchrl\envs\libs\openml.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7838355Z INFO:root:copying torchrl\envs\libs\openspiel.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7843147Z INFO:root:copying torchrl\envs\libs\pettingzoo.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7848028Z INFO:root:copying torchrl\envs\libs\robohive.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7853171Z INFO:root:copying torchrl\envs\libs\smacv2.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7857520Z INFO:root:copying torchrl\envs\libs\unity_mlagents.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7862510Z INFO:root:copying torchrl\envs\libs\utils.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7866984Z INFO:root:copying torchrl\envs\libs\vmas.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7871928Z INFO:root:copying torchrl\envs\libs\_gym_utils.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7876702Z INFO:root:copying torchrl\envs\libs\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\libs 2025-07-02T07:59:21.7882727Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\llm 2025-07-02T07:59:21.7885184Z INFO:root:copying torchrl\envs\llm\chat.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm 2025-07-02T07:59:21.7890081Z INFO:root:copying torchrl\envs\llm\envs.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm 2025-07-02T07:59:21.7895004Z INFO:root:copying torchrl\envs\llm\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm 2025-07-02T07:59:21.7900283Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\model_based 2025-07-02T07:59:21.7902727Z INFO:root:copying torchrl\envs\model_based\common.py -> build\lib.win-amd64-cpython-313\torchrl\envs\model_based 2025-07-02T07:59:21.7907300Z INFO:root:copying torchrl\envs\model_based\dreamer.py -> build\lib.win-amd64-cpython-313\torchrl\envs\model_based 2025-07-02T07:59:21.7911912Z INFO:root:copying torchrl\envs\model_based\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\model_based 2025-07-02T07:59:21.7917633Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7920251Z INFO:root:copying torchrl\envs\transforms\functional.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7924744Z INFO:root:copying torchrl\envs\transforms\gym_transforms.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7929154Z INFO:root:copying torchrl\envs\transforms\llm.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7933651Z INFO:root:copying torchrl\envs\transforms\r3m.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7938182Z INFO:root:copying torchrl\envs\transforms\rb_transforms.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7942622Z INFO:root:copying torchrl\envs\transforms\rlhf.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7947033Z INFO:root:copying torchrl\envs\transforms\transforms.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7957998Z INFO:root:copying torchrl\envs\transforms\utils.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7962460Z INFO:root:copying torchrl\envs\transforms\vc1.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7967062Z INFO:root:copying torchrl\envs\transforms\vecnorm.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7971881Z INFO:root:copying torchrl\envs\transforms\vip.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7976424Z INFO:root:copying torchrl\envs\transforms\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\transforms 2025-07-02T07:59:21.7981792Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\llm\datasets 2025-07-02T07:59:21.7984169Z INFO:root:copying torchrl\envs\llm\datasets\gsm8k.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\datasets 2025-07-02T07:59:21.7988816Z INFO:root:copying torchrl\envs\llm\datasets\ifeval.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\datasets 2025-07-02T07:59:21.7993552Z INFO:root:copying torchrl\envs\llm\datasets\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\datasets 2025-07-02T07:59:21.7998487Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\llm\libs 2025-07-02T07:59:21.8000798Z INFO:root:copying torchrl\envs\llm\libs\mlgym.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\libs 2025-07-02T07:59:21.8005757Z INFO:root:copying torchrl\envs\llm\libs\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\libs 2025-07-02T07:59:21.8010817Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward 2025-07-02T07:59:21.8013297Z INFO:root:copying torchrl\envs\llm\reward\gsm8k.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward 2025-07-02T07:59:21.8017926Z INFO:root:copying torchrl\envs\llm\reward\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward 2025-07-02T07:59:21.8023419Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8028449Z INFO:root:copying torchrl\envs\llm\transforms\browser.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8033398Z INFO:root:copying torchrl\envs\llm\transforms\dataloading.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8038315Z INFO:root:copying torchrl\envs\llm\transforms\format.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8042853Z INFO:root:copying torchrl\envs\llm\transforms\kl.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8048393Z INFO:root:copying torchrl\envs\llm\transforms\policy_version.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8052985Z INFO:root:copying torchrl\envs\llm\transforms\reason.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8058058Z INFO:root:copying torchrl\envs\llm\transforms\tokenizer.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8066225Z INFO:root:copying torchrl\envs\llm\transforms\tools.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8071122Z INFO:root:copying torchrl\envs\llm\transforms\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms 2025-07-02T07:59:21.8076842Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:21.8079370Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_instructions.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:21.8084747Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_instructions_main.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:21.8089355Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_instructions_registry.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:21.8093920Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_instructions_util.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:21.8098806Z INFO:root:copying torchrl\envs\llm\reward\ifeval\_scorer.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:21.8103306Z INFO:root:copying torchrl\envs\llm\reward\ifeval\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:21.8112102Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules\distributions 2025-07-02T07:59:21.8114675Z INFO:root:copying torchrl\modules\distributions\continuous.py -> build\lib.win-amd64-cpython-313\torchrl\modules\distributions 2025-07-02T07:59:21.8119537Z INFO:root:copying torchrl\modules\distributions\discrete.py -> build\lib.win-amd64-cpython-313\torchrl\modules\distributions 2025-07-02T07:59:21.8124468Z INFO:root:copying torchrl\modules\distributions\truncated_normal.py -> build\lib.win-amd64-cpython-313\torchrl\modules\distributions 2025-07-02T07:59:21.8129011Z INFO:root:copying torchrl\modules\distributions\utils.py -> build\lib.win-amd64-cpython-313\torchrl\modules\distributions 2025-07-02T07:59:21.8133388Z INFO:root:copying torchrl\modules\distributions\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules\distributions 2025-07-02T07:59:21.8138579Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules\llm 2025-07-02T07:59:21.8140976Z INFO:root:copying torchrl\modules\llm\utils.py -> build\lib.win-amd64-cpython-313\torchrl\modules\llm 2025-07-02T07:59:21.8145450Z INFO:root:copying torchrl\modules\llm\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules\llm 2025-07-02T07:59:21.8151221Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8153661Z INFO:root:copying torchrl\modules\models\batchrenorm.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8158356Z INFO:root:copying torchrl\modules\models\decision_transformer.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8162810Z INFO:root:copying torchrl\modules\models\exploration.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8168186Z INFO:root:copying torchrl\modules\models\llm.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8172655Z INFO:root:copying torchrl\modules\models\models.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8177976Z INFO:root:copying torchrl\modules\models\model_based.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8182511Z INFO:root:copying torchrl\modules\models\multiagent.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8191107Z INFO:root:copying torchrl\modules\models\rlhf.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8195450Z INFO:root:copying torchrl\modules\models\utils.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8199987Z INFO:root:copying torchrl\modules\models\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules\models 2025-07-02T07:59:21.8205303Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules\planners 2025-07-02T07:59:21.8207782Z INFO:root:copying torchrl\modules\planners\cem.py -> build\lib.win-amd64-cpython-313\torchrl\modules\planners 2025-07-02T07:59:21.8221732Z INFO:root:copying torchrl\modules\planners\common.py -> build\lib.win-amd64-cpython-313\torchrl\modules\planners 2025-07-02T07:59:21.8222773Z INFO:root:copying torchrl\modules\planners\mppi.py -> build\lib.win-amd64-cpython-313\torchrl\modules\planners 2025-07-02T07:59:21.8226058Z INFO:root:copying torchrl\modules\planners\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules\planners 2025-07-02T07:59:21.8231577Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8234050Z INFO:root:copying torchrl\modules\tensordict_module\actors.py -> build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8239641Z INFO:root:copying torchrl\modules\tensordict_module\common.py -> build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8244743Z INFO:root:copying torchrl\modules\tensordict_module\exploration.py -> build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8256154Z INFO:root:copying torchrl\modules\tensordict_module\probabilistic.py -> build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8260973Z INFO:root:copying torchrl\modules\tensordict_module\rnn.py -> build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8266314Z INFO:root:copying torchrl\modules\tensordict_module\sequence.py -> build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8270867Z INFO:root:copying torchrl\modules\tensordict_module\world_models.py -> build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8278121Z INFO:root:copying torchrl\modules\tensordict_module\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module 2025-07-02T07:59:21.8283208Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules\utils 2025-07-02T07:59:21.8287287Z INFO:root:copying torchrl\modules\utils\mappings.py -> build\lib.win-amd64-cpython-313\torchrl\modules\utils 2025-07-02T07:59:21.8291617Z INFO:root:copying torchrl\modules\utils\utils.py -> build\lib.win-amd64-cpython-313\torchrl\modules\utils 2025-07-02T07:59:21.8296110Z INFO:root:copying torchrl\modules\utils\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules\utils 2025-07-02T07:59:21.8301356Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules\llm\backends 2025-07-02T07:59:21.8303789Z INFO:root:copying torchrl\modules\llm\backends\vllm.py -> build\lib.win-amd64-cpython-313\torchrl\modules\llm\backends 2025-07-02T07:59:21.8308373Z INFO:root:copying torchrl\modules\llm\backends\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules\llm\backends 2025-07-02T07:59:21.8313581Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies 2025-07-02T07:59:21.8316018Z INFO:root:copying torchrl\modules\llm\policies\common.py -> build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies 2025-07-02T07:59:21.8321060Z INFO:root:copying torchrl\modules\llm\policies\transformers_wrapper.py -> build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies 2025-07-02T07:59:21.8326444Z INFO:root:copying torchrl\modules\llm\policies\vllm_wrapper.py -> build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies 2025-07-02T07:59:21.8331767Z INFO:root:copying torchrl\modules\llm\policies\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies 2025-07-02T07:59:21.8336815Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\objectives\llm 2025-07-02T07:59:21.8339317Z INFO:root:copying torchrl\objectives\llm\grpo.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\llm 2025-07-02T07:59:21.8344646Z INFO:root:copying torchrl\objectives\llm\sft.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\llm 2025-07-02T07:59:21.8349656Z INFO:root:copying torchrl\objectives\llm\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\llm 2025-07-02T07:59:21.8354694Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\objectives\multiagent 2025-07-02T07:59:21.8357252Z INFO:root:copying torchrl\objectives\multiagent\qmixer.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\multiagent 2025-07-02T07:59:21.8362116Z INFO:root:copying torchrl\objectives\multiagent\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\multiagent 2025-07-02T07:59:21.8367288Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\objectives\value 2025-07-02T07:59:21.8369801Z INFO:root:copying torchrl\objectives\value\advantages.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\value 2025-07-02T07:59:21.8375291Z INFO:root:copying torchrl\objectives\value\functional.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\value 2025-07-02T07:59:21.8380645Z INFO:root:copying torchrl\objectives\value\utils.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\value 2025-07-02T07:59:21.8385184Z INFO:root:copying torchrl\objectives\value\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\objectives\value 2025-07-02T07:59:21.8390510Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\record\loggers 2025-07-02T07:59:21.8393009Z INFO:root:copying torchrl\record\loggers\common.py -> build\lib.win-amd64-cpython-313\torchrl\record\loggers 2025-07-02T07:59:21.8397457Z INFO:root:copying torchrl\record\loggers\csv.py -> build\lib.win-amd64-cpython-313\torchrl\record\loggers 2025-07-02T07:59:21.8402231Z INFO:root:copying torchrl\record\loggers\mlflow.py -> build\lib.win-amd64-cpython-313\torchrl\record\loggers 2025-07-02T07:59:21.8406819Z INFO:root:copying torchrl\record\loggers\tensorboard.py -> build\lib.win-amd64-cpython-313\torchrl\record\loggers 2025-07-02T07:59:21.8411987Z INFO:root:copying torchrl\record\loggers\utils.py -> build\lib.win-amd64-cpython-313\torchrl\record\loggers 2025-07-02T07:59:21.8415789Z INFO:root:copying torchrl\record\loggers\wandb.py -> build\lib.win-amd64-cpython-313\torchrl\record\loggers 2025-07-02T07:59:21.8420241Z INFO:root:copying torchrl\record\loggers\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\record\loggers 2025-07-02T07:59:21.8428082Z INFO:root:creating build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8430619Z INFO:root:copying torchrl\trainers\helpers\collectors.py -> build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8435502Z INFO:root:copying torchrl\trainers\helpers\envs.py -> build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8440449Z INFO:root:copying torchrl\trainers\helpers\logger.py -> build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8445017Z INFO:root:copying torchrl\trainers\helpers\losses.py -> build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8449533Z INFO:root:copying torchrl\trainers\helpers\models.py -> build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8454974Z INFO:root:copying torchrl\trainers\helpers\replay_buffer.py -> build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8459549Z INFO:root:copying torchrl\trainers\helpers\trainers.py -> build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8467094Z INFO:root:copying torchrl\trainers\helpers\__init__.py -> build\lib.win-amd64-cpython-313\torchrl\trainers\helpers 2025-07-02T07:59:21.8557888Z INFO:root:running build_ext 2025-07-02T07:59:21.8666012Z W0702 07:59:21.865000 3068 site-packages\torch\utils\cpp_extension.py:466] Error checking compiler version for cl: [WinError 2] The system cannot find the file specified 2025-07-02T07:59:21.8672510Z INFO:root:building 'torchrl._torchrl' extension 2025-07-02T07:59:23.2896956Z INFO:root:creating D:\a\rl\rl\build\temp.win-amd64-cpython-313\Release\a\rl\rl\torchrl\csrc 2025-07-02T07:59:23.3214714Z W0702 07:59:23.320000 3068 site-packages\torch\utils\cpp_extension.py:466] Error checking compiler version for cl: [WinError 2] The system cannot find the file specified 2025-07-02T07:59:23.3221053Z C:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\setuptools\_distutils\_msvccompiler.py:12: UserWarning: _get_vc_env is private; find an alternative (pypa/distutils#340) 2025-07-02T07:59:23.3221925Z warnings.warn( 2025-07-02T07:59:44.2701192Z [1/2] cl /showIncludes /nologo /O2 /W3 /GL /DNDEBUG /MD -ID:\a\rl\rl -IC:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\torch\include -IC:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\hostedtoolcache\windows\Python\3.13.5\x64\include -IC:\hostedtoolcache\windows\Python\3.13.5\x64\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Auxiliary\VS\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.26100.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\um" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\shared" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\winrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\cppwinrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\include\um" /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /wd4624 /wd4067 /wd4068 /EHsc -c D:\a\rl\rl\torchrl\csrc\utils.cpp /FoD:\a\rl\rl\build\temp.win-amd64-cpython-313\Release\a\rl\rl\torchrl\csrc\utils.obj -O3 -std=c++17 -fdiagnostics-color=always -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_torchrl /std:c++17 2025-07-02T07:59:44.2709183Z cl : Command line warning D9002 : ignoring unknown option '-O3' 2025-07-02T07:59:44.2710288Z cl : Command line warning D9002 : ignoring unknown option '-std=c++17' 2025-07-02T07:59:44.2711283Z cl : Command line warning D9002 : ignoring unknown option '-fdiagnostics-color=always' 2025-07-02T07:59:45.8732644Z [2/2] cl /showIncludes /nologo /O2 /W3 /GL /DNDEBUG /MD -ID:\a\rl\rl -IC:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\torch\include -IC:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\hostedtoolcache\windows\Python\3.13.5\x64\include -IC:\hostedtoolcache\windows\Python\3.13.5\x64\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Auxiliary\VS\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.26100.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\um" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\shared" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\winrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.26100.0\\cppwinrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\include\um" /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /wd4624 /wd4067 /wd4068 /EHsc -c D:\a\rl\rl\torchrl\csrc\pybind.cpp /FoD:\a\rl\rl\build\temp.win-amd64-cpython-313\Release\a\rl\rl\torchrl\csrc\pybind.obj -O3 -std=c++17 -fdiagnostics-color=always -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_torchrl /std:c++17 2025-07-02T07:59:45.8742399Z cl : Command line warning D9002 : ignoring unknown option '-O3' 2025-07-02T07:59:45.8743162Z cl : Command line warning D9002 : ignoring unknown option '-std=c++17' 2025-07-02T07:59:45.8744040Z cl : Command line warning D9002 : ignoring unknown option '-fdiagnostics-color=always' 2025-07-02T07:59:45.8788530Z INFO:root:"C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\bin\HostX86\x64\link.exe" /nologo /INCREMENTAL:NO /LTCG /DLL /MANIFEST:EMBED,ID=2 /MANIFESTUAC:NO /LIBPATH:C:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\torch\lib /LIBPATH:C:\hostedtoolcache\windows\Python\3.13.5\x64\libs /LIBPATH:C:\hostedtoolcache\windows\Python\3.13.5\x64 /LIBPATH:C:\hostedtoolcache\windows\Python\3.13.5\x64\PCbuild\amd64 "/LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\ATLMFC\lib\x64" "/LIBPATH:C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.44.35207\lib\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\lib\um\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\lib\10.0.26100.0\ucrt\x64" "/LIBPATH:C:\Program Files (x86)\Windows Kits\10\\lib\10.0.26100.0\\um\x64" c10.lib torch.lib torch_cpu.lib torch_python.lib sleef.lib /EXPORT:PyInit__torchrl D:\a\rl\rl\build\temp.win-amd64-cpython-313\Release\a\rl\rl\torchrl\csrc\pybind.obj D:\a\rl\rl\build\temp.win-amd64-cpython-313\Release\a\rl\rl\torchrl\csrc\utils.obj /OUT:build\lib.win-amd64-cpython-313\torchrl\_torchrl.cp313-win_amd64.pyd /IMPLIB:D:\a\rl\rl\build\temp.win-amd64-cpython-313\Release\a\rl\rl\torchrl\csrc\_torchrl.cp313-win_amd64.lib 2025-07-02T07:59:46.8225966Z Creating library D:\a\rl\rl\build\temp.win-amd64-cpython-313\Release\a\rl\rl\torchrl\csrc\_torchrl.cp313-win_amd64.lib and object D:\a\rl\rl\build\temp.win-amd64-cpython-313\Release\a\rl\rl\torchrl\csrc\_torchrl.cp313-win_amd64.exp 2025-07-02T07:59:46.8289681Z Generating code 2025-07-02T07:59:53.6282798Z Finished generating code 2025-07-02T07:59:53.8925308Z C:\hostedtoolcache\windows\Python\3.13.5\x64\Lib\site-packages\setuptools\_distutils\cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-07-02T07:59:53.8926612Z !! 2025-07-02T07:59:53.8926786Z 2025-07-02T07:59:53.8926967Z ******************************************************************************** 2025-07-02T07:59:53.8927648Z Please avoid running ``setup.py`` directly. 2025-07-02T07:59:53.8928596Z Instead, use pypa/build, pypa/installer or other 2025-07-02T07:59:53.8929258Z standards-based tools. 2025-07-02T07:59:53.8929565Z 2025-07-02T07:59:53.8930016Z See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-07-02T07:59:53.8930722Z ******************************************************************************** 2025-07-02T07:59:53.8930913Z 2025-07-02T07:59:53.8931011Z !! 2025-07-02T07:59:53.8931193Z self.initialize_options() 2025-07-02T07:59:53.8969878Z INFO:root:installing to build\bdist.win-amd64\wheel 2025-07-02T07:59:53.8970323Z INFO:root:running install 2025-07-02T07:59:53.8984932Z INFO:root:running install_lib 2025-07-02T07:59:53.9037234Z INFO:root:creating build\bdist.win-amd64\wheel 2025-07-02T07:59:53.9041068Z INFO:root:creating build\bdist.win-amd64\wheel\build_tools 2025-07-02T07:59:53.9044479Z INFO:root:creating build\bdist.win-amd64\wheel\build_tools\setup_helpers 2025-07-02T07:59:53.9047332Z INFO:root:copying build\lib.win-amd64-cpython-313\build_tools\setup_helpers\extension.py -> build\bdist.win-amd64\wheel\.\build_tools\setup_helpers 2025-07-02T07:59:53.9052506Z INFO:root:copying build\lib.win-amd64-cpython-313\build_tools\setup_helpers\__init__.py -> build\bdist.win-amd64\wheel\.\build_tools\setup_helpers 2025-07-02T07:59:53.9057287Z INFO:root:copying build\lib.win-amd64-cpython-313\build_tools\__init__.py -> build\bdist.win-amd64\wheel\.\build_tools 2025-07-02T07:59:53.9061776Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl 2025-07-02T07:59:53.9064853Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\collectors 2025-07-02T07:59:53.9067915Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\collectors.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors 2025-07-02T07:59:53.9074538Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\collectors\distributed 2025-07-02T07:59:53.9077509Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\distributed\default_configs.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed 2025-07-02T07:59:53.9082213Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\distributed\generic.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed 2025-07-02T07:59:53.9087007Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\distributed\ray.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed 2025-07-02T07:59:53.9091931Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\distributed\rpc.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed 2025-07-02T07:59:53.9097048Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\distributed\sync.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed 2025-07-02T07:59:53.9101715Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\distributed\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed 2025-07-02T07:59:53.9106045Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\distributed\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\distributed 2025-07-02T07:59:53.9113689Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\collectors\llm 2025-07-02T07:59:53.9116347Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\llm\base.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm 2025-07-02T07:59:53.9121113Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\llm\ray_collector.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm 2025-07-02T07:59:53.9125479Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\llm\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm 2025-07-02T07:59:53.9130118Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\collectors\llm\weight_update 2025-07-02T07:59:53.9132953Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\llm\weight_update\vllm.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm\weight_update 2025-07-02T07:59:53.9137507Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\llm\weight_update\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm\weight_update 2025-07-02T07:59:53.9142027Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors\llm 2025-07-02T07:59:53.9146146Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors 2025-07-02T07:59:53.9150532Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\weight_update.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors 2025-07-02T07:59:53.9155080Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\collectors\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\collectors 2025-07-02T07:59:53.9159734Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data 2025-07-02T07:59:53.9162706Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\datasets 2025-07-02T07:59:53.9165346Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\atari_dqn.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9170880Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\common.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9175138Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\d4rl.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9180279Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\d4rl_infos.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9184877Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\gen_dgrl.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9189216Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\minari_data.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9193731Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\openml.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9199935Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\openx.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9204652Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\roboset.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9209780Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9214064Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\vd4rl.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9218588Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\datasets\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\datasets 2025-07-02T07:59:53.9223113Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\llm 2025-07-02T07:59:53.9225770Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\llm\chat.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm 2025-07-02T07:59:53.9230754Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\llm\common.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm 2025-07-02T07:59:53.9235044Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\llm\dataset.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm 2025-07-02T07:59:53.9239621Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\llm\prompt.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm 2025-07-02T07:59:53.9243863Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\llm\reward.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm 2025-07-02T07:59:53.9248252Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\llm\topk.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm 2025-07-02T07:59:53.9252460Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\llm\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm 2025-07-02T07:59:53.9258727Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\llm 2025-07-02T07:59:53.9263361Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\map 2025-07-02T07:59:53.9265986Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\map\hash.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map 2025-07-02T07:59:53.9270941Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\map\query.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map 2025-07-02T07:59:53.9275206Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\map\tdstorage.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map 2025-07-02T07:59:53.9279477Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\map\tree.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map 2025-07-02T07:59:53.9284816Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\map\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map 2025-07-02T07:59:53.9289670Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\map\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\map 2025-07-02T07:59:53.9294528Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\postprocs 2025-07-02T07:59:53.9298287Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\postprocs\postprocs.py -> build\bdist.win-amd64\wheel\.\torchrl\data\postprocs 2025-07-02T07:59:53.9302993Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\postprocs\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\postprocs 2025-07-02T07:59:53.9309473Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\data\replay_buffers 2025-07-02T07:59:53.9312472Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\checkpointers.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9317754Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\ray_buffer.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9323475Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\replay_buffers.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9330063Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\samplers.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9335552Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\scheduler.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9339781Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\storages.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9347103Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9353294Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\writers.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9358050Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\replay_buffers\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data\replay_buffers 2025-07-02T07:59:53.9363673Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\rlhf.py -> build\bdist.win-amd64\wheel\.\torchrl\data 2025-07-02T07:59:53.9367744Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\tensor_specs.py -> build\bdist.win-amd64\wheel\.\torchrl\data 2025-07-02T07:59:53.9376224Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\data 2025-07-02T07:59:53.9381176Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\data\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\data 2025-07-02T07:59:53.9385976Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs 2025-07-02T07:59:53.9388762Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\async_envs.py -> build\bdist.win-amd64\wheel\.\torchrl\envs 2025-07-02T07:59:53.9393519Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\batched_envs.py -> build\bdist.win-amd64\wheel\.\torchrl\envs 2025-07-02T07:59:53.9399242Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\common.py -> build\bdist.win-amd64\wheel\.\torchrl\envs 2025-07-02T07:59:53.9405786Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\custom 2025-07-02T07:59:53.9408387Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\custom\chess.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom 2025-07-02T07:59:53.9413497Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\custom\llm.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom 2025-07-02T07:59:53.9417850Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\custom\pendulum.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom 2025-07-02T07:59:53.9422527Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\custom\tictactoeenv.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom 2025-07-02T07:59:53.9426949Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\custom\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\custom 2025-07-02T07:59:53.9431071Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\env_creator.py -> build\bdist.win-amd64\wheel\.\torchrl\envs 2025-07-02T07:59:53.9435312Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\gym_like.py -> build\bdist.win-amd64\wheel\.\torchrl\envs 2025-07-02T07:59:53.9440515Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\libs 2025-07-02T07:59:53.9445887Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\brax.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9450700Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\dm_control.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9455563Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\envpool.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9460316Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\gym.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9465581Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\habitat.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9469922Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\isaacgym.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9474310Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\isaac_lab.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9481135Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\jax_utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9485542Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\jumanji.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9490638Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\meltingpot.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9495279Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\openml.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9500567Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\openspiel.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9505535Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\pettingzoo.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9510331Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\robohive.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9514515Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\smacv2.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9519109Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\unity_mlagents.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9524044Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9528247Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\vmas.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9532980Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\_gym_utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9537301Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\libs\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\libs 2025-07-02T07:59:53.9542016Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm 2025-07-02T07:59:53.9544579Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\chat.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm 2025-07-02T07:59:53.9549714Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\datasets 2025-07-02T07:59:53.9552328Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\datasets\gsm8k.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\datasets 2025-07-02T07:59:53.9556712Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\datasets\ifeval.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\datasets 2025-07-02T07:59:53.9560998Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\datasets\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\datasets 2025-07-02T07:59:53.9565153Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\envs.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm 2025-07-02T07:59:53.9570115Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\libs 2025-07-02T07:59:53.9573322Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\libs\mlgym.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\libs 2025-07-02T07:59:53.9578091Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\libs\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\libs 2025-07-02T07:59:53.9582632Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\reward 2025-07-02T07:59:53.9585356Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\gsm8k.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward 2025-07-02T07:59:53.9590049Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:53.9592797Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval\_instructions.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:53.9597864Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval\_instructions_main.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:53.9602830Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval\_instructions_registry.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:53.9607070Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval\_instructions_util.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:53.9611655Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval\_scorer.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:53.9615968Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\ifeval\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward\ifeval 2025-07-02T07:59:53.9624066Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\reward\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\reward 2025-07-02T07:59:53.9628451Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9631077Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\browser.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9635512Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\dataloading.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9640873Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\format.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9646047Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\kl.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9651398Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\policy_version.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9655643Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\reason.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9660074Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\tokenizer.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9666574Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\tools.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9671337Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\transforms\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm\transforms 2025-07-02T07:59:53.9675554Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\llm 2025-07-02T07:59:53.9682606Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\model_based 2025-07-02T07:59:53.9685240Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\model_based\common.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\model_based 2025-07-02T07:59:53.9689677Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\model_based\dreamer.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\model_based 2025-07-02T07:59:53.9693998Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\model_based\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\model_based 2025-07-02T07:59:53.9698429Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\envs\transforms 2025-07-02T07:59:53.9701367Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\functional.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9705816Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\gym_transforms.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9711074Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\llm.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9715826Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\r3m.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9721373Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\rb_transforms.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9725603Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\rlhf.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9730434Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\transforms.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9742776Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9746413Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\vc1.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9752270Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\vecnorm.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9757256Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\vip.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9762993Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\transforms\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs\transforms 2025-07-02T07:59:53.9767217Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\envs 2025-07-02T07:59:53.9773635Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\vec_envs.py -> build\bdist.win-amd64\wheel\.\torchrl\envs 2025-07-02T07:59:53.9812597Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\envs\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\envs 2025-07-02T07:59:53.9813473Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules 2025-07-02T07:59:53.9814145Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\distributions 2025-07-02T07:59:53.9814855Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\distributions\continuous.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions 2025-07-02T07:59:53.9815837Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\distributions\discrete.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions 2025-07-02T07:59:53.9817076Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\distributions\truncated_normal.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions 2025-07-02T07:59:53.9818623Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\distributions\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions 2025-07-02T07:59:53.9819536Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\distributions\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\distributions 2025-07-02T07:59:53.9820402Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\llm 2025-07-02T07:59:53.9820808Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\llm\backends 2025-07-02T07:59:53.9823019Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\llm\backends\vllm.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\backends 2025-07-02T07:59:53.9828380Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\llm\backends\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\backends 2025-07-02T07:59:53.9833005Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\llm\policies 2025-07-02T07:59:53.9835724Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies\common.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\policies 2025-07-02T07:59:53.9840668Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies\transformers_wrapper.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\policies 2025-07-02T07:59:53.9845920Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies\vllm_wrapper.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\policies 2025-07-02T07:59:53.9851134Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\llm\policies\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm\policies 2025-07-02T07:59:53.9855284Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\llm\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm 2025-07-02T07:59:53.9859571Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\llm 2025-07-02T07:59:53.9864585Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\models 2025-07-02T07:59:53.9867240Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\batchrenorm.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9871645Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\decision_transformer.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9875956Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\exploration.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9880723Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\llm.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9885136Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\models.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9891371Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\model_based.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9896023Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\multiagent.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9905229Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\rlhf.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9909711Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9914104Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\models\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\models 2025-07-02T07:59:53.9920065Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\planners 2025-07-02T07:59:53.9922767Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\planners\cem.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\planners 2025-07-02T07:59:53.9927679Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\planners\common.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\planners 2025-07-02T07:59:53.9932226Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\planners\mppi.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\planners 2025-07-02T07:59:53.9936794Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\planners\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\planners 2025-07-02T07:59:53.9942595Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9951797Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module\actors.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9957785Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module\common.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9963936Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module\exploration.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9970073Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module\probabilistic.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9974956Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module\rnn.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9980532Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module\sequence.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9985776Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module\world_models.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9993707Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\tensordict_module\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\tensordict_module 2025-07-02T07:59:53.9998716Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\modules\utils 2025-07-02T07:59:54.0001619Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\utils\mappings.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\utils 2025-07-02T07:59:54.0006094Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\utils\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\utils 2025-07-02T07:59:54.0010463Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\utils\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules\utils 2025-07-02T07:59:54.0014766Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\modules\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\modules 2025-07-02T07:59:54.0022024Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\objectives 2025-07-02T07:59:54.0024778Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\a2c.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0029685Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\common.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0035281Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\cql.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0040514Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\crossq.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0045249Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\ddpg.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0050522Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\decision_transformer.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0054913Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\deprecated.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0062849Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\dqn.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0068141Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\dreamer.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0072867Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\functional.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0077227Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\gail.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0081553Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\iql.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0086833Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\objectives\llm 2025-07-02T07:59:54.0089486Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\llm\grpo.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\llm 2025-07-02T07:59:54.0094170Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\llm\sft.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\llm 2025-07-02T07:59:54.0098830Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\llm\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\llm 2025-07-02T07:59:54.0103418Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\objectives\multiagent 2025-07-02T07:59:54.0106084Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\multiagent\qmixer.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\multiagent 2025-07-02T07:59:54.0110961Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\multiagent\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\multiagent 2025-07-02T07:59:54.0115320Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\ppo.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0120701Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\redq.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0125337Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\reinforce.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0130037Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\sac.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0135103Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\td3.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0139773Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\td3_bc.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0144438Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0149459Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\objectives\value 2025-07-02T07:59:54.0152140Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\value\advantages.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\value 2025-07-02T07:59:54.0157397Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\value\functional.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\value 2025-07-02T07:59:54.0162321Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\value\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\value 2025-07-02T07:59:54.0166669Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\value\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives\value 2025-07-02T07:59:54.0170821Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\objectives\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\objectives 2025-07-02T07:59:54.0175567Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\record 2025-07-02T07:59:54.0178576Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\record\loggers 2025-07-02T07:59:54.0181221Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\loggers\common.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers 2025-07-02T07:59:54.0185595Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\loggers\csv.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers 2025-07-02T07:59:54.0190015Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\loggers\mlflow.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers 2025-07-02T07:59:54.0194255Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\loggers\tensorboard.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers 2025-07-02T07:59:54.0198530Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\loggers\utils.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers 2025-07-02T07:59:54.0202820Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\loggers\wandb.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers 2025-07-02T07:59:54.0207118Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\loggers\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\record\loggers 2025-07-02T07:59:54.0214185Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\recorder.py -> build\bdist.win-amd64\wheel\.\torchrl\record 2025-07-02T07:59:54.0218842Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\record\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\record 2025-07-02T07:59:54.0223344Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\trainers 2025-07-02T07:59:54.0229272Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl\trainers\helpers 2025-07-02T07:59:54.0231998Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\helpers\collectors.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers 2025-07-02T07:59:54.0237221Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\helpers\envs.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers 2025-07-02T07:59:54.0242621Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\helpers\logger.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers 2025-07-02T07:59:54.0246850Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\helpers\losses.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers 2025-07-02T07:59:54.0251145Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\helpers\models.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers 2025-07-02T07:59:54.0255844Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\helpers\replay_buffer.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers 2025-07-02T07:59:54.0260003Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\helpers\trainers.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers 2025-07-02T07:59:54.0266752Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\helpers\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers\helpers 2025-07-02T07:59:54.0271085Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\trainers.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers 2025-07-02T07:59:54.0278042Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\trainers\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl\trainers 2025-07-02T07:59:54.0284297Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\version.py -> build\bdist.win-amd64\wheel\.\torchrl 2025-07-02T07:59:54.0288859Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\_extension.py -> build\bdist.win-amd64\wheel\.\torchrl 2025-07-02T07:59:54.0293487Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\_torchrl.cp313-win_amd64.pyd -> build\bdist.win-amd64\wheel\.\torchrl 2025-07-02T07:59:54.0304549Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\_utils.py -> build\bdist.win-amd64\wheel\.\torchrl 2025-07-02T07:59:54.0313259Z INFO:root:copying build\lib.win-amd64-cpython-313\torchrl\__init__.py -> build\bdist.win-amd64\wheel\.\torchrl 2025-07-02T07:59:54.0317224Z INFO:root:running install_egg_info 2025-07-02T07:59:54.0376391Z INFO:root:running egg_info 2025-07-02T07:59:54.0410982Z INFO:root:creating torchrl_nightly.egg-info 2025-07-02T07:59:54.0413092Z INFO:root:writing torchrl_nightly.egg-info\PKG-INFO 2025-07-02T07:59:54.0514029Z INFO:root:writing dependency_links to torchrl_nightly.egg-info\dependency_links.txt 2025-07-02T07:59:54.0569198Z INFO:root:writing requirements to torchrl_nightly.egg-info\requires.txt 2025-07-02T07:59:54.0572121Z INFO:root:writing top-level names to torchrl_nightly.egg-info\top_level.txt 2025-07-02T07:59:54.0575961Z INFO:root:writing manifest file 'torchrl_nightly.egg-info\SOURCES.txt' 2025-07-02T07:59:54.0754107Z INFO:root:reading manifest file 'torchrl_nightly.egg-info\SOURCES.txt' 2025-07-02T07:59:54.0759489Z INFO:root:adding license file 'LICENSE' 2025-07-02T07:59:54.0814318Z INFO:root:writing manifest file 'torchrl_nightly.egg-info\SOURCES.txt' 2025-07-02T07:59:54.0817880Z INFO:root:Copying torchrl_nightly.egg-info to build\bdist.win-amd64\wheel\.\torchrl_nightly-2025.7.2-py3.13.egg-info 2025-07-02T07:59:54.0847993Z INFO:root:running install_scripts 2025-07-02T07:59:54.0879688Z INFO:root:creating build\bdist.win-amd64\wheel\torchrl_nightly-2025.7.2.dist-info\WHEEL 2025-07-02T07:59:54.0886254Z INFO:wheel:creating 'dist\torchrl_nightly-2025.7.2-cp313-cp313-win_amd64.whl' and adding 'build\bdist.win-amd64\wheel' to it 2025-07-02T07:59:54.0892216Z INFO:wheel:adding 'build_tools/__init__.py' 2025-07-02T07:59:54.0896611Z INFO:wheel:adding 'build_tools/setup_helpers/__init__.py' 2025-07-02T07:59:54.0903681Z INFO:wheel:adding 'build_tools/setup_helpers/extension.py' 2025-07-02T07:59:54.0907729Z INFO:wheel:adding 'torchrl/__init__.py' 2025-07-02T07:59:54.0911572Z INFO:wheel:adding 'torchrl/_extension.py' 2025-07-02T07:59:54.1141616Z INFO:wheel:adding 'torchrl/_torchrl.cp313-win_amd64.pyd' 2025-07-02T07:59:54.1161993Z INFO:wheel:adding 'torchrl/_utils.py' 2025-07-02T07:59:54.1165237Z INFO:wheel:adding 'torchrl/version.py' 2025-07-02T07:59:54.1171495Z INFO:wheel:adding 'torchrl/collectors/__init__.py' 2025-07-02T07:59:54.1235569Z INFO:wheel:adding 'torchrl/collectors/collectors.py' 2025-07-02T07:59:54.1242393Z INFO:wheel:adding 'torchrl/collectors/utils.py' 2025-07-02T07:59:54.1250197Z INFO:wheel:adding 'torchrl/collectors/weight_update.py' 2025-07-02T07:59:54.1254486Z INFO:wheel:adding 'torchrl/collectors/distributed/__init__.py' 2025-07-02T07:59:54.1257685Z INFO:wheel:adding 'torchrl/collectors/distributed/default_configs.py' 2025-07-02T07:59:54.1272591Z INFO:wheel:adding 'torchrl/collectors/distributed/generic.py' 2025-07-02T07:59:54.1285503Z INFO:wheel:adding 'torchrl/collectors/distributed/ray.py' 2025-07-02T07:59:54.1299272Z INFO:wheel:adding 'torchrl/collectors/distributed/rpc.py' 2025-07-02T07:59:54.1309899Z INFO:wheel:adding 'torchrl/collectors/distributed/sync.py' 2025-07-02T07:59:54.1314552Z INFO:wheel:adding 'torchrl/collectors/distributed/utils.py' 2025-07-02T07:59:54.1318551Z INFO:wheel:adding 'torchrl/collectors/llm/__init__.py' 2025-07-02T07:59:54.1326458Z INFO:wheel:adding 'torchrl/collectors/llm/base.py' 2025-07-02T07:59:54.1332119Z INFO:wheel:adding 'torchrl/collectors/llm/ray_collector.py' 2025-07-02T07:59:54.1335351Z INFO:wheel:adding 'torchrl/collectors/llm/utils.py' 2025-07-02T07:59:54.1339480Z INFO:wheel:adding 'torchrl/collectors/llm/weight_update/__init__.py' 2025-07-02T07:59:54.1344797Z INFO:wheel:adding 'torchrl/collectors/llm/weight_update/vllm.py' 2025-07-02T07:59:54.1349172Z INFO:wheel:adding 'torchrl/data/__init__.py' 2025-07-02T07:59:54.1352588Z INFO:wheel:adding 'torchrl/data/rlhf.py' 2025-07-02T07:59:54.1439361Z INFO:wheel:adding 'torchrl/data/tensor_specs.py' 2025-07-02T07:59:54.1446418Z INFO:wheel:adding 'torchrl/data/utils.py' 2025-07-02T07:59:54.1451132Z INFO:wheel:adding 'torchrl/data/datasets/__init__.py' 2025-07-02T07:59:54.1463618Z INFO:wheel:adding 'torchrl/data/datasets/atari_dqn.py' 2025-07-02T07:59:54.1469563Z INFO:wheel:adding 'torchrl/data/datasets/common.py' 2025-07-02T07:59:54.1476918Z INFO:wheel:adding 'torchrl/data/datasets/d4rl.py' 2025-07-02T07:59:54.1482299Z INFO:wheel:adding 'torchrl/data/datasets/d4rl_infos.py' 2025-07-02T07:59:54.1488534Z INFO:wheel:adding 'torchrl/data/datasets/gen_dgrl.py' 2025-07-02T07:59:54.1495927Z INFO:wheel:adding 'torchrl/data/datasets/minari_data.py' 2025-07-02T07:59:54.1500331Z INFO:wheel:adding 'torchrl/data/datasets/openml.py' 2025-07-02T07:59:54.1511755Z INFO:wheel:adding 'torchrl/data/datasets/openx.py' 2025-07-02T07:59:54.1519193Z INFO:wheel:adding 'torchrl/data/datasets/roboset.py' 2025-07-02T07:59:54.1522365Z INFO:wheel:adding 'torchrl/data/datasets/utils.py' 2025-07-02T07:59:54.1530213Z INFO:wheel:adding 'torchrl/data/datasets/vd4rl.py' 2025-07-02T07:59:54.1533500Z INFO:wheel:adding 'torchrl/data/llm/__init__.py' 2025-07-02T07:59:54.1550052Z INFO:wheel:adding 'torchrl/data/llm/chat.py' 2025-07-02T07:59:54.1553712Z INFO:wheel:adding 'torchrl/data/llm/common.py' 2025-07-02T07:59:54.1562096Z INFO:wheel:adding 'torchrl/data/llm/dataset.py' 2025-07-02T07:59:54.1567089Z INFO:wheel:adding 'torchrl/data/llm/prompt.py' 2025-07-02T07:59:54.1571642Z INFO:wheel:adding 'torchrl/data/llm/reward.py' 2025-07-02T07:59:54.1576810Z INFO:wheel:adding 'torchrl/data/llm/topk.py' 2025-07-02T07:59:54.1586235Z INFO:wheel:adding 'torchrl/data/llm/utils.py' 2025-07-02T07:59:54.1589424Z INFO:wheel:adding 'torchrl/data/map/__init__.py' 2025-07-02T07:59:54.1594850Z INFO:wheel:adding 'torchrl/data/map/hash.py' 2025-07-02T07:59:54.1600386Z INFO:wheel:adding 'torchrl/data/map/query.py' 2025-07-02T07:59:54.1608266Z INFO:wheel:adding 'torchrl/data/map/tdstorage.py' 2025-07-02T07:59:54.1630502Z INFO:wheel:adding 'torchrl/data/map/tree.py' 2025-07-02T07:59:54.1634768Z INFO:wheel:adding 'torchrl/data/map/utils.py' 2025-07-02T07:59:54.1638758Z INFO:wheel:adding 'torchrl/data/postprocs/__init__.py' 2025-07-02T07:59:54.1645781Z INFO:wheel:adding 'torchrl/data/postprocs/postprocs.py' 2025-07-02T07:59:54.1649916Z INFO:wheel:adding 'torchrl/data/replay_buffers/__init__.py' 2025-07-02T07:59:54.1656467Z INFO:wheel:adding 'torchrl/data/replay_buffers/checkpointers.py' 2025-07-02T07:59:54.1662198Z INFO:wheel:adding 'torchrl/data/replay_buffers/ray_buffer.py' 2025-07-02T07:59:54.1691603Z INFO:wheel:adding 'torchrl/data/replay_buffers/replay_buffers.py' 2025-07-02T07:59:54.1730079Z INFO:wheel:adding 'torchrl/data/replay_buffers/samplers.py' 2025-07-02T07:59:54.1735598Z INFO:wheel:adding 'torchrl/data/replay_buffers/scheduler.py' 2025-07-02T07:59:54.1754240Z INFO:wheel:adding 'torchrl/data/replay_buffers/storages.py' 2025-07-02T07:59:54.1767569Z INFO:wheel:adding 'torchrl/data/replay_buffers/utils.py' 2025-07-02T07:59:54.1777332Z INFO:wheel:adding 'torchrl/data/replay_buffers/writers.py' 2025-07-02T07:59:54.1782098Z INFO:wheel:adding 'torchrl/envs/__init__.py' 2025-07-02T07:59:54.1792501Z INFO:wheel:adding 'torchrl/envs/async_envs.py' 2025-07-02T07:59:54.1827622Z INFO:wheel:adding 'torchrl/envs/batched_envs.py' 2025-07-02T07:59:54.1878795Z INFO:wheel:adding 'torchrl/envs/common.py' 2025-07-02T07:59:54.1884947Z INFO:wheel:adding 'torchrl/envs/env_creator.py' 2025-07-02T07:59:54.1896300Z INFO:wheel:adding 'torchrl/envs/gym_like.py' 2025-07-02T07:59:54.1921430Z INFO:wheel:adding 'torchrl/envs/utils.py' 2025-07-02T07:59:54.1924654Z INFO:wheel:adding 'torchrl/envs/vec_envs.py' 2025-07-02T07:59:54.1929080Z INFO:wheel:adding 'torchrl/envs/custom/__init__.py' 2025-07-02T07:59:54.1937306Z INFO:wheel:adding 'torchrl/envs/custom/chess.py' 2025-07-02T07:59:54.1942095Z INFO:wheel:adding 'torchrl/envs/custom/llm.py' 2025-07-02T07:59:54.1947921Z INFO:wheel:adding 'torchrl/envs/custom/pendulum.py' 2025-07-02T07:59:54.1952926Z INFO:wheel:adding 'torchrl/envs/custom/tictactoeenv.py' 2025-07-02T07:59:54.1956682Z INFO:wheel:adding 'torchrl/envs/libs/__init__.py' 2025-07-02T07:59:54.1961224Z INFO:wheel:adding 'torchrl/envs/libs/_gym_utils.py' 2025-07-02T07:59:54.1969013Z INFO:wheel:adding 'torchrl/envs/libs/brax.py' 2025-07-02T07:59:54.1976146Z INFO:wheel:adding 'torchrl/envs/libs/dm_control.py' 2025-07-02T07:59:54.1982689Z INFO:wheel:adding 'torchrl/envs/libs/envpool.py' 2025-07-02T07:59:54.2010217Z INFO:wheel:adding 'torchrl/envs/libs/gym.py' 2025-07-02T07:59:54.2014813Z INFO:wheel:adding 'torchrl/envs/libs/habitat.py' 2025-07-02T07:59:54.2018402Z INFO:wheel:adding 'torchrl/envs/libs/isaac_lab.py' 2025-07-02T07:59:54.2022909Z INFO:wheel:adding 'torchrl/envs/libs/isaacgym.py' 2025-07-02T07:59:54.2027063Z INFO:wheel:adding 'torchrl/envs/libs/jax_utils.py' 2025-07-02T07:59:54.2037827Z INFO:wheel:adding 'torchrl/envs/libs/jumanji.py' 2025-07-02T07:59:54.2045529Z INFO:wheel:adding 'torchrl/envs/libs/meltingpot.py' 2025-07-02T07:59:54.2049714Z INFO:wheel:adding 'torchrl/envs/libs/openml.py' 2025-07-02T07:59:54.2057700Z INFO:wheel:adding 'torchrl/envs/libs/openspiel.py' 2025-07-02T07:59:54.2072344Z INFO:wheel:adding 'torchrl/envs/libs/pettingzoo.py' 2025-07-02T07:59:54.2079173Z INFO:wheel:adding 'torchrl/envs/libs/robohive.py' 2025-07-02T07:59:54.2086460Z INFO:wheel:adding 'torchrl/envs/libs/smacv2.py' 2025-07-02T07:59:54.2096848Z INFO:wheel:adding 'torchrl/envs/libs/unity_mlagents.py' 2025-07-02T07:59:54.2101023Z INFO:wheel:adding 'torchrl/envs/libs/utils.py' 2025-07-02T07:59:54.2111442Z INFO:wheel:adding 'torchrl/envs/libs/vmas.py' 2025-07-02T07:59:54.2115220Z INFO:wheel:adding 'torchrl/envs/llm/__init__.py' 2025-07-02T07:59:54.2122346Z INFO:wheel:adding 'torchrl/envs/llm/chat.py' 2025-07-02T07:59:54.2134080Z INFO:wheel:adding 'torchrl/envs/llm/envs.py' 2025-07-02T07:59:54.2138716Z INFO:wheel:adding 'torchrl/envs/llm/datasets/__init__.py' 2025-07-02T07:59:54.2145012Z INFO:wheel:adding 'torchrl/envs/llm/datasets/gsm8k.py' 2025-07-02T07:59:54.2149627Z INFO:wheel:adding 'torchrl/envs/llm/datasets/ifeval.py' 2025-07-02T07:59:54.2153033Z INFO:wheel:adding 'torchrl/envs/llm/libs/__init__.py' 2025-07-02T07:59:54.2164127Z INFO:wheel:adding 'torchrl/envs/llm/libs/mlgym.py' 2025-07-02T07:59:54.2167730Z INFO:wheel:adding 'torchrl/envs/llm/reward/__init__.py' 2025-07-02T07:59:54.2173289Z INFO:wheel:adding 'torchrl/envs/llm/reward/gsm8k.py' 2025-07-02T07:59:54.2176962Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/__init__.py' 2025-07-02T07:59:54.2192934Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_instructions.py' 2025-07-02T07:59:54.2196936Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_instructions_main.py' 2025-07-02T07:59:54.2200598Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_instructions_registry.py' 2025-07-02T07:59:54.2210575Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_instructions_util.py' 2025-07-02T07:59:54.2216802Z INFO:wheel:adding 'torchrl/envs/llm/reward/ifeval/_scorer.py' 2025-07-02T07:59:54.2220400Z INFO:wheel:adding 'torchrl/envs/llm/transforms/__init__.py' 2025-07-02T07:59:54.2225266Z INFO:wheel:adding 'torchrl/envs/llm/transforms/browser.py' 2025-07-02T07:59:54.2234218Z INFO:wheel:adding 'torchrl/envs/llm/transforms/dataloading.py' 2025-07-02T07:59:54.2237689Z INFO:wheel:adding 'torchrl/envs/llm/transforms/format.py' 2025-07-02T07:59:54.2253013Z INFO:wheel:adding 'torchrl/envs/llm/transforms/kl.py' 2025-07-02T07:59:54.2257789Z INFO:wheel:adding 'torchrl/envs/llm/transforms/policy_version.py' 2025-07-02T07:59:54.2263333Z INFO:wheel:adding 'torchrl/envs/llm/transforms/reason.py' 2025-07-02T07:59:54.2269071Z INFO:wheel:adding 'torchrl/envs/llm/transforms/tokenizer.py' 2025-07-02T07:59:54.2278624Z INFO:wheel:adding 'torchrl/envs/llm/transforms/tools.py' 2025-07-02T07:59:54.2282035Z INFO:wheel:adding 'torchrl/envs/model_based/__init__.py' 2025-07-02T07:59:54.2286462Z INFO:wheel:adding 'torchrl/envs/model_based/common.py' 2025-07-02T07:59:54.2290030Z INFO:wheel:adding 'torchrl/envs/model_based/dreamer.py' 2025-07-02T07:59:54.2293970Z INFO:wheel:adding 'torchrl/envs/transforms/__init__.py' 2025-07-02T07:59:54.2297153Z INFO:wheel:adding 'torchrl/envs/transforms/functional.py' 2025-07-02T07:59:54.2302569Z INFO:wheel:adding 'torchrl/envs/transforms/gym_transforms.py' 2025-07-02T07:59:54.2308703Z INFO:wheel:adding 'torchrl/envs/transforms/llm.py' 2025-07-02T07:59:54.2314797Z INFO:wheel:adding 'torchrl/envs/transforms/r3m.py' 2025-07-02T07:59:54.2319363Z INFO:wheel:adding 'torchrl/envs/transforms/rb_transforms.py' 2025-07-02T07:59:54.2322262Z INFO:wheel:adding 'torchrl/envs/transforms/rlhf.py' 2025-07-02T07:59:54.2480862Z INFO:wheel:adding 'torchrl/envs/transforms/transforms.py' 2025-07-02T07:59:54.2487388Z INFO:wheel:adding 'torchrl/envs/transforms/utils.py' 2025-07-02T07:59:54.2492837Z INFO:wheel:adding 'torchrl/envs/transforms/vc1.py' 2025-07-02T07:59:54.2504722Z INFO:wheel:adding 'torchrl/envs/transforms/vecnorm.py' 2025-07-02T07:59:54.2511271Z INFO:wheel:adding 'torchrl/envs/transforms/vip.py' 2025-07-02T07:59:54.2515464Z INFO:wheel:adding 'torchrl/modules/__init__.py' 2025-07-02T07:59:54.2520583Z INFO:wheel:adding 'torchrl/modules/distributions/__init__.py' 2025-07-02T07:59:54.2529177Z INFO:wheel:adding 'torchrl/modules/distributions/continuous.py' 2025-07-02T07:59:54.2537609Z INFO:wheel:adding 'torchrl/modules/distributions/discrete.py' 2025-07-02T07:59:54.2541806Z INFO:wheel:adding 'torchrl/modules/distributions/truncated_normal.py' 2025-07-02T07:59:54.2545901Z INFO:wheel:adding 'torchrl/modules/distributions/utils.py' 2025-07-02T07:59:54.2549278Z INFO:wheel:adding 'torchrl/modules/llm/__init__.py' 2025-07-02T07:59:54.2552141Z INFO:wheel:adding 'torchrl/modules/llm/utils.py' 2025-07-02T07:59:54.2555899Z INFO:wheel:adding 'torchrl/modules/llm/backends/__init__.py' 2025-07-02T07:59:54.2561020Z INFO:wheel:adding 'torchrl/modules/llm/backends/vllm.py' 2025-07-02T07:59:54.2564404Z INFO:wheel:adding 'torchrl/modules/llm/policies/__init__.py' 2025-07-02T07:59:54.2573884Z INFO:wheel:adding 'torchrl/modules/llm/policies/common.py' 2025-07-02T07:59:54.2594410Z INFO:wheel:adding 'torchrl/modules/llm/policies/transformers_wrapper.py' 2025-07-02T07:59:54.2617765Z INFO:wheel:adding 'torchrl/modules/llm/policies/vllm_wrapper.py' 2025-07-02T07:59:54.2623427Z INFO:wheel:adding 'torchrl/modules/models/__init__.py' 2025-07-02T07:59:54.2628205Z INFO:wheel:adding 'torchrl/modules/models/batchrenorm.py' 2025-07-02T07:59:54.2632664Z INFO:wheel:adding 'torchrl/modules/models/decision_transformer.py' 2025-07-02T07:59:54.2644366Z INFO:wheel:adding 'torchrl/modules/models/exploration.py' 2025-07-02T07:59:54.2649633Z INFO:wheel:adding 'torchrl/modules/models/llm.py' 2025-07-02T07:59:54.2655541Z INFO:wheel:adding 'torchrl/modules/models/model_based.py' 2025-07-02T07:59:54.2671432Z INFO:wheel:adding 'torchrl/modules/models/models.py' 2025-07-02T07:59:54.2683422Z INFO:wheel:adding 'torchrl/modules/models/multiagent.py' 2025-07-02T07:59:54.2686514Z INFO:wheel:adding 'torchrl/modules/models/rlhf.py' 2025-07-02T07:59:54.2690513Z INFO:wheel:adding 'torchrl/modules/models/utils.py' 2025-07-02T07:59:54.2693921Z INFO:wheel:adding 'torchrl/modules/planners/__init__.py' 2025-07-02T07:59:54.2698658Z INFO:wheel:adding 'torchrl/modules/planners/cem.py' 2025-07-02T07:59:54.2702091Z INFO:wheel:adding 'torchrl/modules/planners/common.py' 2025-07-02T07:59:54.2707049Z INFO:wheel:adding 'torchrl/modules/planners/mppi.py' 2025-07-02T07:59:54.2710860Z INFO:wheel:adding 'torchrl/modules/tensordict_module/__init__.py' 2025-07-02T07:59:54.2741712Z INFO:wheel:adding 'torchrl/modules/tensordict_module/actors.py' 2025-07-02T07:59:54.2751031Z INFO:wheel:adding 'torchrl/modules/tensordict_module/common.py' 2025-07-02T07:59:54.2761193Z INFO:wheel:adding 'torchrl/modules/tensordict_module/exploration.py' 2025-07-02T07:59:54.2769108Z INFO:wheel:adding 'torchrl/modules/tensordict_module/probabilistic.py' 2025-07-02T07:59:54.2790185Z INFO:wheel:adding 'torchrl/modules/tensordict_module/rnn.py' 2025-07-02T07:59:54.2794698Z INFO:wheel:adding 'torchrl/modules/tensordict_module/sequence.py' 2025-07-02T07:59:54.2797731Z INFO:wheel:adding 'torchrl/modules/tensordict_module/world_models.py' 2025-07-02T07:59:54.2801106Z INFO:wheel:adding 'torchrl/modules/utils/__init__.py' 2025-07-02T07:59:54.2803901Z INFO:wheel:adding 'torchrl/modules/utils/mappings.py' 2025-07-02T07:59:54.2807402Z INFO:wheel:adding 'torchrl/modules/utils/utils.py' 2025-07-02T07:59:54.2811177Z INFO:wheel:adding 'torchrl/objectives/__init__.py' 2025-07-02T07:59:54.2820873Z INFO:wheel:adding 'torchrl/objectives/a2c.py' 2025-07-02T07:59:54.2832082Z INFO:wheel:adding 'torchrl/objectives/common.py' 2025-07-02T07:59:54.2849392Z INFO:wheel:adding 'torchrl/objectives/cql.py' 2025-07-02T07:59:54.2859884Z INFO:wheel:adding 'torchrl/objectives/crossq.py' 2025-07-02T07:59:54.2866824Z INFO:wheel:adding 'torchrl/objectives/ddpg.py' 2025-07-02T07:59:54.2872270Z INFO:wheel:adding 'torchrl/objectives/decision_transformer.py' 2025-07-02T07:59:54.2880103Z INFO:wheel:adding 'torchrl/objectives/deprecated.py' 2025-07-02T07:59:54.2889542Z INFO:wheel:adding 'torchrl/objectives/dqn.py' 2025-07-02T07:59:54.2896320Z INFO:wheel:adding 'torchrl/objectives/dreamer.py' 2025-07-02T07:59:54.2899682Z INFO:wheel:adding 'torchrl/objectives/functional.py' 2025-07-02T07:59:54.2904419Z INFO:wheel:adding 'torchrl/objectives/gail.py' 2025-07-02T07:59:54.2915014Z INFO:wheel:adding 'torchrl/objectives/iql.py' 2025-07-02T07:59:54.2938848Z INFO:wheel:adding 'torchrl/objectives/ppo.py' 2025-07-02T07:59:54.2949239Z INFO:wheel:adding 'torchrl/objectives/redq.py' 2025-07-02T07:59:54.2957460Z INFO:wheel:adding 'torchrl/objectives/reinforce.py' 2025-07-02T07:59:54.2978584Z INFO:wheel:adding 'torchrl/objectives/sac.py' 2025-07-02T07:59:54.2987365Z INFO:wheel:adding 'torchrl/objectives/td3.py' 2025-07-02T07:59:54.2996798Z INFO:wheel:adding 'torchrl/objectives/td3_bc.py' 2025-07-02T07:59:54.3006263Z INFO:wheel:adding 'torchrl/objectives/utils.py' 2025-07-02T07:59:54.3010576Z INFO:wheel:adding 'torchrl/objectives/llm/__init__.py' 2025-07-02T07:59:54.3019342Z INFO:wheel:adding 'torchrl/objectives/llm/grpo.py' 2025-07-02T07:59:54.3026929Z INFO:wheel:adding 'torchrl/objectives/llm/sft.py' 2025-07-02T07:59:54.3030305Z INFO:wheel:adding 'torchrl/objectives/multiagent/__init__.py' 2025-07-02T07:59:54.3036904Z INFO:wheel:adding 'torchrl/objectives/multiagent/qmixer.py' 2025-07-02T07:59:54.3040300Z INFO:wheel:adding 'torchrl/objectives/value/__init__.py' 2025-07-02T07:59:54.3059687Z INFO:wheel:adding 'torchrl/objectives/value/advantages.py' 2025-07-02T07:59:54.3072629Z INFO:wheel:adding 'torchrl/objectives/value/functional.py' 2025-07-02T07:59:54.3079809Z INFO:wheel:adding 'torchrl/objectives/value/utils.py' 2025-07-02T07:59:54.3084112Z INFO:wheel:adding 'torchrl/record/__init__.py' 2025-07-02T07:59:54.3092483Z INFO:wheel:adding 'torchrl/record/recorder.py' 2025-07-02T07:59:54.3096401Z INFO:wheel:adding 'torchrl/record/loggers/__init__.py' 2025-07-02T07:59:54.3099462Z INFO:wheel:adding 'torchrl/record/loggers/common.py' 2025-07-02T07:59:54.3104459Z INFO:wheel:adding 'torchrl/record/loggers/csv.py' 2025-07-02T07:59:54.3108545Z INFO:wheel:adding 'torchrl/record/loggers/mlflow.py' 2025-07-02T07:59:54.3112520Z INFO:wheel:adding 'torchrl/record/loggers/tensorboard.py' 2025-07-02T07:59:54.3115804Z INFO:wheel:adding 'torchrl/record/loggers/utils.py' 2025-07-02T07:59:54.3120684Z INFO:wheel:adding 'torchrl/record/loggers/wandb.py' 2025-07-02T07:59:54.3124112Z INFO:wheel:adding 'torchrl/trainers/__init__.py' 2025-07-02T07:59:54.3141338Z INFO:wheel:adding 'torchrl/trainers/trainers.py' 2025-07-02T07:59:54.3145505Z INFO:wheel:adding 'torchrl/trainers/helpers/__init__.py' 2025-07-02T07:59:54.3152302Z INFO:wheel:adding 'torchrl/trainers/helpers/collectors.py' 2025-07-02T07:59:54.3161306Z INFO:wheel:adding 'torchrl/trainers/helpers/envs.py' 2025-07-02T07:59:54.3164584Z INFO:wheel:adding 'torchrl/trainers/helpers/logger.py' 2025-07-02T07:59:54.3168596Z INFO:wheel:adding 'torchrl/trainers/helpers/losses.py' 2025-07-02T07:59:54.3176253Z INFO:wheel:adding 'torchrl/trainers/helpers/models.py' 2025-07-02T07:59:54.3179677Z INFO:wheel:adding 'torchrl/trainers/helpers/replay_buffer.py' 2025-07-02T07:59:54.3185465Z INFO:wheel:adding 'torchrl/trainers/helpers/trainers.py' 2025-07-02T07:59:54.3190737Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/licenses/LICENSE' 2025-07-02T07:59:54.3204673Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/METADATA' 2025-07-02T07:59:54.3207171Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/WHEEL' 2025-07-02T07:59:54.3209379Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/top_level.txt' 2025-07-02T07:59:54.3219975Z INFO:wheel:adding 'torchrl_nightly-2025.7.2.dist-info/RECORD' 2025-07-02T07:59:54.3225165Z INFO:root:removing build\bdist.win-amd64\wheel 2025-07-02T07:59:54.6820839Z ##[group]Run actions/upload-artifact@v4 2025-07-02T07:59:54.6821187Z with: 2025-07-02T07:59:54.6821384Z name: torchrl-win-3.13.whl 2025-07-02T07:59:54.6821585Z path: dist/*.whl 2025-07-02T07:59:54.6821757Z if-no-files-found: warn 2025-07-02T07:59:54.6821939Z compression-level: 6 2025-07-02T07:59:54.6822106Z overwrite: false 2025-07-02T07:59:54.6822321Z include-hidden-files: false 2025-07-02T07:59:54.6822512Z env: 2025-07-02T07:59:54.6822723Z pythonLocation: C:\hostedtoolcache\windows\Python\3.13.5\x64 2025-07-02T07:59:54.6823005Z ##[endgroup] 2025-07-02T07:59:54.9770110Z With the provided path, there will be 1 file uploaded 2025-07-02T07:59:54.9775736Z Artifact name is valid! 2025-07-02T07:59:54.9778322Z Root directory input is valid! 2025-07-02T07:59:55.2843489Z Beginning upload of artifact content to blob storage 2025-07-02T07:59:55.5150338Z Uploaded bytes 1334070 2025-07-02T07:59:55.5405266Z Finished uploading artifact content to blob storage! 2025-07-02T07:59:55.5411500Z SHA256 digest of uploaded artifact zip is aa0a115eb83a528414f743f58d4437e49368ef15e79c9117a104db2c88151c50 2025-07-02T07:59:55.5414344Z Finalizing artifact upload 2025-07-02T07:59:55.6131965Z Artifact torchrl-win-3.13.whl.zip successfully finalized. Artifact ID 3447229526 2025-07-02T07:59:55.6133183Z Artifact torchrl-win-3.13.whl has been successfully uploaded! Final size is 1334070 bytes. Artifact ID is 3447229526 2025-07-02T07:59:55.6143377Z Artifact download URL: https://github.com/pytorch/rl/actions/runs/16019399355/artifacts/3447229526 2025-07-02T07:59:55.6379444Z Post job cleanup. 2025-07-02T07:59:55.8728129Z [command]"C:\Program Files\Git\bin\git.exe" version 2025-07-02T07:59:55.8936201Z git version 2.50.0.windows.1 2025-07-02T07:59:55.9004605Z Temporarily overriding HOME='D:\a\_temp\42b56c22-ed8f-4e69-82ea-3b0fd034bb06' before making global git config changes 2025-07-02T07:59:55.9005276Z Adding repository directory to the temporary git global config as a safe directory 2025-07-02T07:59:55.9015668Z [command]"C:\Program Files\Git\bin\git.exe" config --global --add safe.directory D:\a\rl\rl 2025-07-02T07:59:55.9236235Z [command]"C:\Program Files\Git\bin\git.exe" config --local --name-only --get-regexp core\.sshCommand 2025-07-02T07:59:55.9453759Z [command]"C:\Program Files\Git\bin\git.exe" submodule foreach --recursive "sh -c \"git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :\"" 2025-07-02T07:59:56.3523600Z [command]"C:\Program Files\Git\bin\git.exe" config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-07-02T07:59:56.3714882Z http.https://github.com/.extraheader 2025-07-02T07:59:56.3748404Z [command]"C:\Program Files\Git\bin\git.exe" config --local --unset-all http.https://github.com/.extraheader 2025-07-02T07:59:56.3967513Z [command]"C:\Program Files\Git\bin\git.exe" submodule foreach --recursive "sh -c \"git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :\"" 2025-07-02T07:59:56.8370015Z Post job cleanup. 2025-07-02T07:59:56.9786291Z Cleaning up orphan processes 2025-07-02T07:59:57.0013544Z Terminate orphan process: pid (2012) (vctip)