Fail to Install on win-arm64 #403
Description
Here is the log from the install. Its the regex dependency that is failing. I can confirm that I have the ARM version of Microsoft C++ Build Tools installed.
Install Log
python -m pip install tiktoken
Collecting tiktoken
Using cached tiktoken-0.9.0.tar.gz (35 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting regex>=2022.1.18 (from tiktoken)
Using cached regex-2024.11.6.tar.gz (399 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting requests>=2.26.0 (from tiktoken)
Using cached requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)
Collecting charset-normalizer<4,>=2 (from requests>=2.26.0->tiktoken)
Using cached charset_normalizer-3.4.2-py3-none-any.whl.metadata (35 kB)
Collecting idna<4,>=2.5 (from requests>=2.26.0->tiktoken)
Using cached idna-3.10-py3-none-any.whl.metadata (10 kB)
Collecting urllib3<3,>=1.21.1 (from requests>=2.26.0->tiktoken)
Using cached urllib3-2.4.0-py3-none-any.whl.metadata (6.5 kB)
Collecting certifi>=2017.4.17 (from requests>=2.26.0->tiktoken)
Using cached certifi-2025.4.26-py3-none-any.whl.metadata (2.5 kB)
Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Using cached charset_normalizer-3.4.2-py3-none-any.whl (52 kB)
Using cached idna-3.10-py3-none-any.whl (70 kB)
Using cached urllib3-2.4.0-py3-none-any.whl (128 kB)
Using cached certifi-2025.4.26-py3-none-any.whl (159 kB)
Building wheels for collected packages: tiktoken, regex
Building wheel for tiktoken (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for tiktoken (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [50 lines of output]
C:\Users\MartinHinshelwoodNKD\AppData\Local\Temp\pip-build-env-wwq7zsf_\overlay\Lib\site-packages\setuptools\config\_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated
!!
********************************************************************************
Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0).
By 2026-Feb-18, you need to update your project and remove deprecated calls
or your builds will no longer be supported.
See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
********************************************************************************
!!
corresp(dist, value, root_dir)
running bdist_wheel
running build
running build_py
creating build\lib.win-arm64-cpython-313\tiktoken
copying tiktoken\core.py -> build\lib.win-arm64-cpython-313\tiktoken
copying tiktoken\load.py -> build\lib.win-arm64-cpython-313\tiktoken
copying tiktoken\model.py -> build\lib.win-arm64-cpython-313\tiktoken
copying tiktoken\registry.py -> build\lib.win-arm64-cpython-313\tiktoken
copying tiktoken\_educational.py -> build\lib.win-arm64-cpython-313\tiktoken
copying tiktoken\__init__.py -> build\lib.win-arm64-cpython-313\tiktoken
creating build\lib.win-arm64-cpython-313\tiktoken_ext
copying tiktoken_ext\openai_public.py -> build\lib.win-arm64-cpython-313\tiktoken_ext
running egg_info
writing tiktoken.egg-info\PKG-INFO
writing dependency_links to tiktoken.egg-info\dependency_links.txt
writing requirements to tiktoken.egg-info\requires.txt
writing top-level names to tiktoken.egg-info\top_level.txt
reading manifest file 'tiktoken.egg-info\SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'Makefile'
adding license file 'LICENSE'
writing manifest file 'tiktoken.egg-info\SOURCES.txt'
copying tiktoken\py.typed -> build\lib.win-arm64-cpython-313\tiktoken
running build_ext
running build_rust
error: can't find Rust compiler
If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.
To update pip, run:
pip install --upgrade pip
and then retry package installation.
If you did intend to build this package from source, try installing a Rust compiler from your system package manager and ensure it is on the PATH during installation. Alternatively, rustup (available at https://rustup.rs) is the recommended way to download and update the Rust compiler toolchain.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tiktoken
Building wheel for regex (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for regex (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [24 lines of output]
C:\Users\MartinHinshelwoodNKD\AppData\Local\Temp\pip-build-env-dqaf6azu\overlay\Lib\site-packages\setuptools\dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
!!
********************************************************************************
Please consider removing the following classifiers in favor of a SPDX license expression:
License :: OSI Approved :: Apache Software License
See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
********************************************************************************
!!
self._finalize_license_expression()
running bdist_wheel
running build
running build_py
creating build\lib.win-arm64-cpython-313\regex
copying regex_3\__init__.py -> build\lib.win-arm64-cpython-313\regex
copying regex_3\regex.py -> build\lib.win-arm64-cpython-313\regex
copying regex_3\_regex_core.py -> build\lib.win-arm64-cpython-313\regex
copying regex_3\test_regex.py -> build\lib.win-arm64-cpython-313\regex
running build_ext
building 'regex._regex' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for regex
Failed to build tiktoken regex
ERROR: Failed to build installable wheels for some pyproject.toml based projects (tiktoken, regex)
System Info
Python 3.13.3
Processor Snapdragon(R) X 12-core X1E80100 @ 3.40 GHz (3.42 GHz)
Installed RAM 64.0 GB (63.5 GB usable)
Device ID 1FF427E9-B5B1-418D-8A83-A02333F109E9
Product ID 00330-80107-06254-AA288
System type 64-bit operating system, ARM-based processor
Pen and touch Pen and touch support with 10 touch points
Edition Windows 11 Business
Version 24H2
Installed on 30/05/2025
OS build 26120.4161
Experience Windows Feature Experience Pack 1000.26100.113.0
Also logged on regex: mrabarnett/mrab-regex#569