SeamlessM4T and pip3

FAb7D

I'm trying to install SeamlessM4T following this guide and I get this error:


  Building wheel for bitarray (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [26 lines of output]
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib.linux-x86_64-cpython-311
      creating build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/__init__.py -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/test_bitarray.py -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/test_util.py -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/util.py -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/__init__.pyi -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/util.pyi -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/py.typed -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/bitarray.h -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/pythoncapi_compat.h -> build/lib.linux-x86_64-cpython-311/bitarray
      copying bitarray/test_data.pickle -> build/lib.linux-x86_64-cpython-311/bitarray
      running build_ext
      building 'bitarray._bitarray' extension
      creating build/temp.linux-x86_64-cpython-311
      creating build/temp.linux-x86_64-cpython-311/bitarray
      x86_64-solus-linux-gcc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -mtune=generic -march=x86-64 -g2 -pipe -fPIC -fno-plt -Wformat -Wformat-security -D_FORTIFY_SOURCE=2 -fstack-protector-strong --param=ssp-buffer-size=32 -fasynchronous-unwind-tables -ftree-vectorize -feliminate-unused-debug-types -Wall -Wno-error -Wp,-D_REENTRANT -fno-semantic-interposition -O3 -falign-functions=32 -I/usr/include -mtune=generic -march=x86-64 -g2 -pipe -fPIC -fno-plt -Wformat -Wformat-security -D_FORTIFY_SOURCE=2 -fstack-protector-strong --param=ssp-buffer-size=32 -fasynchronous-unwind-tables -ftree-vectorize -feliminate-unused-debug-types -Wall -Wno-error -Wp,-D_REENTRANT -fno-semantic-interposition -O3 -falign-functions=32 -fPIC -I/home/fabio/Programmi/seamlessM4T/seamless_communication/venv/include -I/usr/include/python3.11 -c bitarray/_bitarray.c -o build/temp.linux-x86_64-cpython-311/bitarray/_bitarray.o
      bitarray/_bitarray.c:12:10: fatal error: Python.h: File o directory non esistente
         12 | #include "Python.h"
            |          ^~~~~~~~~~
      compilation terminated.
      error: command '/usr/bin/x86_64-solus-linux-gcc' failed with exit code 1
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for bitarray
  Running setup.py clean for bitarray
Successfully built seamless-communication
Failed to build bitarray
ERROR: Could not build wheels for bitarray, which is required to install pyproject.toml-based projects

gcc-devel is installed ...
Does anyone understand anything about this or has already tried to install SeamlessM4T ?

Staudey

FAb7D seems like you need python3-devel

edit: lol, didn't scroll far enough to see @infinitymdm's answer. Yes, pretty much that, but with version 3.

alfisya

Did you have python-wheels installed? Actually I never use pip, so it might not matter at all. Sometimes python package needs a few package prequisite to be compiled (when I work with Solus packages). It usually are python-build, pyhton-installer, python-wheels, and python-setuptools

FAb7D

alfisya yes, all that packages are already installed 🤔 ... then I think it reinstall them because it's a virtualized environment (pip3 venv...), maybe...

infinitymdm

You might also try installing python-devel. That should get you the python.h file it's complaining about, if I'm reading that error correctly.

FAb7D

Staudey infinitymdm

I was missing pythin3-devel, but adding it didn't solve it, same error remains.

infinitymdm

FAb7D Probably due to this flag in the gcc call: -I/usr/include/python3.11.

EDIT: actually scratch that, I didn't realize there's also a -I/usr/include in there. It should pick up the -devel stuff... hmm.

I would wipe out your current venv and spin up a new one. That should (? I think) copy over the new Python.h you just added. Not 100% confident on that one, but it's what I would try.

FAb7D

infinitymdm Unfortunately not, to delete venv I simply gave rm -r venv and then restored it, but nothing. I'm going to sleep now because it's getting late here, in the meantime thanks!

FAb7D

Resolved! We needed the linux-headers package!

and

python3 -m venv venv
source venv/bin/activate
pip3 install fairseq2
pip3 install pydub sentencepiece
pip3 install git+https://github.com/facebookresearch/seamless_communication.git