ingest.py dependency error

[grshennan]

Hi,

In response to python ingest.py I get

$ python ingest.py
Traceback (most recent call last):
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\langchain\embeddings\huggingface.py", line 56, in __init__
    import sentence_transformers
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\sentence_transformers\__init__.py", line 3, in <module>
    from .datasets import SentencesDataset, ParallelSentencesDataset
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\sentence_transformers\datasets\__init__.py", line 3, in <module>
    from .ParallelSentencesDataset import ParallelSentencesDataset
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\sentence_transformers\datasets\ParallelSentencesDataset.py", line 4, in <module>
    from .. import SentenceTransformer
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\sentence_transformers\SentenceTransformer.py", line 12, in <module>
    from huggingface_hub import HfApi, HfFolder, Repository, hf_hub_url, cached_download
ImportError: cannot import name 'cached_download' from 'huggingface_hub' (C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\huggingface_hub\__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "E:\python\Ollama\2-ollama-privateGPT-chat-with-docs\ingest.py", line 161, in <module>
    main()
  File "E:\python\Ollama\2-ollama-privateGPT-chat-with-docs\ingest.py", line 138, in main
    embeddings = HuggingFaceEmbeddings(model_name=embeddings_model_name)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\langchain\embeddings\huggingface.py", line 59, in __init__
    raise ImportError(
ImportError: Could not import sentence_transformers python package. Please install it with `pip install sentence_transformers`.
(ollama)
glens@HOME-DESKTOP MINGW64 /e/python/Ollama/2-ollama-privateGPT-chat-with-docs (main)
$ set MODEL=mistral
(ollama)
glens@HOME-DESKTOP MINGW64 /e/python/Ollama/2-ollama-privateGPT-chat-with-docs (main)
$ python ingest.py
Traceback (most recent call last):
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\langchain\embeddings\huggingface.py", line 56, in __init__
    import sentence_transformers
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\sentence_transformers\__init__.py", line 3, in <module>
    from .datasets import SentencesDataset, ParallelSentencesDataset
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\sentence_transformers\datasets\__init__.py", line 3, in <module>
    from .ParallelSentencesDataset import ParallelSentencesDataset
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\sentence_transformers\datasets\ParallelSentencesDataset.py", line 4, in <module>
    from .. import SentenceTransformer
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\sentence_transformers\SentenceTransformer.py", line 12, in <module>
    from huggingface_hub import HfApi, HfFolder, Repository, hf_hub_url, cached_download
ImportError: cannot import name 'cached_download' from 'huggingface_hub' (C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\huggingface_hub\__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "E:\python\Ollama\2-ollama-privateGPT-chat-with-docs\ingest.py", line 161, in <module>
    main()
  File "E:\python\Ollama\2-ollama-privateGPT-chat-with-docs\ingest.py", line 138, in main
    embeddings = HuggingFaceEmbeddings(model_name=embeddings_model_name)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\glens\miniconda3\envs\ollama\Lib\site-packages\langchain\embeddings\huggingface.py", line 59, in __init__
    raise ImportError(
ImportError: Could not import sentence_transformers python package. Please install it with `pip install sentence_transformers`.

However, sentence_transformers is installed, per requirements.txt

$ pip install sentence_transformers
Requirement already satisfied: sentence_transformers in c:\users\...\envs\ollama\lib\site-packages (2.2.2)

I tried the suggested pdf per this issue, but the error is the same.

[jankytech]

I am also seeing the same issue

[dcdolson]

This workaround got me out of the above problem: huggingface/huggingface-inference-toolkit#92 (comment)

Add huggingface_hub<0.26.0 to requirements.txt