Merge pull request #197 from TuanaCelik/main

adding Haystack to integrations

Author: jeffchuber

docs/integrations/haystack.md

@@ -0,0 +1,81 @@
+---
+slug: /integrations/haystack
+title: 💙 Haystack
+---
+
+[Haystack](https://github.com/deepset-ai/haystack) is an open-source LLM framework in Python. It provides [embedders](https://docs.haystack.deepset.ai/v2.0/docs/embedders), [generators](https://docs.haystack.deepset.ai/v2.0/docs/generators) and [rankers](https://docs.haystack.deepset.ai/v2.0/docs/rankers) via a number of LLM providers, tooling for [preprocessing](https://docs.haystack.deepset.ai/v2.0/docs/preprocessors) and data preparation, connectors to a number of vector databases including Chroma and more. Haystack allows you to build custom LLM applications using both components readily available in Haystack and [custom components](https://docs.haystack.deepset.ai/v2.0/docs/custom-components). Some of the most common applications you can build with Haystack are retrieval-augmented generation pipelines (RAG), question-answering and semantic search.
+
+<img src="https://img.shields.io/github/stars/deepset-ai/haystack.svg?style=social&label=Star&maxAge=2400"/>
+
+|[Docs](https://docs.haystack.deepset.ai/v2.0/docs) | [Github](https://github.com/deepset-ai/haystack) | [Haystack Integrations](https://haystack.deepset.ai/integrations) | [Tutorials](https://haystack.deepset.ai/tutorials) | 
+
+You can use Chroma together with Haystack by installing the integration and using the `ChromaDocumentStore`
+
+### Installation
+
+```bash
+pip install chroma-haystack
+```
+
+### Usage
+
+- The [Chroma Integration page](https://haystack.deepset.ai/integrations/chroma-documentstore)
+- [Chroma + Haystack Example](https://colab.research.google.com/drive/1YpDetI8BRbObPDEVdfqUcwhEX9UUXP-m?usp=sharing)
+
+#### Write documents into a ChromaDocumentStore
+
+```python
+import os
+from pathlib import Path
+
+from haystack import Pipeline
+from haystack.components.converters import TextFileToDocument
+from haystack.components.writers import DocumentWriter
+from chroma_haystack import ChromaDocumentStore
+
+file_paths = ["data" / Path(name) for name in os.listdir("data")]
+
+document_store = ChromaDocumentStore()
+
+indexing = Pipeline()
+indexing.add_component("converter", TextFileToDocument())
+indexing.add_component("writer", DocumentWriter(document_store))
+
+indexing.connect("converter", "writer")
+indexing.run({"converter": {"sources": file_paths}})
+```
+
+#### Build RAG on top of Chroma
+
+```python
+from chroma_haystack.retriever import ChromaQueryRetriever
+from haystack.components.generators import HuggingFaceTGIGenerator
+from haystack.components.builders import PromptBuilder
+
+prompt = """
+Answer the query based on the provided context.
+If the context does not contain the answer, say 'Answer not found'.
+Context: 
+{% for doc in documents %}
+  {{ doc.content }}
+{% endfor %}
+query: {{query}}
+Answer:
+"""
+prompt_builder = PromptBuilder(template=prompt)
+
+llm = HuggingFaceTGIGenerator(model="mistralai/Mixtral-8x7B-Instruct-v0.1", token='YOUR_HF_TOKEN')
+llm.warm_up()
+retriever = ChromaQueryRetriever(document_store)
+
+querying = Pipeline()
+querying.add_component("retriever", retriever)
+querying.add_component("prompt_builder", prompt_builder)
+querying.add_component("llm", llm)
+
+querying.connect("retriever.documents", "prompt_builder.documents")
+querying.connect("prompt_builder", "llm")
+
+results = querying.run({"retriever": {"queries": [query], "top_k": 3},
+                        "prompt_builder": {"query": query}})
+```

docs/integrations/index.md

@@ -19,6 +19,7 @@ We welcome pull requests to add new Integrations to the community.
 | [Braintrust](/integrations/braintrust) | ✅  | ✅ |
 | [🔭 OpenLLMetry](/integrations/openllmetry) | ✅     | :soon: |
 | [🎈 Streamlit](/integrations/streamlit) | ✅     | ➖ |
+| [💙 Haystack](/integrations/haystack) | ✅     | ➖ |
 
 *Coming soon* - integrations with LangSmith, JinaAI, and more.
 

sidebars.js

@@ -68,6 +68,7 @@ const sidebars = {
         'integrations/braintrust',
         'integrations/openllmetry',
         'integrations/streamlit',
+        'integrations/haystack',
       ],
     },
   ],