Skip to content

maximize use of the RHOAI index #173

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
syedriko wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

maximize use of the RHOAI index #173

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 1 addition & 7 deletions .tekton/rag-tool-pull-request.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,12 +35,6 @@ spec:
- name: build-source-image
value: 'true'
- name: prefetch-input
# no source available: torch, faiss-cpu
# hermeto prefetch problems: uv, pip, jiter, tiktoken,
# those need cmake to build: pyarrow
# those need cargo to build: jiter, tiktoken, cryptography, fastuuid, hf_xet, maturin, pydantic_core, rpds_py, safetensors, tokenizers
# to accelerate build:numpy, scipy, pandas, pillow, scikit_learn, etc.
# most wheels are fetched from RHOAI index
value: |
[
{
Expand All @@ -63,7 +57,7 @@ spec:
],
"requirements_build_files": ["requirements-build.txt"],
"binary": {
"packages": "aiohappyeyeballs,aiohttp,aiosignal,aiosqlite,annotated-doc,annotated-types,anyio,asyncpg,beautifulsoup4,cffi,click,colorama,cryptography,dataclasses-json,defusedxml,distro,docling-parse,et-xmlfile,faiss-cpu,filetype,fire,frozenlist,greenlet,h11,hf-xet,httpcore,httpx,httpx-sse,idna,jinja2,jiter,joblib,jsonlines,jsonref,jsonschema-specifications,lxml,markdown-it-py,markupsafe,mdurl,mpire,mpmath,mypy-extensions,nest-asyncio,networkx,numpy,openpyxl,packaging,pandas,pillow,pluggy,prompt-toolkit,propcache,psycopg2-binary,pydantic,pydantic-core,pylatexenc,pypdfium2,python-dateutil,python-docx,python-pptx,pyyaml,referencing,rpds-py,rtree,safetensors,scikit-learn,scipy,setuptools,shapely,shellingham,six,sniffio,sympy,threadpoolctl,tiktoken,tokenizers,torch,torchvision,transformers,triton,typing-extensions,typing-inspect,typing-inspection,tzdata,xlsxwriter,zipp,uv-build,uv,pip,maturin,opencv-python,omegaconf,rapidocr,griffe,griffecli,griffelib,pyclipper,tree-sitter-typescript",
"packages": "aiosqlite,certifi,docling,einops,faiss-cpu,hf-xet,nltk,tomlkit,uv-build,uv,pip,maturin,opencv-python,omegaconf,rapidocr,griffe,griffecli,griffelib,pyclipper,tree-sitter-typescript",
"os": "linux",
"arch": "x86_64,aarch64",
"py_version": 312
Expand Down
7 changes: 1 addition & 6 deletions .tekton/rag-tool-push.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,11 +32,6 @@ spec:
- name: build-source-image
value: 'true'
- name: prefetch-input
# no source available: torch, faiss-cpu
# hermeto prefetch problems: uv, pip, jiter, tiktoken,
# those need cmake to build: pyarrow
# those need cargo to build: jiter, tiktoken, cryptography, fastuuid, hf_xet, maturin, pydantic_core, rpds_py, safetensors, tokenizers
# to accelerate build:numpy, scipy, pandas, pillow, scikit_learn
value: |
[
{
Expand All @@ -59,7 +54,7 @@ spec:
],
"requirements_build_files": ["requirements-build.txt"],
"binary": {
"packages": "aiohappyeyeballs,aiohttp,aiosignal,aiosqlite,annotated-doc,annotated-types,anyio,asyncpg,beautifulsoup4,cffi,click,colorama,cryptography,dataclasses-json,defusedxml,distro,docling-parse,et-xmlfile,faiss-cpu,filetype,fire,frozenlist,greenlet,h11,hf-xet,httpcore,httpx,httpx-sse,idna,jinja2,jiter,joblib,jsonlines,jsonref,jsonschema-specifications,lxml,markdown-it-py,markupsafe,mdurl,mpire,mpmath,mypy-extensions,nest-asyncio,networkx,numpy,openpyxl,packaging,pandas,pillow,pluggy,prompt-toolkit,propcache,psycopg2-binary,pydantic,pydantic-core,pylatexenc,pypdfium2,python-dateutil,python-docx,python-pptx,pyyaml,referencing,rpds-py,rtree,safetensors,scikit-learn,scipy,setuptools,shapely,shellingham,six,sniffio,sympy,threadpoolctl,tiktoken,tokenizers,torch,torchvision,transformers,triton,typing-extensions,typing-inspect,typing-inspection,tzdata,xlsxwriter,zipp,uv-build,uv,pip,maturin,opencv-python,omegaconf,rapidocr,griffe,griffecli,griffelib,pyclipper,tree-sitter-typescript",
"packages": "aiosqlite,certifi,docling,einops,faiss-cpu,hf-xet,nltk,tomlkit,uv-build,uv,pip,maturin,opencv-python,omegaconf,rapidocr,griffe,griffecli,griffelib,pyclipper,tree-sitter-typescript",
"os": "linux",
"arch": "x86_64,aarch64",
"py_version": 312
Expand Down
3 changes: 3 additions & 0 deletions pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,9 @@ force-exclude = true
"tests/*" = ["S101", "D104", "D100"]
"scripts/*" = ["S101"]
"src/lightspeed_rag_content/image_builder.py" = ["S603", "S607"]
# Konflux/uv helper scripts: HTTPS to known indexes, subprocess to uv, and high cyclomatic complexity.
"scripts/generate_requirements_overrides.py" = ["C901", "D101", "D102", "D103", "D107", "S310", "S603"]
"scripts/merge_pep517_build_requires.py" = ["S310", "D103"]

[tool.black]
line-length = 100
Expand Down
127 changes: 7 additions & 120 deletions requirements-build.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,62 +6,29 @@
#
calver==2025.10.20
# via trove-classifiers
coherent-licensed==0.5.2
# via importlib-metadata
cython==3.2.4
# via
# oracledb
# sqlalchemy
dunamai==1.26.0
# via uv-dynamic-versioning
expandvars==1.1.2
# via yarl
# via oracledb
flit-core==3.12.0
# via
# coherent-licensed
# jinja2
# marshmallow
# packaging
# pathspec
# pypdf
# tinytag
# wheel
hatch-fancy-pypi-readme==25.1.0
# via
# attrs
# jsonschema
# llama-stack-client
# openai
# via llama-stack-client
hatch-vcs==0.5.0
# via
# attrs
# chardet
# filelock
# fsspec
# jsonschema
# platformdirs
# termcolor
# urllib3
# via chardet
hatchling==1.26.3
# via
# hatch-fancy-pypi-readme
# llama-stack-client
# openai
hatchling==1.29.0
# via
# attrs
# banks
# chardet
# einops
# expandvars
# filelock
# fsspec
# hatch-fancy-pypi-readme
# hatch-vcs
# jsonschema
# latex2mathml
# llama-index
# llama-index-cli
# llama-index-core
# llama-index-embeddings-huggingface
# llama-index-embeddings-openai
Expand All @@ -70,30 +37,6 @@ hatchling==1.29.0
# llama-index-readers-file
# llama-index-vector-stores-faiss
# llama-index-vector-stores-postgres
# mcp
# opentelemetry-api
# opentelemetry-exporter-otlp-proto-common
# opentelemetry-exporter-otlp-proto-http
# opentelemetry-proto
# opentelemetry-sdk
# opentelemetry-semantic-conventions
# platformdirs
# polyfactory
# pydantic-settings
# pygments
# python-multipart
# semchunk
# soupsieve
# starlette
# termcolor
# urllib3
# uv-dynamic-versioning
# uvicorn
# wcwidth
jinja2==3.1.6
# via uv-dynamic-versioning
markupsafe==3.0.3
# via jinja2
maturin==1.10.2
# via uv-build
packaging==26.0
Expand All @@ -104,99 +47,43 @@ packaging==26.0
# wheel
pathspec==1.0.4
# via hatchling
pdm-backend==2.4.7
# via
# fastapi
# marko
# typer
pluggy==1.6.0
# via hatchling
poetry-core==2.3.2
# via
# dunamai
# rich
# tomlkit
semantic-version==2.10.0
# via setuptools-rust
setuptools-rust==1.12.1
# via maturin
setuptools-scm==10.0.5
# via
# hatch-vcs
# importlib-metadata
# llama-stack
# llama-stack-api
# pluggy
# setuptools-rust
# tabulate
# tenacity
# tqdm
setuptools-scm==9.2.2
# via
# hatch-vcs
# urllib3
tomlkit==0.14.0
# via uv-dynamic-versioning
trove-classifiers==2026.1.14.14
# via hatchling
uv-build==0.9.30
# via llama-index-workflows
uv-dynamic-versioning==0.14.0
# via mcp
vcs-versioning==1.1.1
# via setuptools-scm
wheel==0.46.3
# via
# oracledb
# pycparser
# sentence-transformers
# tornado
# tree-sitter-c
# tree-sitter-javascript
# tree-sitter-python
# wrapt
# via oracledb

# The following packages are considered to be unsafe in a requirements file:
setuptools==82.0.0
# via charset-normalizer
setuptools==82.0.1
# via
# calver
# certifi
# colorlog
# dill
# googleapis-common-protos
# importlib-metadata
# llama-stack
# llama-stack-api
# markupsafe
# maturin
# multidict
# multiprocess
# oracledb
# pathspec
# pgvector
# pluggy
# psutil
# pycparser
# pyjwt
# python-dotenv
# regex
# requests
# sentence-transformers
# setuptools-rust
# setuptools-scm
# sqlalchemy
# sse-starlette
# tabulate
# tenacity
# tornado
# tqdm
# tree-sitter
# tree-sitter-c
# tree-sitter-javascript
# tree-sitter-python
# trove-classifiers
# vcs-versioning
# wrapt
# yarl
# --- PEP 517 [build-system] (from pyproject.toml; merged by konflux_requirements.sh) ---
pdm-backend==2.4.8
# --- end PEP 517 [build-system] ---
Loading
Loading