[HWORKS-2175][APPEND] Kueue - queues, cohorts and topologies (#496) (#497)

Co-authored-by: Alex Ormenisan <ormenisan.adrian@gmail.com>

Author: SirOibaf

docs/user_guides/mlops/serving/deployment.md

@@ -87,7 +87,13 @@ You will be redirected to a full-page deployment creation form where you can see
 
 Once you are done with the changes, click on `Create new deployment` at the bottom of the page to create the deployment for your model.
 
-### Step 4: Deployment creation
+### Step 4: (Kueue enabled) Select a Queue
+
+If the cluster is installed with Kueue enabled, you will need to select a queue in which the deployment should run. This can be done from `Advance configuration -> Scheduler section`.
+
+![Default queue for job](../../../assets/images/guides/project/scheduler/job_queue.png)
+
+### Step 5: Deployment creation
 
 Wait for the deployment creation process to finish.
 
@@ -98,7 +104,7 @@ Wait for the deployment creation process to finish.
   </figure>
 </p>
 
-### Step 5: Deployment overview
+### Step 6: Deployment overview
 
 Once the deployment is created, you will be redirected to the list of all your existing deployments in the project. You can use the filters on the top of the page to easily locate your new deployment.
 

docs/user_guides/projects/jobs/notebook_job.md

@@ -92,7 +92,13 @@ You can always modify the arguments in the job settings.
   </figure>
 </p>
 
-### Step 7: Execute the job
+### Step 7: (Kueue enabled) Select a Queue
+
+If the cluster is installed with Kueue enabled, you will need to select a queue in which the job should run. This can be done from `Advance configuration -> Scheduler section`.
+
+![Default queue for job](../../../assets/images/guides/project/scheduler/job_queue.png)
+
+### Step 8: Execute the job
 
 Now click the `Run` button to start the execution of the job. You will be redirected to the `Executions` page where you can see the list of all executions.
 
@@ -103,7 +109,7 @@ Now click the `Run` button to start the execution of the job. You will be redire
   </figure>
 </p>
 
-### Step 8: Visualize output notebook
+### Step 9: Visualize output notebook
 Once the execution is finished, click `Logs` and then `notebook out` to see the logs for the execution.
 
 <p align="center">

docs/user_guides/projects/jobs/pyspark_job.md

@@ -128,7 +128,11 @@ Line-separates [properties](https://spark.apache.org/docs/3.1.1/configuration.ht
   </figure>
 </p>
 
-### Step 7: Execute the job
+### Step 7: (Kueue enabled) Select a Queue
+
+Currently we do not have Kueue support for Spark. You do not need to select a queue to run the job in.
+
+### Step 8: Execute the job
 
 Now click the `Run` button to start the execution of the job. You will be redirected to the `Executions` page where you can see the list of all executions.
 
@@ -139,7 +143,7 @@ Now click the `Run` button to start the execution of the job. You will be redire
   </figure>
 </p>
 
-### Step 8: Application logs
+### Step 9: Application logs
 
 To monitor logs while the execution is running, click `Spark UI` to open the Spark UI in a separate tab. 
 

docs/user_guides/projects/jobs/python_job.md

@@ -91,7 +91,13 @@ It is possible to also set following configuration settings for a `PYTHON` job.
   </figure>
 </p>
 
-### Step 7: Execute the job
+### Step 7: (Kueue enabled) Select a Queue
+
+If the cluster is installed with Kueue enabled, you will need to select a queue in which the job should run. This can be done from `Advance configuration -> Scheduler section`.
+
+![Default queue for job](../../../assets/images/guides/project/scheduler/job_queue.png)
+
+### Step 8: Execute the job
 
 Now click the `Run` button to start the execution of the job. You will be redirected to the `Executions` page where you can see the list of all executions.
 

docs/user_guides/projects/jobs/ray_job.md

@@ -109,7 +109,13 @@ environment and additional files">
   </figure>
 </p>
 
-### Step 6: Execute the job
+### Step 6: (Kueue enabled) Select a Queue
+
+If the cluster is installed with Kueue enabled, you will need to select a queue in which the job should run. This can be done from `Advance configuration -> Scheduler section`.
+
+![Default queue for job](../../../assets/images/guides/project/scheduler/job_queue.png)
+
+### Step 7: Execute the job
 
 Now click the `Run` button to start the execution of the job, and then click on `Executions` to see the list of all executions.
 
@@ -120,7 +126,7 @@ Now click the `Run` button to start the execution of the job, and then click on
   </figure>
 </p>
 
-## Ray Dashboard
+### Step 8: Ray Dashboard
 When the Ray job is running, you can access the Ray dashboard to monitor the job. The Ray dashboard is accessible from the 
 `Executions` page. Please note that the Ray dashboard is only available when the job execution is running. In the Ray Dashboard, 
 you can monitor the resources used by the job, the number of workers, logs, and the tasks that are running.

docs/user_guides/projects/jobs/spark_job.md

@@ -131,7 +131,11 @@ Line-separates [properties](https://spark.apache.org/docs/3.1.1/configuration.ht
   </figure>
 </p>
 
-### Step 8: Execute the job
+### Step 8: (Kueue enabled) Select a Queue
+
+Currently we do not have Kueue support for Spark. You do not need to select a queue to run the job in.
+
+### Step 9: Execute the job
 
 Now click the `Run` button to start the execution of the job, and then click on `Executions` to see the list of all executions.
 
@@ -143,7 +147,7 @@ Now click the `Run` button to start the execution of the job, and then click on
   </figure>
 </p>
 
-### Step 9: Application logs
+### Step 10: Application logs
 
 To monitor logs while the execution is running, click `Spark UI` to open the Spark UI in a separate tab.
 

docs/user_guides/projects/jupyter/python_notebook.md

@@ -70,8 +70,14 @@ The root path from which to start the Jupyter instance can be configured. By def
   </figure>
 </p>
 
+## Step 4: (Kueue enabled) Select a Queue
 
-## Step 4: Start Jupyter
+If the cluster is installed with Kueue enabled, you will need to select a queue in which the notebook should run. This can be done from `Advance configuration -> Scheduler section`.
+
+![Default queue for job](../../../assets/images/guides/project/scheduler/job_queue.png)
+
+
+## Step 5: Start Jupyter
 
 Start the Jupyter instance by clicking the `Run Jupyter` button.
 

docs/user_guides/projects/jupyter/ray_notebook.md

@@ -111,7 +111,13 @@ Hopsworks provides a variety of environments to run Jupyter notebooks. Select th
 In order to be able to run a Ray notebook, you need to select the environment that has the Ray kernel installed. 
 Environment with Ray kernel have a `Ray Enabled` label next to them.
 
-## Step 5: Start Jupyter
+## Step 5: (Kueue enabled) Select a Queue
+
+If the cluster is installed with Kueue enabled, you will need to select a queue in which the notebook should run. This can be done from `Advance configuration -> Scheduler section`.
+
+![Default queue for job](../../../assets/images/guides/project/scheduler/job_queue.png)
+
+## Step 6: Start Jupyter
 
 Start the Jupyter instance by clicking the `Run Jupyter` button.
 
@@ -126,7 +132,7 @@ Once the Jupyter instance is started, you can create a new notebook by clicking
   </figure>
 </p>
 
-## Step 6: Access Ray Dashboard
+## Step 7: Access Ray Dashboard
 
 When you start a Ray session in Jupyter, a new application will appear in the Jupyter page.
 The notebook name from which the session was started is displayed. You can access the Ray UI by clicking on the `Ray Dashboard` and a new 

docs/user_guides/projects/jupyter/spark_notebook.md

@@ -113,6 +113,10 @@ The root path from which to start the Jupyter instance can be configured. By def
 </p>
 
 
+## Step 5: (Kueue enabled) Select a Queue
+
+Currently we do not have Kueue support for Spark. You do not need to select a queue to run the notebook in.
+
 ## Step 5: Start Jupyter
 
 Start the Jupyter instance by clicking the `Run Jupyter` button.