add iluvatar and npu docs

.github/workflows/test_gpu.yml

@@ -3,18 +3,8 @@ name: PaddleOCR PR Tests GPU
 on:
   push:
     branches: ["main"]
-    paths-ignore:
-      - '**.md'
-      - '**.txt'
-      - '**.yml'
-      - '**.yaml'
   pull_request:
     branches: ["main"]
-    paths-ignore:
-      - '**.md'
-      - '**.txt'
-      - '**.yml'
-      - '**.yaml'
   workflow_dispatch:
 env:
   PR_ID: ${{ github.event.pull_request.number }}
@@ -29,8 +19,26 @@ permissions:
   contents: read
 
 jobs:
+  detect-changes:
+    runs-on: ubuntu-latest
+    outputs:
+      docs_only: ${{ steps.filter.outputs.docs_only }}
+    steps:
+      - uses: actions/checkout@v4
+      - id: filter
+        uses: dorny/paths-filter@v3
+        with:
+          filters: |
+            docs_only:
+              - '**.md'
+              - '**.txt'
+              - '**.yml'
+              - '**.yaml'
+
   test-pr-gpu:
     runs-on: [self-hosted, GPU-2Card-OCR]
+    needs: detect-changes
+    if: needs.detect-changes.outputs.docs_only != 'true'
     steps:
       - name: run test
         env:

.github/workflows/tests.yaml

@@ -3,25 +3,35 @@ name: PaddleOCR PR Tests
 on:
   push:
     branches: ["main", "release/*"]
-    paths-ignore:
-      - '**.md'
-      - '**.txt'
-      - '**.yml'
-      - '**.yaml'
   pull_request:
     branches: ["main", "release/*"]
     paths-ignore:
-      - '**.md'
-      - '**.txt'
-      - '**.yml'
-      - '**.yaml'
+
 
 permissions:
   contents: read
 
 jobs:
+  detect-changes:
+    runs-on: ubuntu-latest
+    outputs:
+      docs_only: ${{ steps.filter.outputs.docs_only }}
+    steps:
+      - uses: actions/checkout@v4
+      - id: filter
+        uses: dorny/paths-filter@v3
+        with:
+          filters: |
+            docs_only:
+              - '**.md'
+              - '**.txt'
+              - '**.yml'
+              - '**.yaml'
+
   test-pr:
     runs-on: ubuntu-latest
+    needs: detect-changes
+    if: needs.detect-changes.outputs.docs_only != 'true'
 
     steps:
     - uses: actions/checkout@v4

docs/version3.x/pipeline_usage/PaddleOCR-VL-DCU.en.md

@@ -57,10 +57,9 @@ Execute the following commands to complete the installation:
 ```shell
 python -m pip install paddlepaddle-dcu==3.2.1 -i https://www.paddlepaddle.org.cn/packages/stable/dcu/
 python -m pip install -U "paddleocr[doc-parser]"
-python -m pip install https://paddle-whl.bj.bcebos.com/nightly/cu126/safetensors/safetensors-0.6.2.dev0-cp38-abi3-linux_x86_64.whl
 ```
 
-> **Please note to install PaddlePaddle version 3.2.1 or above, and install the special version of safetensors.**
+> **Please note to install PaddlePaddle version 3.2.1 or above.**
 
 ## 2. Quick Start
 
@@ -93,7 +92,7 @@ docker run -it \
 
 If you wish to start the service in an environment without internet access, replace `ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-vllm-server:latest-dcu` in the above command with the offline version image `ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-vllm-server:latest-dcu-offline`.
 
-When launching the vLLM inference service, we provide a set of default parameter settings. If you need to adjust parameters such as GPU memory usage, you can configure additional parameters yourself. Please refer to [3.3.1 Server-side Parameter Adjustment](./PaddleOCR-VL.md#331-server-side-parameter-adjustment) to create a configuration file, then mount the file into the container and specify the configuration file using `backend_config` in the command to start the service, for example:
+When launching the vLLM inference service, we provide a set of default parameter settings. If you need to adjust parameters such as GPU memory usage, you can configure additional parameters yourself. Please refer to [3.3.1 Server-side Parameter Adjustment](./PaddleOCR-VL.en.md#331-server-side-parameter-adjustment) to create a configuration file, then mount the file into the container and specify the configuration file using `backend_config` in the command to start the service, for example:
 
 ```shell
 docker run -it \

docs/version3.x/pipeline_usage/PaddleOCR-VL-DCU.md

@@ -57,10 +57,9 @@ source .venv_paddleocr/bin/activate
 ```shell
 python -m pip install paddlepaddle-dcu==3.2.1 -i https://www.paddlepaddle.org.cn/packages/stable/dcu/
 python -m pip install -U "paddleocr[doc-parser]"
-python -m pip install https://paddle-whl.bj.bcebos.com/nightly/cu126/safetensors/safetensors-0.6.2.dev0-cp38-abi3-linux_x86_64.whl
 ```
 
-> **请注意安装 3.2.1 及以上版本的飞桨框架，同时安装特殊版本的 safetensors。**
+> **请注意安装 3.2.1 及以上版本的飞桨框架。**
 
 ## 2. 快速开始
 

docs/version3.x/pipeline_usage/PaddleOCR-VL-Iluvatar-GPU.en.md

@@ -0,0 +1,230 @@
+---
+comments: true
+---
+
+# PaddleOCR-VL iluvatar GPU Environment Configuration Tutorial
+
+This tutorial is a guide for configuring the PaddleOCR-VL iluvatar GPU environment. The purpose is to complete the relevant environment setup. After the environment configuration is complete, please refer to the [PaddleOCR-VL Usage Tutorial](./PaddleOCR-VL.en.md) to use PaddleOCR-VL.
+
+## 1. Environment Preparation
+
+This step mainly introduces how to set up the runtime environment for PaddleOCR-VL. There are two methods available; choose either one:
+
+- Method 1: Use the official Docker image.
+
+- Method 2: Manually install PaddlePaddle and PaddleOCR.
+
+**We strongly recommend using the Docker image to minimize potential environment-related issues.**
+
+### 1.1 Method 1: Using Docker Image
+
+We recommend using the official Docker image (requires Docker version >= 19.03):
+
+```shell
+docker run -it \
+  --user root \
+  --privileged \
+  -v /usr/src:/usr/src \
+  -v /lib/modules:/lib/modules \
+  -v /dev:/dev \
+  --cap-add SYS_PTRACE \
+  --pid host \
+  --shm-size 64g \
+  --network host \
+  ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-vl:latest-iluvatar \
+  /bin/bash
+# Call PaddleOCR CLI or Python API in the container
+```
+
+If you wish to start the service in an environment without internet access, replace `ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-vl:latest-iluvatar` in the above command with the offline version image `ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-vl:latest-iluvatar-offline`.
+
+### 1.2 Method 2: Manually Install PaddlePaddle and PaddleOCR
+
+If you cannot use Docker, you can also manually install PaddlePaddle and PaddleOCR. Python version 3.8–3.12 is required.
+
+**We strongly recommend installing PaddleOCR-VL in a virtual environment to avoid dependency conflicts.** For example, use the Python venv standard library to create a virtual environment:
+
+```shell
+# Create a virtual environment
+python -m venv .venv_paddleocr
+# Activate the environment
+source .venv_paddleocr/bin/activate
+```
+
+Execute the following commands to complete the installation:
+
+```shell
+python -m pip install paddlepaddle==3.2.0 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
+python -m pip install paddle-iluvatar-gpu==3.2.0 -i https://www.paddlepaddle.org.cn/packages/stable/maca/
+python -m pip install -U "paddleocr[doc-parser]"
+```
+
+> **Please note to install PaddlePaddle version 3.2.0 or above.**
+
+## 2. Quick Start
+
+Please refer to the corresponding section in the [PaddleOCR-VL Usage Tutorial](./PaddleOCR-VL.en.md), making sure to specify `device='iluvatar_gpu'`.
+
+## 3. Improving VLM Inference Performance Using Inference Acceleration Framework
+
+The inference performance under default configurations is not fully optimized and may not meet actual production requirements. This step mainly introduces how to use the FastDeploy inference acceleration framework to improve the inference performance of PaddleOCR-VL.
+
+### 3.1 Starting the VLM Inference Service
+
+PaddleOCR provides a Docker image for quickly starting the FastDeploy inference service. Use the following command to start the service (requires Docker version >= 19.03):
+
+```shell
+docker run -it \
+  --user root \
+  --privileged \
+  -v /usr/src:/usr/src \
+  -v /lib/modules:/lib/modules \
+  -v /dev:/dev \
+  --cap-add SYS_PTRACE \
+  --pid host \
+  --shm-size 64g \
+  --network host \
+  ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-fastdeploy-server:latest-iluvatar \
+  paddleocr genai_server --model_name PaddleOCR-VL-0.9B --host 0.0.0.0 --port 8118 --backend fastdeploy
+```
+
+If you wish to start the service in an environment without internet access, replace `ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-fastdeploy-server:latest-iluvatar` in the above command with the offline version image `ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-fastdeploy-server:latest-iluvatar-offline`.
+
+When launching the FastDeploy inference service, we provide a set of default parameter settings. If you need to adjust parameters such as GPU memory usage, you can configure additional parameters yourself. Please refer to [3.3.1 Server-side Parameter Adjustment](./PaddleOCR-VL.en.md#331-server-side-parameter-adjustment) to create a configuration file, then mount the file into the container and specify the configuration file using `backend_config` in the command to start the service, for example:
+
+```shell
+docker run -it \
+  --user root \
+  --privileged \
+  -v /usr/src:/usr/src \
+  -v /lib/modules:/lib/modules \
+  -v /dev:/dev \
+  --cap-add SYS_PTRACE \
+  --pid host \
+  --shm-size 64g \
+  --network host \
+  -v fastdeploy_config.yml:/tmp/fastdeploy_config.yml \
+  ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddleocr-genai-fastdeploy-server:latest-iluvatar \
+  paddleocr genai_server --model_name PaddleOCR-VL-0.9B --host 0.0.0.0 --port 8118 --backend fastdeploy --backend_config /tmp/fastdeploy_config.yml
+```
+
+### 3.2 Client Usage Method
+
+Please refer to the corresponding section in the [PaddleOCR-VL Usage Tutorial](./PaddleOCR-VL.en.md).
+
+### 3.3 Performance Tuning
+
+Please refer to the corresponding section in the [PaddleOCR-VL Usage Tutorial](./PaddleOCR-VL.en.md).
+
+## 4. Service Deployment
+
+>Please note that the PaddleOCR-VL service introduced in this section is different from the VLM inference service in the previous section: the latter is only responsible for one part of the complete process (i.e., VLM inference) and is called as an underlying service by the former.
+
+This step mainly introduces how to use Docker Compose to deploy PaddleOCR-VL as a service and call it. The specific process is as follows:
+
+1. Download the Compose file and the environment variable configuration file separately from [here](https://github.com/PaddlePaddle/PaddleOCR/blob/main/deploy/paddleocr_vl_docker/accelerators/iluvatar-gpu/compose.yaml) and [here](https://github.com/PaddlePaddle/PaddleOCR/blob/main/deploy/paddleocr_vl_docker/accelerators/iluvatar-gpu/.env) to your local machine.
+
+2. Execute the following command in the directory where the `compose.yaml` and `.env` files are located to start the server, which listens on port **8080** by default:
+
+    ```shell
+    # Must be executed in the directory where compose.yaml and .env files are located
+    docker compose up
+    ```
+
+    After startup, you will see output similar to the following:
+
+    ```text
+    paddleocr-vl-api             | INFO:     Started server process [1]
+    paddleocr-vl-api             | INFO:     Waiting for application startup.
+    paddleocr-vl-api             | INFO:     Application startup complete.
+    paddleocr-vl-api             | INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
+    ```
+
+This method accelerates VLM inference using the FastDeploy framework and is more suitable for production environment deployment.
+
+Additionally, after starting the server in this manner, no internet connection is required except for image pulling. For deployment in an offline environment, you can first pull the images involved in the Compose file on a connected machine, export them, and transfer them to the offline machine for import to start the service in an offline environment.
+
+Docker Compose starts two containers sequentially by reading configurations from the `.env` and `compose.yaml` files, running the underlying VLM inference service and the PaddleOCR-VL service (pipeline service) respectively.
+
+The meanings of each environment variable contained in the `.env` file are as follows:
+
+```
+- `API_IMAGE_TAG_SUFFIX`: The tag suffix of the image used to launch the pipeline service.
+- `VLM_BACKEND`: The VLM inference backend.
+- `VLM_IMAGE_TAG_SUFFIX`: The tag suffix of the image used to launch the VLM inference service.
+```
+
+You can modify `compose.yaml` to meet custom requirements, for example:
+
+<details>
+<summary>1. Change the port of the PaddleOCR-VL service</summary>
+
+Edit <code>paddleocr-vl-api.ports</code> in the <code>compose.yaml</code> file to change the port. For example, if you need to change the service port to 8111, make the following modifications:
+
+```diff
+  paddleocr-vl-api:
+    ...
+    ports:
+-     - 8080:8080
++     - 8111:8080
+    ...
+```
+
+</details>
+
+<details>
+<summary>2. Specify the GPU used by the PaddleOCR-VL service</summary>
+
+Edit <code>environment</code> in the <code>compose.yaml</code> file to change the GPU used. For example, if you need to use card 1 for deployment, make the following modifications:
+
+```diff
+  paddleocr-vl-api:
+    ...
+    environment:
++     - CUDA_VISIBLE_DEVICES: 1
+    ...
+  paddleocr-vlm-server:
+    ...
+    environment:
++     - CUDA_VISIBLE_DEVICES: 1
+    ...
+```
+
+
+</details>
+
+<details>
+<summary>3. Adjust VLM server-side configuration</summary>
+
+If you want to adjust the VLM server configuration, refer to <a href="./PaddleOCR-VL.en.md#331-server-parameter-adjustment">3.3.1 Server Parameter Adjustment</a> to generate a configuration file.
+
+After generating the configuration file, add the following <code>paddleocr-vlm-server.volumes</code> and <code>paddleocr-vlm-server.command</code> fields to your <code>compose.yaml</code>. Replace <code>/path/to/your_config.yaml</code> with your actual configuration file path.
+
+```yaml
+  paddleocr-vlm-server:
+    ...
+    volumes: /path/to/your_config.yaml:/home/paddleocr/vlm_server_config.yaml
+    command: paddleocr genai_server --model_name PaddleOCR-VL-0.9B --host 0.0.0.0 --port 8118 --backend fastdeploy --backend_config /home/paddleocr/vlm_server_config.yaml
+    ...
+```
+
+</details>
+
+<details>
+<summary>4. Adjust pipeline-related configurations (such as model path, batch size, deployment device, etc.)</summary>
+
+Refer to the <a href="./PaddleOCR-VL.en.md#44-pipeline-configuration-adjustment-instructions">4.4 Pipeline Configuration Adjustment Instructions</a> section.
+
+</details>
+
+### 4.3 Client Invocation Method
+
+Please refer to the corresponding section in the [PaddleOCR-VL Usage Tutorial](./PaddleOCR-VL.en.md).
+
+### 4.4 Pipeline Configuration Adjustment Instructions
+
+Please refer to the corresponding section in the [PaddleOCR-VL Usage Tutorial](./PaddleOCR-VL.en.md).
+
+## 5. Model Fine-Tuning
+
+Please refer to the corresponding section in the [PaddleOCR-VL Usage Tutorial](./PaddleOCR-VL.en.md).