From bugzilla_noreply at suse.com Thu Sep 11 19:22:24 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Thu, 11 Sep 2025 19:22:24 +0000 Subject: =?UTF-8?B?W0J1ZyAxMjQ5NDYxXSBOZXc6IElOc3RhbGxhdGlvbiBvZiBOdmlk?= =?UTF-8?B?aWEgdXRpbHMgZmFpbHMgd2hpbGUgZm9sbHdvaW5nIHRoZSBvZmZpY2ljaWFs?= =?UTF-8?B?IGRvY3VtZW50YXRpb246IGh0dHBzOi8vZG9jdW1lbnRhdGlvbi5zdXNlLmNv?= =?UTF-8?B?bS9zdXNlLWFpLzEuMC9odG1sL05WSURJQS1HUFUtZHJpdmVyLW9uLVNMLU1p?= =?UTF-8?B?Y3JvL2luZGV4Lmh0bWwjbnZpZGlhLWdwdS1wcmUtaW5zdGFsbC1wcm9jZWR1?= =?UTF-8?B?cmU=?= Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249461 Bug ID: 1249461 Summary: INstallation of Nvidia utils fails while follwoing the officicial documentation: https://documentation.suse.com/suse-ai/1.0/html/NVIDIA -GPU-driver-on-SL-Micro/index.html#nvidia-gpu-pre-inst all-procedure Classification: SUSE AI Product: SUSE AI Application Containers Version: unspecified Hardware: x86-64 OS: SLES 15 Status: NEW Severity: Normal Priority: P5 - None Component: documentation Assignee: tbazant at suse.com Reporter: tapas.nandi at suse.com QA Contact: ai-maintainers at lists.suse.com Target Milestone: --- Found By: --- Blocker: --- When following the official doc: https://documentation.suse.com/suse-ai/1.0/html/NVIDIA-GPU-driver-on-SL-Micro/index.html#nvidia-gpu-pre-install-procedure in SLE Micro 6.1 in AWS in region Mumbai with ami : ami-0cfef6687dda2090c The installation of nvidia utils fails as below: transactional update ~# version=$(rpm -qa --queryformat '%{VERSION}\n' \ > nvidia-open-driver-G06-signed-cuda-kmp-default \ > | cut -d "_" -f1 | sort -u | tail -n 1) transactional update ~# echo $version 575.57.08 transactional update ~# zypper install -y --auto-agree-with-licenses \ > nvidia-compute-utils-G06=${version} Refreshing service 'SUSE_Linux_Micro_6.1_x86_64'. Loading repository data... Reading installed packages... Resolving package dependencies... Problem: 1: the to be installed nvidia-compute-utils-G06-575.57.08-1.x86_64 requires 'nvidia-compute-G06 = 575.57.08', but this requirement cannot be provided not installable providers: nvidia-compute-G06-575.57.08-1.x86_64[cuda-sle15] Solution 1: Following actions will be done: install nvidia-common-G06-575.57.08-1.x86_64 from vendor NVIDIA replacing kernel-firmware-nvidia-gspx-G06-550.100-slfo.1.1_1.2.x86_64 from vendor SUSE LLC deinstallation of nvidia-open-driver-G06-signed-kmp-default-550.100_k6.4.0_19-slfo.1.1_1.5.x86_64 Solution 2: do not install nvidia-compute-utils-G06-575.57.08-1.x86_64 Solution 3: break nvidia-compute-utils-G06-575.57.08-1.x86_64 by ignoring some of its dependencies ===== to work around the problem we have to uninstall the kernel firmware as below: kernel-firmware-nvidia-gspx-G06-550.100-slfo.1.1_1.2.x86_64 transactional update ~# zypper remove kernel-firmware-nvidia-gspx-G06-550.100-slfo.1.1_1.2.x86_64 Reading installed packages... Resolving package dependencies... The following package is going to be REMOVED: kernel-firmware-nvidia-gspx-G06 1 package to remove. Package install size change: | 0 B required by packages that will be installed -58.9 MiB | - 58.9 MiB released by packages that will be removed Backend: classic_rpmtrans Continue? [y/n/v/...? shows all options] (y): y (1/1) Removing: kernel-firmware-nvidia-gspx-G06-550.100-slfo.1.1_1.2.x86_64 ...................................................[done] Running post-transaction scripts ..............................................................................................[done] Since the last system boot core libraries or services have been updated. Reboot is suggested to ensure that your system benefits from these updates. =============== Post this the drivers get installed correctly: transactional update ~# zypper install -y --auto-agree-with-licenses \ > nvidia-compute-utils-G06=${version} Refreshing service 'SUSE_Linux_Micro_6.1_x86_64'. Loading repository data... Reading installed packages... Resolving package dependencies... The following 7 NEW packages are going to be installed: libOpenCL1 libnvidia-gpucomp nvidia-common-G06 nvidia-compute-G06 nvidia-compute-utils-G06 nvidia-modprobe nvidia-persistenced 7 new packages to install. Package download size: 142.7 MiB Package install size change: | 506.0 MiB required by packages that will be installed 506.0 MiB | - 0 B released by packages that will be removed ============================ Suggestion to add a step in document which would indicate to remove the existing kernel package which is part of the sle micro AWS image and proceed accordingly. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Fri Sep 12 09:10:39 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Fri, 12 Sep 2025 09:10:39 +0000 Subject: =?UTF-8?B?W0J1ZyAxMjQ5NDYxXSBJTnN0YWxsYXRpb24gb2YgTnZpZGlhIHV0?= =?UTF-8?B?aWxzIGZhaWxzIHdoaWxlIGZvbGx3b2luZyB0aGUgb2ZmaWNpY2lhbCBkb2N1?= =?UTF-8?B?bWVudGF0aW9uOiBodHRwczovL2RvY3VtZW50YXRpb24uc3VzZS5jb20vc3Vz?= =?UTF-8?B?ZS1haS8xLjAvaHRtbC9OVklESUEtR1BVLWRyaXZlci1vbi1TTC1NaWNyby9p?= =?UTF-8?B?bmRleC5odG1sI252aWRpYS1ncHUtcHJlLWluc3RhbGwtcHJvY2VkdXJl?= In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249461 https://bugzilla.suse.com/show_bug.cgi?id=1249461#c1 Tom?? Ba?ant changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |CONFIRMED Whiteboard| |https://jira.suse.com/brows | |e/DOCTEAM-1963 --- Comment #1 from Tom?? Ba?ant --- Thank you for reporting this bug! It is being tracked and processed as part of our queue. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Fri Sep 12 13:00:30 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Fri, 12 Sep 2025 13:00:30 +0000 Subject: =?UTF-8?B?W0J1ZyAxMjQ5NTQxXSBOZXc6IElzc3VlcyB3aGlsZSBkZXBsb3lp?= =?UTF-8?B?bmcgdGhlIG52aWRpYSBncHUgb3BlcmF0b3IgZm9sbG93aW5nIHRoZSBvZmZp?= =?UTF-8?B?Y2lhbCBzdGVwcyBmcm9tOiBodHRwczovL2RvY3VtZW50YXRpb24uc3VzZS5j?= =?UTF-8?B?b20vY2xvdWRuYXRpdmUvcmtlMi9sYXRlc3QvZW4vYWR2YW5jZWQuaHRtbCNf?= =?UTF-8?B?b3BlcmF0b3JfaW5zdGFsbGF0aW9u?= Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249541 Bug ID: 1249541 Summary: Issues while deploying the nvidia gpu operator following the official steps from: https://documentation.suse.com/cloudnative/rke2/latest /en/advanced.html#_operator_installation Classification: SUSE AI Product: SUSE AI Application Containers Version: unspecified Hardware: x86-64 OS: SLES 15 Status: NEW Severity: Normal Priority: P5 - None Component: documentation Assignee: tbazant at suse.com Reporter: tapas.nandi at suse.com QA Contact: ai-maintainers at lists.suse.com Target Milestone: --- Found By: --- Blocker: --- While following the official documentation "https://documentation.suse.com/cloudnative/rke2/latest/en/advanced.html#_operator_installation" for installing GPU operator on RKE2 v1.32.8+rke2r1 we face an issue where the pod: nvidia-container-toolkit-daemonset fails to run because of the below error: "level=error msg="error running nvidia-toolkit: unable to setup runtime: unable to restart containerd: unable to dial: dial unix /runtime/sock-dir/containerd.sock: connect: no such file or directory"" =============================== On investigating despite mentioning the containerd socket information during deployment as below: toolkit: env: - name: CONTAINERD_SOCKET value: /run/k3s/containerd/containerd.sock =============================== Tested this on 3 different clusters The workaround for this is to manually edit the daemonset and add the correct hostpath under volumes: kubectl edit ds -n gpu-operator nvidia-container-toolkit-daemonset ---------------------------- Before: - hostPath: path: /run/containerd type: "" name: containerd-socket ---------------------------- After: - hostPath: path: /run/k3s/containerd type: "" name: containerd-socket ---------------------------- After this the pod starts successfully. Before: suse-ai-n1:~ # kubectl get pods -n gpu-operator | grep nvidia-container-toolkit nvidia-container-toolkit-daemonset-bjqsl 0/1 CrashLoopBackOff 12 (41s ago) 44m nvidia-container-toolkit-daemonset-d5ktb 0/1 CrashLoopBackOff 12 (30s ago) 44m nvidia-container-toolkit-daemonset-sj826 0/1 CrashLoopBackOff 12 (45s ago) 44m After: suse-ai-n1:~ # kubectl get pods -n gpu-operator | grep nvidia-container-toolkit nvidia-container-toolkit-daemonset-s6qjg 1/1 Running 0 81s nvidia-container-toolkit-daemonset-twtcs 1/1 Running 0 79s nvidia-container-toolkit-daemonset-xhf7b 1/1 Running 0 82s ============================ Suggestion: Add the workaround in the documentation as below: In case the deployment of the Nvidia container toolkit fails and the toolkit daemonset fails to start follow the below steps to resolve this: Manually edit the daemonset and add the correct hostpath under volumes: kubectl edit ds -n gpu-operator nvidia-container-toolkit-daemonset ---------------------------- Before: - hostPath: path: /run/containerd type: "" name: containerd-socket ---------------------------- After: - hostPath: path: /run/k3s/containerd type: "" name: containerd-socket -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Sun Sep 14 10:02:14 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Sun, 14 Sep 2025 10:02:14 +0000 Subject: [Bug 1249576] New: [doc] Issue in "BASIC OVERRIDE FILE WITH GPU AND TWO MODELS PULLED AT STARTUP" Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249576 Bug ID: 1249576 Summary: [doc] Issue in "BASIC OVERRIDE FILE WITH GPU AND TWO MODELS PULLED AT STARTUP" Classification: SUSE AI Product: SUSE AI Application Containers Version: unspecified Hardware: Other OS: Other Status: NEW Severity: Normal Priority: P5 - None Component: documentation Assignee: tbazant at suse.com Reporter: tapas.nandi at suse.com QA Contact: ai-maintainers at lists.suse.com Target Milestone: --- Found By: --- Blocker: --- BASIC OVERRIDE FILE WITH GPU AND TWO MODELS PULLED AT STARTUP: https://documentation.suse.com/suse-ai/1.0/html/AI-deployment-intro/index.html#id-1.5.5.7.3 The provided override file does not utilize the nvidia gou when ollma is installed. When tried to run nvidia-smi command inside ollama container is says command not found as well as when running models it runs without any gpu. the below modified overdie file works: global: imagePullSecrets: - application-collection ingress: enabled: false defaultModel: "gemma:2b" runtimeClassName: nvidia ollama: models: pull: - "gemma:2b" - "llama3.1" run: - "gemma:2b" - "llama3.1" gpu: enabled: true type: 'nvidia' number: 1 nvidiaResource: "nvidia.com/gpu" persistentVolume: enabled: true storageClass: longhorn Request: replace the override file in the documentation with the above given override file. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Mon Sep 15 08:39:01 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Mon, 15 Sep 2025 08:39:01 +0000 Subject: [Bug 1249576] [doc] Issue in "BASIC OVERRIDE FILE WITH GPU AND TWO MODELS PULLED AT STARTUP" In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249576 https://bugzilla.suse.com/show_bug.cgi?id=1249576#c1 Tom?? Ba?ant changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |CONFIRMED Whiteboard| |https://jira.suse.com/brows | |e/DOCTEAM-1966 --- Comment #1 from Tom?? Ba?ant --- Thank you for reporting this bug! It is being tracked and processed as part of our queue. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Wed Sep 17 10:11:42 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Wed, 17 Sep 2025 10:11:42 +0000 Subject: [Bug 1249576] [doc] Issue in "BASIC OVERRIDE FILE WITH GPU AND TWO MODELS PULLED AT STARTUP" In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249576 https://bugzilla.suse.com/show_bug.cgi?id=1249576#c2 Tom?? Ba?ant changed: What |Removed |Added ---------------------------------------------------------------------------- Status|CONFIRMED |IN_PROGRESS --- Comment #2 from Tom?? Ba?ant --- Progress is racked in https://github.com/SUSE/doc-modular/pull/539 -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Wed Sep 17 16:45:29 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Wed, 17 Sep 2025 16:45:29 +0000 Subject: [Bug 1249576] [doc] Issue in "BASIC OVERRIDE FILE WITH GPU AND TWO MODELS PULLED AT STARTUP" In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249576 https://bugzilla.suse.com/show_bug.cgi?id=1249576#c3 Tom?? Ba?ant changed: What |Removed |Added ---------------------------------------------------------------------------- Status|IN_PROGRESS |RESOLVED Resolution|--- |FIXED --- Comment #3 from Tom?? Ba?ant --- fixed by https://github.com/SUSE/doc-modular/commit/9f41d971eb87d6b4c86f99f66d5f4ccecad4d6f3 -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Thu Sep 18 14:54:55 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Thu, 18 Sep 2025 14:54:55 +0000 Subject: =?UTF-8?B?W0J1ZyAxMjQ5NDYxXSBJTnN0YWxsYXRpb24gb2YgTnZpZGlhIHV0?= =?UTF-8?B?aWxzIGZhaWxzIHdoaWxlIGZvbGx3b2luZyB0aGUgb2ZmaWNpY2lhbCBkb2N1?= =?UTF-8?B?bWVudGF0aW9uOiBodHRwczovL2RvY3VtZW50YXRpb24uc3VzZS5jb20vc3Vz?= =?UTF-8?B?ZS1haS8xLjAvaHRtbC9OVklESUEtR1BVLWRyaXZlci1vbi1TTC1NaWNyby9p?= =?UTF-8?B?bmRleC5odG1sI252aWRpYS1ncHUtcHJlLWluc3RhbGwtcHJvY2VkdXJl?= In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249461 https://bugzilla.suse.com/show_bug.cgi?id=1249461#c2 Rhuan Felipe Cunha de Queiroz changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |INVALID Status|CONFIRMED |RESOLVED CC| |rhuan.queiroz at suse.com --- Comment #2 from Rhuan Felipe Cunha de Queiroz --- Using the same AMI described on the ticket (ami-0cfef6687dda2090c), using the same region (ap-south-1 - Mumbai) and g4dn.2xlarge (NVIDIA T4) as instance type, the issue was not reproducible. Below, there is some test evidences. The installation of the GPU Drivers was made following the instructions found on our documentation (https://documentation.suse.com/suse-ai/1.0/html/NVIDIA-GPU-driver-on-SL-Micro/index.html#nvidia-gpu-pre-install-procedure). ec2-user at ip-10-0-10-162:~> nvidia-smi Fri Sep 12 19:50:58 2025 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 575.57.08 Driver Version: 575.57.08 CUDA Version: 12.9 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 Tesla T4 On | 00000000:00:1E.0 Off | 0 | | N/A 32C P8 11W / 70W | 0MiB / 15360MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | No running processes found | +-----------------------------------------------------------------------------------------+ -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Fri Sep 19 15:33:48 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Fri, 19 Sep 2025 15:33:48 +0000 Subject: [Bug 1250213] New: [doc] Issue in "POINTS TO NOTICE" Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1250213 Bug ID: 1250213 Summary: [doc] Issue in "POINTS TO NOTICE" Classification: SUSE AI Product: SUSE AI Application Containers Version: unspecified Hardware: Other OS: Other Status: NEW Severity: Normal Priority: P5 - None Component: documentation Assignee: tbazant at suse.com Reporter: tapas.nandi at suse.com QA Contact: ai-maintainers at lists.suse.com Target Milestone: --- Found By: --- Blocker: --- POINTS TO NOTICE: https://documentation.suse.com/suse-ai/1.0/html/AI-deployment-intro/index.html#id-1.4.4.4.8 Can we add here that for Openwebui we need to enable pipelines and set the correct instrumentation scripts with few samples as below: =============== pipelines: enabled: true persistence: storageClass: local-path extraEnvVars: - name: PIPELINES_URLS value: "https://raw.githubusercontent.com/SUSE/suse-ai-observability-extension/refs/heads/main/integrations/oi-filter/suse_ai_filter.py" - name: PRICING_JSON value: "https://raw.githubusercontent.com/SUSE/suse-ai-observability-extension/refs/heads/main/integrations/oi-filter/pricing.json" - name: PIPELINES_API_KEY value: "AT08HJvZYHneDanV7sh645vvXQQoUq8F" - name: OTEL_EXPORTER_HTTP_OTLP_ENDPOINT value: "http://opentelemetry-collector.opentelemetry.svc.cluster.local:4318" =============== This will be easier to understand and follow. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Fri Sep 19 15:44:25 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Fri, 19 Sep 2025 15:44:25 +0000 Subject: [Bug 1250214] New: [doc] Issue in "OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED" Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1250214 Bug ID: 1250214 Summary: [doc] Issue in "OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED" Classification: SUSE AI Product: SUSE AI Application Containers Version: unspecified Hardware: Other OS: Other Status: NEW Severity: Normal Priority: P5 - None Component: documentation Assignee: tbazant at suse.com Reporter: tapas.nandi at suse.com QA Contact: ai-maintainers at lists.suse.com Target Milestone: --- Found By: --- Blocker: --- OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED: https://documentation.suse.com/suse-ai/1.0/html/AI-deployment-intro/index.html#owui-helm-overrides-ollama There are 2 things here: 1. Can we provide a sample yaml for openwebui with pipeline samples or atleast mention the sample snippet: --- pipelines: enabled: true persistence: storageClass: local-path extraEnvVars: - name: PIPELINES_URLS value: "https://raw.githubusercontent.com/SUSE/suse-ai-observability-extension/refs/heads/main/integrations/oi-filter/suse_ai_filter.py" - name: PRICING_JSON value: "https://raw.githubusercontent.com/SUSE/suse-ai-observability-extension/refs/heads/main/integrations/oi-filter/pricing.json" - name: PIPELINES_API_KEY value: "AT08HJvZYHneDanV7sh645vvXQQoUq8F" - name: OTEL_EXPORTER_HTTP_OTLP_ENDPOINT value: "http://opentelemetry-collector.opentelemetry.svc.cluster.local:4318" ------- 2. The pipeline env which points to suse_ai_filter gives errors when implemented and does not ship data to observability: https://raw.githubusercontent.com/SUSE/suse-ai-observability-extension/refs/heads/main/integrations/oi-filter/suse_ai_filter.py -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Fri Sep 19 15:53:13 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Fri, 19 Sep 2025 15:53:13 +0000 Subject: [Bug 1250214] [doc] Issue in "OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED" In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1250214 https://bugzilla.suse.com/show_bug.cgi?id=1250214#c1 --- Comment #1 from Tapas Nandi --- Here is the error i get when using the pipeline: ----------------------------------- INFO: 10.42.0.74:40256 - "GET /suse_ai_filter/valves HTTP/1.1" 200 OK INFO: 10.42.0.74:51276 - "GET /models HTTP/1.1" 200 OK [DEBUG] Inlet function called with body: {'stream': True, 'model': 'gemma:2b', 'messages': [{'role': 'user', 'content': "Help me study vocabulary: write a sentence for me to fill in the blank, and I'll try to pick the correct option."}], 'features': {'image_generation': False, 'code_interpreter': False, 'web_search': False}, 'metadata': {'user_id': '02931cd2-78df-4aee-b51c-4eaa4fd14979', 'chat_id': '057ee8aa-2d05-4a12-a440-3435c6a4e7b1', 'message_id': '70832873-0435-4850-ab86-d4d443069911', 'session_id': 'jDgJL8nO2nncHwXtAAAG', 'tool_ids': None, 'files': None, 'features': {'image_generation': False, 'code_interpreter': False, 'web_search': False}, 'variables': {'{{USER_NAME}}': 'tapas', '{{USER_LOCATION}}': 'Unknown', '{{CURRENT_DATETIME}}': '2025-09-19 04:42:18', '{{CURRENT_DATE}}': '2025-09-19', '{{CURRENT_TIME}}': '04:42:18', '{{CURRENT_WEEKDAY}}': 'Friday', '{{CURRENT_TIMEZONE}}': 'Asia/Kolkata', '{{USER_LANGUAGE}}': 'en-US'}, 'model': None, 'direct': False}, 'options': {}} and user: {'id': '02931cd2-78df-4aee-b51c-4eaa4fd14979', 'email': 'tnandi at suse.com', 'name': 'tapas', 'role': 'admin'} INFO: 10.42.0.74:51288 - "POST /suse_ai_filter/filter/inlet HTTP/1.1" 200 OK [DEBUG] Outlet function called with body: {'model': 'gemma:2b', 'messages': [{'id': '1a0094a4-bba9-44b6-be54-e3df99d945d7', 'role': 'user', 'content': "Help me study vocabulary: write a sentence for me to fill in the blank, and I'll try to pick the correct option.", 'timestamp': 1758237137}, {'id': '70832873-0435-4850-ab86-d4d443069911', 'role': 'assistant', 'content': "Sure, here's a sentence to fill in the blank:\n\n**The _____ of the party was quite lively.**\n\nA. mood\nB. atmosphere\nC. energy\nD. charisma", 'timestamp': 1758237137}], 'chat_id': '057ee8aa-2d05-4a12-a440-3435c6a4e7b1', 'session_id': 'jDgJL8nO2nncHwXtAAAG', 'id': '70832873-0435-4850-ab86-d4d443069911'} and user {'id': '02931cd2-78df-4aee-b51c-4eaa4fd14979', 'email': 'tnandi at suse.com', 'name': 'tapas', 'role': 'admin'} unsupported operand type(s) for +: 'NoneType' and 'NoneType' INFO: 10.42.0.74:51292 - "POST /suse_ai_filter/filter/outlet HTTP/1.1" 500 Internal Server Error [DEBUG] Inlet function called with body: {'stream': True, 'model': 'llama3.1:latest', 'messages': [{'role': 'user', 'content': "Help me study vocabulary: write a sentence for me to fill in the blank, and I'll try to pick the correct option."}], 'features': {'image_generation': False, 'code_interpreter': False, 'web_search': False}, 'metadata': {'user_id': '02931cd2-78df-4aee-b51c-4eaa4fd14979', 'chat_id': '485c20e6-9d87-414a-a48b-1ef494f8bddc', 'message_id': 'd6be2ce2-86b6-45c7-9401-39dfa9437c3d', 'session_id': 'jDgJL8nO2nncHwXtAAAG', 'tool_ids': None, 'files': None, 'features': {'image_generation': False, 'code_interpreter': False, 'web_search': False}, 'variables': {'{{USER_NAME}}': 'tapas', '{{USER_LOCATION}}': 'Unknown', '{{CURRENT_DATETIME}}': '2025-09-19 04:44:25', '{{CURRENT_DATE}}': '2025-09-19', '{{CURRENT_TIME}}': '04:44:25', '{{CURRENT_WEEKDAY}}': 'Friday', '{{CURRENT_TIMEZONE}}': 'Asia/Kolkata', '{{USER_LANGUAGE}}': 'en-US'}, 'model': None, 'direct': False}, 'options': {}} and user: {'id': '02931cd2-78df-4aee-b51c-4eaa4fd14979', 'email': 'tnandi at suse.com', 'name': 'tapas', 'role': 'admin'} INFO: 10.42.0.74:56690 - "POST /suse_ai_filter/filter/inlet HTTP/1.1" 200 OK [DEBUG] Outlet function called with body: {'model': 'llama3.1:latest', 'messages': [{'id': '8d45599c-67cc-4e56-aa9d-87785afad4fb', 'role': 'user', 'content': "Help me study vocabulary: write a sentence for me to fill in the blank, and I'll try to pick the correct option.", 'timestamp': 1758237264}, {'id': 'd6be2ce2-86b6-45c7-9401-39dfa9437c3d', 'role': 'assistant', 'content': "Here's your first sentence:\n\nThe new policy aims to _______________________ air pollution by reducing emissions from factories.\n\nAnd here are your options:\n\nA) decrease\nB) increase\nC) minimize\nD) eliminate\n\nWhich word do you think fits best in the sentence?", 'timestamp': 1758237264}], 'chat_id': '485c20e6-9d87-414a-a48b-1ef494f8bddc', 'session_id': 'jDgJL8nO2nncHwXtAAAG', 'id': 'd6be2ce2-86b6-45c7-9401-39dfa9437c3d'} and user {'id': '02931cd2-78df-4aee-b51c-4eaa4fd14979', 'email': 'tnandi at suse.com', 'name': 'tapas', 'role': 'admin'} unsupported operand type(s) for +: 'NoneType' and 'NoneType' INFO: 10.42.0.74:56514 - "POST /suse_ai_filter/filter/outlet HTTP/1.1" 500 Internal Server Error --------------- -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Sat Sep 20 19:11:50 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Sat, 20 Sep 2025 19:11:50 +0000 Subject: [Bug 1250230] New: [doc] Issue in "OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED" Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1250230 Bug ID: 1250230 Summary: [doc] Issue in "OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED" Classification: SUSE AI Product: SUSE AI Application Containers Version: unspecified Hardware: Other OS: Other Status: NEW Severity: Normal Priority: P5 - None Component: documentation Assignee: tbazant at suse.com Reporter: tapas.nandi at suse.com QA Contact: ai-maintainers at lists.suse.com Target Milestone: --- Found By: --- Blocker: --- OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED: https://documentation.suse.com/suse-ai/1.0/html/AI-deployment-intro/index.html#owui-helm-overrides-ollama RAG Capability is slow and sometimes fail with the given config. To workaround the same adding an annotation especially for Nginx worked for me, below is the config: annotations: nginx.ingress.kubernetes.io/ssl-redirect: "true" nginx.ingress.kubernetes.io/proxy-body-size: "1024m" Also Sometimes i faced issue with getting errors in openwebui log which breaks the RAG capabilities, adding the below parameter in ExtraEnvVars section solved the issue: - name: OMP_NUM_THREADS value: "1" This applies to both: https://documentation.suse.com/suse-ai/1.0/html/AI-deployment-intro/index.html#owui-helm-overrides-ollama AND https://documentation.suse.com/suse-ai/1.0/html/AI-deployment-intro/index.html#owui-ollama-deploy-separate -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Sat Sep 20 19:25:25 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Sat, 20 Sep 2025 19:25:25 +0000 Subject: [Bug 1250230] [doc] Issue in "OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED" In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1250230 https://bugzilla.suse.com/show_bug.cgi?id=1250230#c1 --- Comment #1 from Tapas Nandi --- The error i get is as below: OpenBLAS Warning : Detect OpenMP Loop and this application may hang. Please rebuild the library with USE_OPENMP=1 option. In the openwebui log during file upload. Which is reolved by adding: - name: OMP_NUM_THREADS value: "1" -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Mon Sep 22 09:51:50 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Mon, 22 Sep 2025 09:51:50 +0000 Subject: =?UTF-8?B?W0J1ZyAxMjQ5NTQxXSBJc3N1ZXMgd2hpbGUgZGVwbG95aW5nIHRo?= =?UTF-8?B?ZSBudmlkaWEgZ3B1IG9wZXJhdG9yIGZvbGxvd2luZyB0aGUgb2ZmaWNpYWwg?= =?UTF-8?B?c3RlcHMgZnJvbTogaHR0cHM6Ly9kb2N1bWVudGF0aW9uLnN1c2UuY29tL2Ns?= =?UTF-8?B?b3VkbmF0aXZlL3JrZTIvbGF0ZXN0L2VuL2FkdmFuY2VkLmh0bWwjX29wZXJh?= =?UTF-8?B?dG9yX2luc3RhbGxhdGlvbg==?= In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1249541 https://bugzilla.suse.com/show_bug.cgi?id=1249541#c1 Tom?? Ba?ant changed: What |Removed |Added ---------------------------------------------------------------------------- Whiteboard| |https://jira.suse.com/brows | |e/DOCTEAM-1972 Status|NEW |CONFIRMED --- Comment #1 from Tom?? Ba?ant --- Thank you for reporting this bug! It is being tracked and processed as part of our queue. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Mon Sep 22 10:01:21 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Mon, 22 Sep 2025 10:01:21 +0000 Subject: [Bug 1250213] [doc] Issue in "POINTS TO NOTICE" In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1250213 https://bugzilla.suse.com/show_bug.cgi?id=1250213#c1 Tom?? Ba?ant changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |CONFIRMED Whiteboard| |https://jira.suse.com/brows | |e/DOCTEAM-1973 --- Comment #1 from Tom?? Ba?ant --- Thank you for reporting this bug! It is being tracked and processed as part of our queue. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Mon Sep 22 10:02:39 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Mon, 22 Sep 2025 10:02:39 +0000 Subject: [Bug 1250214] [doc] Issue in "OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED" In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1250214 https://bugzilla.suse.com/show_bug.cgi?id=1250214#c2 Tom?? Ba?ant changed: What |Removed |Added ---------------------------------------------------------------------------- Whiteboard| |https://jira.suse.com/brows | |e/DOCTEAM-1975 Status|NEW |CONFIRMED --- Comment #2 from Tom?? Ba?ant --- Thank you for reporting this bug! It is being tracked and processed as part of our queue. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bugzilla_noreply at suse.com Mon Sep 22 10:03:33 2025 From: bugzilla_noreply at suse.com (bugzilla_noreply at suse.com) Date: Mon, 22 Sep 2025 10:03:33 +0000 Subject: [Bug 1250230] [doc] Issue in "OPEN WEBUI OVERRIDE FILE WITH OLLAMA INCLUDED" In-Reply-To: References: Message-ID: https://bugzilla.suse.com/show_bug.cgi?id=1250230 https://bugzilla.suse.com/show_bug.cgi?id=1250230#c2 Tom?? Ba?ant changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |CONFIRMED Whiteboard| |https://jira.suse.com/brows | |e/DOCTEAM-1976 --- Comment #2 from Tom?? Ba?ant --- Thank you for reporting this bug! It is being tracked and processed as part of our queue. -- You are receiving this mail because: You are the QA Contact for the bug. -------------- next part -------------- An HTML attachment was scrubbed... URL: