[Bug 1249576] New: [doc] Issue in "BASIC OVERRIDE FILE WITH GPU AND TWO MODELS PULLED AT STARTUP"

[bugzilla_noreply at suse.com]

https://bugzilla.suse.com/show_bug.cgi?id=1249576


            Bug ID: 1249576
           Summary: [doc] Issue in "BASIC OVERRIDE FILE WITH GPU AND TWO
                    MODELS PULLED AT STARTUP"
    Classification: SUSE AI
           Product: SUSE AI Application Containers
           Version: unspecified
          Hardware: Other
                OS: Other
            Status: NEW
          Severity: Normal
          Priority: P5 - None
         Component: documentation
          Assignee: tbazant at suse.com
          Reporter: tapas.nandi at suse.com
        QA Contact: ai-maintainers at lists.suse.com
  Target Milestone: ---
          Found By: ---
           Blocker: ---

BASIC OVERRIDE FILE WITH GPU AND TWO MODELS PULLED AT STARTUP:

https://documentation.suse.com/suse-ai/1.0/html/AI-deployment-intro/index.html#id-1.5.5.7.3

The provided override file does not utilize the nvidia gou when ollma is
installed.
When tried to run nvidia-smi command inside ollama container is says command
not found as well as when running models it runs without any gpu.

the below modified overdie file works:

global:
  imagePullSecrets:
  - application-collection
ingress:
  enabled: false
defaultModel: "gemma:2b"
runtimeClassName: nvidia
ollama:
  models:
    pull:
      - "gemma:2b"
      - "llama3.1"
    run:
      - "gemma:2b"
      - "llama3.1"
  gpu:
    enabled: true
    type: 'nvidia'
    number: 1
    nvidiaResource: "nvidia.com/gpu"
persistentVolume:
  enabled: true
  storageClass: longhorn

Request:
replace the override file in the documentation with the above given override
file.
-- 
You are receiving this mail because:
You are the QA Contact for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.suse.com/pipermail/ai-maintainers/attachments/20250914/4f58d4b8/attachment-0001.htm>