summaryrefslogtreecommitdiff
path: root/scripts/server-llm.sh
diff options
context:
space:
mode:
authorNeuman Vong <neuman.vong@gmail.com>2024-02-10 05:30:19 +1100
committerGitHub <noreply@github.com>2024-02-09 19:30:19 +0100
commit4b7b38bef5addbd31f453871d79647fbae6bec8a (patch)
tree030bb90369b868f59a7ccfcd28f4c6f46ecedd61 /scripts/server-llm.sh
parente00d2a62dd1441e3b089570ec06d05c18800d368 (diff)
vulkan: Set limit for task concurrency (#5427)
A common default for the maximum number of open files is 256, which can lead to `asyncio.gather(*tasks)` failing with Too many open files. $ python ggml_vk_generate_shaders.py --glslc=$ANDROID_NDK_PATH/shader-tools/darwin-x86_64/glslc ggml_vulkan: Generating and compiling shaders to SPIR-V Traceback (most recent call last): File "/Users/neuman/Code.noindex/github/llama.cpp/ggml_vk_generate_shaders.py", line 2326, in <module> asyncio.run(main()) File "/Users/neuman/Code.noindex/miniforge3/lib/python3.10/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/Users/neuman/Code.noindex/miniforge3/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete return future.result() File "/Users/neuman/Code.noindex/github/llama.cpp/ggml_vk_generate_shaders.py", line 2294, in main await asyncio.gather(*tasks) [...snip...] OSError: [Errno 24] Too many open files This change sets a reasonable concurrency limit for tasks (and therefore open files), without significant impact on run time.
Diffstat (limited to 'scripts/server-llm.sh')
0 files changed, 0 insertions, 0 deletions