diff options
author | Neuman Vong <neuman.vong@gmail.com> | 2024-02-10 05:30:19 +1100 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-02-09 19:30:19 +0100 |
commit | 4b7b38bef5addbd31f453871d79647fbae6bec8a (patch) | |
tree | 030bb90369b868f59a7ccfcd28f4c6f46ecedd61 /scripts/sync-ggml.sh | |
parent | e00d2a62dd1441e3b089570ec06d05c18800d368 (diff) |
vulkan: Set limit for task concurrency (#5427)
A common default for the maximum number of open files is 256, which can
lead to `asyncio.gather(*tasks)` failing with Too many open files.
$ python ggml_vk_generate_shaders.py --glslc=$ANDROID_NDK_PATH/shader-tools/darwin-x86_64/glslc
ggml_vulkan: Generating and compiling shaders to SPIR-V
Traceback (most recent call last):
File "/Users/neuman/Code.noindex/github/llama.cpp/ggml_vk_generate_shaders.py", line 2326, in <module>
asyncio.run(main())
File "/Users/neuman/Code.noindex/miniforge3/lib/python3.10/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/Users/neuman/Code.noindex/miniforge3/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
return future.result()
File "/Users/neuman/Code.noindex/github/llama.cpp/ggml_vk_generate_shaders.py", line 2294, in main
await asyncio.gather(*tasks)
[...snip...]
OSError: [Errno 24] Too many open files
This change sets a reasonable concurrency limit for tasks (and therefore
open files), without significant impact on run time.
Diffstat (limited to 'scripts/sync-ggml.sh')
0 files changed, 0 insertions, 0 deletions