diff options
author | Bailey Chittle <39804642+bachittle@users.noreply.github.com> | 2023-11-27 09:56:52 -0500 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-11-27 16:56:52 +0200 |
commit | bb03290c17540768a16000a2b01ee4f22440aba1 (patch) | |
tree | f7aa31e8fad0519df3736658dad2e4a1ed03cf6d /examples/llama.swiftui/README.md | |
parent | f3b269813f6147c5b5cda082e6b45cf04a932e0d (diff) |
examples : iOS example with swift ui (#4159)
* copy to llama.cpp as subdir
* attempt enabling metal, fails
* ggml metal compiles!
* Update README.md
* initial conversion to new format, utf8 errors?
* bug fixes, but now has an invalid memory access :(
* added O3, now has insufficient memory access
* begin sync with master
* update to match latest code, new errors
* fixed it!
* fix for loop conditionals, increase result size
* fix current workflow errors
* attempt a llama.swiftui workflow
* Update .github/workflows/build.yml
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/llama.swiftui/README.md')
-rw-r--r-- | examples/llama.swiftui/README.md | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/examples/llama.swiftui/README.md b/examples/llama.swiftui/README.md new file mode 100644 index 00000000..fa68e6ed --- /dev/null +++ b/examples/llama.swiftui/README.md @@ -0,0 +1,7 @@ +# llama.swiftui + +Local inference of llama.cpp on an iPhone. +So far I only tested with starcoder 1B model, but it can most likely handle 7B models as well. + +https://github.com/bachittle/llama.cpp/assets/39804642/e290827a-4edb-4093-9642-2a5e399ec545 + |