diff options
author | Georgi Gerganov <ggerganov@gmail.com> | 2024-01-08 15:57:36 +0200 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-01-08 15:57:36 +0200 |
commit | 42ea63c5a3da01d4a94e906d8565868012c79f4f (patch) | |
tree | 137aaa550cb35c1505c25653bed1cf3a9d818c81 | |
parent | 52531fdff88764282c1b233174721aab8347252d (diff) |
llama.swiftui : update readme
-rw-r--r-- | examples/llama.swiftui/README.md | 13 |
1 files changed, 9 insertions, 4 deletions
diff --git a/examples/llama.swiftui/README.md b/examples/llama.swiftui/README.md index fa68e6ed..96cf743d 100644 --- a/examples/llama.swiftui/README.md +++ b/examples/llama.swiftui/README.md @@ -1,7 +1,12 @@ -# llama.swiftui +# llama.cpp/examples/llama.swiftui -Local inference of llama.cpp on an iPhone. -So far I only tested with starcoder 1B model, but it can most likely handle 7B models as well. +Local inference of llama.cpp on an iPhone. This is a sample app that can be used as a starting +point for more advanced projects. -https://github.com/bachittle/llama.cpp/assets/39804642/e290827a-4edb-4093-9642-2a5e399ec545 +For usage instructions and performance stats, check the following discussion: https://github.com/ggerganov/llama.cpp/discussions/4508 + + +Video demonstration: + +https://github.com/bachittle/llama.cpp/assets/39804642/e290827a-4edb-4093-9642-2a5e399ec545 |