all repos — nix-packages @ 25e2a39e06307ff94534b3e0bb4101740f8e78e3

My personal collection of packages for nix

add llama-cpp-cuda package

Alin
commit

25e2a39e06307ff94534b3e0bb4101740f8e78e3

parent

d427deb2551ff298a6c9bee7f755b2ab9cddc90a

2 files changed, 9 insertions(+), 0 deletions(-)

changed files
M README.md → README.md
@@ -13,6 +13,11 @@ - Version: 0.3.7
 - Homepage: https://github.com/scullionw/dirstat-rs
 - Description: Fastest(?) disk usage cli, similar to windirstat
 
+### llama-cpp-cuda
+- Version: 8864
+- Homepage: https://github.com/ggml-org/llama.cpp
+- Description: Inference of Meta's LLaMA model (and others) in pure C/C++
+
 ### lunchy-go
 - Version: 0.2.1-unstable-2022-02-12
 - Homepage: https://github.com/sosedoff/lunchy-go
A pkgs/by-directory/llama-cpp-cuda/package.nix
@@ -0,0 +1,4 @@
+{ llama-cpp }:
+llama-cpp.override {
+  cudaSupport = true;
+}