I just wrote a change that's going to let your LLaMA models load instantly, thanks to a custom malloc() and the power of mmap(). Follow our progr

JavaScript is not available.

submited by
Style Pass
2023-03-18 12:00:05

I just wrote a change that's going to let your LLaMA models load instantly, thanks to a custom malloc() and the power of mmap(). Follow our progress here: https:// github.com/ggerganov/llama.cpp/issues/91#issuecomment-1473271638 …

I just wrote a change that's going to let your LLaMA models load instantly, thanks to a custom malloc() and the power of mmap(). Follow our progress here: https:// github.com/ggerganov/llama.cpp/issues/91#issuecomment-1473271638 …

Leave a Comment