Search code, repositories, users, issues, pull requests...
submited by
Style Pass
Prepare the quantized model by refering to the usage section on the llama.cpp README. For example, preparing the quatization model based on open_llama_7b is as follows:
Bug reports and pull requests are welcome on GitHub at https://github.com/yoshoku/llama_cpp.rb. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the code of conduct.
Everyone interacting in the LlamaCpp project's codebases, issue trackers, chat rooms and mailing lists is expected to follow the code of conduct.
Read more github.com/y...
