Georgi Gerganov
6990e2f1f7
* cmake : allow libcommon to be shared * cmake : rename libcommon to libllama-common * cont : set -fPIC for httplib * cont : export all symbols * cont : fix build_info exports * libs : add libllama-common-base * log : add common_log_get_verbosity_thold()
Results
The llama-results tool can be used to --check the outputs of a model vs. a previous commit to detect whether they have changed.
Example usage:
llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed." # writes results to file
llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed." --check # compares results vs file
The metric by which the results are compared is the normalized mean squared error (NMSE) with a tolerance of 10^{-6}.