Reese Levine
7ca5991d2b
* Faster tensors (#8) Add fast matrix and matrix/vector multiplication. * Use map for shader replacements instead of pair of strings * Wasm (#9) * webgpu : fix build on emscripten * more debugging stuff * test-backend-ops: force single thread on wasm * fix single-thread case for init_tensor_uniform * use jspi * add pthread * test: remember to set n_thread for cpu backend * Add buffer label and enable dawn-specific toggles to turn off some checks * Intermediate state * Fast working f16/f32 vec4 * Working float fast mul mat * Clean up naming of mul_mat to match logical model, start work on q mul_mat * Setup for subgroup matrix mat mul * Basic working subgroup matrix * Working subgroup matrix tiling * Handle weirder sg matrix sizes (but still % sg matrix size) * Working start to gemv * working f16 accumulation with shared memory staging * Print out available subgroup matrix configurations * Vectorize dst stores for sg matrix shader * Gemv working scalar * Minor set_rows optimization (#4) * updated optimization, fixed errors * non vectorized version now dispatches one thread per element * Simplify * Change logic for set_rows pipelines --------- Co-authored-by: Neha Abbas <nehaabbas@macbookpro.lan> Co-authored-by: Neha Abbas <nehaabbas@ReeseLevines-MacBook-Pro.local> Co-authored-by: Reese Levine <reeselevine1@gmail.com> * Comment on dawn toggles * Working subgroup matrix code for (semi)generic sizes * Remove some comments * Cleanup code * Update dawn version and move to portable subgroup size * Try to fix new dawn release * Update subgroup size comment * Only check for subgroup matrix configs if they are supported * Add toggles for subgroup matrix/f16 support on nvidia+vulkan * Make row/col naming consistent * Refactor shared memory loading * Move sg matrix stores to correct file * Working q4_0 * Formatting * Work with emscripten builds * Fix test-backend-ops emscripten for f16/quantized types * Use emscripten memory64 to support get_memory * Add build flags and try ci --------- Co-authored-by: Xuan Son Nguyen <son@huggingface.co> * Remove extra whitespace * Move wasm single-thread logic out of test-backend-ops for cpu backend * Disable multiple threads for emscripten single-thread builds in ggml_graph_plan * Fix .gitignore * Add memory64 option and remove unneeded macros for setting threads to 1 --------- Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
139 lines
1.6 KiB
Plaintext
139 lines
1.6 KiB
Plaintext
# Extensions
|
|
|
|
*.a
|
|
*.bat
|
|
*.bin
|
|
*.d
|
|
*.dll
|
|
*.dot
|
|
*.etag
|
|
*.exe
|
|
*.gcda
|
|
*.gcno
|
|
*.gcov
|
|
*.gguf
|
|
*.gguf.json
|
|
*.lastModified
|
|
*.log
|
|
*.metallib
|
|
*.o
|
|
*.so
|
|
*.swp
|
|
*.tmp
|
|
*.DS_Store
|
|
|
|
# IDE / OS
|
|
|
|
/.cache/
|
|
/.ccls-cache/
|
|
/.direnv/
|
|
/.envrc
|
|
/.idea/
|
|
/.swiftpm
|
|
/.vs/
|
|
/.vscode/
|
|
/nppBackup
|
|
|
|
|
|
# Coverage
|
|
|
|
/gcovr-report/
|
|
/lcov-report/
|
|
|
|
# Build Artifacts
|
|
|
|
/tags
|
|
/.build/
|
|
/build*
|
|
/release
|
|
/debug
|
|
/libllama.so
|
|
/llama-*
|
|
/vulkan-shaders-gen
|
|
/rpc-server
|
|
/out/
|
|
/tmp/
|
|
/autogen-*.md
|
|
|
|
# Deprecated
|
|
|
|
/main
|
|
/server
|
|
|
|
# CI
|
|
|
|
!/.github/workflows/*.yml
|
|
|
|
# Models
|
|
|
|
/models/*
|
|
/models-mnt
|
|
!/models/.editorconfig
|
|
!/models/ggml-vocab-*.gguf*
|
|
!/models/templates
|
|
|
|
# Zig
|
|
/zig-out/
|
|
/zig-cache/
|
|
|
|
# Examples
|
|
|
|
/examples/jeopardy/results.txt
|
|
/tools/server/*.css.hpp
|
|
/tools/server/*.html.hpp
|
|
/tools/server/*.js.hpp
|
|
/tools/server/*.mjs.hpp
|
|
/tools/server/*.gz.hpp
|
|
!/build_64.sh
|
|
!/examples/*.bat
|
|
!/examples/*/*.kts
|
|
!/examples/*/*/*.kts
|
|
!/examples/sycl/*.bat
|
|
!/examples/sycl/*.sh
|
|
|
|
# Server Web UI temporary files
|
|
/tools/server/webui/node_modules
|
|
/tools/server/webui/dist
|
|
|
|
# Python
|
|
|
|
/.venv
|
|
__pycache__/
|
|
*/poetry.lock
|
|
poetry.toml
|
|
|
|
# Nix
|
|
/result
|
|
|
|
# Test binaries
|
|
/tests/test-backend-ops
|
|
/tests/test-double-float
|
|
/tests/test-grad0
|
|
/tests/test-grammar-parser
|
|
/tests/test-llama-grammar
|
|
/tests/test-opt
|
|
/tests/test-quantize-fns
|
|
/tests/test-quantize-perf
|
|
/tests/test-rope
|
|
/tests/test-sampling
|
|
/tests/test-tokenizer-0
|
|
/tests/test-tokenizer-1-bpe
|
|
/tests/test-tokenizer-1-spm
|
|
|
|
# Scripts
|
|
!/scripts/install-oneapi.bat
|
|
|
|
# Test models for lora adapters
|
|
/lora-tests
|
|
|
|
# Local scripts
|
|
/run-vim.sh
|
|
/run-chat.sh
|
|
/.ccache/
|
|
|
|
# IDE
|
|
/*.code-workspace
|
|
/.windsurf/
|
|
# emscripten
|
|
a.out.*
|