Xuan-Son Nguyen
7adf160c41
Copilot Setup Steps / copilot-setup-steps (push) Has been cancelled
Check Pre-Tokenizer Hashes / pre-tokenizer-hashes (push) Has been cancelled
Python check requirements.txt / check-requirements (push) Has been cancelled
Python Type-Check / python type-check (push) Has been cancelled
Update Operations Documentation / update-ops-docs (push) Has been cancelled
* init * wip * wire it up * make it clear that it's experimental * add props.connect_code * nits * fix windows build * server: do not advertise a connect code without the tunnel --connect-code on its own had no effect other than being served in /props, so the Web UI showed a remote access code that no tunnel was serving. Clear it when --connect is off, and say so once at startup. The teardown comment claimed that terminate() closes the child stdout. It does not: the log thread leaves fgets() only once every writer of that pipe is gone, so a descendant of llama-connect would block the join forever. Describe the real contract instead. Also restore the --reasoning-preserve default in the generated docs. * Update tools/connect/CMakeLists.txt Co-authored-by: Adrien Gallouët <angt@huggingface.co> * server: dial llama-connect on the bound port and a reachable host Pass ctx_http.port so --port 0 and the GCP override work, pick the dial host from --host (wildcards map to loopback, IPv6 is bracketed) and refuse --connect when only unix sockets are bound. --------- Co-authored-by: Pascal <admin@serveurperso.com> Co-authored-by: Adrien Gallouët <angt@huggingface.co>
49 lines
1.1 KiB
CMake
49 lines
1.1 KiB
CMake
# dependencies
|
|
|
|
find_package(Threads REQUIRED)
|
|
|
|
# third-party
|
|
|
|
# ...
|
|
|
|
# flags
|
|
|
|
llama_add_compile_flags()
|
|
|
|
# tools
|
|
|
|
if (EMSCRIPTEN)
|
|
else()
|
|
add_subdirectory(batched-bench)
|
|
add_subdirectory(gguf-split)
|
|
add_subdirectory(imatrix)
|
|
add_subdirectory(llama-bench)
|
|
add_subdirectory(completion)
|
|
add_subdirectory(perplexity)
|
|
add_subdirectory(quantize)
|
|
if (LLAMA_BUILD_SERVER)
|
|
add_subdirectory(ui)
|
|
add_subdirectory(cli)
|
|
add_subdirectory(server)
|
|
endif()
|
|
add_subdirectory(tokenize)
|
|
add_subdirectory(tts)
|
|
add_subdirectory(mtmd)
|
|
if (GGML_RPC)
|
|
add_subdirectory(rpc)
|
|
endif()
|
|
if (LLAMA_CONNECT)
|
|
add_subdirectory(connect)
|
|
endif()
|
|
if (NOT GGML_BACKEND_DL AND GGML_CPU)
|
|
# these tools use backends directly (no dynamic loading) and depend on CPU backend symbols
|
|
add_subdirectory(cvector-generator)
|
|
add_subdirectory(export-lora)
|
|
endif()
|
|
add_subdirectory(fit-params)
|
|
if (GGML_METAL)
|
|
add_subdirectory(tuning)
|
|
endif()
|
|
add_subdirectory(results)
|
|
endif()
|