#cplusplus #ggml #llama
The `llama.cpp` project allows you to run large language models (LLMs) like LLaMA and others with high performance on various hardware, including local machines and cloud services. Here are the key benefits It works on Apple Silicon, x86 architectures, NVIDIA, AMD, and Moore Threads GPUs, as well as CPUs, ensuring you can use it on a wide range of devices.
- **Optimized Performance** You can build and run the project locally, install it via package managers, use Docker images, or download pre-built binaries.
- **Extensive Model Support** It includes tools like `llama-cli` for simple text completion, `llama-server` for setting up an HTTP server, and `llama-perplexity` for measuring model quality.
This makes `llama.cpp` a powerful and flexible tool for anyone looking to work with LLMs efficiently.
https://github.com/ggerganov/llama.cpp
The `llama.cpp` project allows you to run large language models (LLMs) like LLaMA and others with high performance on various hardware, including local machines and cloud services. Here are the key benefits It works on Apple Silicon, x86 architectures, NVIDIA, AMD, and Moore Threads GPUs, as well as CPUs, ensuring you can use it on a wide range of devices.
- **Optimized Performance** You can build and run the project locally, install it via package managers, use Docker images, or download pre-built binaries.
- **Extensive Model Support** It includes tools like `llama-cli` for simple text completion, `llama-server` for setting up an HTTP server, and `llama-perplexity` for measuring model quality.
This makes `llama.cpp` a powerful and flexible tool for anyone looking to work with LLMs efficiently.
https://github.com/ggerganov/llama.cpp
GitHub
GitHub - ggml-org/llama.cpp: LLM inference in C/C++
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
#cplusplus #asr #ggml #gguf #speech_to_text
transcribe.cpp is a fast, free C/C++ library that turns speech into text using 16 model families (like Whisper and Parakeet) on your own GPU or CPU, with official supports for Python, JavaScript, Rust, and Swift. You benefit by getting accurate, verified transcriptions without paying cloud API fees, running entirely on your device for privacy, and supporting streaming, batch, and specialized tasks like medical dictation or speaker diarization.
https://github.com/handy-computer/transcribe.cpp
transcribe.cpp is a fast, free C/C++ library that turns speech into text using 16 model families (like Whisper and Parakeet) on your own GPU or CPU, with official supports for Python, JavaScript, Rust, and Swift. You benefit by getting accurate, verified transcriptions without paying cloud API fees, running entirely on your device for privacy, and supporting streaming, batch, and specialized tasks like medical dictation or speaker diarization.
https://github.com/handy-computer/transcribe.cpp
GitHub
GitHub - handy-computer/transcribe.cpp: ggml speech-to-text inference for 16+ model families
ggml speech-to-text inference for 16+ model families - handy-computer/transcribe.cpp
👍1