Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -11,8 +11,8 @@ pinned: false
|
|
11 |
|
12 |
Neural Magic helps developers in accelerating deep learning performance using automated model compression technologies and inference engines.
|
13 |
Download our compression-aware inference engines and open source tools for fast model inference.
|
14 |
-
* [
|
15 |
-
* [
|
16 |
* [DeepSparse](https://github.com/neuralmagic/deepsparse): Inference runtime offering accelerated performance on CPUs and APIs to integrate ML into your application
|
17 |
|
18 |
![NM Workflow](https://cdn-uploads.huggingface.co/production/uploads/60466e4b4f40b01b66151416/oFtTSqKjDLwd095gtYHlc.png)
|
|
|
11 |
|
12 |
Neural Magic helps developers in accelerating deep learning performance using automated model compression technologies and inference engines.
|
13 |
Download our compression-aware inference engines and open source tools for fast model inference.
|
14 |
+
* [nm-vllm](https://neuralmagic.com/nm-vllm/): Enterprise-ready inferencing system based on the open-source library, vLLM, for at-scale operationalization of performant open-source LLMs
|
15 |
+
* [LLM Compressor](https://github.com/vllm-project/llm-compressor/): HF-native library for applying quantization and sparsity algorithms to llms for optimized deployment with vLLM
|
16 |
* [DeepSparse](https://github.com/neuralmagic/deepsparse): Inference runtime offering accelerated performance on CPUs and APIs to integrate ML into your application
|
17 |
|
18 |
![NM Workflow](https://cdn-uploads.huggingface.co/production/uploads/60466e4b4f40b01b66151416/oFtTSqKjDLwd095gtYHlc.png)
|