Spaces:
Running
Running
File size: 1,305 Bytes
5464733 e423c11 5464733 e423c11 5464733 e423c11 7365648 e423c11 7365648 e423c11 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 |
---
title: Phi-3.5 WebGPU
emoji: ⚡
colorFrom: yellow
colorTo: red
sdk: static
pinned: false
license: apache-2.0
models:
- onnx-community/Phi-3.5-mini-instruct-onnx-web
short_description: A powerful AI chatbot that runs locally in your browser
thumbnail: https://huggingface.co/spaces/webml-community/phi-3.5-webgpu/resolve/main/banner.png
---
# Phi-3.5 WebGPU
A simple React + Vite application for running [Phi-3.5-mini-instruct](https://huggingface.co/onnx-community/Phi-3.5-mini-instruct-onnx-web), a powerful small language model, locally in the browser using Transformers.js and WebGPU-acceleration.
## Getting Started
Follow the steps below to set up and run the application.
### 1. Clone the Repository
Clone the examples repository from GitHub:
```sh
git clone https://github.com/huggingface/transformers.js-examples.git
```
### 2. Navigate to the Project Directory
Change your working directory to the `phi-3.5-webgpu` folder:
```sh
cd transformers.js-examples/phi-3.5-webgpu
```
### 3. Install Dependencies
Install the necessary dependencies using npm:
```sh
npm i
```
### 4. Run the Development Server
Start the development server:
```sh
npm run dev
```
The application should now be running locally. Open your browser and go to `http://localhost:5173` to see it in action.
|