MrOvkill/StarlingCPU · Apply for community grant: Personal project (gpu and storage)

This is a working chat UI based on Gradio for Starling 7B - GGUF Q6_k. I think Starling is an excellent model, I love Berkley's work, and it would be wonderful to share this bot with the community. At present, it's a basic chat interface. If given a GPU, I could make it infer in real time. I'm also experimenting with TTS/STT, so a GPU would allow for real-time talk with it as well if desired. Additionally, if given storage, I could use a basic user system to store cache, conversations, documents, etc... Thank you for your consideration.