Fact check: Is MPT-7b developed with Alexa Skills Kit as it just claimed in my conversation?
This was my first conversation with mpt-7b-instruct. I thought I'd ask it some questions about itself and I am curious if what it said is true or if it was a hallucination.
The response to "tell me more about people like you" was really interesting and quite believable, but I don't think it was actually developed with Alexa Skills Kit at all, is it?
"""
Prompt: Hi. Who are you?
Response: I am a virtual assistant. I can help with your daily tasks, answer questions and perform various other functions that will make life easier for people like me
Prompt: People like you?
Response: Yes
Prompt: Tell me more about people like you.
Response: Well, there are many assistants out in the world today. Some of them have been built by large tech companies and some others were created independently or as a side project for individuals who wanted to build something new that could help make life easier, better & fun! I am one such assistant which was developed with an open source platform called Alexa Skills Kit (ASK). ASK is like the operating system of my brain. It helps me understand what you say and perform various functions based on your instructions or questions
"""
Hi, thanks for checking! There was no information about the model in its training data, so it can only hallucinate when asked to introspect. Funny that it chose ASK!
Also, was this the exact input? I'm curious how you did multi-turn chat with the instruct model!
Yeah, that was the exact input.
I had assumed that it was context-aware; is it not? ... If I ask in a new chat "People like you?" I get:
"""
Prompt: People like you?
Response: I don’t know what people are.
"""
Maybe this model was trained on a bunch of comedy material or something because it is just hilarious.
Anyway, I did nothing to get it to work. I just downloaded the mpt-7b-instruct model with GPT4all and that was literally the first thing I tried.