I was able to use the huggingface API to prompt Mistral 8x7B-Instruct-v0.1. By formatting the prompt as context + “Question: " + userInput + " Answer: " I was able to get a very basic chatbot going. It has no memory but it kind of works. Everything is done with $0.
Give it a try: