Recent content by crypticgoose

  1. crypticgoose

    Ollama

    You can also hook it up to: https://www.litellm.ai. Then you can load balance in case ollama fails to gpt-4 or another service like groq.
  2. crypticgoose

    Ollama

    @Willie Trombone Using it on desktop at home and in AWS. I have a RTX 3090 I got second hand with and AMD Ryzen 6800X. Use it for embedding & inference. Embedding: https://ollama.com/library/nomic-embed-text. Inference: mistral-7b-instruct, llama3.1-7b, etc. I build RAG demos with a focus on...
  3. crypticgoose

    API for Sixty60 / Pick n Pay

    Would love to know as well.
See more
Back
Top
Sign up to the MyBroadband newsletter
X