In other news I got the open weight chat gpt model going on my Mac with ollama. If you have a machine with 32gb ram it works pretty good.
In other news I got the open weight chat gpt model going on my Mac with ollama. If you have a machine with 32gb ram it works pretty good.
It turns out I had not properly understood the memory limitation. I adjusted my prompt & bingo it found every reference I was looking for, and correctly summarized them.
It turns out I had not properly understood the memory limitation. I adjusted my prompt & bingo it found every reference I was looking for, and correctly summarized them.
Here's a writeup on how to do it, with everything you need to set it up yourself in five minutes.
Leave a comment on this post to test it out!
www.coryzue.com/writing/blue...
Here's a writeup on how to do it, with everything you need to set it up yourself in five minutes.
Leave a comment on this post to test it out!
www.coryzue.com/writing/blue...