It isn't actually the same, though - they don't support streaming. How are you getting around this?
ahyatt
joined 1 year ago
I've now added this to the llm package. Although I have to say it's not nearly as complete as Ollama is. In particular, it lacks embedding functionality and streaming.
Yes, the llm package does not have this but does have ollama, which seems pretty similar. I’m curious what the differences are. But if anyone thinks this is worth adding, it can be done, making it available to any package integrating with the llm package.
I really like the functionality you offer here, very interesting!
You may be interested in the LLM package in GNU ELPA which handles the llm connection and lets the user use the llm they wish. It supports ollama already (as of last week). I’m trying to convince authors of packages like yours to make the switch, so packages can focus on functionality instead of llm connection details.
I think you are right, at least for problems of configuring multiple packages together. I think there may be another useful way to organize configs, but I haven’t come up with anything yet. For now use-package is pretty optimal.