|
- r ollama - Reddit
How good is Ollama on Windows? I have a 4070Ti 16GB card, Ryzen 5 5600X, 32GB RAM I want to run Stable Diffusion (already installed and working), Ollama with some 7B models, maybe a little heavier if possible, and Open WebUI
- How safe are models from ollama? : r ollama - Reddit
Models in Ollama do not contain any "code" These are just mathematical weights Like any software, Ollama will have vulnerabilities that a bad actor can exploit So, deploy Ollama in a safe manner E g : Deploy in isolated VM Hardware Deploy via docker compose , limit access to local network Keep OS Docker Ollama updated
- How to Uninstall models? : r ollama - Reddit
just type ollama into the command line and you'll see the possible commands Usage: ollama [flags] ollama [command] Available Commands: serve Start ollama create Create a model from a Modelfile show Show information for a model run Run a model pull Pull a model from a registry push Push a model to a registry list List models cp Copy a model rm Remove a model help Help about any command Flags
- Best Model to locally run in a low end GPU with 4 GB RAM right now
I have a 12th Gen i7 with 64gb ram and no gpu (Intel NUC12Pro), I have been running 1 3B, 4 7B and 7B models with ollama with reasonable response time, about 5-15 seconds to first output token and then about 2-4 tokens second after that
- What is the best small (4b-14b) uncensored model you know and use?
Hey guys, I am mainly using my models using Ollama and I am looking for suggestions when it comes to uncensored models that I can use with it Since there are a lot already, I feel a bit overwhelmed For me the perfect model would have the following properties Refusal should be as low as possible
- Training a model with my own data : r LocalLLaMA - Reddit
I'm using ollama to run my models I want to use the mistral model, but create a lora to act as an assistant that primarily references data I've supplied during training This data will include things like test procedures, diagnostics help, and general process flows for what to do in different scenarios
- Ollama iOS mobile app (open source) : r LocalLLaMA - Reddit
OLLAMA_HOST=your ip address here ollama serve Ollama will run and bind to that IP instead of localhost and the Ollama server can be accessed on your local network (ex: within your house) As long as your phone is on the same wifi network, you can enter the URL in this app in settings like:
- Request for Stop command for Ollama Server : r ollama - Reddit
Ok so ollama doesn't Have a stop or exit command We have to manually kill the process And this is not very useful especially because the server respawns immediately So there should be a stop command as well Edit: yes I know and use these commands But these are all system commands which vary from OS to OS I am talking about a single command
|
|
|