antoninoLorenzo/Ollama-on-Colab-with-ngrok
Notebook to run Ollama on Google Colab
You can run large language models (LLMs) like Llama 2 or Mistral without paying for a powerful graphics card yourself. This project helps you set up Ollama, a tool for running these models, on Google Colab's free computing environment. It takes your desired LLM and provides an accessible way for you to experiment with or use it for various tasks. This is for individuals who want to work with LLMs but lack dedicated GPU resources.
No commits in the last 6 months.
Use this if you want to run large language models for free directly from a web browser without complex setup.
Not ideal if you require continuous, high-performance LLM inference for production applications or have strict data privacy requirements that preclude cloud environments.
Stars
9
Forks
2
Language
Jupyter Notebook
License
—
Category
Last pushed
Aug 06, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/antoninoLorenzo/Ollama-on-Colab-with-ngrok"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
SepineTam/stata-mcp
Let LLM help you achieve your regression with Stata. Evolve from reg monkey to causal thinker.
datawhalechina/code-your-own-llm
一份全栈式大语言模型参考指南，用最简洁的代码帮助你端到端定义模型从零训练到工程落地的每一个细节
leonid20000/odin-slides
This is an advanced Python tool that empowers you to effortlessly draft customizable PowerPoint...
onejune2018/Awesome-LLM-Eval
Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs...
axhiao/QuickNote
Capture what you want with LLM