Colab AI Model Runner — Generator by Uzair Mughal

description your_model_colab.py

warning Do NOT Paste Into a Cell

Running the script with !python3 file.py or pasting directly into a Colab cell will NOT work properly — Cloudflare URLs, rich progress bars, and interactive CLI chat require a real terminal, not a notebook cell.

Instead, upload the file and run it from the Colab terminal as described below. 👇

menu_book What To Do Next

Save the Script

Click the 💾 Save as .py button above to download the generated script as a .py file to your computer. Or use 📋 Copy Code and save it manually.

Open Google Colab

Go to colab.research.google.com and create a new notebook.

Select GPU Runtime

Click Runtime → Change runtime type and select T4 GPU (free tier) or A100 (Colab Pro). Larger models need more VRAM.

Upload the Script File

In the left sidebar, click the 📁 Files tab, then click the ⬆ Upload button. Upload the .py file you saved in Step 1. It will appear in /content/.

Open a Terminal

Click Runtime → Run in Terminal, or use the keyboard shortcut. You can also type !bash in a cell and press Enter to open a shell. This gives you a real terminal that shows all output correctly.

Run the Script

In the terminal, run:
python3 /content/your_model_colab.py
Replace the filename with whatever you saved it as. The script will install everything, download the model, and show progress bars.

Get Your Public URL

A Cloudflare tunnel will create a public URL like https://xyz.trycloudflare.com. This URL will be clearly displayed in the terminal output. Share it with anyone!

Start Chatting!

Use the web chat UI via the public URL, or use the CLI chat directly in the terminal. Type exit to quit CLI mode.

info Important Notes

• Always use the terminal — never !python3 in a cell. The ! prefix breaks rich output and Cloudflare URL detection.

• Free Colab gives you ~12.7 GB VRAM with T4. Models up to ~14B parameters (quantized) fit here.

• Session time limit: Free Colab disconnects after ~90 minutes of idle time or ~12 hours total.

• Don't close the tab while the script is running — the Colab session needs to stay active.

• Cloudflare URL changes each time you restart — share the new one.

• For models > 14B parameters, use Colab Pro with A100 GPU (40/80 GB VRAM).