Local AI 🤔
AI assisted coding is addictive ...
As huge investments were made in the infrastructure and models, I expect token prices to raise. The dependency of the software development process on complex external infrastructure and unknown future costs I perceive as a risk.
256 GB, 16 GB, M4, Apple M4 10-Core
Enough reasons to do a little investment to elaborate what can be done locally. An Apple Mac Mini from 2024 should do for some first experiments ... together with ollama:
VNC and SSH work 👍 - time to load a model:
pgfeller@shodan ~ % ollama --version
ollama version is 0.30.8
pgfeller@shodan ~ % ollama run gemma4:e4b
pulling manifest
pulling 4c27e0f5b5ad: 5% ▕██ ▏ 448 MB/9.6 GB 26 MB/s 5m43sAfter a few minutes the API responds (/api/tags):
{
"models": [
{
"name": "gemma4:e4b",
"model": "gemma4:e4b",
"modified_at": "2026-06-13T21:57:22.685110531+02:00",
"size": 9608350718,
"digest": "c6eb396dbd5992bbe3f5cdb947e8....",
"details": {
"parent_model": "",
"format": "gguf",
"family": "gemma4",
"families": [
"gemma4"
],
"parameter_size": "8.0B",
"quantization_level": "Q4_K_M"
},
"capabilities": [
"completion",
"tools",
"thinking"
]
}
]
}
Based on the image, here is a detailed description:
Overall Impression:
The image is a portrait of a middle-aged man taken in what appears to be an underwater environment. The photograph has dramatic lighting and a slightly ethereal mood due to the water setting.
The Subject (The Man):
He is smiling widely, projecting a friendly, genuine, and happy demeanor. He is looking directly into the camera. He has close-cropped hair and visible stubble on his jawline and chin.
His expression suggests he is enjoying the moment or the activity they are participating in (diving/swimming).
The Setting and Lighting:
Environment: The setting is clearly underwater, indicated by the soft, diffused light filtering through the surface and the presence of suspended particles or bubbles visible around him.
Lighting: The lighting is dramatic—likely natural sunlight coming from above—which illuminates his face warmly while leaving the background in deeper shadow. This contrast adds depth and an adventurous feel to the portrait.
Summary:
It is a high-contrast, captivating underwater portrait of a man who looks happy and relaxed in his aquatic surroundings.