Some questions to ask:

Nice write up: https://simonwillison.net/2025/Feb/3/a-computer-can-never-be-held-accountable/
Johannes’ tips:
Johannes’ tips:
Beware of context rot!
Long conversations / Many tokens make models become ‘dumber’
Caution
Note that when using cloud models, the company controlling the API gets this information too!
| Cloud Models | Local Models |
|---|---|
| Subscription | Hardware + Electricity |
| Environmental | Electricity |
| Societal | Skills |
| Exposure | Maintenance |