blob: 85f571b93ed62fbea3ae5dbda18afbce110dda1d (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
|
We install some stuff on Nix (as much as we can) and the rest with `uv pip`.
That works well. Which means it installs. But the `venv`, which is in `.venv`, also has a python runtime there, and as we're using the nix store python runtime, it won't see the venv packages. So you gotta do `source .venv/bin/activate` which is pretty weird but it does work.
21-9-2025- Long convo with ChatGPT about torch and numpy and tensors and ndarrays. idgi but interesting, should revisit.
Apparently transformers need the with torch.no_grad(): thing all the time but sentence transformers don't. at all
## DIM creating the DB table is retarded damn you chatgpt
>> he says
TL;DR
DIM = number of floats per embedding vector (fixed by the model).
sqlite-vec needs it at table creation.
You don’t restart the DB every run — you just make sure new embeddings match the stored DIM.
Best practice: store model+dim in a meta table so you don’t accidentally mix dimensions.
|
