Перейти к содержимому

I Evaluated EmbeddingGemma 2 Like an Architect Would. Here's the Decision Record.

decodize

0:00 / 0:00

I Evaluated EmbeddingGemma 2 Like an Architect Would. Here's the Decision Record.

113 просмотров · 8 дней назад
decodize
8 подписчиков
113 просмотров · 8 дней назад
Can one open model make a mixed-media archive searchable without a transcription pipeline, and under what conditions would I recommend it to an organisation? This is an architecture decision record, narrated. Not a benchmark review, not a product demo. Five options including no AI at all, seven criteria, every number tagged with its source, what held up, what didn't, four sub-decisions with the option rejected, and a conditional recommendation gated on an evaluation I have not yet run. The reference implementation is Footage Finder: a local app that indexes video, audio, photos and PDF pages with EmbeddingGemma 2 into one SQLite index and searches it by typed text, spoken question or image. Loopback only. Nothing leaves the machine after the weights download. Status, stated plainly: independent build on a personal test library of public clips. Not a client system. Not deployed. The labelled evaluation is proposed, not run. Code and the written decision record: 🔗 https://github.com/praveenvijayan/foo... 🔗 https://github.com/praveenvijayan/foo... Model: google/embeddinggemma-2 (open weights, Hugging Face, licence-gated) Chapters 0:00 The question 0:52 Baseline and business case 1:58 Options: no AI, caption chain, managed API, local open model, hybrid 3:03 The candidate: EmbeddingGemma 2 in a minute 3:56 Reference implementation: Footage Finder 5:12 Evaluation: what held, what broke 7:24 Decision records: four sub-decisions, each with the rejected option 8:44 Enterprise consequences: boundary, cost, operations, hybrid search 10:09 Recommendation: conditional pilot, and when not to use it 10:48 Close Evidence codes used on screen M measured on my MacBook · B observed in my build · P public Colab test · C model card · J my judgement · V unverified · I illustrative · N not run Numbers quoted from public tests (Flickr-1k photo retrieval, 50 sound categories) are not my data. My own accuracy numbers do not exist yet; the gate for producing them is in the video and the ADR. If you would weight a criterion differently, or make a different call, say which one in the comments. That is more useful to me than agreement.