Перейти к содержимому

Você está usando IA errado — entenda LoRA, QLoRA, RAG e Guardrails

Gian Technologies

0:00 / 0:00

Você está usando IA errado — entenda LoRA, QLoRA, RAG e Guardrails

34 просмотра · 12 дней назад
Gian Technologies
9 подписчиков
34 просмотра · 12 дней назад
Opa Galera, tudo certo? Lembrem-se pesquisem e entendam as coisas por conta própria Segue as fontes LoRA Hu et al., 2021 — "LoRA: Low-Rank Adaptation of Large Language Models" — https://arxiv.org/abs/2106.09685 QLoRA Dettmers et al., 2023 — "QLoRA: Efficient Finetuning of Quantized LLMs" — https://arxiv.org/abs/2305.14314 Repositório oficial (bitsandbytes/QLoRA) — https://github.com/artidoro/qlora RAG Lewis et al., 2020 — "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks" — https://arxiv.org/abs/2005.11401 Quantização (GGUF / GPTQ / AWQ) llama.cpp — formato GGUF explicado — https://apxml.com/courses/practical-l... Cast AI — "LLM Quantization Methods: GPTQ, AWQ, GGUF" — https://cast.ai/blog/demystifying-qua... Documentação Qwen sobre GGUF/AWQ — https://qwen.readthedocs.io/en/v1.5/q... Temperatura, Top-p e Top-k OpenAI Developer Community — "Temperature and top_p interactions" — https://community.openai.com/t/temper... "Understanding LLM Temperature and Other Parameters" — https://apxml.com/courses/prompt-engi... Guardrails e segurança OWASP Top 10 for LLM Applications — https://owasp.org/www-project-top-10-... Wallace et al., 2024 — "The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions" — https://arxiv.org/abs/2404.13208