← 返回资源分享
Llama 2: Open Foundation and Fine-Tuned Chat Models
论文
论文
发布时间2023-07-18
发表arXiv:2307.09288
作者:Thibaut Lavril,Sharan Narang,Guillem Cucurull,Angela Fan,Hakan Inan,Marcin Kardas,Eric Michael Smith,Sergey Edunov,Naman Goyal,Louis Martin,Adina Williams,Madian Khabsa,Hugo Touvron,Marie-Anne Lachaux,Yuchen Zhang,Thomas Scialom,Yuning Mao,Rui Hou,Amjad Almahairi,Yixin Nie,Shruti Bhosale,Todor Mihaylov,Punit Singh Koura,Kevin Stone,Moya Chen,Ross Taylor,Anthony Hartshorn,Andrew Poulton,Viktor Kerkez,Robert Stojnic,Saghar Hosseini,Vedanuj Goswami,Prajjwal Bhargava,Igor Molybog,Peter Albert,David Esiobu,Ruan Silva,Binh Tang,Diana Liskovich,Puxin Xu,Melanie Kambadur,Xiaoqing Ellen Tan,Cynthia Gao,Rashi Rungta,Brian Fuller,Zheng Yan,Alan Schelten,Artem Korenev,Aurelien Rodriguez,Cristian Canton Ferrer,Iliyan Zarov,Isabel Kloumann,Jenya Lee,Jeremy Fu,Lukas Blecher,Nikolay Bashlykov,Soumya Batra,Wenyin Fu,Xavier Martinet,Yasmine Babaei,Jeremy Reizenstein,Dan Bikel,Jude Fernandes,Yinghai Lu,Pushkar Mishra,Kalyan Saladi,Ranjan Subramanian,Jian Xiang Kuan
详细介绍
In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters. Our fine-tuned LLMs, called Llama 2-Chat, are optimized for dialogue use cases. Our models outperform open-source chat models on most benchmarks we tested, and based on our human evaluations for helpfulness and safety, may be a suitable substitute for closed-source models. We provide a detailed description of our approach to fine-tuning and safety improvements of Llama 2-Chat in order to enable the community to build on our work and contribute to the responsible development of LLMs.
代码仓库 (19)
IBM/Dromedary官方PyTorch
rijgersberg/geitje官方PyTorch
facebookresearch/llama官方PyTorch
eternityyw/tram-benchmark
llamafamily/llama-chinesePyTorch
flagalpha/llama2-chinesePyTorch
Lightning-AI/lit-gptPyTorch
ninglab/ecellmPyTorch
xzhang97666/alpacare
xverse-ai/xverse-13bPyTorch
