← 返回资源分享
Reactor Mk.1 performances: MMLU, HumanEval and BBH test results
论文
论文
发布时间2024-06-15
发表arXiv:2406.10515
作者:TJ Dunham,Henry Syahputra
详细介绍
The paper presents the performance results of Reactor Mk.1, ARCs flagship large language model, through a benchmarking process analysis. The model utilizes the Lychee AI engine and possesses less than 100 billion parameters, resulting in a combination of efficiency and potency. The Reactor Mk.1 outperformed models such as GPT-4o, Claude Opus, and Llama 3, with achieved scores of 92% on the MMLU dataset, 91% on HumanEval dataset, and 88% on BBH dataset. It excels in both managing difficult jobs and reasoning, establishing as a prominent AI solution in the present cutting-edge AI technology.
