LLM Farm

LLM Farm

Run LLM

开发者: Artem Savkin

中国
APP ID 复制
6461209867
价格
免费
内购
0个评分
软件开发工具(免费)
昨日下载量
最近更新
2024-06-28
最早发布
2023-12-13
版本统计
  • 94天16小时

    最新版本上线距今

  • 7

    近1年版本更新次数

  • 2023-12-13

    全球最早版本上线日期

版本记录
显示信息
日期
  • 全部
每页显示条数
  • 请选择
  • 版本: 1.3.0

    版本更新日期

    2024-06-28

    LLM Farm

    LLM Farm

    Run LLM

    更新日志

    Changes:
    * LLaMA.cpp updated to b3190
    * Added support for DeepseekV2, GPTNeoX (Pythia and others)
    * Added support for Markdown formatting
    * Added support for using history in Shortcuts
    * Added Flash Attention support
    * Added NPredict option
    * Save/Load context state. Now it is possible to continue the dialog with the model even after the program is reopened.
    * Chat settings such as sampling are now applied without reloading the chat.
    * Skip tokens option. Allows you to specify tokens that will not be displayed in the results. May be useful for phi3 and qwen.
    * Metal and CPU inference improvements
    * Sampling and eval improvements
    * Some fixes for phi-3 and MiniCPM
    * Fixed some errors
    * Added Qwen template

    视频/截图

    LLM Farm App 截图
    LLM Farm App 截图
    LLM Farm App 截图
    LLM Farm App 截图

    应用描述

    LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

    # Features
    * Various inferences
    * Various sampling methods
    * Metal
    * Model setting templates
    * LoRA adapters support
    * LoRA FineTune and Export

    # Inferences
    * LLaMA
    * GPTNeoX
    * Replit
    * GPT2 + Cerebras
    * Starcoder(Santacoder)
    * RWKV (20B tokenizer)
    * Falcon
    * MPT
    * Bloom
    * StableLM-3b-4e1t
    * Qwen
    * Gemma
    * Phi
    * Mamba
    * Others

    # Multimodal
    * LLaVA 1.5 models
    * Obsidian
    * MobileVLM 1.7B/3B models

    Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

    Sampling methods
    * Temperature (temp, tok-k, top-p)
    * Tail Free Sampling (TFS)
    * Locally Typical Sampling
    * Mirostat
    * Greedy
    * Grammar (dont work with GGJTv3)
  • 版本: 1.2.0

    版本更新日期

    2024-05-23

    LLM Farm

    LLM Farm

    Run LLM

    更新日志

    Changes:
    * Added shortcuts support
    * llama.cpp updated to b2864
    * Some llama-3, Command-R fixes
    * Added llama3 instruct template
    * Fixed a bug that could cause the application to crash if the system prompt format is incorrect
    * Fix memory bug in grammar parser
    * Fixed some other bugs

    视频/截图

    LLM Farm App 截图
    LLM Farm App 截图
    LLM Farm App 截图
    LLM Farm App 截图

    应用描述

    LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

    # Features
    * Various inferences
    * Various sampling methods
    * Metal
    * Model setting templates
    * LoRA adapters support
    * LoRA FineTune and Export

    # Inferences
    * LLaMA
    * GPTNeoX
    * Replit
    * GPT2 + Cerebras
    * Starcoder(Santacoder)
    * RWKV (20B tokenizer)
    * Falcon
    * MPT
    * Bloom
    * StableLM-3b-4e1t
    * Qwen
    * Gemma
    * Phi
    * Mamba
    * Others

    # Multimodal
    * LLaVA 1.5 models
    * Obsidian
    * MobileVLM 1.7B/3B models

    Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

    Sampling methods
    * Temperature (temp, tok-k, top-p)
    * Tail Free Sampling (TFS)
    * Locally Typical Sampling
    * Mirostat
    * Greedy
    * Grammar (dont work with GGJTv3)
  • 版本: 1.1.1

    版本更新日期

    2024-05-05

    LLM Farm

    LLM Farm

    Run LLM

    更新日志

    Changes:
    * llama.cpp updated to b2717
    * Phi3, Mamba(CPU only), Gemma, StarCoder2, GritLM, Command-R, MobileVLM_V2, qwen2moe models
    * IQ1_S, IQ2_S, IQ2_M, IQ3_S, IQ4_NL, IQ4_XS quntization support
    * Performance improvements
    * Fixed crash when EOS option is on
    * Fixed image orientation
    * Added warning about creating a chat without a selected model

    视频/截图

    LLM Farm App 截图
    LLM Farm App 截图
    LLM Farm App 截图
    LLM Farm App 截图

    应用描述

    LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

    # Features
    * Various inferences
    * Various sampling methods
    * Metal
    * Model setting templates
    * LoRA adapters support
    * LoRA FineTune and Export

    # Inferences
    * LLaMA
    * GPTNeoX
    * Replit
    * GPT2 + Cerebras
    * Starcoder(Santacoder)
    * RWKV (20B tokenizer)
    * Falcon
    * MPT
    * Bloom
    * StableLM-3b-4e1t
    * Qwen
    * Gemma
    * Phi
    * Mamba
    * Others

    # Multimodal
    * LLaVA 1.5 models
    * Obsidian
    * MobileVLM 1.7B/3B models

    Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

    Sampling methods
    * Temperature (temp, tok-k, top-p)
    * Tail Free Sampling (TFS)
    * Locally Typical Sampling
    * Mirostat
    * Greedy
    * Grammar (dont work with GGJTv3)
  • 版本: 1.0.1

    版本更新日期

    2024-03-25

    LLM Farm

    LLM Farm

    Run LLM

    更新日志

    If you are getting strange prediction results in version 1.0.1, but everything was fine in version 0.9.0, try disabling the BOS option in the template.

    ## Changes:
    * llama.cpp updated to b2135
    * Added support for multimodal models MobileVLM, Yi-VL, LLaVA, Obsidian tested on (mobileVLM 3B)
    * Added the ability to download models from the application menu
    * Added possibility to specify System Prompt, which will be added to the text of the first message in the session. See (https://github.com/guinmoon/LLMFarm/wiki/FAQ)
    * Added ability to clone chat (without message history)
    * Added progress indicator for model loading
    * Added the ability to hide the keyboard, to do this tap anywhere in the chat window
    * Added ability to temporarily disable chat autoscrolling by tapping anywhere in the chat window, autoscrolling will be enabled automatically when sending a new message
    * When you clear the message history, the model context is also cleared
    * Chats are sorted by last modification date
    * Clear chat history button is placed on the toolbox.
    * You can now use both {prompt} and {{prompt}} designations in templates
    * Templates have been updated
    * Fixed disappearing keyboard bug
    * Fixed a bug with displaying already deleted chats and models
    * Fixed crash on switch model
    * Fixed a bug that could cause a crash on startup of feintune
    * Fixed some bugs that could cause the application to crash
    * Fixed some other bugs
    * Some UI improvements

    应用描述

    暂无应用描述数据

  • 版本: 0.9.0

    版本更新日期

    2024-02-01

    LLM Farm

    LLM Farm

    Run LLM

    更新日志

    Changes:
    * llama.cpp updated to b1891
    * added support for Phi2, TinyLlama and other models
    * various GUI improvements
    * added clear chat button
    * user templates improve
    * fixed token to string issue
    * fixed gpt2 metal
    * fixed many other errors

    视频/截图

    LLM Farm App 截图
    LLM Farm App 截图
    LLM Farm App 截图

    应用描述

    LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

    # Features
    * Various inferences
    * Various sampling methods
    * Metal
    * Model setting templates
    * LoRA adapters support
    * LoRA FineTune and Export

    # Inferences
    * LLaMA
    * GPTNeoX
    * Replit
    * GPT2 + Cerebras
    * Starcoder(Santacoder)
    * RWKV (20B tokenizer)
    * Falcon
    * MPT
    * Bloom
    * StableLM-3b-4e1t
    * Qwen

    Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

    Sampling methods
    * Temperature (temp, tok-k, top-p)
    * Tail Free Sampling (TFS)
    * Locally Typical Sampling
    * Mirostat
    * Greedy
    * Grammar (dont work with GPTNeoX, GPT-2, RWKV)
    * Classifier-Free Guidance
  • 版本: 0.8.1

    版本更新日期

    2023-12-24

    LLM Farm

    LLM Farm

    Run LLM

    更新日志

    * llama.cpp updated to b1601
    * added support for StableLM-3b-4e1t models
    * added support for Qwen models
    * added the possibility to merge LoRA with the model
    * added merge and train LoRA progress bar
    * added the possibility to save user templates
    * added multyline input
    * fixed many other errors

    视频/截图

    LLM Farm App 截图
    LLM Farm App 截图
    LLM Farm App 截图

    应用描述

    LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

    # Features
    * Various inferences
    * Various sampling methods
    * Metal
    * Model setting templates
    * LoRA adapters support
    * LoRA FineTune and Export

    # Inferences
    * LLaMA
    * GPTNeoX
    * Replit
    * GPT2 + Cerebras
    * Starcoder(Santacoder)
    * RWKV (20B tokenizer)
    * Falcon
    * MPT
    * Bloom
    * StableLM-3b-4e1t
    * Qwen

    Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

    Sampling methods
    * Temperature (temp, tok-k, top-p)
    * Tail Free Sampling (TFS)
    * Locally Typical Sampling
    * Mirostat
    * Greedy
    * Grammar (dont work with GPTNeoX, GPT-2, RWKV)
    * Classifier-Free Guidance
  • 预订版本: 0.7.5

    版本更新日期

    2023-12-13

    预订转上架日期

    2023-12-13
    LLM Farm

    LLM Farm

    Run LLM

    更新日志

    暂无更新日志数据

    应用描述

    暂无应用描述数据