LLMFarm is an application available for iOS and MacOS designed for managing large language models (LLM). It provides the functionality to load various LLMs customizable with specific parameters.
Features:
- Multiple inference capabilities
- Diverse sampling methods
- Metal integration
- Model configuration templates
- Support for LoRA adapters and LoRA FineTune and Export features
Inferences:
- LLaMA
- GPTNeoX
- Replit
- GPT2 + Cerebras
- Starcoder (Santacoder)
- RWKV (20B tokenizer)
- Falcon
- MPT
- Bloom
- StableLM-3b-4e1t
- Qwen
Multimodal:
- LLaVA 1.5 models
- Obsidian
- MobileVLM 1.7B/3B models
Note: For detailed model settings for Falcon, Alpaca, GPT4All, Chinese LLaMA/Alpaca, Chinese LLaMA-2/Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivatives, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom, please select the llama inference in the model settings.
Sampling methods:
- Temperature variations (temp, tok-k, top-p)
- Tail Free Sampling (TFS)
- Locally Typical Sampling
- Mirostat
- Greedy sampling
- Grammar-based sampling (does not work with GGJTv3)
Overview
LLM Farm is a Freeware software in the category Development developed by Artem Savkin.
The latest version of LLM Farm is 1.0.1, released on 06/14/2024. It was initially added to our database on 06/14/2024.
LLM Farm runs on the following operating systems: iOS.
Users of LLM Farm gave it a rating of 4 out of 5 stars.
11/11/2024 | Skype 8.132.0.201 |
11/11/2024 | Boom 3D for Mac 2.2.2 |
11/11/2024 | Glary Utilities 6.18.0.22 |
11/11/2024 | WD Drive Utilities 2.1.2.167 |
11/11/2024 | Ferdium 7.0.0 |
Latest Reviews
MP3 Converter V4
Effortlessly Convert Audio Files to MP3 with MP3 Converter V4! |
|
Spark
Streamline Communication and Collaboration with Spark by Jive Software |
|
Complemento Guardar como PDF o XPS de Microsoft para programas de Microsoft Office
Effortlessly save Microsoft Office files as PDF or XPS with this Microsoft add-on |
|
GrabIt Beta
Efficient file downloading with GrabIt Beta! |
|
Doro
Enhance your digital creativity with Doro by CompSoft! |
|
IncrediMail 2
Email made fun and easy with IncrediMail 2! |