Versions of the OpenAssist Dataset for chat fine-tuning different models. See https://youtu.be/71x8EMrB0Gc for a full video run through of methods.
Trelis
company
AI & ML interests
Function Calling. Quantizing. Fine-Tuning. Summarizing. Long-context Length.
Organization Card
About org cards
last updated Feb 16th 2024
About
Trelis Research provides:
- Function-calling models.
- Advanced LLM fine-tuning scripts.
- Advanced LLM inference guides.
- Advanced vision fine-tuning scripts.
- Advanced voice/transcription fine-tuning scripts.
- One click LLM API templates
Function-calling Models and Datasets
- Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. Collection here
- Dataset to fine-tune models for function calling. Access here
- Scripts to fine-tune models for function calling and structured responses.
ADVANCED Fine-tuning Scripts
- Unsupervised + Supervised Fine-tuning Notebooks
- Chat fine-tuning scripts
- Long context fine-tuning scripts
- Function calling fine-tuning
- Q&A Dataset Preparation + Cleaning Scripts
- Scripts to create and use Embeddings
- Quantization Scripts
ADVANCED Inference
- Server setup, API setup and inference guide for open source models.
- Inference for function calling.
ADVANCED Vision
- Dataset Preparation
- Fine-tuning Llava and IDEFICS
ADVANCED Transcription
- Fine-tuning Whisper on custom datasets
- Dataset Generation
- Evaluation
One-click LLM API/Server Templates
- Check out the full list here
- Includes Llama 70B, Mistral 7B, Mixtral 8x7B and many more
Collections
2
Models fine-tuned for function-calling
-
Trelis/Meta-Llama-3-70B-Instruct-function-calling
Text Generation • Updated • 30 • 7 -
Trelis/Meta-Llama-3-8B-Instruct-function-calling
Text Generation • Updated • 1.33k • 14 -
Trelis/openchat_3.5-function-calling-v3
Text Generation • Updated • 12 • 18 -
Trelis/Llama-2-7b-chat-hf-function-calling-v3
Text Generation • Updated • 694 • 34
models
115
Trelis/idefics2-8b-chatty-bf16
Image-Text-to-Text
•
Updated
•
30
Trelis/OpenELM-270M-instruct-ORPO
Text Generation
•
Updated
•
4
Trelis/OpenELM-450M-instruct-ORPO
Text Generation
•
Updated
•
3
Trelis/Meta-Llama-3-8B-Instruct-function-calling
Text Generation
•
Updated
•
1.33k
•
14
Trelis/Meta-Llama-3-8B-Instruct-forced-french-adapters
Updated
Trelis/Meta-Llama-3-8B-Instruct-no-fin-advice-adapters
Updated
Trelis/Phi-3-mini-128k-instruct-function-calling
Text Generation
•
Updated
•
326
•
4
Trelis/Meta-Llama-3-70B-Instruct-function-calling
Text Generation
•
Updated
•
30
•
7
Trelis/Mixtral-8x7B-Instruct-v0.1-function-calling-adapters-v3
Updated
•
1
Trelis/TinyLlama-chat-SFT
Text Generation
•
Updated
•
2.7k
datasets
31
Trelis/video_clip_descriptions
Viewer
•
Updated
Trelis/dpo-mix-7k-SHORT
Viewer
•
Updated
•
80
Trelis/dpo-mix-7kSHORT
Viewer
•
Updated
Trelis/dpo-mix-7k
Viewer
•
Updated
Trelis/orpo-dpo-mix-40k-SHORT
Viewer
•
Updated
•
6
•
2
Trelis/englishQ_germanA
Viewer
•
Updated
•
45
•
2
Trelis/oasst2_top1_chat_format_fr
Viewer
•
Updated
•
3
Trelis/oasst2_top1_chat_format_en
Viewer
•
Updated
•
3
•
2
Trelis/function_calling_v3
Updated
•
440
•
36
Trelis/touch-rugby-memorisation-simple
Viewer
•
Updated
•
3