Official implementation of GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimization

LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA

Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first approach

An implementation of GRPO for Unsloth's VLMs training

基于DPO算法微调语言大模型，简单好上手。

Code repository dedicated to experimenting and research with tiny reasoning language model

Various training, inference and validation code and results related to Open LLM's that were pretrained (full or partially) on the Dutch language.

simpleR1: A Simple Framework for Training R1-like Models

realize the reinforcement learning training for gpt2 llama bloom and so on llm model

使用trl、peft、transformers等库，实现对huggingface上模型的微调。

This project demonstrates the process of fine-tuning the Qwen2.5-3B-Instruct model using GRPO (Generalized Reward Policy Optimization) on the GSM8K dataset.

Different post-training techniques for LLMs, including: SFT, DPO and Online RL

Notebooks to create an instruction following version of Microsoft's Phi 2 LLM with Supervised Fine Tuning and Direct Preference Optimization (DPO)

Minimal code to train reasoning model with reinforcement learning.

Federated Supervised Fine-Tuning for Small Language Models (SLMs)

Kontext-Photo-Mate-v2 is an advanced image manipulation application built on top of the FLUX.1 Kontext AI model, featuring multiple LoRA adapters for fine-grained perspective and object editing.

Finetune language models to automatically generate documentation for different programming language (Python, Java, go, etc)

Supervised Fine tuning using TRL library

The overall aim of this project is to create a term rewriting system that could be useful in everyday programming, and to represent data in a way that roughly correspond to the definition of a term in formal logic. Terms should be familiar to any programmer because they are basically constants, variables, and function symbols.

finetune gpt-oss and smollm3 on your data easily and cheaply