#

parameter-efficient-fine-tuning

Here are 25 public repositories matching this topic...

Chongjie-Si / Subspace-Tuning

A generalized framework for subspace tuning methods in parameter efficient fine-tuning.

adapter natural-language-processing glue llama lora pretrained-models natural-language-generation natural-language-understanding commonsense-reasoning soft-prompt-tuning low-rank-adaptation llama2-7b parameter-efficient-fine-tuning subject-driven-generation llama3-8b subspace-tuning lora-dash

Updated Sep 16, 2024
Python

miccunifi / KDPL

[ECCV 2024] - Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation

clip knowledge-distillation few-shot-learning prompt-learning vision-language-model parameter-efficient-fine-tuning kdpl

Updated Sep 13, 2024
Python

Paranioar / SHERL

[ECCV2024] The code of "SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning"

transfer-learning cross-modal parameter-efficient-learning parameter-efficient-tuning memory-efficient-tuning memory-efficient-learning parameter-efficient-fine-tuning

Updated Sep 13, 2024

cityuhkai / SBoRA

natural-language-processing low-rank-adaptation parameter-efficient-fine-tuning

Updated Sep 9, 2024
Python

NVlabs / DoRA

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

deep-neural-networks deep-learning lora commonsense-reasoning vision-and-language large-language-models parameter-efficient-tuning instruction-tuning large-vision-language-models parameter-efficient-fine-tuning

Updated Aug 30, 2024
Python

synbol / Awesome-Parameter-Efficient-Transfer-Learning

Collection of awesome parameter-efficient fine-tuning resources.

computer-vision deep-learning survey transformer awesome-list transfer-learning pre-trained-models parameter-efficient-fine-tuning

Updated Aug 15, 2024

umbertocappellazzo / PETL_AST

This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters".

adapter transfer-learning lora audio-processing mixture-of-experts prompt-tuning audio-spectrogram-transformer parameter-efficient-fine-tuning mixture-of-adapters

Updated Jul 31, 2024
Python

qiqinyi / GenAI-with-LLMs

My lab work of “Generative AI with Large Language Models” course offered by DeepLearning.AI and Amazon Web Services on coursera.

python machine-learning kl-divergence proximal-policy-optimization llms generative-ai flan-t5 low-rank-adaptation parameter-efficient-fine-tuning peft-fine-tuning-llm

Updated Jul 31, 2024
Jupyter Notebook

liuqidong07 / MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

multi-task peft multitask-learning mixture-of-experts large-language-models chatglm low-rank-adaptation parameter-efficient-fine-tuning peft-fine-tuning-llm

Updated Jul 22, 2024
Python

iboing / CorDA

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models

catastrophic-forgetting large-language-models parameter-efficient-fine-tuning world-knowledge

Updated Jul 12, 2024
Python

Paranioar / Awesome_Matching_Pretraining_Transfering

The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.

tutorial awesome-list vision-and-language video-text-recognition cross-modal-retrieval visual-semantic-embedding image-text-matching video-text-retrieval image-text-retrieval multimodal-pretraining large-language-models large-vision-language-models multimodal-large-language-models memory-efficient-tuning parameter-efficient-fine-tuning large-vision-models

Updated Jul 11, 2024

giuseppedipoce / Task-Arithmetic-Tuning-of-MobileNetV2-

This repository contain a project which goal is to find new parameter efficient fine tuning framework in order to improve performance of Deep Artificial Neural Network onto "out of distribution" data (OOD). In this specific case you can find Multi-task Learning problem.

transfer-learning fine-tuning mobilenetv2 parameter-efficient-fine-tuning task-arithmetic ada-merging

Updated Jul 7, 2024
Jupyter Notebook

UniFAQ

KayvanShah1 / UniFAQ

Fine-Tuned LLM-Based FAQ Generation for University Admissions: A project involving the fine-tuning of state-of-the-art language models, including LLaMA-3 8b, LLaMA-2 7b, Mistral 7b, T5, and BART, leveraging QLoRA PEFT.

python natural-language-processing bart t5 frequently-asked-questions huggingface-transformers openai-api large-language-models generative-ai chatgpt qlora llama2 parameter-efficient-fine-tuning llama3

Updated Jul 5, 2024
Jupyter Notebook

PurdueDigitalTwin / MACP

[WACV 2024] MACP: Efficient Model Adaptation for Cooperative Perception.

computer-vision perception autonomous-vehicles object-tracking cooperative-perception wacv cvf-conference wacv2024 parameter-efficient-fine-tuning model-adaptation

Updated May 3, 2024
Python

Paranioar / UniPT

[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"

transfer-learning cross-modal parameter-efficient-learning parameter-efficient-tuning memory-efficient-tuning memory-efficient-learning parameter-efficient-fine-tuning

Updated Apr 25, 2024
Python

GeorgeVern / lmcor

Code for the EACL 2024 paper: "Small Language Models Improve Giants by Rewriting Their Outputs"

machine-translation summarization grammatical-error-correction data-to-text-generation large-language-models parameter-efficient-fine-tuning

Updated Apr 20, 2024
Python

ZhengxiangShi / DePT

[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"

nlp natural-language-processing transfer-learning language-model nlp-machine-learning fine-tuning peft prompt-tuning large-language-models parameter-efficient-tuning parameter-efficient-fine-tuning

Updated Apr 10, 2024
Python

Raman1121 / FairTune

A framework to optimize Parameter-Efficient Fine-Tuning for Fairness in Medical Image Analysis

deep-learning medical-image-analysis fairness-ml vision-transformer parameter-efficient-fine-tuning

Updated Feb 29, 2024
Python

auniquesun / PPT

[ICRA 2024] Official Implementation of the Paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"

point-cloud-recognition 3d-point-cloud point-cloud-analysis prompt-learning parameter-efficient-tuning point-cloud-understanding 3d-shape-part-segmentation parameter-efficient-fine-tuning 3d-shape-analysis

Updated Jan 31, 2024
Jupyter Notebook

fork123aniket / LLM-RAG-powered-QA-App

A Production-Ready, Scalable RAG-powered LLM-based Context-Aware QA App

question-answering ray fine-tuning context-aware-system large-language-models ray-serve llmops llm-serving eleutherai llm-training llm-inference retrieval-augmented-generation parameter-efficient-fine-tuning

Updated Jan 8, 2024
Python

Improve this page

Add a description, image, and links to the parameter-efficient-fine-tuning topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the parameter-efficient-fine-tuning topic, visit your repo's landing page and select "manage topics."