1196 149 189

Merve Noyan PRO

merve

AI & ML interests

VLMs, vision & co

Articles

Organizations

merve's activity

upvoted a paper 6 days ago

DriveLM: Driving with Graph Visual Question Answering

Paper • 2312.14150 • Published Dec 21, 2023 • 4

upvoted a paper 20 days ago

Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model

Paper • 2408.11039 • Published 29 days ago • 53

upvoted a paper 25 days ago

TableBench: A Comprehensive and Complex Benchmark for Table Question Answering

Paper • 2408.09174 • Published Aug 17 • 51

upvoted a collection about 1 month ago

InternVideo2

Collection

InternVideo2 • 15 items • Updated 20 days ago • 13

upvoted 5 papers about 1 month ago

KAN or MLP: A Fairer Comparison

Paper • 2407.16674 • Published Jul 23 • 41

Meltemi: The first open Large Language Model for Greek

Paper • 2407.20743 • Published Jul 30 • 67

Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey

Paper • 2407.21794 • Published Jul 31 • 4

SAM 2: Segment Anything in Images and Videos

Paper • 2408.00714 • Published Aug 1 • 103

Gemma 2: Improving Open Language Models at a Practical Size

Paper • 2408.00118 • Published Jul 31 • 73

upvoted a collection about 2 months ago

SpaceVLMs

Collection

Features VLMs fine-tuned for enhanced spatial reasoning using a synthetic data pipeline similar to Spatial VLM. • 3 items • Updated Jul 26 • 1

upvoted 5 papers about 2 months ago

VisFocus: Prompt-Guided Vision Encoders for OCR-Free Dense Document Understanding

Paper • 2407.12594 • Published Jul 17 • 18

MAVIS: Mathematical Visual Instruction Tuning

Paper • 2407.08739 • Published Jul 11 • 30

SEED-Story: Multimodal Long Story Generation with Large Language Model

Paper • 2407.08683 • Published Jul 11 • 22

MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Paper • 2407.08083 • Published Jul 10 • 27

LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models

Paper • 2407.07895 • Published Jul 10 • 40

upvoted 3 papers 2 months ago

BM25S: Orders of magnitude faster lexical search via eager sparse scoring

Paper • 2407.03618 • Published Jul 4 • 10

Vision language models are blind

Paper • 2407.06581 • Published Jul 9 • 80

PaliGemma: A versatile 3B VLM for transfer

Paper • 2407.07726 • Published Jul 10 • 64

upvoted an article 2 months ago

Article

How NuminaMath Won the 1st AIMO Progress Prize

Jul 11

• 91

upvoted 3 papers 2 months ago

ColPali: Efficient Document Retrieval with Vision Language Models

Paper • 2407.01449 • Published Jun 27 • 36

HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale

Paper • 2406.19280 • Published Jun 27 • 59

Direct Preference Knowledge Distillation for Large Language Models

Paper • 2406.19774 • Published Jun 28 • 21

upvoted 2 papers 3 months ago

4M-21: An Any-to-Any Vision Model for Tens of Tasks and Modalities

Paper • 2406.09406 • Published Jun 13 • 13

An Image is Worth More Than 16x16 Patches: Exploring Transformers on Individual Pixels

Paper • 2406.09415 • Published Jun 13 • 50

upvoted an article 3 months ago

Article

Thoughts on LoRA Training #1

•

Jun 18

• 31

upvoted 2 papers 3 months ago

Needle In A Multimodal Haystack

Paper • 2406.07230 • Published Jun 11 • 52

ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

Paper • 2406.12793 • Published Jun 18 • 31

upvoted 3 articles 3 months ago

Article

Uncensor any LLM with abliteration

•

Jun 13

• 311

Article

Introduction to State Space Models (SSM)

•

Jul 19

• 77

Article

An Analysis of Chinese LLM Censorship and Bias with Qwen 2 Instruct

•

Jun 11

• 45

upvoted a paper 4 months ago

Jina CLIP: Your CLIP Model Is Also Your Text Retriever

Paper • 2405.20204 • Published May 30 • 29

upvoted an article 4 months ago

Article

Training and Finetuning Embedding Models with Sentence Transformers v3

May 28

• 145

upvoted a collection 4 months ago

ConvLLaVA

Collection

A collection of ConvLLaVA models. • 10 items • Updated May 28 • 10

upvoted an article 4 months ago

Article

AI has a problem with objectifying women

•

May 24

• 54

upvoted 9 papers 5 months ago

PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning

Paper • 2404.16994 • Published Apr 25 • 35

A Multimodal Automated Interpretability Agent

Paper • 2404.14394 • Published Apr 22 • 20

SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generation

Paper • 2404.14396 • Published Apr 22 • 18

BLINK: Multimodal Large Language Models Can See but Not Perceive

Paper • 2404.12390 • Published Apr 18 • 24

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

Paper • 2404.13013 • Published Apr 19 • 29

Pegasus-v1 Technical Report

Paper • 2404.14687 • Published Apr 23 • 30

FlashSpeech: Efficient Zero-Shot Speech Synthesis

Paper • 2404.14700 • Published Apr 23 • 29

Multi-Head Mixture-of-Experts

Paper • 2404.15045 • Published Apr 23 • 58

OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework

Paper • 2404.14619 • Published Apr 22 • 124

upvoted an article 5 months ago

Article

How to Finetune phi-3 on MacBook Pro

•

Apr 24

• 62

upvoted 2 papers 5 months ago

ViTAR: Vision Transformer with Any Resolution

Paper • 2403.18361 • Published Mar 27 • 51

MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?

Paper • 2403.14624 • Published Mar 21 • 50

upvoted 7 articles 5 months ago

Article

It's raining diffusion personalization techniques☔️🎭🖼️

•

Apr 11

• 18

Article

Orchestration of Experts: The First-Principle Multi-Model System

•

May 30

• 15

Article

Many-shot jailbreaking

•

Apr 2

• 4

Article

Mixture of Depth is Vibe

•

Apr 22

• 43

Article

Mergoo: Efficiently Build Your Own MoE LLM

•

Jun 3

• 40

Article

Design choices for Vision Language Models in 2024

•

Apr 16

• 23

Article

Custom architectures with HuggingFace 🤗

•

Apr 22

• 21

upvoted 2 collections 6 months ago

Llama3 HQQ

Collection

4 items • Updated Aug 13 • 17

DBRX

Collection

DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks. • 3 items • Updated Mar 27 • 90

upvoted 3 papers 6 months ago

VideoMamba: State Space Model for Efficient Video Understanding

Paper • 2403.06977 • Published Mar 11 • 27

An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models

Paper • 2403.06764 • Published Mar 11 • 24

DragAnything: Motion Control for Anything using Entity Representation

Paper • 2403.07420 • Published Mar 12 • 12

upvoted a collection 6 months ago

MetricX-23

Collection

A collection of MetricX-23 models (https://aclanthology.org/2023.wmt-1.63/) • 6 items • Updated Jul 31 • 14

upvoted a paper 7 months ago

Grandmaster-Level Chess Without Search

Paper • 2402.04494 • Published Feb 7 • 65

Merve Noyan PRO

AI & ML interests

Articles

Preference Optimization for Vision Language Models

Fine-tuning Florence-2 - Microsoft's Cutting-edge Vision Language Models

PaliGemma – Google's Cutting-Edge Open Vision Language Model

Vision Language Models Explained

Introduction to Quantization cooked in 🤗 with 💗🧑‍🍳

Deploy MusicGen in no time with Inference Endpoints

Open-Source Text Generation & LLM Ecosystem at Hugging Face

Jupyter X Hugging Face

Using Machine Learning to Aid Survivors and Race through Time

Introducing Skops

Announcing the Hugging Face Fellowship Program

Hosting your Models and Datasets on Hugging Face Spaces using Streamlit

Showcase Your Projects in Spaces using Gradio

Organizations

merve's activity

How NuminaMath Won the 1st AIMO Progress Prize

Thoughts on LoRA Training #1

Uncensor any LLM with abliteration

Introduction to State Space Models (SSM)

An Analysis of Chinese LLM Censorship and Bias with Qwen 2 Instruct

Training and Finetuning Embedding Models with Sentence Transformers v3

AI has a problem with objectifying women

How to Finetune phi-3 on MacBook Pro

It's raining diffusion personalization techniques☔️🎭🖼️

Orchestration of Experts: The First-Principle Multi-Model System

Many-shot jailbreaking

Mixture of Depth is Vibe

Mergoo: Efficiently Build Your Own MoE LLM

Design choices for Vision Language Models in 2024

Custom architectures with HuggingFace 🤗