NVLM: Open Frontier-Class Multimodal LLMs
Paper
•
2409.11402
•
Published
•
47
Jinyeong Kim
rubatoyeong
AI & ML interests
None yet
Organizations
None yet
rubatoyeong's activity
upvoted
a
paper
1 day ago
upvoted
3
papers
7 days ago
Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers
Paper
•
2409.04109
•
Published
•
37
Agent Workflow Memory
Paper
•
2409.07429
•
Published
•
25
MEDIC: Towards a Comprehensive Framework for Evaluating LLMs in Clinical Applications
Paper
•
2409.07314
•
Published
•
49
upvoted
a
paper
8 days ago
upvoted
6
papers
13 days ago
Guide-and-Rescale: Self-Guidance Mechanism for Effective Tuning-Free Real Image Editing
Paper
•
2409.01322
•
Published
•
94
FrozenSeg: Harmonizing Frozen Foundation Models for Open-Vocabulary Segmentation
Paper
•
2409.03525
•
Published
•
11
mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understanding
Paper
•
2409.03420
•
Published
•
23
Attention Heads of Large Language Models: A Survey
Paper
•
2409.03752
•
Published
•
83
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
Paper
•
2409.02813
•
Published
•
27
LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
Paper
•
2409.02889
•
Published
•
53
upvoted
3
papers
15 days ago
upvoted
2
papers
19 days ago
upvoted
2
papers
21 days ago
upvoted
3
papers
24 days ago
HiRED: Attention-Guided Token Dropping for Efficient Inference of High-Resolution Vision-Language Models in Resource-Constrained Environments
Paper
•
2408.10945
•
Published
•
6
MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?
Paper
•
2408.13257
•
Published
•
25
Building and better understanding vision-language models: insights and future directions
Paper
•
2408.12637
•
Published
•
109
upvoted
a
paper
25 days ago
upvoted
2
papers
28 days ago
upvoted
a
paper
29 days ago
upvoted
18
papers
about 1 month ago
Fine-tuning Large Language Models with Human-inspired Learning Strategies in Medical Question Answering
Paper
•
2408.07888
•
Published
•
10
xGen-MM (BLIP-3): A Family of Open Large Multimodal Models
Paper
•
2408.08872
•
Published
•
96
LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Paper
•
2408.07055
•
Published
•
65
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Paper
•
2408.06195
•
Published
•
55
Med42-v2: A Suite of Clinical LLMs
Paper
•
2408.06142
•
Published
•
50
The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
Paper
•
2408.06292
•
Published
•
114
UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling
Paper
•
2408.04810
•
Published
•
22
Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2
Paper
•
2408.05147
•
Published
•
36
mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models
Paper
•
2408.04840
•
Published
•
31
VITA: Towards Open-Source Interactive Omni Multimodal LLM
Paper
•
2408.05211
•
Published
•
46
EXAONE 3.0 7.8B Instruction Tuned Language Model
Paper
•
2408.03541
•
Published
•
32
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI
Paper
•
2408.03361
•
Published
•
85
Transformer Explainer: Interactive Learning of Text-Generative Models
Paper
•
2408.04619
•
Published
•
152
Self-Taught Evaluators
Paper
•
2408.02666
•
Published
•
22
MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
Paper
•
2408.02718
•
Published
•
60
LLaVA-OneVision: Easy Visual Task Transfer
Paper
•
2408.03326
•
Published
•
59
MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine
Paper
•
2408.02900
•
Published
•
25
Medical SAM 2: Segment medical images as video via Segment Anything Model 2
Paper
•
2408.00874
•
Published
•
40
upvoted
17
papers
about 2 months ago
Gemma 2: Improving Open Language Models at a Practical Size
Paper
•
2408.00118
•
Published
•
73
SAM 2: Segment Anything in Images and Videos
Paper
•
2408.00714
•
Published
•
103
MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts
Paper
•
2407.21770
•
Published
•
20
The Llama 3 Herd of Models
Paper
•
2407.21783
•
Published
•
102
Visual Riddles: a Commonsense and World Knowledge Challenge for Large Vision and Language Models
Paper
•
2407.19474
•
Published
•
22
Diffusion Feedback Helps CLIP See Better
Paper
•
2407.20171
•
Published
•
34
TextGrad: Automatic "Differentiation" via Text
Paper
•
2406.07496
•
Published
•
26
OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding
Paper
•
2406.19389
•
Published
•
52
HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale
Paper
•
2406.19280
•
Published
•
59
RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models
Paper
•
2407.05131
•
Published
•
23
Unveiling Encoder-Free Vision-Language Models
Paper
•
2406.11832
•
Published
•
49
Understanding Visual Feature Reliance through the Lens of Complexity
Paper
•
2407.06076
•
Published
•
5
Multi-Object Hallucination in Vision-Language Models
Paper
•
2407.06192
•
Published
•
9
VILA^2: VILA Augmented VILA
Paper
•
2407.17453
•
Published
•
38
Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps
Paper
•
2407.07071
•
Published
•
11
Vision language models are blind
Paper
•
2407.06581
•
Published
•
80
LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models
Paper
•
2407.07895
•
Published
•
40