vilarin (VILARIN)

reacted to merve's post with 👀 25 days ago

Post

1629

Tencent released a new depth model that generates temporally consistent depth maps over videos ⏯️

Model: tencent/DepthCrafter
Demo: tencent/DepthCrafter
Paper: DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videos (2409.02095)

You don't need to input anything other than video itself, no need for optical flow or camera poses! 🤩

reacted to merve's post with 🔥 2 months ago

Post

5496

I have put together a notebook on Multimodal RAG, where we do not process the documents with hefty pipelines but natively use:
- vidore/colpali for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
- Qwen/Qwen2-VL-2B-Instruct for generation 💬 directly feed images as is to a vision language model with no processing to text!
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie 🤗
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb

reacted to clem's post with 🔥 2 months ago

Post

1754

"LLM inference at scale with TGI". Cool blogpost: https://www.adyen.com/knowledge-hub/llm-inference-at-scale-with-tgi

Well done
@martinigoyanes @rafa-hernandez @Vidusharma @frisokingma @hannahwright @jeanmarcs @antonioramos & the whole https://huggingface.co/adyen team. Could be useful to cross-post here: https://huggingface.co/blog/community

2 replies

·

posted an update 2 months ago

Post

1579

🐣Ai2 Releasing OLMoE!
OLMoE-1B-7B-Instruct is a Mixture-of-Experts LLM with 1B active and 7B total parameters, and, OLMoE is 100% open-source in model, code-base, datasets!

🦖Paper: https://arxiv.org/abs/2409.02060

🤗Model: allenai/OLMoE-1B-7B-0924-Instruct

💾Datasets: allenai/OLMoE-mix-0924

posted an update 3 months ago

Post

5990

🤩 Amazing day. AWPortrait-FL finally here!
🦖 AWPortrait-FL is finetuned on FLUX.1-dev using the training set of AWPortrait-XL and nearly 2,000 fashion photography photos with extremely high aesthetic quality.

🤗Model: Shakker-Labs/AWPortrait-FL

🙇Demo: vilarin/flux-labs

6 replies

·

posted an update 3 months ago

Post

2448

Shakker-Labs brings an amazing LoRA trained on FLUX.1-dev for blended realistic illustration by Muertu 😍 the front character is in illustration style, while the background is realistic. 🤩

🤙Model: https://huggingface.co/Shakker-Labs/FLUX.1-dev-LoRA-blended-realistic-illustration

🙇‍♂️My space for demo: vilarin/flux-lab-light

posted an update 4 months ago

Post

4185

Black Forest Labs, BASED! 👏
FLUX.1 is more delightful, with good instruction following.
FLUX.1 dev( black-forest-labs/FLUX.1-dev) with a 12B parameter distillation model, second only to Black Forest Labs' state-of-the-art model FLUX.1 pro. 🙀

Update 🤙Official demo:
black-forest-labs/FLUX.1-dev

1 reply

·

replied to merve's post 5 months ago

Thank you :) I updated the demo to support file.

reacted to merve's post with ❤️ 5 months ago

Post

2736

THUDM has released GLM-4V-9B and it's.. chatty! 😂
I asked it to describe my favorite Howl's Moving Castle scene and here's how it went 👇🏻

joke aside it seems to outperform the previous VLMs. however the license isn't open-source 📈
model repo: THUDM/glm-4v-9b
a community member has built a demo: vilarin/VL-Chatbox

1 reply

·

VILARIN

AI & ML interests

Organizations

vilarin's activity