🐤 MagicVideo-V2 announced! 🐤

👉#Bytedance announces a novel multi-stage pipeline capable of generating high-aesthetic videos from textual description

👉Review https://t.ly/zIq4v
👉Project https://lnkd.in/dKUrJPJd
👉Paper https://lnkd.in/dixnN-kU

🔥 #6D Foundation Pose 🔥

👉#Nvidia unveils FoundationPose, a novel (and unified) foundation model for 6D object pose estimation and tracking.

👉Review https://t.ly/HGd4h
👉Project https://lnkd.in/dPcnBKWm
👉Paper https://lnkd.in/dixn_iHZ
👉Code coming 🩷

🃏ReplaceAnything: demo is out!🃏

👉ReplaceAnything: ultra-high quality content replacement. The ultimate #AI solution for human, clothing & background replacement to change the e-commerce experience for vendors.

👉Review https://t.ly/FMyvf
👉Project https://lnkd.in/dcyZvP2b
👉ModelScope https://lnkd.in/dU4x4nE6
👉Hugging Face https://lnkd.in/dn3uXWgd
👉Empty report https://lnkd.in/dcuGXd6c
👉Paper coming?

🥛 Transparent Object Tracking 🥛

👉Trans2k: transparent object tracking dataset of 2,000+ sequences with 100,000+ images, annotated by bounding boxes & segmentation mask.

👉Review https://t.ly/mEI6O
👉Paper https://lnkd.in/dsudY3DB
👉Project https://lnkd.in/d48SSJJ3
👉TOB https://lnkd.in/dykBUNfC

💊💊 AGNOSTIC Object Counting 💊💊

👉PseCo: combining SAM to segment all possible objects as mask proposals & CLIP to classify proposals to obtain accurate object counts. The new SOTA in both few-shot/zero-shot object counting/detection.

👉Review https://t.ly/e4iza
👉Paper https://lnkd.in/dbzMXKWG
👉Repo https://lnkd.in/db9Q9Pse

💥 Announcing #Py4Ai Conference💥

👉 Super proud to unveil #Py4AI, the newest conference dedicated to exploring the depths of Python & AI. Py4AI is a 1-day free event for Python and Artificial Intelligence developers.

𝐓𝐡𝐞 𝐟𝐢𝐫𝐬𝐭 𝐛𝐚𝐭𝐜𝐡 𝐨𝐟 𝐬𝐩𝐞𝐚𝐤𝐞𝐫𝐬:
🚀Merve Noyan | #HuggingFace 🤗
🚀Gabriele Lombardi | ARGO Vision
🚀Amanda Cercas Curry | Uni. Bocconi
🚀Piero Savastano | Cheshire Cat AI
🚀Francesco Zuppichini | Zurich Insurance
🚀Andrea Palladino, PhD | Sr. Data Scientist

👉 More: https://www.linkedin.com/posts/visionarynet_py4ai-py4ai-python-activity-7152928716988243968-pOUn?utm_source=share&utm_medium=member_desktop

💃Timeline Text-Driven Humans💃

👉Novel challenge: timeline control for text-driven motion synthesis of 3D Humans.

👉Review https://t.ly/HLm-N
👉Paper https://lnkd.in/esaR_M_9
👉Project https://lnkd.in/epCZDvFW
👉Repo coming

🔥🔥 Code is out 🔥🔥

Check the comments for the links ;)

🫒 AlphaGeometry: Olympiad-level AI 🫒

👉 Theorem prover for Euclidean plane geometry that sidesteps the need for human demonstrations by
synthesizing millions of theorems and proofs across different levels of complexity 🤯

👉Review https://t.ly/2-Z7C
👉Paper https://lnkd.in/g3QkqwCE
👉Blog https://lnkd.in/ge-mpM7q
👉Repo https://lnkd.in/gHjwks_9

🦠 XINC: Pixels to Neurons 🦠

👉eXplaining the Implicit Neural Canvas (XINC) from the University of Maryland, is a unified framework for explaining properties of INRs by examining the strength of each neuron’s contribution to each output pixel

👉Review https://t.ly/wwAmz
👉Paper arxiv.org/pdf/2401.10217.pdf
👉Project namithap10.github.io/xinc
👉Repo github.com/namithap10/xinc

👽 One Model <-> All Segmentations 👽

👉 10+ different segmentation tasks in one framework, including image-level, video-level, interactive segmentation, & open-vocabulary segmentation. All in one!

👉Review https://t.ly/fywVz
👉Paper https://lnkd.in/dw3S4B74
👉Project https://lnkd.in/dzHT9v45
👉Repo https://lnkd.in/d6fDCnSp

😻 GARField: Group Anything 😻

👉 GARField is a novel approach for decomposing #3D scenes into a hierarchy of semantically meaningful groups from posed image inputs.

👉Review https://t.ly/6Hkeq
👉Paper https://lnkd.in/d28mfRcZ
👉Project https://lnkd.in/dzYdRNKy
👉Repo (coming) https://lnkd.in/d2VeRJCS

🔥 Depth Anything: new SOTA 🔥

👉Depth Anything: the new SOTA in monocular depth estimation (MDE), trained with 1.5M labeled images and 62M+ unlabeled images jointly. It's the new SOTA!

👉Review https://t.ly/tCBwO
👉Paper https://lnkd.in/djx-9k2J
👉Project https://lnkd.in/dYetqZFa
👉Repo https://lnkd.in/d87CrUGv
👉Demo🤗 https://lnkd.in/dJhvKBep

🎭 ULTRA-Realistic Avatar 🎭

👉Novel 3D avatar with enhanced fidelity of geometry, and superior quality of physically based rendering (PBR) textures without unwanted lighting.

👉Review https://t.ly/B3BEu
👉Project https://lnkd.in/dkUQHFEV
👉Paper https://lnkd.in/dtEQxrBu
👉Code coming 🩷

🔥Lumiere: SOTA video-gen🔥

👉#Google unveils Lumiere: Space-Time Diffusion Model for Realistic Video Generation. It's the new SOTA, tasks: Text-to-Video, Video Stylization, Cinemagraphs & Video Inpainting.

👉Review https://t.ly/nalJR
👉Paper https://lnkd.in/d-PvrGjT
👉Project https://t.ly/gK8hz

🧪 SUPIR: SOTA restoration 🧪

👉SUPIR is the new SOTA in image restoration; suitable for restoration of blurry objects, defining the material texture of objects, and adjusting restoration based on high-level semantics

👉Review https://t.ly/wgObH
👉Project https://supir.xpixel.group/
👉Paper https://lnkd.in/dZPYcUuq
👉Demo coming 🩷 but no code announced :(

🫧 SAM + Open Models 🫧

👉Grounded SAM (w/ DINO) as an open-set detector to combine with SAM. It can seamlessly integrate with other Open-World models to accomplish more intricate visual tasks.

👉Review https://t.ly/FwasQ
👉Paper arxiv.org/pdf/2401.14159.pdf
👉Code github.com/IDEA-Research/Grounded-Segment-Anything

👢"Virtual Try-All" by #Amazon 👢

👉#Amazon announces ”Diffuse to Choose”: diffusion-based image-conditioned inpainting for VTON. Virtually place any e-commerce item in any setting.

👉Review https://t.ly/at07Y
👉Paper https://lnkd.in/dxR7nGtd
👉Project diffuse2choose.github.io/

🦩 WildRGB-D: Objects in the Wild 🦩

👉#NVIDIA unveils a novel RGB-D object dataset captured in the wild: ~8500 recorded objects, ~20,000 RGBD videos, 46 categories with corresponding masks and 3D point clouds.

👉Review https://t.ly/WCqVz
👉Data github.com/wildrgbd/wildrgbd
👉Paper arxiv.org/pdf/2401.12592.pdf
👉Project wildrgbd.github.io/

🌋EasyVolcap: Accelerating Neural Volumetric🌋

👉Novel #PyTorch library for accelerating neural video:volumetric video capturing, reconstruction & rendering

👉Review https://t.ly/8BISl
👉Paper arxiv.org/pdf/2312.06575.pdf
👉Code github.com/zju3dv/EasyVolcap

🐙 Rock-Track announced! 🐙

👉Rock-Track: the evolution of Poly-MOT, the previous SOTA in 3D MOT Tracking-By-Detection framework.

👉Review https://t.ly/hC0ak
👉Repo, coming: https://lnkd.in/dtDkPwCC
👉Paper coming