High-Resolution Image Synthesis with Latent Diffusion Models

📝By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond.

https://github.com/compvis/stable-diffusion

USB: A Unified Semi-supervised Learning Benchmark

📝Semi-supervised learning (SSL) improves model generalization by leveraging massive unlabeled data to augment limited labeled samples.

https://github.com/microsoft/semi-supervised-learning

Advancing Model Pruning via Bi-level Optimization

📝To reduce the computation overhead, various efficient 'one-shot' pruning methods have been developed, but these schemes are usually unable to find winning tickets as good as IMP.

https://github.com/optml-group/bip

An Efficient Person Clustering Algorithm for Open Checkout-free Groceries

📝Then, to ensure that the method adapts to the dynamic and unseen person flow, we propose Graph Convolutional Network (GCN) with a simple Nearest Neighbor (NN) strategy to accurately cluster the instances of CSG.

https://github.com/WuJunde/checkoutfree

NerfAcc: A General NeRF Acceleration Toolbox

📝We propose NerfAcc, a toolbox for efficient volumetric rendering of radiance fields.
https://github.com/kair-bair/nerfacc

Human Motion Diffusion Model

📝In this paper, we introduce Motion Diffusion Model (MDM), a carefully adapted classifier-free diffusion-based generative model for the human motion domain.
https://github.com/guytevet/motion-diffusion-model

VToonify: Controllable High-Resolution Portrait Video Style Transfer

📝Although a series of successful portrait image toonification models built upon the powerful StyleGAN have been proposed, these image-oriented methods have obvious limitations when applied to videos, such as the fixed frame size, the requirement of face alignment, missing non-facial details and temporal inconsistency.
https://github.com/williamyang1991/vtoonify

Content-Based Search for Deep Generative Models

📝The growing proliferation of pretrained generative models has made it infeasible for a user to be fully cognizant of every model in existence.
https://github.com/generative-intelligence-lab/modelverse

DigiFace-1M: 1 Million Digital Face Images for Face Recognition

📝Such models are trained on large-scale datasets that contain millions of real human face images collected from the internet.
https://github.com/microsoft/digiface1m

Ask Me Anything: A simple strategy for prompting language models

📝Prompting is a brittle process wherein small modifications to the prompt can cause large variations in the model predictions, and therefore significant effort is dedicated towards designing a painstakingly "perfect prompt" for a task.
https://github.com/hazyresearch/ama_prompting

DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models

📝We analyze prompts in the dataset and discuss key properties of these prompts.
https://github.com/poloclub/diffusiondb

Lightweight and High-Fidelity End-to-End Text-to-Speech with Multi-Band Generation and Inverse Short-Time Fourier Transform

📝We propose a lightweight end-to-end text-to-speech model using multi-band generation and inverse short-time Fourier transform.
https://github.com/masayakawamura/mb-istft-vits

High Fidelity Neural Audio Compression

📝We introduce a state-of-the-art real-time, high-fidelity, audio codec leveraging neural networks.
https://github.com/facebookresearch/encodec

Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation

📝In this work, we present a dense tracking and mapping system named Vox-Fusion, which seamlessly fuses neural implicit representations with traditional volumetric fusion methods.
https://github.com/zju3dv/vox-fusion

Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training

📝The success of Transformer models has pushed the deep learning model scale to billions of parameters.
https://github.com/hpcaitech/colossalai

Towards High-Quality Neural TTS for Low-Resource Languages by Learning Compact Speech Representations

📝Moreover, we optimize the training strategy by leveraging more audio to learn MSMCRs better for low-resource languages.
https://github.com/hhguo/msmc-tts

Referring Image Matting

📝Image matting refers to extracting the accurate foregrounds in the image.
https://github.com/jizhizili/rim

What Makes Convolutional Models Great on Long Sequence Modeling?

📝We focus on the structure of the convolution kernel and identify two critical but intuitive principles enjoyed by S4 that are sufficient to make up an effective global convolutional model: 1) The parameterization of the convolutional kernel needs to be efficient in the sense that the number of parameters should scale sub-linearly with sequence length.
https://github.com/ctlllll/sgconv

MetaFormer Baselines for Vision

📝By simply applying depthwise separable convolutions as token mixer in the bottom stages and vanilla self-attention in the top stages, the resulting model CAFormer sets a new record on ImageNet-1K: it achieves an accuracy of 85. 5% at 224x224 resolution, under normal supervised training without external data or distillation.
https://github.com/sail-sg/metaformer

Real-Time Target Sound Extraction

📝We present the first neural network model to achieve real-time and streaming target sound extraction.
https://github.com/vb000/waveformer

Poisson Flow Generative Models

📝We interpret the data points as electrical charges on the $z=0$ hyperplane in a space augmented with an additional dimension $z$, generating a high-dimensional electric field (the gradient of the solution to Poisson equation).
https://github.com/newbeeer/poisson_flow