Independent partial patch reconstruction facilitates efficient representation learning.

A novel unified framework adept at performing various instance, semantic and panoptic segmentation tasks without any supervision.

A text-to-image generation framework that iteratively corrects inaccuracies by integrating a self-correcting LLM with diffusion models, significantly improving image alignment with complex prompts and enabling image editing tasks.

Improving text-to-video generation by using a large language model to make plans before the actual video generation, achieving realistic video generation that align with complex input prompts.

Enhancing the prompt understanding capabilities of text-to-image diffusion models with large-language models for grounding.

Running Stable Diffusion in 4-bit weights with high generation quality for the first time.

Segmenting objects in videos without any human annotation in any training stage.

We focus on selecting the right data to query for label for semi-supervised learning without any label or task information. Our method demonstrates that a small compute spent on careful labeled data selection brings big annotation efficiency.

We propose a novel and effective debiased learning method based on counterfactual reasoning and adaptive margins to deal with the undesired effect from naturally imbalanced pseudo-labels.

Rather than training a universal RL policy invariant to train-test distribution shift, we proposed unsupervised visual attention and invariance method (VAI) to disperse interference task-irrelevant factors towards a RL policy robust to distractions.

Leveraging bias-variance tradeoff, we proposed a universal classification framework for long-tailed distributed data with RoutIng Diverse Experts (RIDE) that improves both accuracy and inference speed.