Lightnews — Scholar-powered news

Reposted by Kirill Neklyudov

majhas.bsky.social @majhas.bsky.social · Jun 10

(1/n)🚨Train a model solving DFT for any geometry with almost no training data
Introducing Self-Refining Training for Amortized DFT: a variational method that predicts ground-state solutions across geometries and generates its own training data!
📜 arxiv.org/abs/2506.01225
💻 github.com/majhas/self-...

1 4 12

Kirill Neklyudov @k-neklyudov.bsky.social · May 2

David is disrupting everone's neurips grind by putting out amazing works, such a dirty trick!

David Pfau @davidpfau.com · May 2

New paper accepted to ICML! We present a novel policy optimization algorithm for continuous control with a simple closed form which generalizes DDPG, SAC etc. to generic stochastic policies: Wasserstein Policy Optimization (WPO).

1 7

Reposted by Kirill Neklyudov

Martin Bauer @martinmbauer.bsky.social · Apr 21

Renormalisation is a central concept in modern physics. It describes how the dynamics of a system change at different scales. A great way to understand and visualise renormalisation is the Ising model

(some math, but one can follow without it )

1/13

4 37 190

Kirill Neklyudov @k-neklyudov.bsky.social · Mar 6

1

Kirill Neklyudov @k-neklyudov.bsky.social · Mar 6

1

Kirill Neklyudov @k-neklyudov.bsky.social · Mar 6

1

Kirill Neklyudov @k-neklyudov.bsky.social · Mar 6

1

Kirill Neklyudov @k-neklyudov.bsky.social · Mar 6

1

Kirill Neklyudov @k-neklyudov.bsky.social · Mar 6

Every image was generated using SuperDiff for SDXL with two different prompts. Now, what are the prompts?🤔

1

Kirill Neklyudov @k-neklyudov.bsky.social · Mar 6

SuperDiff goes super big!
- Spotlight at #ICLR2025!🥳
- Stable Diffusion XL pipeline on HuggingFace huggingface.co/superdiff/su... made by Viktor Ohanesian
- New results for molecules in the camera-ready arxiv.org/abs/2412.17762
Let's celebrate with a prompt guessing game in the thread👇

1 4 14

Kirill Neklyudov @k-neklyudov.bsky.social · Jan 22

4. Diffusion Models as Constrained Samplers for Optimization with Unknown Constraints arxiv.org/abs/2402.18012

Diffusion Models as Constrained Samplers for Optimization with Unknown Constraints

Addressing real-world optimization problems becomes particularly challenging when analytic objective functions or constraints are unavailable. While numerous studies have addressed the issue of unknow...

arxiv.org

1

Kirill Neklyudov @k-neklyudov.bsky.social · Jan 22

3. Efficient Evolutionary Search Over Chemical Space with Large Language Models arxiv.org/abs/2406.16976

Efficient Evolutionary Search Over Chemical Space with Large Language Models

Molecular discovery, when formulated as an optimization problem, presents significant computational challenges because optimization objectives can be non-differentiable. Evolutionary Algorithms (EAs),...

arxiv.org

1 1

Kirill Neklyudov @k-neklyudov.bsky.social · Jan 22

2. Meta Flow Matching: Integrating Vector Fields on the Wasserstein Manifold arxiv.org/abs/2408.14608

Meta Flow Matching: Integrating Vector Fields on the Wasserstein Manifold

Numerous biological and physical processes can be modeled as systems of interacting entities evolving continuously over time, e.g. the dynamics of communicating cells or physical particles. Learning t...

arxiv.org

1 2

Kirill Neklyudov @k-neklyudov.bsky.social · Jan 22

1. The Superposition of Diffusion Models Using the Itô Density Estimator arxiv.org/abs/2412.17762

The Superposition of Diffusion Models Using the Itô Density Estimator

The Cambrian explosion of easily accessible pre-trained diffusion models suggests a demand for methods that combine multiple different pre-trained diffusion models without incurring the significant co...

arxiv.org

1 1

Kirill Neklyudov @k-neklyudov.bsky.social · Jan 22

We've been sharing these projects during the year, but today, they have been accepted at #ICLR2025 (1-3) and #AISTATS2025 (4)

1 1 6

Kirill Neklyudov @k-neklyudov.bsky.social · Dec 28

🧵(7/7) The main result that unlocks all these possibilities is our new Itô density estimator, an efficient way to estimate the density of the generated samples for an already-trained diffusion model (assuming that we know the score). It does not require any extra computations, just the forward pass!

1 3

Kirill Neklyudov @k-neklyudov.bsky.social · Dec 28

🧵(6/7) We try out SuperDiff on generating images with #StableDiffusion by superimposing two prompts so that the image satisfies both. Ever wondered what a waffle cone would look like if it doubled as a volcano? Check out our paper! You’ll find marvellous new creatures in there such as an otter-duck

1 1

Kirill Neklyudov @k-neklyudov.bsky.social · Dec 28

🧵(5/7) We test our model for unconditional de novo protein generation, where we superimpose two diffusion models: Proteus generates more designable and novel proteins, while FrameDiff generates more diverse proteins. SuperDiff combines them to generate designable and novel and diverse proteins!

1 4

Kirill Neklyudov @k-neklyudov.bsky.social · Dec 28

🧵(4/7) Here’s a 2D example for intuition: given two already trained models, we combine their outputs (vector fields) based on estimated densities, allowing us to generate samples from all modes (e.g. for continual learning) or from the surface of equal densities (e.g. for concept interpolation).

1 3

Kirill Neklyudov @k-neklyudov.bsky.social · Dec 28

🧵(3/7)This is all due to an amazing team: @martaowesyou.bsky.social @lazaratan.bsky.social @joeybose.bsky.social @alextong.bsky.social

📄Paper: arxiv.org/abs/2412.17762
💻Code: github.com/necludov/sup...
🤗HuggingFace: huggingface.co/superdiff

The Superposition of Diffusion Models Using the Itô Density Estimator

The Cambrian explosion of easily accessible pre-trained diffusion models suggests a demand for methods that combine multiple different pre-trained diffusion models without incurring the significant co...

arxiv.org

1 3 15

Kirill Neklyudov @k-neklyudov.bsky.social · Dec 28

🧵(2/7)We provide a new approach for estimating density without touching the divergence. This gives us the control to easily interpolate concepts (logical AND) or mix densities (logical OR), allowing us to create one-of-a-kind generations! ⚡🌀🤗

The Superposition of Diffusion Models Using the Itô Density Estimator

The Cambrian explosion of easily accessible pre-trained diffusion models suggests a demand for methods that combine multiple different pre-trained diffusion models without incurring the significant co...

arxiv.org

1 1 2

Kirill Neklyudov @k-neklyudov.bsky.social · Dec 28

🧵(1/7) Have you ever wanted to combine different pre-trained diffusion models but don't have time or data to retrain a new, bigger model?

🚀 Introducing SuperDiff 🦹‍♀️ – a principled method for efficiently combining multiple pre-trained diffusion models solely during inference!

1 7 44

Reposted by Kirill Neklyudov

Alán Aspuru-Guzik @aspuru.bsky.social · Dec 23

10 minutes ago

I am excited to share a perspective on the much-needed topic of hashtag#safety for hashtag#selfdrivinglaboratories. As the field progresses, understanding the challenges and gaps in building safe setups will be crucial for scaling up this technology!

doi.org/10.26434/che...

Steering towards safe self-driving laboratories

The past decade has witnessed remarkable advancements in autonomous systems, such as automobiles that are evolving from traditional vehicles to ones capable of navigating complex environments without ...

doi.org

3 9 33

Reposted by Kirill Neklyudov

Alexander Kolesnikov @kolesnikov.ch · Dec 20

With some delay, JetFormer's *prequel* paper is finally out on arXiv: a radically simple ViT-based normalizing flow (NF) model that achieves SOTA results in its class.

Jet is one of the key components of JetFormer, deserving a standalone report. Let's unpack: 🧵⬇️

2 7 42