Lightnews — Scholar-powered news

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Sep 4

Has anyone successfully done RL post-training of GPT-oss with meaningful performance gains?

What libraries even support it? I guess technically TRL/axolotl, maybe Unsloth... but there are no good examples of doing it...

2 1 7

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Apr 1

Check out our website: sophontai.com

Read our manifesto/announcement: tanishq.ai/blog/sophont

If you're interested in building & collaborating in this space, whether you're in genAI or medicine/pharma/life sciences, feel free to reach out at: [email protected]

1 5

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Apr 1

researcher at Princeton University, and served as Head of NeuroAI at Stability AI. He led the team behind the MindEye publications, which achieved state-of-the-art reconstructions of seen images from brain activity.

1 3

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Apr 1

With over five years of experience applying generative AI to medicine, I bring a wealth of expertise, having previously served as the Research Director at Stability AI and CEO of MedARC. My co-founder, Paul Scotti, has a decade of experience in computational neuroscience, was a postdoctoral ...

1 3

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Apr 1

We are strong believers in open, transparent research, based on our proven track records in medical AI research and building open science online communities. We hope to continue this science-in-the-open approach to research at Sophont to build towards the future of healthcare.

1 2

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Apr 1

Our vision is to merge highly performant, specialized medical foundation models into a single holistic, highly flexible medical-specific multimodal foundation model. We believe that this should be done open-source for maximum transparency and flexibility

1 2

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Apr 1

These approaches succumb to the parable of the blind men and the elephant: The blind men are unimodal medical models and the patient is the elephant.

1 2

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Apr 1

AI is clearly needed to enhance doctors’ ability to provide the best care.

However, currently deployed medical AI models are inflexible, rigid, suited for narrow tasks focused on individual data modalities.

1 2

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Apr 1

I have EXCITING news:

I've started a company!

Introducing Sophont

We’re building open multimodal foundation models for the future of healthcare. We need a DeepSeek for medical AI, and @sophontai.bsky.social will be that company!

Check out our website & blog post for more info (link below)

1 2 29

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Mar 17

Btw, I posted this 2 weeks ago on Twitter but forgot to post here, so doing it now. Twitter is probably going to always be the fastest place to get updates from me unfortunately 😅

1 5

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Mar 17

NEW BLOG POST: LLMs in medicine: evaluations, advances, and the future

www.tanishq.ai/blog/posts/l...

A short blog post discussing how LLMs are evaluated for medical capabilities and what's the future for LLMs in medicine (spoiler: it's reasoning!)

1 2 21

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Feb 20

Yeah, but compute scaling can mean lots of things including synthetic data for example

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Feb 20

Artificial superintelligence

1 1

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Feb 19

New blog post coming tomorrow on medical LLMs...

7

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Feb 19

I restarted my blog a few weeks ago. The 1st post was:

Debunking DeepSeek Delusions

I discussed 5 main myths that I saw spreading online back during the DeepSeek hype.

It may be a little less relevant now, but hopefully still interesting to folks.

Check it out → www.tanishq.ai/blog/posts/d...

4 1 22

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Feb 19

Are folks still here? 😅

11 46

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Jan 20

github.com/deepseek-ai/...

github.com

7

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Jan 20

Okay so this is so far the most important paper in AI of the year

2 1 23

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Jan 11

Anthropic, please add a higher tier plan for unlimited messages 😭🙏

4 16

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Jan 10

Decentralized Diffusion Models

UC Berkeley and Luma AI introduce Decentralized Diffusion Models, a way to train diffusion models on decentralized compute with no communication between nodes.

abs: arxiv.org/abs/2501.05450
project page: decentralizeddiffusion.github.io

2 21

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Jan 10

The GAN is dead; long live the GAN! A Modern Baseline GAN

This is a very interesting paper, exploring making GANs simpler and more performant.

abs: arxiv.org/abs/2501.05441
code: github.com/brownvc/R3GAN

2 13

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Jan 10

Happy birthday to my incredible and awesome Mamma! 🥳🎉🎂

To many more years of health and happiness.

Tiara (my sister) and I love you very much ❤️❤️❤️

1 9

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Dec 28

Happy 19th birthday to my amazing sister Tiara Abraham! 🥳🎉 🎂

Proud of you graduating with your Master's degree at 18 and starting your doctorate in music degree this past year!

Excited to see what this final teen year holds for you!

15

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Dec 10

Flow matching is closely related to diffusion and rectified flows and Gaussian flow matching is equivalent to denoising diffusion.

1

Tanishq Mathew Abraham @iscienceluvr.bsky.social · Dec 10

PyTorch library: github.com/facebookrese...

GitHub - facebookresearch/flow_matching: A PyTorch library for implementing flow matching algorithms, featuring state-of-the-art continuous and discrete flow matching implementations. It includes prac...

A PyTorch library for implementing flow matching algorithms, featuring state-of-the-art continuous and discrete flow matching implementations. It includes practical examples for both text and image...

github.com

1 2