Umair Abid
@umairabid205.bsky.social
Data Scientist | CS Grad | Bookworm | Outdoor Enthusiast
Reposted by Umair Abid
The model is very interesting, it has different encoders for different modalities each (visual prompt, text prompt, image and video) then it concatenates these to feed into LLM 💬
the output segmentation tokens are passed to SAM2, to sort of match text (captions or semantic classes) to masks ⤵️
January 9, 2025 at 12:00 PM
The model is very interesting, it has different encoders for different modalities each (visual prompt, text prompt, image and video) then it concatenates these to feed into LLM 💬
the output segmentation tokens are passed to SAM2, to sort of match text (captions or semantic classes) to masks ⤵️
Reposted by Umair Abid
ByteDance just dropped SA2VA: a new family of vision LMs combining Qwen2VL/InternVL and SAM2 with MIT license 💗
The models are capable of tasks involving vision-language understanding and visual referrals (referring segmentation) both for images and videos ⏯️
The models are capable of tasks involving vision-language understanding and visual referrals (referring segmentation) both for images and videos ⏯️
January 9, 2025 at 12:00 PM
ByteDance just dropped SA2VA: a new family of vision LMs combining Qwen2VL/InternVL and SAM2 with MIT license 💗
The models are capable of tasks involving vision-language understanding and visual referrals (referring segmentation) both for images and videos ⏯️
The models are capable of tasks involving vision-language understanding and visual referrals (referring segmentation) both for images and videos ⏯️
Join Our English Speaking Community!
I’m starting a community where we can all practice speaking English together! Whether you’re looking to improve your fluency, build confidence, or just enjoy meaningful conversations, this is the place for you.
Just Comment below
#EnglishPractice #SpeakingSkills
I’m starting a community where we can all practice speaking English together! Whether you’re looking to improve your fluency, build confidence, or just enjoy meaningful conversations, this is the place for you.
Just Comment below
#EnglishPractice #SpeakingSkills
January 9, 2025 at 10:21 AM
Join Our English Speaking Community!
I’m starting a community where we can all practice speaking English together! Whether you’re looking to improve your fluency, build confidence, or just enjoy meaningful conversations, this is the place for you.
Just Comment below
#EnglishPractice #SpeakingSkills
I’m starting a community where we can all practice speaking English together! Whether you’re looking to improve your fluency, build confidence, or just enjoy meaningful conversations, this is the place for you.
Just Comment below
#EnglishPractice #SpeakingSkills
Reposted by Umair Abid
A whole bunch of systems that depend on effort being costly are going to be breaking.
Academic journals are seeing this happen already.
Academic journals are seeing this happen already.
December 13, 2024 at 6:56 PM
A whole bunch of systems that depend on effort being costly are going to be breaking.
Academic journals are seeing this happen already.
Academic journals are seeing this happen already.
Reposted by Umair Abid
Why are so many proteins hyper-phosphorylated during mitosis?
Well, extensive phosphorylation renders individual proteins more soluble & disrupts protein-protein interactions.
So global hyper-phosphorylation may 𝐟𝐥𝐮𝐢𝐝𝐢𝐳𝐞 the cytoplasm - to mechanically aide the process of cell division.
Well, extensive phosphorylation renders individual proteins more soluble & disrupts protein-protein interactions.
So global hyper-phosphorylation may 𝐟𝐥𝐮𝐢𝐝𝐢𝐳𝐞 the cytoplasm - to mechanically aide the process of cell division.
December 2, 2024 at 7:58 PM
Why are so many proteins hyper-phosphorylated during mitosis?
Well, extensive phosphorylation renders individual proteins more soluble & disrupts protein-protein interactions.
So global hyper-phosphorylation may 𝐟𝐥𝐮𝐢𝐝𝐢𝐳𝐞 the cytoplasm - to mechanically aide the process of cell division.
Well, extensive phosphorylation renders individual proteins more soluble & disrupts protein-protein interactions.
So global hyper-phosphorylation may 𝐟𝐥𝐮𝐢𝐝𝐢𝐳𝐞 the cytoplasm - to mechanically aide the process of cell division.
Reposted by Umair Abid
While this amazing preprint beautifully demonstrates softening & fluidification of the cell's cytoplasm during mitosis - it attributes the effect to cytoskeletal elements, while not discussing global phosphorylation as contributor:
www.biorxiv.org/content/10.1...
www.biorxiv.org/content/10.1...
December 2, 2024 at 8:09 PM
While this amazing preprint beautifully demonstrates softening & fluidification of the cell's cytoplasm during mitosis - it attributes the effect to cytoskeletal elements, while not discussing global phosphorylation as contributor:
www.biorxiv.org/content/10.1...
www.biorxiv.org/content/10.1...
Reposted by Umair Abid
Marconi: Prefix Caching for the Era of Hybrid LLMs
paper: arxiv.org/abs/2411.19379
Marconi improves caching for hybrid LLMs with policies optimizing reuse likelihood and compute savings, achieving 34.4× higher token hit rates and significantly reducing latency.
paper: arxiv.org/abs/2411.19379
Marconi improves caching for hybrid LLMs with policies optimizing reuse likelihood and compute savings, achieving 34.4× higher token hit rates and significantly reducing latency.
December 2, 2024 at 9:35 AM
Marconi: Prefix Caching for the Era of Hybrid LLMs
paper: arxiv.org/abs/2411.19379
Marconi improves caching for hybrid LLMs with policies optimizing reuse likelihood and compute savings, achieving 34.4× higher token hit rates and significantly reducing latency.
paper: arxiv.org/abs/2411.19379
Marconi improves caching for hybrid LLMs with policies optimizing reuse likelihood and compute savings, achieving 34.4× higher token hit rates and significantly reducing latency.
Reposted by Umair Abid
I wrote a summary of the main ingredients of the neat proof by Hugo Lavenant that diffusion models do not generally define optimal transport. github.com/mathematical...
November 30, 2024 at 8:35 AM
I wrote a summary of the main ingredients of the neat proof by Hugo Lavenant that diffusion models do not generally define optimal transport. github.com/mathematical...
Reposted by Umair Abid
My PhD thesis is now available online! It is called "Finding Structure in Language Models" and presents the work I have done in the past 4 years on the intersection of NLP, interpretability, and linguistics.
I'll defend it on December 10, streamed here: jumelet.ai/phd
arxiv.org/abs/2411.16433
🧵
I'll defend it on December 10, streamed here: jumelet.ai/phd
arxiv.org/abs/2411.16433
🧵
November 29, 2024 at 3:49 PM
My PhD thesis is now available online! It is called "Finding Structure in Language Models" and presents the work I have done in the past 4 years on the intersection of NLP, interpretability, and linguistics.
I'll defend it on December 10, streamed here: jumelet.ai/phd
arxiv.org/abs/2411.16433
🧵
I'll defend it on December 10, streamed here: jumelet.ai/phd
arxiv.org/abs/2411.16433
🧵
Reposted by Umair Abid
🇬🇧🇪🇺 Published Today in EJPR 🇬🇧🇪🇺
@simonhix.bsky.social @juhoharkonen.bsky.social and I find that 1/3 of the anti-Brexit shift in the UK can be attributed to the impact of cohort replacement (old voters dying, young people becoming eligible to vote)! 1/12
ejpr.onlinelibrary.wiley.com/doi/10.1111/...
@simonhix.bsky.social @juhoharkonen.bsky.social and I find that 1/3 of the anti-Brexit shift in the UK can be attributed to the impact of cohort replacement (old voters dying, young people becoming eligible to vote)! 1/12
ejpr.onlinelibrary.wiley.com/doi/10.1111/...
November 30, 2024 at 8:10 AM
🇬🇧🇪🇺 Published Today in EJPR 🇬🇧🇪🇺
@simonhix.bsky.social @juhoharkonen.bsky.social and I find that 1/3 of the anti-Brexit shift in the UK can be attributed to the impact of cohort replacement (old voters dying, young people becoming eligible to vote)! 1/12
ejpr.onlinelibrary.wiley.com/doi/10.1111/...
@simonhix.bsky.social @juhoharkonen.bsky.social and I find that 1/3 of the anti-Brexit shift in the UK can be attributed to the impact of cohort replacement (old voters dying, young people becoming eligible to vote)! 1/12
ejpr.onlinelibrary.wiley.com/doi/10.1111/...
Reposted by Umair Abid
A lovely overview of meta-learning, or as they call it, networks that improve through practice arxiv.org/abs/2410.10596
Found by a PhD student in our group
Found by a PhD student in our group
Neural networks that overcome classic challenges through practice
Since the earliest proposals for neural network models of the mind and brain, critics have pointed out key weaknesses in these models compared to human cognitive abilities. Here we review recent work ...
arxiv.org
November 30, 2024 at 2:21 AM
A lovely overview of meta-learning, or as they call it, networks that improve through practice arxiv.org/abs/2410.10596
Found by a PhD student in our group
Found by a PhD student in our group
Reposted by Umair Abid
1/
Baumeister et al have another paper out defending ego depletion theory.
www.sciencedirect.com/science/arti...
They recently published paper called: Ego Depletion is the Best Replicated Finding in All of Social Psychology
(wowzers!!)
lupinepublishers.com/psychology-b...
Baumeister et al have another paper out defending ego depletion theory.
www.sciencedirect.com/science/arti...
They recently published paper called: Ego Depletion is the Best Replicated Finding in All of Social Psychology
(wowzers!!)
lupinepublishers.com/psychology-b...
Self-control and limited willpower: Current status of ego depletion theory and research
Ego depletion theory proposes that self-regulation depends on a limited energy resource (willpower). The simple initial theory has been refined to emp…
www.sciencedirect.com
November 27, 2024 at 10:12 PM
1/
Baumeister et al have another paper out defending ego depletion theory.
www.sciencedirect.com/science/arti...
They recently published paper called: Ego Depletion is the Best Replicated Finding in All of Social Psychology
(wowzers!!)
lupinepublishers.com/psychology-b...
Baumeister et al have another paper out defending ego depletion theory.
www.sciencedirect.com/science/arti...
They recently published paper called: Ego Depletion is the Best Replicated Finding in All of Social Psychology
(wowzers!!)
lupinepublishers.com/psychology-b...
@bsky.app, I kindly request the addition of a translation feature, at least in other languages to English. I am encountering difficulties understanding content in various languages.
November 27, 2024 at 4:10 PM
@bsky.app, I kindly request the addition of a translation feature, at least in other languages to English. I am encountering difficulties understanding content in various languages.
Reposted by Umair Abid
It's pretty sad to see the negative sentiment towards Hugging Face on this platform due to a dataset put by one of the employees. I want to write a small piece. 🧵
Hugging Face empowers everyone to use AI to create value and is against monopolization of AI it's a hosting platform above all.
Hugging Face empowers everyone to use AI to create value and is against monopolization of AI it's a hosting platform above all.
November 27, 2024 at 3:23 PM
It's pretty sad to see the negative sentiment towards Hugging Face on this platform due to a dataset put by one of the employees. I want to write a small piece. 🧵
Hugging Face empowers everyone to use AI to create value and is against monopolization of AI it's a hosting platform above all.
Hugging Face empowers everyone to use AI to create value and is against monopolization of AI it's a hosting platform above all.
Reposted by Umair Abid
My deep learning course at the University of Geneva is available on-line. 1000+ slides, ~20h of screen-casts. Full of examples in PyTorch.
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
November 26, 2024 at 6:15 AM
My deep learning course at the University of Geneva is available on-line. 1000+ slides, ~20h of screen-casts. Full of examples in PyTorch.
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
Reposted by Umair Abid
Does anyone have any recs for training/courses/books/resources around knowledge management / document management?
I don't have much experience in this space, and as I'm diving into enterprise genAI enabled tooling, it's becoming clear just how important getting the foundations right is.
I don't have much experience in this space, and as I'm diving into enterprise genAI enabled tooling, it's becoming clear just how important getting the foundations right is.
November 25, 2024 at 11:02 PM
Does anyone have any recs for training/courses/books/resources around knowledge management / document management?
I don't have much experience in this space, and as I'm diving into enterprise genAI enabled tooling, it's becoming clear just how important getting the foundations right is.
I don't have much experience in this space, and as I'm diving into enterprise genAI enabled tooling, it's becoming clear just how important getting the foundations right is.
Reposted by Umair Abid
🧵 1/4 Our biggest #opendata service so far is the Planning Datahub: For decades, #city planning London's future meant wrestling with outdated #IT systems, siloed data across 35 #localgov authorities. Now we process 120k+ applications/pa in real-time 👇 www.london.gov.uk/programmes-s...
The Planning London Datahub
The Datahub is a freely accessible store of all planning permissions in London, together with data about progress
www.london.gov.uk
November 26, 2024 at 1:13 PM
🧵 1/4 Our biggest #opendata service so far is the Planning Datahub: For decades, #city planning London's future meant wrestling with outdated #IT systems, siloed data across 35 #localgov authorities. Now we process 120k+ applications/pa in real-time 👇 www.london.gov.uk/programmes-s...
Reposted by Umair Abid
Full thread on this graphics: x.com/NTFabiano/st...
x.com
x.com
November 26, 2024 at 1:58 PM
Full thread on this graphics: x.com/NTFabiano/st...
Reposted by Umair Abid
At @huggingface.bsky.social 🤗 we're preparing a collaborative annotation effort to build an open-source multilingual dataset.
If you'd like to get high-quality open data for your language, check if yours is listed in this form and sign up!
forms.gle/DHJdtvoSNxAA...
If you'd like to get high-quality open data for your language, check if yours is listed in this form and sign up!
forms.gle/DHJdtvoSNxAA...
Language Lead sign-up
At Hugging Face 🤗, we're launching a big community initiative to improve LLM training for many languages. We're looking for Language Leads to help us cultivate specific languages during this initiativ...
forms.gle
November 26, 2024 at 1:16 PM
At @huggingface.bsky.social 🤗 we're preparing a collaborative annotation effort to build an open-source multilingual dataset.
If you'd like to get high-quality open data for your language, check if yours is listed in this form and sign up!
forms.gle/DHJdtvoSNxAA...
If you'd like to get high-quality open data for your language, check if yours is listed in this form and sign up!
forms.gle/DHJdtvoSNxAA...
Reposted by Umair Abid
🧪 🛟 AI is transforming global systems, but without accountability, inequities deepen. Ethical, transparent reforms are essential for justice and equity. Here's our take on "Inescapable AI", a report from TechTonic Justice: https://buff.ly/3V6s1s8 #PublicHealth #Ethics #MedSky #EpiSky #Housing
Inescapable AI: Public Health, Justice, and Algorithmic Accountability -
ALT: A woman with neck length hair and an overlay of transparent circuits looks at a facade of a human, implied to be AI, which is filled in with those same transparent circuits, dark background, blue/red lighting.
buff.ly
November 24, 2024 at 11:00 PM
🧪 🛟 AI is transforming global systems, but without accountability, inequities deepen. Ethical, transparent reforms are essential for justice and equity. Here's our take on "Inescapable AI", a report from TechTonic Justice: https://buff.ly/3V6s1s8 #PublicHealth #Ethics #MedSky #EpiSky #Housing
Reposted by Umair Abid
Interested in seeing what happens behind the scenes when you prompt an AI tool? Check out this wonderful infographic of material resources, labor, and data that make up the anatomy of AI, by Crawford and Joler (2018): anatomyof.ai
#CriticalAILiteracy #DH #CreativeCoding #TeamRhetoric #NLP #AIML
#CriticalAILiteracy #DH #CreativeCoding #TeamRhetoric #NLP #AIML
Anatomy of an AI System
Anatomy of an AI System - The Amazon Echo as an anatomical map of human labor, data and planetary resources. By Kate Crawford and Vladan Joler (2018)
anatomyof.ai
November 11, 2024 at 3:57 PM
Interested in seeing what happens behind the scenes when you prompt an AI tool? Check out this wonderful infographic of material resources, labor, and data that make up the anatomy of AI, by Crawford and Joler (2018): anatomyof.ai
#CriticalAILiteracy #DH #CreativeCoding #TeamRhetoric #NLP #AIML
#CriticalAILiteracy #DH #CreativeCoding #TeamRhetoric #NLP #AIML
Reposted by Umair Abid
If you're an NLP researcher and haven't made it into either Starter Pack yet, please let me know! We're over halfway full at this point 😧
go.bsky.app/JgneRQk
go.bsky.app/JgneRQk
November 18, 2024 at 7:45 AM
If you're an NLP researcher and haven't made it into either Starter Pack yet, please let me know! We're over halfway full at this point 😧
go.bsky.app/JgneRQk
go.bsky.app/JgneRQk
Reposted by Umair Abid
Just realized BlueSky allows sharing valuable stuff cause it doesn't punish links. 🤩
Let's start with "What are embeddings" by @vickiboykis.com
The book is a great summary of embeddings, from history to modern approaches.
The best part: it's free.
Link: vickiboykis.com/what_are_emb...
Let's start with "What are embeddings" by @vickiboykis.com
The book is a great summary of embeddings, from history to modern approaches.
The best part: it's free.
Link: vickiboykis.com/what_are_emb...
November 22, 2024 at 11:13 AM
Just realized BlueSky allows sharing valuable stuff cause it doesn't punish links. 🤩
Let's start with "What are embeddings" by @vickiboykis.com
The book is a great summary of embeddings, from history to modern approaches.
The best part: it's free.
Link: vickiboykis.com/what_are_emb...
Let's start with "What are embeddings" by @vickiboykis.com
The book is a great summary of embeddings, from history to modern approaches.
The best part: it's free.
Link: vickiboykis.com/what_are_emb...