Prolific
@joinprolific.bsky.social
The ultimate human data platform to power world-changing AI and research.
🔗 www.prolific.com
🔗 www.prolific.com
Pinned
Protocol is our five-layer system built to ensure your data is of the highest quality.
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
Reposted by Prolific
Lots of chatter about this paper currently. Its a stark warning, but at present I see this as a stark warning of what might come, not what is happening now. As a research community we need to see it as a call-to-arms to develop new strategies, NOT a call to abandon online sampling. Reasoning below
From my colleague; paper here dropbox.com/scl/fi/55uok...
new paper by Sean Westwood:
With current technology, it is impossible to tell whether survey respondents are real or bots. Among other things, makes it easy for bad actors to manipulate outcomes. No good news here for the future of online-based survey research
With current technology, it is impossible to tell whether survey respondents are real or bots. Among other things, makes it easy for bad actors to manipulate outcomes. No good news here for the future of online-based survey research
November 19, 2025 at 3:39 PM
Lots of chatter about this paper currently. Its a stark warning, but at present I see this as a stark warning of what might come, not what is happening now. As a research community we need to see it as a call-to-arms to develop new strategies, NOT a call to abandon online sampling. Reasoning below
Reposted by Prolific
Without minimising the seriousness of the threat raised in this paper, I'm more optimistic. This is just the latest challenge in online integrity of online research.
We've been proactively adding to our suite of authenticity tools - more every week - including many of Sean's recommendations:
We've been proactively adding to our suite of authenticity tools - more every week - including many of Sean's recommendations:
November 19, 2025 at 11:24 AM
Without minimising the seriousness of the threat raised in this paper, I'm more optimistic. This is just the latest challenge in online integrity of online research.
We've been proactively adding to our suite of authenticity tools - more every week - including many of Sean's recommendations:
We've been proactively adding to our suite of authenticity tools - more every week - including many of Sean's recommendations:
We’re proud to surpass multiple industry benchmarks in the Insights Association’s recent Global Data Quality (GDQ) Benchmarking Report for online #research data quality.
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
November 12, 2025 at 4:09 PM
We’re proud to surpass multiple industry benchmarks in the Insights Association’s recent Global Data Quality (GDQ) Benchmarking Report for online #research data quality.
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Reposted by Prolific
There's not just a generational wealth gap anymore. There's a wellbeing gap too.
And right now, it's hitting younger people the hardest.
(Data from our latest @joinprolific.bsky.social poll - November 2024)
Full data: www.prolific.com/polling
And right now, it's hitting younger people the hardest.
(Data from our latest @joinprolific.bsky.social poll - November 2024)
Full data: www.prolific.com/polling
Representative polling data | Prolific
Find out what the United States and UK really thinks, with reliable poll results for the questions that matter.
www.prolific.com
November 7, 2025 at 5:03 PM
There's not just a generational wealth gap anymore. There's a wellbeing gap too.
And right now, it's hitting younger people the hardest.
(Data from our latest @joinprolific.bsky.social poll - November 2024)
Full data: www.prolific.com/polling
And right now, it's hitting younger people the hardest.
(Data from our latest @joinprolific.bsky.social poll - November 2024)
Full data: www.prolific.com/polling
Protocol is our five-layer system built to ensure your data is of the highest quality.
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
November 6, 2025 at 4:23 PM
Protocol is our five-layer system built to ensure your data is of the highest quality.
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
In an AI-powered world, genuine human perspectives are both precious and vulnerable.
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
November 5, 2025 at 5:21 PM
In an AI-powered world, genuine human perspectives are both precious and vulnerable.
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
🎓 Great news for academic researchers - our $100 / £100 free credit offer has been extended!
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
October 28, 2025 at 11:25 AM
🎓 Great news for academic researchers - our $100 / £100 free credit offer has been extended!
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Reposted by Prolific
What is one question you'd dearly love to ask a representative sample of 2,000 US adults?
Going to try this again because it was super interesting last time. I'll stick the best question in our next @joinprolific.bsky.social poll that goes live at the start of November.
#polling #research
Going to try this again because it was super interesting last time. I'll stick the best question in our next @joinprolific.bsky.social poll that goes live at the start of November.
#polling #research
October 24, 2025 at 1:58 PM
What is one question you'd dearly love to ask a representative sample of 2,000 US adults?
Going to try this again because it was super interesting last time. I'll stick the best question in our next @joinprolific.bsky.social poll that goes live at the start of November.
#polling #research
Going to try this again because it was super interesting last time. I'll stick the best question in our next @joinprolific.bsky.social poll that goes live at the start of November.
#polling #research
Limited time offer for academic researchers 🚨
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
October 22, 2025 at 2:36 PM
Limited time offer for academic researchers 🚨
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
Reposted by Prolific
The Double Squeeze hitting Trump's base.
9 months of @joinprolific.bsky.social tracking show voters report surging costs AND growing fears of US global decline.
They voted for prosperity & strength. They got strain & decline.
Full analysis: www.prolific.com/resources/tr...
#poll #geopolitics
9 months of @joinprolific.bsky.social tracking show voters report surging costs AND growing fears of US global decline.
They voted for prosperity & strength. They got strain & decline.
Full analysis: www.prolific.com/resources/tr...
#poll #geopolitics
The double squeeze: Trump's base reports rising costs | Prolific
Polling data since Donald Trump's inauguration reveals Republicans are increasingly reporting rising costs and growing safety concerns
www.prolific.com
October 20, 2025 at 9:49 AM
The Double Squeeze hitting Trump's base.
9 months of @joinprolific.bsky.social tracking show voters report surging costs AND growing fears of US global decline.
They voted for prosperity & strength. They got strain & decline.
Full analysis: www.prolific.com/resources/tr...
#poll #geopolitics
9 months of @joinprolific.bsky.social tracking show voters report surging costs AND growing fears of US global decline.
They voted for prosperity & strength. They got strain & decline.
Full analysis: www.prolific.com/resources/tr...
#poll #geopolitics
How to design studies and get quality data with Dr. Simon Jones 🎥
Join our Senior Research Consultant's refresher as he shares expert tips to optimize data quality, and runs through the latest platform features designed to make launching studies faster and easier than ever.
#AcademicSky #Research
Join our Senior Research Consultant's refresher as he shares expert tips to optimize data quality, and runs through the latest platform features designed to make launching studies faster and easier than ever.
#AcademicSky #Research
How to design studies and get quality data with Dr. Simon Jones
This webinar explores how, as AI transforms how we interact with tech, the human role is shifting from data provider to strategic designer.
resources.prolific.com
October 10, 2025 at 3:11 PM
How to design studies and get quality data with Dr. Simon Jones 🎥
Join our Senior Research Consultant's refresher as he shares expert tips to optimize data quality, and runs through the latest platform features designed to make launching studies faster and easier than ever.
#AcademicSky #Research
Join our Senior Research Consultant's refresher as he shares expert tips to optimize data quality, and runs through the latest platform features designed to make launching studies faster and easier than ever.
#AcademicSky #Research
📢 Authenticity checks are out of beta, with upgrades for ease of use.
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
October 9, 2025 at 11:53 AM
📢 Authenticity checks are out of beta, with upgrades for ease of use.
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
AI benchmarks show models like GPT-5 might ace scientific reasoning, or Gemini and Claude adapt to new concepts. But which LLMs offer the best user experience?
@tomsguide.com explains how Prolific's AI leaderboard HUMAINE is a big step forward.
#ArtificialIntelligence #MachineLearning #LLM
@tomsguide.com explains how Prolific's AI leaderboard HUMAINE is a big step forward.
#ArtificialIntelligence #MachineLearning #LLM
27 AI models were ranked by the public and ChatGPT came 8th — these are the models that beat it
A surprising set of results for the big AI chatbots
www.tomsguide.com
September 19, 2025 at 3:32 PM
AI benchmarks show models like GPT-5 might ace scientific reasoning, or Gemini and Claude adapt to new concepts. But which LLMs offer the best user experience?
@tomsguide.com explains how Prolific's AI leaderboard HUMAINE is a big step forward.
#ArtificialIntelligence #MachineLearning #LLM
@tomsguide.com explains how Prolific's AI leaderboard HUMAINE is a big step forward.
#ArtificialIntelligence #MachineLearning #LLM
Reposted by Prolific
Super excited to share this work with the world!
We wanted to put human preference at the heart of our AI model leaderboard, and to do so in a principled and representative manner.
The result: HUMAINE
Check out the data here and get in touch with any questions: huggingface.co/spaces/Proli...
We wanted to put human preference at the heart of our AI model leaderboard, and to do so in a principled and representative manner.
The result: HUMAINE
Check out the data here and get in touch with any questions: huggingface.co/spaces/Proli...
September 17, 2025 at 6:22 PM
Super excited to share this work with the world!
We wanted to put human preference at the heart of our AI model leaderboard, and to do so in a principled and representative manner.
The result: HUMAINE
Check out the data here and get in touch with any questions: huggingface.co/spaces/Proli...
We wanted to put human preference at the heart of our AI model leaderboard, and to do so in a principled and representative manner.
The result: HUMAINE
Check out the data here and get in touch with any questions: huggingface.co/spaces/Proli...
Introducing HUMAINE: the LLM benchmark that puts real human experience first 🎯
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
September 17, 2025 at 4:13 PM
Introducing HUMAINE: the LLM benchmark that puts real human experience first 🎯
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
New: Periodic identity confirmation checks with video recording to ensure authentic, human feedback in your academic and industry research.
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
September 11, 2025 at 7:43 PM
New: Periodic identity confirmation checks with video recording to ensure authentic, human feedback in your academic and industry research.
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
AI/ML researchers in San Francisco, we have a few spaces left at our community event 🇺🇸
Join us Sep 11 for this month’s theme: Researchers building real-world AI tooling. With speakers Prolific CEO Phelim Bradley and Jiaxin Pei, Postdoc at @stanfordhai.bsky.social. 👇
#MLSky #ArtificialIntelligence
Join us Sep 11 for this month’s theme: Researchers building real-world AI tooling. With speakers Prolific CEO Phelim Bradley and Jiaxin Pei, Postdoc at @stanfordhai.bsky.social. 👇
#MLSky #ArtificialIntelligence
Prolific Meetup #1 – Researchers Building Real-World AI Tooling · Luma
About the Event
Prolific is bringing the AI community together in San Francisco to explore the evolving role of humans in post-training, alignment, evaluation,…
luma.com
September 8, 2025 at 6:41 PM
AI/ML researchers in San Francisco, we have a few spaces left at our community event 🇺🇸
Join us Sep 11 for this month’s theme: Researchers building real-world AI tooling. With speakers Prolific CEO Phelim Bradley and Jiaxin Pei, Postdoc at @stanfordhai.bsky.social. 👇
#MLSky #ArtificialIntelligence
Join us Sep 11 for this month’s theme: Researchers building real-world AI tooling. With speakers Prolific CEO Phelim Bradley and Jiaxin Pei, Postdoc at @stanfordhai.bsky.social. 👇
#MLSky #ArtificialIntelligence
🔍 Audience Finder is here.
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
August 21, 2025 at 10:11 AM
🔍 Audience Finder is here.
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
In the age of AI, authenticity matters more than ever in academic research. LLM-generated responses, false demographics, and more pose a threat.
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
August 18, 2025 at 5:29 PM
In the age of AI, authenticity matters more than ever in academic research. LLM-generated responses, false demographics, and more pose a threat.
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
"Through three experiments (N = 975), we found that bots, though more prosocial than humans and linguistically distinguishable, were not selected preferentially when their identity was hidden. Instead, humans misattributed bots’ behavior to humans and vice versa."
arxiv.org/abs/2507.13524
arxiv.org/abs/2507.13524
August 4, 2025 at 8:17 PM
"Through three experiments (N = 975), we found that bots, though more prosocial than humans and linguistically distinguishable, were not selected preferentially when their identity was hidden. Instead, humans misattributed bots’ behavior to humans and vice versa."
arxiv.org/abs/2507.13524
arxiv.org/abs/2507.13524
Reposted by Prolific
New preprint -- we (me, @klempert.bsky.social, Dave Wolk, and Joe Kable) examined whether characteristic aging-related changes in cognition and personality show up on six online platforms (3 crowdsourcing sites -- MTurk, CloudResearch Toolkit, & Prolific, and 3 panels). osf.io/preprints/ps... 1/
OSF
osf.io
July 28, 2025 at 7:27 PM
New preprint -- we (me, @klempert.bsky.social, Dave Wolk, and Joe Kable) examined whether characteristic aging-related changes in cognition and personality show up on six online platforms (3 crowdsourcing sites -- MTurk, CloudResearch Toolkit, & Prolific, and 3 panels). osf.io/preprints/ps... 1/
Reposted by Prolific
Sharing a piece I wrote for The AI Journal on who should govern AI: aijourn.com/a-fine-balan...
Our recent @joinprolific.bsky.social polling shows 69.7% of people think AI investment will primarily benefit corporations not the public. They're probably right. [1/3]
#AI #AIGovernance #TechPolicy
Our recent @joinprolific.bsky.social polling shows 69.7% of people think AI investment will primarily benefit corporations not the public. They're probably right. [1/3]
#AI #AIGovernance #TechPolicy
July 28, 2025 at 10:14 AM
Sharing a piece I wrote for The AI Journal on who should govern AI: aijourn.com/a-fine-balan...
Our recent @joinprolific.bsky.social polling shows 69.7% of people think AI investment will primarily benefit corporations not the public. They're probably right. [1/3]
#AI #AIGovernance #TechPolicy
Our recent @joinprolific.bsky.social polling shows 69.7% of people think AI investment will primarily benefit corporations not the public. They're probably right. [1/3]
#AI #AIGovernance #TechPolicy
The largest investigation of AI persuasion with 76,977 participants across 3 large-scale experiments. Excellent work by @ox.ac.uk PhD candidate @kobihackenburg.bsky.social.
19 LLMs. 707 political issues. 466,769 fact-checkable claims evaluated.
arxiv.org/abs/2507.13919
#AcademicSky #MLSky #PhDSky
19 LLMs. 707 political issues. 466,769 fact-checkable claims evaluated.
arxiv.org/abs/2507.13919
#AcademicSky #MLSky #PhDSky
July 24, 2025 at 7:56 PM
The largest investigation of AI persuasion with 76,977 participants across 3 large-scale experiments. Excellent work by @ox.ac.uk PhD candidate @kobihackenburg.bsky.social.
19 LLMs. 707 political issues. 466,769 fact-checkable claims evaluated.
arxiv.org/abs/2507.13919
#AcademicSky #MLSky #PhDSky
19 LLMs. 707 political issues. 466,769 fact-checkable claims evaluated.
arxiv.org/abs/2507.13919
#AcademicSky #MLSky #PhDSky
4 new security enhancements for better data quality in your academic research 🧵
With data quality an absolute priority yet challenge for many researchers, we’ve made several important updates to strengthen security and maintain data quality on the Prolific platform.
#AcademicSky #PhDSky #Research
With data quality an absolute priority yet challenge for many researchers, we’ve made several important updates to strengthen security and maintain data quality on the Prolific platform.
#AcademicSky #PhDSky #Research
July 10, 2025 at 2:01 PM
4 new security enhancements for better data quality in your academic research 🧵
With data quality an absolute priority yet challenge for many researchers, we’ve made several important updates to strengthen security and maintain data quality on the Prolific platform.
#AcademicSky #PhDSky #Research
With data quality an absolute priority yet challenge for many researchers, we’ve made several important updates to strengthen security and maintain data quality on the Prolific platform.
#AcademicSky #PhDSky #Research
🎥 Webinar: Why AI leaderboards miss the mark 🚫
@cohereforai.bsky.social’s Oliver Nan, University of Washington's @huashen.bsky.social, and Prolific’s Nora Petrova will be discussing where leaderboards are falling short, how to improve them, and more.
🔗 www.prolific.com/resources/wh... | #MLSky #AI
@cohereforai.bsky.social’s Oliver Nan, University of Washington's @huashen.bsky.social, and Prolific’s Nora Petrova will be discussing where leaderboards are falling short, how to improve them, and more.
🔗 www.prolific.com/resources/wh... | #MLSky #AI
July 7, 2025 at 2:02 PM
🎥 Webinar: Why AI leaderboards miss the mark 🚫
@cohereforai.bsky.social’s Oliver Nan, University of Washington's @huashen.bsky.social, and Prolific’s Nora Petrova will be discussing where leaderboards are falling short, how to improve them, and more.
🔗 www.prolific.com/resources/wh... | #MLSky #AI
@cohereforai.bsky.social’s Oliver Nan, University of Washington's @huashen.bsky.social, and Prolific’s Nora Petrova will be discussing where leaderboards are falling short, how to improve them, and more.
🔗 www.prolific.com/resources/wh... | #MLSky #AI