Prolific
@joinprolific.bsky.social
The ultimate human data platform to power world-changing AI and research.
🔗 www.prolific.com
🔗 www.prolific.com
Introducing bot authenticity checks that detect agentic AI and bots in academic research.
100% accuracy in testing. Our tool flags automated browser scripts or non-human behavior within your Qualtrics studies, so you can collect data with high confidence that it's human.
#AcademicSky #Research
100% accuracy in testing. Our tool flags automated browser scripts or non-human behavior within your Qualtrics studies, so you can collect data with high confidence that it's human.
#AcademicSky #Research
February 4, 2026 at 4:02 PM
Introducing bot authenticity checks that detect agentic AI and bots in academic research.
100% accuracy in testing. Our tool flags automated browser scripts or non-human behavior within your Qualtrics studies, so you can collect data with high confidence that it's human.
#AcademicSky #Research
100% accuracy in testing. Our tool flags automated browser scripts or non-human behavior within your Qualtrics studies, so you can collect data with high confidence that it's human.
#AcademicSky #Research
When platforms consolidate, research options shrink.
Researchers are rightly asking whether participant access will stay tool-agnostic, high-quality, and reliable.
As @phe-lim.bsky.social says, we believe access works best when it’s open by design. So if you're reassessing, get in touch. #Research
Researchers are rightly asking whether participant access will stay tool-agnostic, high-quality, and reliable.
As @phe-lim.bsky.social says, we believe access works best when it’s open by design. So if you're reassessing, get in touch. #Research
January 9, 2026 at 3:13 PM
When platforms consolidate, research options shrink.
Researchers are rightly asking whether participant access will stay tool-agnostic, high-quality, and reliable.
As @phe-lim.bsky.social says, we believe access works best when it’s open by design. So if you're reassessing, get in touch. #Research
Researchers are rightly asking whether participant access will stay tool-agnostic, high-quality, and reliable.
As @phe-lim.bsky.social says, we believe access works best when it’s open by design. So if you're reassessing, get in touch. #Research
Thank you 2025. You’ve been great. ⭐️
Together, our global community across AI, research, and participants made this a truly monumental year.
Whether you were collecting high-quality data or contributing your expertise, we were honored to be your human data platform of choice.
Together, our global community across AI, research, and participants made this a truly monumental year.
Whether you were collecting high-quality data or contributing your expertise, we were honored to be your human data platform of choice.
December 19, 2025 at 5:06 PM
Thank you 2025. You’ve been great. ⭐️
Together, our global community across AI, research, and participants made this a truly monumental year.
Whether you were collecting high-quality data or contributing your expertise, we were honored to be your human data platform of choice.
Together, our global community across AI, research, and participants made this a truly monumental year.
Whether you were collecting high-quality data or contributing your expertise, we were honored to be your human data platform of choice.
AI agents are becoming more sophisticated, more capable of mimicking human behavior, more accessible.
This raises questions about how we keep real human feedback at the core of online research. 🧵 #AcademicSky #ResearchIntegrity
This raises questions about how we keep real human feedback at the core of online research. 🧵 #AcademicSky #ResearchIntegrity
December 15, 2025 at 3:58 PM
AI agents are becoming more sophisticated, more capable of mimicking human behavior, more accessible.
This raises questions about how we keep real human feedback at the core of online research. 🧵 #AcademicSky #ResearchIntegrity
This raises questions about how we keep real human feedback at the core of online research. 🧵 #AcademicSky #ResearchIntegrity
🇬🇧 At the @universities-uk.bsky.social conference, Dr. Simon Jones discussed digital transformation in research services, with insights from 35,000+ researchers using Prolific.
He explored challenges and successful institutional practices. Great to sponsor another #UUK! #AcademicSky #Research
He explored challenges and successful institutional practices. Great to sponsor another #UUK! #AcademicSky #Research
December 10, 2025 at 3:39 PM
🇬🇧 At the @universities-uk.bsky.social conference, Dr. Simon Jones discussed digital transformation in research services, with insights from 35,000+ researchers using Prolific.
He explored challenges and successful institutional practices. Great to sponsor another #UUK! #AcademicSky #Research
He explored challenges and successful institutional practices. Great to sponsor another #UUK! #AcademicSky #Research
We’re proud to surpass multiple industry benchmarks in the Insights Association’s recent Global Data Quality (GDQ) Benchmarking Report for online #research data quality.
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
November 12, 2025 at 4:09 PM
We’re proud to surpass multiple industry benchmarks in the Insights Association’s recent Global Data Quality (GDQ) Benchmarking Report for online #research data quality.
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Protocol is our five-layer system built to ensure your data is of the highest quality.
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
November 6, 2025 at 4:23 PM
Protocol is our five-layer system built to ensure your data is of the highest quality.
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
Ongoing human oversight and fine-tuning of our data quality systems is also crucial in protecting good participants and research integrity.
Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.
Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.
November 5, 2025 at 5:21 PM
Ongoing human oversight and fine-tuning of our data quality systems is also crucial in protecting good participants and research integrity.
Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.
Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.
We architect authentic data through Protocol, a state-of-the-art system that sets the industry standard for data quality. With five layers of defense, it ensures every response on our platform is authentically human.
Each layer is detailed in the full article.
Each layer is detailed in the full article.
November 5, 2025 at 5:21 PM
We architect authentic data through Protocol, a state-of-the-art system that sets the industry standard for data quality. With five layers of defense, it ensures every response on our platform is authentically human.
Each layer is detailed in the full article.
Each layer is detailed in the full article.
We put authenticity above all else.
Independent research validates Prolific as setting the standard for data quality (2017-2025). Only 0.5% of Prolific participant responses were rejected in 2025. And a recent audit shows that just 0.99% of participants were flagged for AI-generated responses.
Independent research validates Prolific as setting the standard for data quality (2017-2025). Only 0.5% of Prolific participant responses were rejected in 2025. And a recent audit shows that just 0.99% of participants were flagged for AI-generated responses.
November 5, 2025 at 5:21 PM
We put authenticity above all else.
Independent research validates Prolific as setting the standard for data quality (2017-2025). Only 0.5% of Prolific participant responses were rejected in 2025. And a recent audit shows that just 0.99% of participants were flagged for AI-generated responses.
Independent research validates Prolific as setting the standard for data quality (2017-2025). Only 0.5% of Prolific participant responses were rejected in 2025. And a recent audit shows that just 0.99% of participants were flagged for AI-generated responses.
When you commission human data, you deserve human data.
Our commitment to data integrity remains constant. Protecting access to real human perspectives has been Prolific’s top priority since its inception in 2014.
Our commitment to data integrity remains constant. Protecting access to real human perspectives has been Prolific’s top priority since its inception in 2014.
November 5, 2025 at 5:21 PM
When you commission human data, you deserve human data.
Our commitment to data integrity remains constant. Protecting access to real human perspectives has been Prolific’s top priority since its inception in 2014.
Our commitment to data integrity remains constant. Protecting access to real human perspectives has been Prolific’s top priority since its inception in 2014.
In an AI-powered world, genuine human perspectives are both precious and vulnerable.
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
November 5, 2025 at 5:21 PM
In an AI-powered world, genuine human perspectives are both precious and vulnerable.
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
🎓 Great news for academic researchers - our $100 / £100 free credit offer has been extended!
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
October 28, 2025 at 11:25 AM
🎓 Great news for academic researchers - our $100 / £100 free credit offer has been extended!
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Limited time offer for academic researchers 🚨
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
October 22, 2025 at 2:36 PM
Limited time offer for academic researchers 🚨
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
📢 Authenticity checks are out of beta, with upgrades for ease of use.
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
October 9, 2025 at 11:53 AM
📢 Authenticity checks are out of beta, with upgrades for ease of use.
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
Probability of Practical Superiority (PPS) Comparison Matrix is available under "Model Comparison" for estimating how likely one model is likely to outperform another in real-world usage.
Values >55% suggest one model meaningfully outperforms beyond random chance.
Values >55% suggest one model meaningfully outperforms beyond random chance.
September 17, 2025 at 4:13 PM
Probability of Practical Superiority (PPS) Comparison Matrix is available under "Model Comparison" for estimating how likely one model is likely to outperform another in real-world usage.
Values >55% suggest one model meaningfully outperforms beyond random chance.
Values >55% suggest one model meaningfully outperforms beyond random chance.
HUMAINE uses rigorous methodology to ensure representative and reliable results.
Our methodology includes:
- Comparative assessment
- Statistically rigorous hierarchical modeling
- Four core dimensions of user experience and overall winner
- Commitment to demographic representation
Our methodology includes:
- Comparative assessment
- Statistically rigorous hierarchical modeling
- Four core dimensions of user experience and overall winner
- Commitment to demographic representation
September 17, 2025 at 4:13 PM
HUMAINE uses rigorous methodology to ensure representative and reliable results.
Our methodology includes:
- Comparative assessment
- Statistically rigorous hierarchical modeling
- Four core dimensions of user experience and overall winner
- Commitment to demographic representation
Our methodology includes:
- Comparative assessment
- Statistically rigorous hierarchical modeling
- Four core dimensions of user experience and overall winner
- Commitment to demographic representation
🏆 Gemini-2.5-Pro takes the #1 spot decisively, with DeepSeek-V3 emerging as the surprise runner-up.
⚖️ Age groups show highest disagreement on model rankings.
📊 27 models tested across 100K+ human comparisons - one of the largest public AI evaluations to date.
⚖️ Age groups show highest disagreement on model rankings.
📊 27 models tested across 100K+ human comparisons - one of the largest public AI evaluations to date.
September 17, 2025 at 4:13 PM
🏆 Gemini-2.5-Pro takes the #1 spot decisively, with DeepSeek-V3 emerging as the surprise runner-up.
⚖️ Age groups show highest disagreement on model rankings.
📊 27 models tested across 100K+ human comparisons - one of the largest public AI evaluations to date.
⚖️ Age groups show highest disagreement on model rankings.
📊 27 models tested across 100K+ human comparisons - one of the largest public AI evaluations to date.
Our human-centered evaluation and leaderboard shows how people actually experience AI models in the real world.
Rich, multi-dimensional feedback from a diverse, representative sample of real users from our pool - revealing not just which model they prefer, but why.
Rich, multi-dimensional feedback from a diverse, representative sample of real users from our pool - revealing not just which model they prefer, but why.
September 17, 2025 at 4:13 PM
Our human-centered evaluation and leaderboard shows how people actually experience AI models in the real world.
Rich, multi-dimensional feedback from a diverse, representative sample of real users from our pool - revealing not just which model they prefer, but why.
Rich, multi-dimensional feedback from a diverse, representative sample of real users from our pool - revealing not just which model they prefer, but why.
Introducing HUMAINE: the LLM benchmark that puts real human experience first 🎯
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
September 17, 2025 at 4:13 PM
Introducing HUMAINE: the LLM benchmark that puts real human experience first 🎯
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
New: Periodic identity confirmation checks with video recording to ensure authentic, human feedback in your academic and industry research.
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
September 11, 2025 at 7:43 PM
New: Periodic identity confirmation checks with video recording to ensure authentic, human feedback in your academic and industry research.
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
🔍 Audience Finder is here.
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
August 21, 2025 at 10:11 AM
🔍 Audience Finder is here.
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
In the age of AI, authenticity matters more than ever in academic research. LLM-generated responses, false demographics, and more pose a threat.
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
August 18, 2025 at 5:29 PM
In the age of AI, authenticity matters more than ever in academic research. LLM-generated responses, false demographics, and more pose a threat.
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
Interesting findings around how agents compete with humans for partnerships by @yaominj.bsky.social, @levinbrinkmann.bsky.social, Anne-Marie Nussberger, Ivan Soraperra, @jfbonnefon.bsky.social, @iyadrahwan.bsky.social, @mpib-berlin.bsky.social.
Taskers sourced via Prolific.
#AI #MLSky #AcademicSky
Taskers sourced via Prolific.
#AI #MLSky #AcademicSky
August 4, 2025 at 8:17 PM
Interesting findings around how agents compete with humans for partnerships by @yaominj.bsky.social, @levinbrinkmann.bsky.social, Anne-Marie Nussberger, Ivan Soraperra, @jfbonnefon.bsky.social, @iyadrahwan.bsky.social, @mpib-berlin.bsky.social.
Taskers sourced via Prolific.
#AI #MLSky #AcademicSky
Taskers sourced via Prolific.
#AI #MLSky #AcademicSky
"Through three experiments (N = 975), we found that bots, though more prosocial than humans and linguistically distinguishable, were not selected preferentially when their identity was hidden. Instead, humans misattributed bots’ behavior to humans and vice versa."
arxiv.org/abs/2507.13524
arxiv.org/abs/2507.13524
August 4, 2025 at 8:17 PM
"Through three experiments (N = 975), we found that bots, though more prosocial than humans and linguistically distinguishable, were not selected preferentially when their identity was hidden. Instead, humans misattributed bots’ behavior to humans and vice versa."
arxiv.org/abs/2507.13524
arxiv.org/abs/2507.13524