Andrew Ho
@andrewdeanho.bsky.social
Charles William Elliot Professor of Education, Harvard
Testing, Measurement, Psychometrics, Statistics
Testing, Measurement, Psychometrics, Statistics
Applying to a PhD in measurement? Remember to look beyond "the usual suspects" to great programs in N. America and beyond, including these from @ncme38.bsky.social: ncme.org/students/gra...
ICYMI, here is my advice for @harvardeducation.bsky.social: andrewho.scholars.harvard.edu/sites/g/file...
ICYMI, here is my advice for @harvardeducation.bsky.social: andrewho.scholars.harvard.edu/sites/g/file...
November 20, 2025 at 3:42 PM
Applying to a PhD in measurement? Remember to look beyond "the usual suspects" to great programs in N. America and beyond, including these from @ncme38.bsky.social: ncme.org/students/gra...
ICYMI, here is my advice for @harvardeducation.bsky.social: andrewho.scholars.harvard.edu/sites/g/file...
ICYMI, here is my advice for @harvardeducation.bsky.social: andrewho.scholars.harvard.edu/sites/g/file...
In my Week 1 assignment, I ask students to critique AI/GPT's answer to, "What is 'validity' in the context of educational measurement?"
Now that Harvard has updated its sandbox from GPT4.1 to GPT5.1, its answer is mostly right instead of mostly wrong.
Still, a good task! @ncme38.bsky.social
Now that Harvard has updated its sandbox from GPT4.1 to GPT5.1, its answer is mostly right instead of mostly wrong.
Still, a good task! @ncme38.bsky.social
November 18, 2025 at 4:54 PM
In my Week 1 assignment, I ask students to critique AI/GPT's answer to, "What is 'validity' in the context of educational measurement?"
Now that Harvard has updated its sandbox from GPT4.1 to GPT5.1, its answer is mostly right instead of mostly wrong.
Still, a good task! @ncme38.bsky.social
Now that Harvard has updated its sandbox from GPT4.1 to GPT5.1, its answer is mostly right instead of mostly wrong.
Still, a good task! @ncme38.bsky.social
"We like fruit" is going in my personal quote hall of fame. Nice work, @mattbarnum.bsky.social, @emilyoster.bsky.social, Clare Halloran.
Proficiency metrics are distorting estimates, but I don't expect it would change top-line findings. A probit transformation validation check is straightforward.
Proficiency metrics are distorting estimates, but I don't expect it would change top-line findings. A probit transformation validation check is straightforward.
New: Pandemic-era school closures still occupy a significant part of the American political discourse, but do they still matter for student test scores?
Answer: yes, but only a bit.
cbnewsletters.chalkbeat.org/p/we-re-stil...
Answer: yes, but only a bit.
cbnewsletters.chalkbeat.org/p/we-re-stil...
November 14, 2025 at 7:16 PM
"We like fruit" is going in my personal quote hall of fame. Nice work, @mattbarnum.bsky.social, @emilyoster.bsky.social, Clare Halloran.
Proficiency metrics are distorting estimates, but I don't expect it would change top-line findings. A probit transformation validation check is straightforward.
Proficiency metrics are distorting estimates, but I don't expect it would change top-line findings. A probit transformation validation check is straightforward.
Reposted by Andrew Ho
Hi folks attending #2025APPAM #APPAM2025! Excited to see many of you in Seattle this week.
As usual, I am organizing a very informal happy hour for education policy folks at the conference to get together: Fri 11/14 starting at 6pm at Seattle Beer Co on Western Ave (~15 min walk from conference).
As usual, I am organizing a very informal happy hour for education policy folks at the conference to get together: Fri 11/14 starting at 6pm at Seattle Beer Co on Western Ave (~15 min walk from conference).
November 12, 2025 at 3:37 PM
Hi folks attending #2025APPAM #APPAM2025! Excited to see many of you in Seattle this week.
As usual, I am organizing a very informal happy hour for education policy folks at the conference to get together: Fri 11/14 starting at 6pm at Seattle Beer Co on Western Ave (~15 min walk from conference).
As usual, I am organizing a very informal happy hour for education policy folks at the conference to get together: Fri 11/14 starting at 6pm at Seattle Beer Co on Western Ave (~15 min walk from conference).
We are looking for great folks to lead @ncme38.bsky.social through an important era for measurement science and practice. Nominations are due on Friday. Questions? See below or send me a DM!
Nominations: form.jotform.com/252314794748...
Info: higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
Nominations: form.jotform.com/252314794748...
Info: higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
November 11, 2025 at 4:55 PM
We are looking for great folks to lead @ncme38.bsky.social through an important era for measurement science and practice. Nominations are due on Friday. Questions? See below or send me a DM!
Nominations: form.jotform.com/252314794748...
Info: higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
Nominations: form.jotform.com/252314794748...
Info: higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
On Friday, I moderated a National Academy of Education panel on the state and future of education research, with Peggy Carr, @agamoran.bsky.social, Pam Grossman. Many calls for resilience, creativity, advocacy, engagement, and alliances for funding, data, freedom. Photo credit: @aadukia.bsky.social
November 10, 2025 at 4:50 PM
On Friday, I moderated a National Academy of Education panel on the state and future of education research, with Peggy Carr, @agamoran.bsky.social, Pam Grossman. Many calls for resilience, creativity, advocacy, engagement, and alliances for funding, data, freedom. Photo credit: @aadukia.bsky.social
Reposted by Andrew Ho
On the "Mississippi Miracle:"
We've heard a lot about MS reading gains. The puzzle: in the Spencer (2024) study, MS NAEP math and scores in 4th grade increased by similar amounts. Perhaps retention, not instruction, is doing some of the work here?
1/
We've heard a lot about MS reading gains. The puzzle: in the Spencer (2024) study, MS NAEP math and scores in 4th grade increased by similar amounts. Perhaps retention, not instruction, is doing some of the work here?
1/
November 4, 2025 at 6:16 PM
On the "Mississippi Miracle:"
We've heard a lot about MS reading gains. The puzzle: in the Spencer (2024) study, MS NAEP math and scores in 4th grade increased by similar amounts. Perhaps retention, not instruction, is doing some of the work here?
1/
We've heard a lot about MS reading gains. The puzzle: in the Spencer (2024) study, MS NAEP math and scores in 4th grade increased by similar amounts. Perhaps retention, not instruction, is doing some of the work here?
1/
Heading to DC realizing that I've been discussing "The Future of NAEP" for 15 years.
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
November 4, 2025 at 6:43 PM
Heading to DC realizing that I've been discussing "The Future of NAEP" for 15 years.
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
When districts sued Texas for AI scoring, how did independent measurement experts help inform the case? At 1:45, I'm talking about the important, often unseen role of Technical Advisory Committees in evaluating testing (and AI) evidence. @ncme38.bsky.social #AIMECon www.xcdsystem.com/ncme/program...
October 29, 2025 at 4:12 PM
When districts sued Texas for AI scoring, how did independent measurement experts help inform the case? At 1:45, I'm talking about the important, often unseen role of Technical Advisory Committees in evaluating testing (and AI) evidence. @ncme38.bsky.social #AIMECon www.xcdsystem.com/ncme/program...
Liberty Munson's great keynote to open @ncme38.bsky.social's AIME-Con. I asked for examples of GenAI tests where we have evidence they're more 1) engaging, 2) precise, 3) predictive, and 4) impactful than traditional alternatives. She cited early evidence by Khan and Duolingo. With more at AIME-Con!
October 28, 2025 at 1:55 PM
Liberty Munson's great keynote to open @ncme38.bsky.social's AIME-Con. I asked for examples of GenAI tests where we have evidence they're more 1) engaging, 2) precise, 3) predictive, and 4) impactful than traditional alternatives. She cited early evidence by Khan and Duolingo. With more at AIME-Con!
Heading to @ncme38.bsky.social's sold-out AIME-Con in Pittsburgh. Kudos to Pres. Amy Hendrickson for growing this from a notion to a key signal of our field's advancement of new tech. www.ncme-aime.org/meetings/AIM...
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
October 27, 2025 at 7:38 PM
Heading to @ncme38.bsky.social's sold-out AIME-Con in Pittsburgh. Kudos to Pres. Amy Hendrickson for growing this from a notion to a key signal of our field's advancement of new tech. www.ncme-aime.org/meetings/AIM...
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
What's a TAC? Our new NCME initiative honors the service of 150+ experts who advise state testing programs. Together, they advance validity, precision, and fairness.
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
October 23, 2025 at 6:51 PM
What's a TAC? Our new NCME initiative honors the service of 150+ experts who advise state testing programs. Together, they advance validity, precision, and fairness.
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
I finally did it. Here is my TAC Bingo Card: bit.ly/tacbingo
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
October 22, 2025 at 8:44 PM
I finally did it. Here is my TAC Bingo Card: bit.ly/tacbingo
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
Reposted by Andrew Ho
A key point in this article is whether OMB will allow agencies to have funds and whether legislation by Congress will be respected. www.insidehighered.com/news/governm...
Trump Gutted IES. Skepticism of Its Renewal Abounds.
The Education Department recently requested ideas on how to “modernize” the data collection and education research funding agency, and it sought to hire for a few positions.
www.insidehighered.com
October 21, 2025 at 2:41 PM
A key point in this article is whether OMB will allow agencies to have funds and whether legislation by Congress will be respected. www.insidehighered.com/news/governm...
What's behind this map of measurement programs? Hundreds of faculty and students, all part of a networked community that @ncme38.bsky.social is proud to support.
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
October 21, 2025 at 2:59 PM
What's behind this map of measurement programs? Hundreds of faculty and students, all part of a networked community that @ncme38.bsky.social is proud to support.
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
Interested in measurement? NCME has expanded its list of PhD programs in North America (82 and counting). Our community is strong.
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
October 16, 2025 at 6:17 PM
Interested in measurement? NCME has expanded its list of PhD programs in North America (82 and counting). Our community is strong.
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
NCME keeps upping its swag game, now with AIME-Con-specific swag! (And plushies of course.) bit.ly/ncmeswag
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
October 15, 2025 at 6:26 PM
NCME keeps upping its swag game, now with AIME-Con-specific swag! (And plushies of course.) bit.ly/ncmeswag
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
EOP is hosting a (small) conference for quantitative research on educational opportunity at Stanford, February 5 & 6, 2026! We hope you'll submit your work and join us. Proposals are due 11/7. #SEDA forms.gle/jYfz9CasQ5c1...
October 14, 2025 at 4:10 PM
EOP is hosting a (small) conference for quantitative research on educational opportunity at Stanford, February 5 & 6, 2026! We hope you'll submit your work and join us. Proposals are due 11/7. #SEDA forms.gle/jYfz9CasQ5c1...
NCME responds to the IES RFI. We ask IES to invest in professional standards, NAEP, high-quality research, training grants, a robust infrastructure for high-quality measurement in education, and more. @ncme38.bsky.social
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
October 10, 2025 at 3:59 PM
NCME responds to the IES RFI. We ask IES to invest in professional standards, NAEP, high-quality research, training grants, a robust infrastructure for high-quality measurement in education, and more. @ncme38.bsky.social
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
I finally wrote up my advice to PhD applicants in FAQ format. It's only my unofficial, personal perspective for folks interested in working with me at Harvard @harvardeducation.bsky.social. I also plug other measurement programs at @ncme38.bsky.social! andrewho.scholars.harvard.edu/sites/g/file...
October 7, 2025 at 3:12 PM
I finally wrote up my advice to PhD applicants in FAQ format. It's only my unofficial, personal perspective for folks interested in working with me at Harvard @harvardeducation.bsky.social. I also plug other measurement programs at @ncme38.bsky.social! andrewho.scholars.harvard.edu/sites/g/file...
Should @harvard.edu shift norms on screen management and active learning in its large classrooms? Two interesting policy ideas emerged from a standing-room-only HILT plenary panel at @harvardeducation.bsky.social on Friday with Jal Mehta, Todd Rogers, Dave Deming, and Karen Thornber...
October 6, 2025 at 1:28 PM
Should @harvard.edu shift norms on screen management and active learning in its large classrooms? Two interesting policy ideas emerged from a standing-room-only HILT plenary panel at @harvardeducation.bsky.social on Friday with Jal Mehta, Todd Rogers, Dave Deming, and Karen Thornber...
[email protected]'s reappointment is earned and timely. NAEP isn't just data, it's like bedrock connecting states, a foundation supporting our shared pursuit of educational progress. Scott continuing in the "Testing & Measurement Expert" role keeps NAEP steady amid turbulent political winds.
We're delighted to announce that @scottnh24.bsky.social has been reappointed to the National Assessment Governing Board, which set policy for NAEP. Congrats, Scott! bit.ly/472FeIO
Scott Marion Reappointed to National Assessment Governing Board | Center for Assessment
Scott Marion, principal learning associate at the Center for Assessment, has been reappointed to the National Assessment Governing Board.
bit.ly
October 1, 2025 at 2:30 PM
[email protected]'s reappointment is earned and timely. NAEP isn't just data, it's like bedrock connecting states, a foundation supporting our shared pursuit of educational progress. Scott continuing in the "Testing & Measurement Expert" role keeps NAEP steady amid turbulent political winds.
Reposted by Andrew Ho
Really good opportunity, director of strategic data and evaluation in LAUSD careers.lausd.org/job/Director...
Director of Strategic Data and Evaluation
Director of Strategic Data and Evaluation
careers.lausd.org
September 25, 2025 at 4:30 PM
Really good opportunity, director of strategic data and evaluation in LAUSD careers.lausd.org/job/Director...
Reposted by Andrew Ho
Yet more evidence from @andrewdeanho.bsky.social on the perils of reliance on "percent proficient," and the alternatives needed to understand school performance over time and across groups journals.sagepub.com/doi/abs/10.1...
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
journals.sagepub.com
September 23, 2025 at 2:13 PM
Yet more evidence from @andrewdeanho.bsky.social on the perils of reliance on "percent proficient," and the alternatives needed to understand school performance over time and across groups journals.sagepub.com/doi/abs/10.1...
Mid-COVID, I wrote my "Three Metrics" memo, encouraging states to use better metrics lest they mislead the public and themselves about educational progress. It's now published in TCR with a bit of "I told you so" context.
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
September 22, 2025 at 3:36 PM
Mid-COVID, I wrote my "Three Metrics" memo, encouraging states to use better metrics lest they mislead the public and themselves about educational progress. It's now published in TCR with a bit of "I told you so" context.
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...