Such a great app and tool! What is your reasoning in still showing edges between two nodes even if one indicates that one doesn't think there is a connection? Can i indicate that a link is for sure not there?

that would require the papers to have a testable research question 🙊

also, happy to give you access to our documents to assess your guess

I can see that par cor are more prone to differences because you condition on a set of variables (and if that set of variables differs between two samples the par cor can also differ). zero-order cor and par cor have the same amount of parameters and as such I would expect the same robustness

Interesting thought. For me, robustness of findings is a necessary condition to determine (non-)replication.

1) robustness (in this paper): sufficient support from data that my findings hold.
2) non-replication: there is sufficient evidence in sample A and B, in A it is present and absent in B

and yes i am also super curious about the uncertainty underlying reported individual-level networks 🤓

"[...], if an edge is present in one sample, but not in another, and we have inconclusive evidence in at least one of the samples, this does not mean that there is a contradiction [...]" (p9) We simply have insufficient information in at least one sample. With more data both edges may be present

Thanks for the kind thread Miri! To clarify the last point: We fully agree with you that there are/were concerns in the robustness of the network literature. The difference (as I see it) is that we attribute it to insufficient information (data), rather than an inherent property of the networks.

Thankful for... 🙏
...all the researchers providing access and input to their data
...the dedicated assistants and colleagues that helped with data collection and cleaning
...everyone providing helpful input and calming words during the extensive project 🙏🧡 /end

Applied researcher interested in understanding your phenomenon from a network perspective? Use our website to get an insight into previous studies for potential meta-networks or insights into the nodes/questionnaires commonly included.

All results are available in an accompanying open-access website uvasobe.shinyapps.io/ReBayesed/

Methodologist interested in methodology development? Use our resource of aggregated statistics for realistic simulation conditions (i.e., network density and expected edge weights).

What to do with...
...past network studies: Interpret their findings which caution and ideally aggregated them as a meta-network
...future network studies: Conduct a Bayesian analysis of your network, so you are at least aware of how (un)certain your results are. See how to doi.org/10.1177/2515...

Our results do not imply a criticism of network models in general, but rather point out the inherent uncertainty underlying highly-parameterized models estimated on the common insufficient sample sizes.

This does not mean that most network results are flawed but rather that most network findings are reported with more confidence than is warranted from the data.
Many network results are overstated of which some may be incorrect (not hold upon further data).

80% of all edges in the analyzed networks lack sufficient data support to confirm their presence or absence. One-third show inconclusive evidence (BF < 3), half show weak evidence (BF 3–10), and fewer than 20% show compelling evidence (BF > 10).

Are psychometric networks sufficiently supported by data such that one can be confident when interpreting its results? We analysed 294 psychometric networks from 126 papers with the Bayesian approach to address this question @jmbh.bsky.social Sara Ruth van Holst @maartenmarsman.bsky.social 🧵

Eager to tackle challenges related to climate change?

Then apply for the upcoming Amsterdam Complexity School on Climate Change (ACSCC), hosted by the Institute for Advanced Study, which brings together early-career researchers from all disciplines and non-academic stakeholders.

Website: acscc.nl