SZodixStudyAcademic Library
ShelvesOpen access
Study · an open academic library·Metadata from OpenAlex (CC0)·Shelves·OpenAlex metadata, de-duplicated
Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotation
16 references·1 citing·53 second hopsampled
Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotation (2025)Large Language Model Hacking: Quantifying…Open-source LLMs for text annotation: a practical guide for model setting and fine-tuning (2024)Open-source LLMs for text ann…Large Language Models Outperform Expert Coders and Supervised Classifiers at Annotating Political Social Media Messages (2024)Large Language Models Outperf…AI for social science and social science of AI: A survey (2024)AI for social science and soc…LLM-Assisted Content Analysis: Using Large Language Models to Support Deductive Coding (2023)LLM-Assisted Content Analysis…ChatGPT outperforms crowd workers for text-annotation tasks (2023)ChatGPT outperforms crowd wor…Big little lies: a compendium and simulation of p -hacking strategies (2023)Big little lies: a compendium…Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty (2022)Observing many researchers us…FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social Media (2020)FakeNewsNet: A Data Repositor…The Extent and Consequences of P-Hacking in Science (2015)The Extent and Consequences o…Scientific apophenia in strategic management research: Significance tests & mistaken inference (2015)Scientific apophenia in strat…Beyond Power Calculations (2014)Beyond Power CalculationsP-curve: A key to the file-drawer. (2013)P-curve: A key to the file-dr…False-Positive Psychology (2011)False-Positive PsychologyPrediction Versus Accommodation and the Risk of Overfitting (2004)Prediction Versus Accommodati…Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability (2002)Content Analysis in Mass Comm…Theory-Testing in Psychology and Physics: A Methodological Paradox (1967)Theory-Testing in Psychology …The Threat of Analytic Flexibility in Using Large Language Models to Simulate Human Data (2026)The Threat of Analytic Flexib…The logic of scientific discovery (1959)CONJECTURES AND REFUTATIONS (1963)Falsification and the Methodology of Scientific Research Programmes (1970)Falsification and the Methodology of Scientific Research Programmes (1976)The earth is round (p < .05). (1994)Logic of Scientific Discovery, The (2010)Fact, Fiction, and Forecast. (1955)Conjectures and Refutations: The Growth of Scientific Knowledge. (1965)Predictive Analytics in Information Systems Research (2010)To Explain or to Predict? (2010)Predictive Analytics in Information Systems Research1 (2011)The Logic of Scientific Discovery (2013)Scientific Utopia (2012)Power failure: why small sample size undermines the reliability of neuroscience (2013)Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? (2015)Redefine statistical significance (2017)Fake news game confers psychological resistance against online misinformation (2019)A Coefficient of Agreement for Nominal Scales (1960)Content Analysis: An Introduction to its Methodology. (1984)Answering the Call for a Standard Reliability Measure for Coding Data (2007)Coding In-depth Semistructured Interviews (2013)The Content Analysis Guidebook (2017)Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines (2020)The case for motivated reasoning. (1990)Why Most Published Research Findings Are False (2005)Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling (2012)A manifesto for reproducible science (2017)The file drawer problem and tolerance for null results. (1979)Methods for the detection of carelessly invalid responses in survey data (2015)The Contact Hypothesis Revisited (2017)Preferred reporting items for systematic reviews and meta‐analyses in ecology and evolutionary biology: a PRISMA extension (2021)"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection (2017)Fake News Detection on Social Media (2017)The spread of true and false news online (2018)A Survey of Fake News (2020)FakeBERT: Fake news detection in social media with a BERT-based deep learning approach (2021)Fake news, disinformation and misinformation in social media: a review (2023)Experimental and Quasi-Experimental Designs for Research (1963)A power primer. (1992)Bias in meta-analysis detected by a simple, graphical test (1997)Scientific method: Statistical errors (2014)The technology acceptance model (TAM): A meta-analytic structural equation modeling approach to explaining teachers’ adoption of digital technology in education (2018)Estimating the reproducibility of psychological science (2015)The association between adolescent well-being and digital technology use (2019)The replication crisis has led to positive structural, procedural, and community changes (2023)Artificial intelligence and illusions of understanding in scientific research (2024)Same model, same data, but different outcomes: Evaluating the impact of method choices in structural equation modeling (2024)The Media Frames Corpus: Annotations of Frames Across Issues (2015)Crowd-sourced Text Analysis: Reproducible and Agile Production of Political Data (2016)Can Large Language Models Transform Computational Social Science? (2023)Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena (2023)Out of One, Many: Using Language Models to Simulate Human Samples (2023)Can Generative AI improve social science? (2024)
this work references cited by second hop· second hop is a sample of the most-cited connections

References

  • 2011False-Positive Psychology6,587 cited
  • 2002Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability3,105 cited
  • 2013P-curve: A key to the file-drawer.1,501 cited
  • 2015The Extent and Consequences of P-Hacking in Science1,393 cited
  • 2014Beyond Power Calculations1,363 cited
  • 2023ChatGPT outperforms crowd workers for text-annotation tasks1,338 cited
  • 2020FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social Media1,163 cited
  • 1967Theory-Testing in Psychology and Physics: A Methodological Paradox962 cited
  • 2004Prediction Versus Accommodation and the Risk of Overfitting313 cited
  • 2022Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty249 cited
  • 2023LLM-Assisted Content Analysis: Using Large Language Models to Support Deductive Coding199 cited
  • 2024Open-source LLMs for text annotation: a practical guide for model setting and fine-tuning146 cited
  • 2015Scientific apophenia in strategic management research: Significance tests & mistaken inference145 cited
  • 2024Large Language Models Outperform Expert Coders and Supervised Classifiers at Annotating Political Social Media Messages130 cited

Only edges whose both ends are imported exist here. Widen the year window, or show the whole map. Back to the work

  • 2024AI for social science and social science of AI: A survey125 cited
  • 2023Big little lies: a compendium and simulation of p -hacking strategies118 cited
  • Cited by

    • 2026The Threat of Analytic Flexibility in Using Large Language Models to Simulate Human Data39 cited