The rapid advancements in large language models (LLMs) such as ChatGPT have raised concerns about their potential impact on academic integrity. While initial concerns focused on ChatGPT’s writing capabilities, recent updates have integrated DALL-E 3’s image generation features, extending the risks to visual evidence in biomedical research. Our tests revealed ChatGPT’s nearly barrier-free image generation feature can be used to generate experimental result images, such as blood smears, Western Blot, immunofluorescence and so on. Although the current ability of ChatGPT to generate experimental images is limited, the risk of misuse is evident. This development underscores the need for immediate action. We suggest that AI providers restrict the generation of experimental image, develop tools to detect AI-generated images, and consider adding “invisible watermarks” to the generated images. By implementing these measures, we can better ensure the responsible use of AI technology in academic research and maintain the integrity of scientific evidence.

中文翻译：

---

ChatGPT 生成逼真的实验图像的能力对学术诚信构成新挑战


ChatGPT 等大型语言模型 （LLMs引发了人们对它们对学术诚信潜在影响的担忧。虽然最初的担忧集中在 ChatGPT 的写作能力上，但最近的更新集成了 DALL-E 3 的图像生成功能，将风险扩展到生物医学研究中的视觉证据。我们的测试表明，ChatGPT 几乎无障碍的图像生成功能可用于生成实验结果图像，例如血涂片、Western Blot、免疫荧光等。虽然目前 ChatGPT 生成实验图像的能力有限，但滥用的风险是显而易见的。这一发展凸显了立即采取行动的必要性。我们建议 AI 提供商限制实验图像的生成，开发检测 AI 生成图像的工具，并考虑为生成的图像添加“不可见水印”。通过实施这些措施，我们可以更好地确保在学术研究中负责任地使用 AI 技术，并维护科学证据的完整性。