The recent revelation that a report supporting Australia's teen social media ban may contain AI-generated content has sparked concern and calls for scrutiny. This incident highlights the potential risks associated with the use of artificial intelligence in research and reporting, particularly when it comes to government submissions and policy-making. The Age Check Certification Scheme (ACCS), a UK-based organization, conducted a $3.48 million trial to test age-verification technologies for social media platforms as part of Australia's under-16 social media ban. The report, which was instrumental in paving the way for the ban's implementation, has now been questioned for its accuracy and the methods used in its creation.
The Senate inquiry, which aims to strengthen the social media ban law, received a submission pointing out citation errors in the report. These errors, according to the submission, were not due to human mistakes but rather AI hallucinations. Initially, ACCS denied the use of AI, but later admitted to using it to rewrite paragraphs more succinctly. However, further analysis by Guardian Australia identified multiple issues with the report's citations, including non-existent Digital Object Identifiers (DOIs) and incorrect or misleading references.
The use of AI in report generation raises important ethical and procedural questions. While AI can assist in summarizing and rewriting content, it is crucial to ensure that the sources and accuracy of the information are verified by human experts. The federal government's previous stance on AI in government reports, exemplified by the Deloitte case, suggests that such practices can lead to significant issues. The potential for AI to generate false citations or inaccurate information could have far-reaching consequences, eroding public trust in institutions and potentially leading to misguided decisions.
This incident underscores the need for transparency and accountability in the use of AI in research and reporting. As AI technology continues to advance, it is essential to establish clear guidelines and penalties to prevent the misuse of AI in government submissions. The public and policymakers must be aware of the risks and implications associated with AI-generated content to ensure that decisions are made based on accurate and reliable information.
