Revolutionizing Research: A Look at AI and Data Innovations in Higher Education

New AI and Data Innovations in the Classroom: A Roundtable Discussion

Presented by Miraj Berry, Brian Cooper, Josh Nicholson, and Joe Karaganis

Introduction

The Charleston Library Conference hosted a virtual roundtable discussion titled "New AI and Data Innovations in the Classroom". The session brought together experts in the field of educational technology to discuss the application and usefulness of AI tools and databases in higher education settings. The panelists included:

• Miraj Berry: Director of Business Development at Overton.
• Brian Cooper: Associate Dean of Innovation and Learning at Florida International University (FIU) Libraries.
• Josh Nicholson: Founder and CEO of Scite.
• Joe Karaganis: Director of Open Syllabus.

The 30-minute session, followed by a 10-minute live Q&A, aimed to explore the use cases of three innovative tools—Overton, Scite, and Open Syllabus—and their impact on teaching, learning, and library services in higher education. The discussion focused on how these tools leverage AI and large data sets to enhance content discovery, support classroom instruction, and contribute to textbook affordability and collection development initiatives.

Overview of the Tools

Overton

Overton is the world's largest database of policy documents and grey literature. It indexes over 9.3 million policy documents from more than 1,800 sources across 32,000 organizations in 188 countries. The platform makes policy documents easily searchable and discoverable by indexing their full text and linking them to academic papers, relevant people, topics, and Sustainable Development Goals (SDGs).

Miraj explained that Overton's mission is to support evidence-based policymaking by providing a platform that allows users to explore the connections between policy documents and scholarly research. Overton helps surface content that might otherwise be difficult to find, putting existing content into perspective for researchers, students, and policymakers.

Open Syllabus

Open Syllabus is an open-source syllabus archive that collects and analyzes millions of syllabi from around the world. With a database of around 20 million syllabi, the platform uses AI and machine learning to extract structured information from these documents, such as course descriptions, reading lists, and learning outcomes.

Joe highlighted that Open Syllabus aims to make the intellectual backdrop of teaching more accessible. By aggregating syllabi at scale, the platform provides insights into what is being taught, how subjects are structured, and which materials are considered central or peripheral in various fields. This information can inform curricular design, collection development, and OER (Open Educational Resources) adoption initiatives.

Scite

Scite is an AI-powered platform designed to help users better understand and evaluate research articles. By leveraging machine learning, Scite processes millions of full-text PDFs to extract citation statements, providing context on how and why an article, researcher, journal, or university has been cited.

Josh explained that Scite addresses challenges related to information overload and trust in scholarly communication. The platform offers a "next-generation citation index" that brings more nuance and context to citations, enabling users to discover, trust, evaluate, and use research more effectively. Scite also integrates with large language models to provide fact-checking and grounding against the scientific literature.

Challenges and Opportunities in Adopting AI Tools

Critical Evaluation and Adoption

The panelists discussed the importance of critically evaluating AI tools before adopting them in educational settings. Josh emphasized that while large language models like ChatGPT offer powerful capabilities, they can also produce untrustworthy or fabricated information. Therefore, it's crucial to implement guardrails, such as providing citations and allowing users to verify sources.

Joe added that the barriers to textual analysis have significantly decreased due to advancements in AI and machine learning. This democratization means that specialized capabilities are now accessible to a broader audience, but it also raises questions about data aggregation, ethical considerations, and the responsible use of AI in education.

Supporting Staff and Students

Brian shared insights from the librarian's perspective, highlighting the challenges and initiatives at FIU in supporting textbook affordability and collection development. He noted that librarians play a neutral role in fostering AI literacy among students and faculty. By creating resources like LibGuides and engaging with faculty liaisons, libraries can help navigate the complexities of AI and digital tools.

The panelists agreed that it's essential to provide advice, training, and support for staff and student consumption of these tools. This includes understanding where these technologies might be useful, testing them, and finding possible ways to package them for educational purposes.

Feedback Channels and Collaboration

Effective adoption of AI tools requires collaboration among various stakeholders, including students, teachers, librarians, and technology vendors. The panelists discussed the importance of establishing feedback channels to gather input from users and to refine the tools based on real-world needs.

Josh mentioned that libraries have a critical role in guiding researchers and students through the suite of available tools, helping them understand the strengths and limitations of each. By being proactive and embracing these technologies, libraries can better support their communities in an era of rapid technological change.

Use Cases and Impact

Overton's Application in Policy Research

Miraj highlighted how Overton supports evidence-based policymaking by making grey literature and policy documents more accessible. Researchers and students can discover policy documents related to their field of study, explore citations between policy and academic literature, and gain a broader understanding of the policy landscape.

This accessibility enables users to incorporate policy perspectives into their research and teaching, fostering a more interdisciplinary approach to education.

Open Syllabus and Curriculum Development

Joe discussed how Open Syllabus aids in curriculum development and OER adoption. By analyzing syllabi at scale, the platform can identify commonly assigned materials, trends in subject matter, and gaps in available resources. This information can inform collection development decisions and help educators select materials that align with their instructional goals.

Brian shared that FIU is leveraging Open Syllabus to map out peer-reviewed OER materials aligned with classes nationwide. By correlating these with existing classes at FIU, faculty can be informed about OER options that their peers are using, promoting textbook affordability and enhancing student success.

Scite's Role in Research and Education

Josh explained that Scite helps address the challenges of information overload and the need for trustworthy sources. By providing context to citations and integrating with large language models, Scite allows users to fact-check information and understand the credibility of sources more effectively.

In educational settings, Scite can assist students in starting quality research papers by guiding them to relevant and reliable sources, thereby enhancing the research and learning process.

The Role of Libraries and Vendors

Libraries as Facilitators

Brian emphasized that libraries are in a unique position to bridge the gap between technology and users. By engaging in new and novel ways with their constituencies, libraries can support the adoption of AI tools, promote AI literacy, and contribute to student and faculty success.

He highlighted the potential for libraries to expand their involvement in areas like institutional effectiveness and accreditation by leveraging data and insights from tools like Open Syllabus and Scite.

Vendor Collaboration

The panelists agreed that collaboration between libraries and vendors is essential for maximizing the benefits of AI tools. Vendors can support libraries by providing data, integrating with existing systems, and offering solutions that address specific institutional needs.

Miraj mentioned Overton's commitment to being a responsible data provider, focusing on ethical considerations and user needs. Josh added that understanding how these tools can be used responsibly and developing training materials are critical steps in ensuring their effective adoption.

Conclusion

The roundtable discussion highlighted the transformative potential of AI and data innovations in the classroom and library services. By leveraging tools like Overton, Open Syllabus, and Scite, educational institutions can enhance teaching and learning experiences, support evidence-based research, promote textbook affordability, and foster AI literacy among students and faculty.

The panelists underscored the importance of critically evaluating these tools, providing support and training, and fostering collaboration among stakeholders. Libraries, in particular, have a pivotal role in guiding the adoption of AI technologies and ensuring they are used ethically and effectively.

As the landscape of educational technology continues to evolve, ongoing dialogue and partnerships will be crucial in addressing challenges and harnessing opportunities to improve education in the digital age.

Contact Information

• Overton: Visit overton.io or contact Miraj at miraj@overton.io.
• Open Syllabus: Learn more at opensyllabus.org.
• Scite: Explore Scite at scite.ai.
• Florida International University Libraries: Visit library.fiu.edu.