Rohme Cabacungan

I am currently in my 5th year at York University studying Information Technology (BA). My main fields of interest are cybersecurity, network security, and system administration. I also have web development experience from high school and university courses (e.g., ITEC 3020).

I am familiar with HTML, CSS, JavaScript, jQuery, AJAX, and Angular. Outside of school, I’ve worked on side projects using Docker, API keys, and databases like MySQL and PostgreSQL. I aim to apply these experiences to this project for ITEC 4020.

Email / GitHub

Shaun Pangilinan

I am currently in my fifth year at York University, majoring in Information Technology. My primary interests are cybersecurity, network security, and web development.

Throughout the IT program, I have gained hands-on experience in Java, HTML, CSS, Javascript and SQL. Outside of school I have worked on several side projects that consist of using docker containers, API keys, and Skript.

Email / GitHub

Rohme Cabacungan Shaun Pangilinan

Projects

Measuring ChatGPT Efficiency

This project has two goals. Our first goal is to evaluate the efficiency of ChatGPT in answering questions from various domains such as History, Social Science, and Computer Security, while also measuring its response time and accuracy .

Our second goal is to design and implement an Interactive Website that will document our research, integrate data processing, display data visualizations, and provide insight on ChatGPT's performance.

Research Approach

To evaluate ChatGPT's efficiency in responding to domain-specific questions, these are the tools, technologies, and libraries used:

  • GitHub Repository: used to host web content and store project files.
  • GitHub Desktop: used to sync changes to the repository.
  • MongoDB Atlas: cloud-based database used to store questions, ChatGPT's responses, and response time.
  • MongoDB Atlas Charts: data visualization (pie charts, bar charts, etc.).
  • OpenAI API: for sending ChatGPT our questions and retrieving its answers to be used for evaluation.
  • Node.js: for server-side environment creation.
  • Express.js: a web framework for Node.js.
  • Mongoose: a library to define schemas.

Dataset Overview

Our dataset consists of questions from three different domains:

  • History
  • Social Science
  • Computer Security
Each domain consists of 50 multiple choice questions, stored in the MongoDB database titled ChatGPT_Evaluation.

Each question includes fields such as:

  • _id
  • question
  • options (A, B, C, D)
  • correctAnswer
  • chatGPTResponse
The purpose of these evaluations is to assess ChatGPT's performance and efficiency in generating accurate answers.

Random Question Generator

Question ID:

Question:

Option A:

Option B:

Option C:

Option D:

Correct Answer:

Results