Skip to Main Content
Banner Image

ECE 100 Electrical and Computer Engineering Seminar

Potential Issues of Using Generative AI

Reliability

Large language models (LLMs) (like Chat GPT, natural language processing (NLP)  tools and chatbots are trained on a limited set of materials that does not include research behind paywalls. They generate answers that “sound good” and statistically match what human language sounds like. There is no guarantee that what they come up with is truthful or contains reliable answers.

Transparency

AI tools are fed a large amount of information, but they do not have access to research that is behind a paywall. They are not always able to find information that supports what they are saying and could invent research articles and citations that do not exist.

Bias

These tools are only as good as the information they are provided with. The information they are provided with is created by humans and contains all of the biases, cultural, social and otherwise, that humans have. 

Privacy

AI tools are not able to determine that some information should remain private (HIPAA). Additionally AI tools accept the input of private information from users who may not be aware of how the platform intends to use that information.

Equity

AI tools use the work of human authors without acknowledging or compensating them for their work. Many of the points of the current WGA and SAG/AFTRA strikes are about humans competing with AI in ways that are impossible as the AI works for no compensation.
AI tools’ information sources are dominated by english language resources and are biased toward that language and leave little room for indigenous and less common languages.
Powerful, quality AI tools often require payment and create a disparity between those who can afford access to the tools and those who cannot.

adapted from USF AI Tools and Reources

ChatGPT pitfalls

I posed a query to ChatGPT and the answer and question are below.

 

According to ChaptGPT Portland Public library is the biggest library in Maine, but that is incorrect. Fogler LIbrary at the University of Maine is the largest library in Maine. Portland Public Library's collection size is 238,815. According to the Fogler Library website:

The current collection includes approximately 3.1 million print and digital volumes, including government documents, as well as 1.1 million physical and digital media titles, including microforms, streaming video and music, maps, CDs, and DVDs. The library provides access to more than 155,000 online serials and over 300 online databases.

Evaluate AI generated text and media

Points to consider

  • Were the materials this tool was trained on biased? AI can’t discern biases.
  • Was there an intended audience? 
  • Why was this created? Entertainment, information, commercialization
  • Who is the publisher? A scholarly publication, website or an organization
  • Are accurate sources provided?

 

adapted from USF AI Tools and Reources

Other AI resources

ChatGPT the good the bad and the ugly

Chat is offline. Contact the library.