An Acronym That Says It All

Richard Lee on January 4, 2024

The Right Click – January 2024 Edition

by Richard Lee

Generative, pre-trained, transformers are the words behind GPT, as in ChatGPT. Let’s break down each one, including what the word “chat” means.

Starting with the word “chat,” ChatGPT is designed to support interactive conversations and is done in ways that chat systems or chatbots have permitted, whereby you type inside of a field what you want to say or ask and, in a vertical flow, you see the response and previous inputs and outputs. As an interactive conversation, it means that unlike your searches with Google, you do not need to continuously repeat the main gist of your search. If you’re interested in geoglyphs and you initially ask, “What is a geoglyph?”, your continued queries on the same topic do not need to include “geoglyph,” as ChatGPT has a memory of what the topic is, and, like a conversation with a person, you can continue to converse around a topic without being redundant.

As for the term generative, it means that it is designed to generate text as the answer. This means that the resulting answer to a question like “What is a geoglyph?” doesn’t yield pages from the web like a Google Search does; it instead generates the answer for you. If you were to copy any of that generated text and search the web for it, you wouldn’t find anything because that text was generated and therefore original. This is where an evolving legal battle continues over who can copyright the content produced by an AI tool that lacks human authorship yet was directed by a human to generate content.

Pre-trained means that ChatGPT was trained using real-world information as the foundation of its intelligence. Not only the knowledge of “What is a geoglyph?” but also a broad understanding of language, context, and how to understand and speak human language. The amount of training data used in size, like gigabytes or terabytes, has never been released by OpenAI, but from what I have read, it did not exceed hundreds of terabytes (a terabyte is one thousand gigabytes) and not hundreds of yottabytes. There’s controversy within this as training data. Recently, the New York Times sued both OpenAI and Microsoft, the most significant investor behind OpenAI, for unlawful use of its work. Prior to that lawsuit, there was news about various authors, including the comedian Sarah Silverman, suing OpenAI for the same reason. Even though the content that ChatGPT creates has been generated, it was sourced from web-based information which did not appear on the web automatically and was generated by a human author.

The transformer is what weighs the importance of each word in your query or prompt in order to understand the context and relationships between words in a sentence. Whether your prompt is in broken English or any other language, the transformer understands intent. This is a significant difference over Google Search, which was all about keywords, and is also why the results with Google versus ChatGPT are significant. With Google, you have to do a lot of parsing of the results before you click to determine which will be the best use of your time. Whereas with ChatGPT, your terrific answer is right in front of you if you asked using a succinct prompt. The transformer architecture offers powerful language processing and is also the cornerstone in the advancement of AI-driven natural language understanding and generation.

Prompting for Better Thinking and Communication

Richard Lee on July 19, 2023

The emergence of generative AI tools like ChatGPT and MidJourney has brought about the study of prompt engineering, enabling natural language input to generate original content. Prompt engineering focuses on effectively formulating prompts or instructions to elicit desired responses. However, this practice goes beyond interacting with generative AI models; it can enhance your thinking process regardless of the technology used.

Understanding the role of generative AI as a tool for humanity rather than human replacement is crucial. Not only can you learn from the expertise within ChatGPT, but the process of prompt engineering itself can improve your mind.

Effective communication, whether with ChatGPT or with another person, has the potential to enhance one’s thinking in multiple ways. It fosters clarity of thought and the ability to articulate ideas effectively. By refining the communication process, individuals can become more precise and organized in their thinking, leading to improved cognitive skills. Both humans and generative AI tools operate on the basis of a question-and-response dynamic, where each subsequent input builds upon the previous response.

Prior to the advent of generative AI, reading was a valuable means of improving one’s ability to ask insightful questions and engage in deeper conversations. Through extensive reading on diverse topics, individuals expose themselves to different perspectives, ideas, and information. This broadens their knowledge base and enhances their understanding of various subjects.

Reading offers multiple benefits for question-asking. It familiarizes individuals with the language and terminology associated with specific topics, enabling them to frame relevant and precise questions more easily. Additionally, reading exposes individuals to different styles of communication and critical thinking, inspiring them to ask thought-provoking questions that challenge assumptions and delve deeper into the subject matter.

Reading exposes individuals to different viewpoints and encourages critical thinking, enabling them to approach conversations with an open mind and ask insightful questions that lead to richer discussions. Active listening, curiosity, open-mindedness, empathy, research, and reflective thinking are also key practices that deepen one’s ability to ask meaningful questions and improve as a conversationalist during human interactions.

Constructing a string of words for a human differs from communicating with ChatGPT in several aspects. While both involve conveying information, humans possess contextual understanding, emotional intelligence, and the ability to interpret non-verbal cues, all of which significantly influence the way information is conveyed and received. ChatGPT, on the other hand, relies solely on textual inputs and lacks human-like understanding of the world, emotions, or common sense. Therefore, tailoring the communication approach to each entity requires adapting to their unique capabilities and limitations.

Remember, prompt engineering and effective communication are skills that can be developed and refined, contributing to better thinking and more meaningful interactions, whether with generative AI models or fellow humans.