L.M. Whitaker's Blog
August 19, 2025
Catch me at Killer Nashville
Rinse and Repeat: The Rehab Racket
July 16, 2025
Spy Thriller Karla's Choice with retired CIA officer Carmen Amato
Review of Spy Thriller Karla's Choice with retired CIA officer Carmen Amato
May 17, 2025
Reviewing Kevin Bohacz's Immortality
May 11, 2025
Welcome to From Fact To Fiction
April 10, 2025
Reviewing Douglas Preston's Extinction
January 17, 2024
ChatGPT Basics - The Language of Numbers
In this Blog Post, I'll try to give you an idea of how ChatGPT works. In later posts we can talk about implications and ethics.
What is ChatGPT? It is an Artificial Intelligence (AI) application "specifically designed to generate human-like text responses." (so says ChatGPT). ChatGPT 4 is the latest released version, 3.5 is the latest free version.
Have you tried ChatGPT? If not, it has a very simple User Interface. You enter a question, or a phrase, or several pages of text, and it responds.
In this example, ChatGPT responded with -
"The best thing about AI is its ability to perform tasks and solve problems that would be challenging or impossible for humans to do quickly or accurately. AI can analyze vast amounts of data, make predictions, automate repetitive tasks, and even learn from new information to continuously improve its performance."
Pretty incredible, right? How does it do it? Let's find out.
Caveats - We'll be simplifying a lot. All you AI experts - if I have missed a big point or oversimplified too much, please tell me! ,,linda@lmwhitaker.com.
*Most examples are taken from this great article by ,,Stephen Wolfram, an icon of data science. It's a fantastic article. If you have some background in AI/Math/Computer Science I highly recommend it.
What is Artificial Intelligence?
I found the definitions of AI (and related concepts) are changing and not always consistent. Here's how current definitions seems to be coaslescing:
AI - AI is a broad concept of machines/systems doing smart things. It includes many applications like physical robots, chatbots, self-driving cars, text to speech, speech to text, and text and image comprehension and generation.
ML – Machine Learning is now being defined as the underlying Models/Algorithms used in AI that can learn over time. These are predominantly Complex Neural Networks (ie - Deep Learning Networks).
GPT - (Generative Pre-Trained Transformers) is the type of neural networks used by ChatGPT.
The Math behind the Machine
We'll talk about the Machine Learning aspects, focusing on the most basic concepts of how GPT-3 works. (Source code for later versions is not available.)
There are 4 steps that happen when you use GPT for text generation. I'll try to give you an idea of each.
1 - Transform inputs (words, questions, websites, articles, etc) into a set of numbers
2 – Feed numbers (representing words and phrases) through Deep Learning models
3 – Output predictions for the next word
4 – Add selected word to phrase and repeat
1 - Transform words into numbers (called embeddings).
This clever mechanism is best described with an example. Here words are transformed into two dimensions. (Think of cities using lat/long identifiers). This allows calculation of distances between words, just as you would calculate distances between cities on a map. So we can see that "cat" and "dog" are much closer than "cat" and "turnip".
GPT does this, but with 12,000 dimensions, which allows for a lot of nuance and sophistication, but no possible way for humans to understand it.
(Ok, so really GPT uses tokens - small words like cat, or pieces of long words, face + book = Facebook...let's ignore that for now.)
2 - Feed words (as numbers) into Deep learning models. (What the heck does that mean?)
You can think of Neural Network Models as a series of fairly simple mathematical calculations, where the calculations are linked together (the output of one or more = input to the next).
We represent them as a diagram like this, where the circles (nodes) show where calculations take place, and the arrows (edges) show which calculations are connected (and how strongly). The final output is the answer.
These models "learn" to minimize error by referencing a "training" dataset. GPT 3 used 570 GB of Training Data- mostly Web Sites, Books, Articles. The final model is then really just a series of optimized numerical equations and data transformations (with many thousands of equations and billions of parameters). Once this dataset is used, it is discarded, and only the equations remain.
3 - Output predictions for the next word. For Example - Type into ChatGPT the following phrase:
“The best thing about AI is its ability to...”
Try it! I did it 3 times (in three different sessions) and got 3 different next words.
“The best thing about AI is its ability to...perform
“The best thing about AI is its ability to...learn
“The best thing about AI is its ability to...efficiently
Why different words? The model outputs all possible words (using a reverse sort of embedding to go from numbers to words), along with a probability that the next word is "correct." That comes from similar references it found in the 570GB of training data. The model selects the next word based upon these probabilities - in our example here are the top selections- so it does not always pick the top one. But you also probably won't get a totally wrong word, like "whale" or "puke."
These probabilities mean you will likely never get the same exact answer twice.
4 - Add selected word to phrase and repeat.
ChatGPT outputs not just one word, but phrases, outlines, lists, and entire pages of text. But here's the thing, it does it ONE word (token) at a time. For the below example, the model runs its calculations four times, to output three words, plus one period.
The best thing about AI is its ability to...
The best thing about AI is its ability to learn
The best thing about AI is its ability to learn over
The best thing about AI is its ability to learn over time
The best thing about AI is its ability to learn over time,.,
Here is one actual output from ChatGPT:
The best thing about AI is its ability to ... perform tasks and solve problems that would be challenging or impossible for humans to do quickly or accurately. AI can analyze vast amounts of data, make predictions, automate repetitive tasks, and even learn from new information to continuously improve its performance.
Each word the result of many thousands if not millions of calculations. Let that sink in a moment.
Take-a-ways:
1 - GPT Makes up Answers. You may hear people worry about GPT making up answers. You've just seen that GPT does not use actual words or articles when it answers your questions. It uses equations and probabilities. So ALL answers are made up.
2 - GPT Answers can be Biased. ChatGPT outputs are proportional to their input. So it can be hard to get new answers that break old patterns. This is why there are so many examples of failed AI programs. (Example - Amazon's secret AI recruiting tool actively discriminated against women, exactly what they didn't want.)
3 - No one knows how this works. Humans defined the configuration of the system (the number and placement of nodes and types of transformations), and the system determines the parameters values (the learning). Aside from the staggering number of calculations, The human created configuration is just trial and error; it's not based upon theory or rigorous mathematics. Things that work are expanded upon year over year, with the models growing incrementally better (and often larger). But no one knows why.
That's it!
I hope you enjoyed this intro to the numbers behind the words of ChatGPT. While it might feel scary that a black box can mimic human thinking so well, I think a lot of computational linguistics researchers must be very excited right now about the implications into human thought, since neural networks are indeed modeled after our brains.
What do you think? Drop me your thoughts via email (linda@lmwhitaker,com) or ,,Facebook ,.
June 30, 2023
Ride a Wagon Train to the Stars with ChatGPT.
My friend David sent me this interaction he had with ChatGPT. With his permission, I am posting to evoke emotion, thought, and conversation.
The rest of the post is in David's and ChatGPT's own words. edited for length.
I (David) asked ChatGPT to Write a science fiction story about a wagon train to the stars.” IIRC, Wagon Train to the Stars was Gene Roddenberry’s working title and concept back in the 1960’s for what became Star Trek. Anyway, this was the result:
As the sun began to set on Earth, a group of intrepid explorers gathered around a massive, sleek spaceship. The ship towered over them, an awe-inspiring sight that filled them with a sense of excitement and trepidation. This wagon train to the stars was embarking on a journey that would take them far beyond anything humanity had ever known.
The team of explorers, all carefully selected for their unique skills, expertise, and experience, climbed aboard the spaceship. As the engines hummed to life and the vessel began to rise, they took one last look at the familiar world below them before it vanished from view. Their adventure had begun.
The first few weeks were exhilarating, as the wagon train traveled deeper and deeper into the unknown reaches of space. They encountered strange new worlds and bizarre, never-before-seen life forms. Every day was a new adventure, as they charted a course through the uncharted void.
As the weeks turned into months, however, things became more challenging. The explorers were pushed to their limits, struggling to adapt to the harsh realities of space travel. They battled malfunctioning equipment, battled the loneliness and isolation of being cut off from the rest of humanity, and battled with each other as tensions mounted.
But they persevered. With each passing day, they grew stronger, more resilient, and more determined to succeed. They formed a tight-knit community, a wagon train to the stars that worked together to overcome every obstacle that stood in their way.
And then, finally, they arrived at their destination. The planet they had been searching for, a world that held the promise of a new life for humanity. They landed the spaceship, and as they stepped out onto the alien soil, they knew that they had accomplished something incredible. They had taken a wagon train to the stars and reached the end of their journey.
But as they looked up at the vast expanse of the cosmos, they knew that their journey was far from over. They had only scratched the surface of what lay beyond, and there were countless other worlds waiting to be explored. And so they set out once more, a wagon train to the stars, ready to discover what lay beyond the horizon.
That’s promising, but not really a full story, so I wrote, “Add more details and make it much longer.”
As the wagon train to the stars made its way deeper into space, the explorers faced challenges they had never anticipated. They had prepared for the physical hardships of space travel, but the psychological impact was something else entirely. They spent months in isolation, cut off from the rest of humanity, and it began to take a toll on them.
But they persevered. They found ways to stay occupied, to stay connected to one another, and to keep their spirits up. They held daily meetings to discuss their progress and plans, and they took turns cooking meals and hosting movie nights. They even created a small garden aboard the ship, growing vegetables under artificial lights.
As they traveled through the stars, they encountered all manner of strange and wondrous sights. They discovered new planets, each with their unique ecosystems, and strange life forms that they had never seen before. They collected samples and data, taking notes and photographs to bring back to Earth.
One planet they landed on had towering cliffs that stretched towards the sky. The air was thick with a green mist, and strange creatures with tentacles roamed the surface. The explorers had to wear special suits to breathe, but they reveled in the opportunity to explore a world that was so vastly different from their own.
Another planet was covered in a vast, sprawling forest. The trees towered over them, and the underbrush was thick and tangled. They saw animals with fur that changed color to blend in with their surroundings and birds that sang haunting melodies. The explorers had to cut their way through the dense foliage, but the beauty of the world made it all worthwhile.
As they traveled further into the cosmos, the wagon train began to experience technical difficulties. The engines started to sputter, and the life-support systems faltered. They had to make repairs on the fly, cobbling together solutions from whatever materials they had on hand. They spent days working tirelessly, but they managed to fix everything.
The wagon train to the stars reached their destination, a planet that scientists believed could support human life. It was a lush, verdant world with rolling hills, a massive ocean, and forests teeming with wildlife. They landed the ship and set up a base camp, eager to begin exploring their new home.
Over the years that followed, the explorers built a colony, planting crops and raising livestock. They constructed homes and established a community, thriving in this new world. They continued to explore, pushing further into the unknown, and every discovery they made brought them closer to understanding the vastness of the universe.
The wagon train to the stars became a symbol of humanity's indomitable spirit, a testament to the boundless potential of the human race. They had taken the first steps towards a future where humans could travel to the far reaches of the cosmos, exploring new worlds and learning from their experiences. And they had done it together, as a community, working towards a common goal.
As the explorers looked up at the night sky, they knew that there were countless more worlds waiting to be explored. The universe was vast and unknowable, but they were ready to face whatever challenges lay ahead. The wagon train to the stars was just the beginning.
Hmm. Still not there, so I instructed, “Add characters and tell the story from the first officer's point of view.”
As the first officer of the wagon train to the stars, my job was to keep everyone on track, both literally and figuratively. I had been selected for the mission because of my expertise in navigation, but as time went on, I found myself becoming much more than just a pilot.
Our team of explorers was a diverse bunch, each bringing unique skills and perspectives to the table. There was Dr. Jameson, the resident biologist who was fascinated by the new life forms we encountered on our journey. Then there was Jackson, the engineer who kept our ship running, even when everything seemed to be falling apart. And of course, there was Captain Lin, the fearless leader who had brought us all together and inspired us to push past our limits.
We spent months in the cramped confines of our spaceship, navigating the vast expanse of space. At first, the journey was exhilarating. We were charting new territory, seeing sights that no human had ever seen before. But as time went on, the isolation started to take a toll on us. We were cut off from the rest of humanity, alone in the void of space.
It was my job to keep morale up, to make sure that everyone stayed focused on the mission. I organized daily meetings, where we would discuss our progress and plans. We took turns cooking meals and hosting movie nights, trying to maintain some sense of normalcy in this strange environment.
As we traveled further into the cosmos, we encountered all manner of strange and wondrous sights. One planet was covered in a thick layer of ice, with towering glaciers and icy seas. We had to wear special suits to keep warm, but the beauty of the world was worth it. Another planet was a barren wasteland, with scorching temperatures and howling winds. We had to take shelter in our ship for days at a time, waiting out the worst of the storms.
But the most challenging part of the journey was the technical difficulties we faced. The ship's engines started to sputter, and our life-support systems began to falter. We had to make repairs on the fly, using whatever materials we had on hand. It was a team effort, and we all worked tirelessly to keep our ship running.
Finally, we arrived at our destination, a planet that scientists believed could support human life. We landed the ship and set up a base camp, eager to begin exploring this new world. We found rolling hills, a massive ocean, and forests teeming with wildlife. We even discovered a tribe of aliens who were friendly and curious, and we began to learn from them.
Over the years that followed, we built a colony, planting crops and raising livestock. We constructed homes and established a community, thriving in this new world. As the years passed, we grew old and passed on, but the colony continued to flourish. And as we looked up at the night sky, we knew that the wagon train to the stars had paved the way for generations to come.
The journey had been a challenging one, but we had faced it together, as a team. And as the first officer of that team, I knew that I had been a part of something truly extraordinary.
And the AI knows its limitations: I then asked, “Can you make it a full novel?”
Yes, I can certainly expand this story into a full novel! However, as an AI language model, I don't have the ability to create a full novel on my own. I can provide the framework and some ideas for the story, but it would require a human author to flesh out the details, characters, plot, and other elements needed to make a full novel.
But I tried to push anyway with, “Please expand it into a full novel.”
Certainly! I will provide a basic outline for a potential novel based on the wagon train to the stars story.
Title: The Wagon Train to the Stars
Overview: The novel follows the journey of a crew of explorers as they embark on a mission to discover new planets and ultimately find a new home for humanity. Along the way, they encounter a variety of challenges and make discoveries that force them to confront the limits of human knowledge and the fragility of their existence in the vastness of space.
Chapter 1: Departure
The novel begins with the crew of the wagon train to the stars preparing for their journey. We meet the main characters, including the first officer, Dr. Jameson, Jackson, and Captain Lin. The crew is a diverse group of individuals from different backgrounds, brought together by a shared sense of purpose and adventure.
Chapter 2: The First Planet
The crew lands on their first planet and discovers a strange alien civilization. They encounter a variety of challenges, including communication difficulties and differences in cultural norms. Dr. Jameson takes the lead in studying the alien life forms, and her discoveries challenge the crew's preconceptions about the nature of life and intelligence.
Chapter 3: The First Conflict
As the crew continues their journey, tensions begin to rise between Jackson and other crew members. He pushes the crew to work harder and faster, and his methods become increasingly abrasive. The crew begins to question whether Jackson's leadership style is sustainable in the long term.
Chapter 4: The Crisis
The crew faces a crisis when their ship is damaged by a meteorite. They must work together to make repairs and keep the ship stable. The crew is pushed to their limits as they face the fragility of their existence in the vastness of space.
Chapter 5: The Second Planet
The crew lands on a second planet and discovers a lush, verdant world that seems perfect for human habitation. However, they soon discover that the planet is already inhabited by a highly intelligent alien species. The crew must navigate the complexities of diplomacy and negotiation as they try to establish a relationship with the alien civilization.
Chapter 6: The Second Conflict
Tensions between Jackson and other crew members come to a head as the crew faces new challenges on the second planet. The crew must confront the limits of human knowledge and the danger of assuming that their way of life is the only valid one.
Chapter 7: The Home Stretch
As the crew prepares to leave the second planet, they receive a message from Earth indicating that a new crisis has emerged. They must decide whether to continue their mission or return to Earth to help their fellow humans.
Chapter 8: The New Home
The crew arrives at their destination, a planet that can support human life. They work together to build a new colony and establish a thriving community. However, they soon discover that the planet is not without its own dangers and challenges.
Chapter 9: The Final Conflict
As the colony grows and prospers, tensions once again rise between Jackson and other crew members. The crew must navigate new challenges and confront the reality that their journey has changed them in ways they never anticipated.
Chapter 10: The Legacy
The novel concludes with a reflection on the legacy of the wagon train to the stars. The crew members are remembered as heroes and pioneers who paved the way for humanity to explore the stars. The first officer, who has been our guide throughout the journey, reflects on the lessons he has learned and the people he has met along the way. The novel ends with a sense of wonder and possibility, as we imagine the many adventures and discoveries that lie ahead for humanity.
This is just a basic outline, and a full novel would require much more development in terms of plot, characters, themes, and other elements
Maybe I should ask it to write a horror story about human authors all being replaced by AI engines!
David
May 13, 2023
Georgia's Playlist
A few weeks ago, I confessed to my writing group that I had lost Georgia's voice. It can be hard, not just to maintain your characters over several books, but also keep up with how they change from book to book.
Georgia has faced a lot of adversity, and become, well, more of a badass. And I was writing her too timidly.
So my best writing pals showed me what they do to get into their characters heads and worlds, from Pinterest Boards to Playlists.
They even started Georgia's list with LCD Soundsystem. Georgia and I added the rest. I give you, Georgia's Playlist. Enjoy.
