The paragraph above makes literally no sense in the context of the story. The algorithm struggles to stay on track. In fact, the AI doesn’t seem to know how to write a cohesive story, it only knows how to imitate human writing. This appears to be a clear limitation in the AI, which only becomes more apparent as the story goes on.
Finally, nice said about GPT-x stuff. x >= 2.
The are just statistically averaged human writers that generated a "lot" of text in one step, with preserved context. All the rest is: take the last several words/sentences and make the next step. Can't miss to lose the initially assigned context.