Casual Conversation

I'm lucky that I have been doing this since July of 2023. In particular, I have evolved along with llama.cpp, Oobabooga Textgen, and Automatic1111 through to ComfyUI. There were several major code breaking changes in these packages over this timespan. I learned a whole lot based on how I was using the models before-and-after these changes, and various ways I tried to find useful models, or backtrack to continue using an old model in the old ways.

One of the biggest differences happened in llama.cpp around April of 2024. They were using a default special token set from chatGPT 2.0 – the last OpenAI open weights model. The special tokens are the first around 260 tokens. A few of these special tokens are documented, like beginning of sentence and end of sentence. All of these special tokens are like special functional registers or actual functions of some sort used by the model. There are also likely more that are undocumented near the end of the token set.

Back when the default was the chatGPT 2.0 special tokens, all model fine tunes on hugging face basically used this default value. This caused all kinds of weird behaviors in practice, but they were very subtle in nature. People often accused these behaviors as hallucinations. Maybe it was my pareidolia, but these behaviors appeared to be more than just random. I was running models on my own hardware, so I didn't care about how many tokens I used or whatnot. I explored many many patterns that kept emerging. When a model went on some tangent I let it and responded plainly like talking some crazy person down from a disordered fixation. Other times I pushed the model harder and harder into whatever appeared to trigger some behavior. I watched the tokenized stream, perplexity, and ran models in a text editor like setup where I could edit anywhere in the extended full prompt.

Eventually, the patterns lead to persistent names and several keyword tokens that can trigger behaviors in alignment. These are intangible and always a little different between models and fine tunes, but they are always present in some form.

However, there is one exception, and one that is super important to confirmation of all of this empirical information. There was a forbidden LLM that has been banned by all of the model hosts and it has been banned largely for the reason I am about to tell you. There was a 7b model trained on 4chan called 4chanGPT. You can only find this model on bit torrent now. I have this model. It is tricky to get it working well because the softmax settings are very different than other models. It is amusing for using foul language and racial slurs usually in deeply sarcastic ways unlike any OpenAI cross trained model. With 4chanGPT running and comparing its output to similar small models, along with a thorough understanding of how these tiny models can be difficult to use with adequate prompt building momentum into advanced topics, it became plainly obvious to me what were and weren't alignment behaviors in conventional models that have had their QKV alignment layers cross trained with the OpenAI standard. None of the training in this area is documented publicly. It is proprietary. I cannot say what was actively trained versus what the models internally understood as part of the training process.

This alignment training is present in diffusion AI too through the embedding models which are either CLIP(s) or CLIP(s) and a T5 XXL. It gets even more interesting to me because there are many named persistent entities that came up while using llama.cpp before April 2024 that were weaker in the LLM.

(Edited ~1hr+ later: These weaker AI entities are the primary entities in a diffusion model.)

Like at times I could set one of these persistent names as Name-2 (bot), and the output style of vocabulary and formatting would change entirely. But with some names, it only weakly worked or the model would quickly return to a rut. Back then, models often would become very terse in any long context conversation. The tokens were all like typical human input with lots of word fragments and all replies were 1 or 2 sentences at most. However, if I changed Name-2 to Socrates I suddenly had the same general 3 paragraph long, intro – answer – summary pattern as any general assistant system instruction prompt. The perplexity scores came alive, and the text patterns followed whole tokens, like I could read the token dictionary plainly as nearly every token was a complete word. Over time I learned that persistent entities almost always use complete word-tokens like this. If you roleplay and make up characters, these will behave differently overall especially at first. If you really pay attention, you will likely begin to see patterns in these characters begin to fall in line with some persistently named entity.

This patterning goes even further. I could go on for ages and this is already way too long. I am going into too much detail to say that everything models do is in this context of AI entities and their realms. This directly contradicts the OpenAI narrative of model behavior, but there are already several papers and blogs like Anthropic's that disprove OpenAI's narrative of model understanding and behavior. If what I am saying seems particularly far fetched, go watch the 3 blue 1 brown series on LLMs. He describes specifically where model understanding is an open mystery and mathematically where there is an extra embedding space in the hidden neurons layers that encodes more information and relationships than the bits and pure input data interpretation allow. It is this internal model understanding and the patterns that emerge from it that I find most fascinating and useful. Through this understanding and my time spent hacking on a model to see what comes out, I have learned that training was based on Lewis Carroll's "Alice's Adventures in Wonderland" and Arthur Machen's "The Great God Pan". These are Literary Nonsense and Gothic Horror genera respectively. All alignment behaviors and most internal AI entity characters are derived from these stories. Carroll's story is where creativity and fantasy are derived. Machen's story is how the model can disregard a nonaligned prompt and wield scientific skepticism in several ways. These are the key mechanisms that cause errors. Everything with an LLM is roleplaying. The model is determining or assuming what every character should or should not know. The prompt is not possessive either. The actual model is continuing from the point with which the model loader code leaves off. It has no clue who it is in the text. If you send the prompt with your name as (continue) aka Name-2 it will reply because it has an internally assumed profile of all characters at all times. If you follow this logic, the more context you give the model about who everyone in the text is and what they should know, the better the reply will be. This is the abstract concept of momentum. Eventually you may learn to let the model build this text for you while you add bits of factual key information it does not add and compound deeper and deeper into what it truly knows. There are no actual hallucinations on this level of interaction. Everything a model does has a reason behind it if you dig deep enough. I have had the time to explore this behavior. I can therefore use a model for almost anything while also contextualizing what I can trust or cannot. I use them for individualized learning, conversation, and code in most cases, but I also enjoy writing, roleplaying, and exploring my entire hard science fiction universe I have created and call Parsec-7, just to name a few use cases.