date
newest »

message 1:
by
Shelby
(new)
Apr 26, 2021 07:40AM

reply
|
flag

Basically, in the field of artificial intelligence people figured out that neural networks were the most likely to produce human-like intelligence, and it might be a matter of technology getting strong enough to handle billions of parameters, but they didn't know if adding more and more parameters would reach a plateau. With GPT-3 they proved that it doesn't. In fact they are already coming out with GPT-4, which is orders of magnitude more competent.
GPT-3 produces original human-like texts, something that had never been achieved before. And that isn't reduced to writing articles or fiction: it can even program websites based on you describing what you want as I'm writing right now.
There are many videos on GPT-3, which despite being mostly unknown yet, it will likely change many industries. A video with examples is the following: YouTube video. Personally I use the premium version of AI Dungeon, which in theory is used to generate roleplaying-like stories, but that can be gently coerced into helping you write regular stories.
If for whatever reason you want to read more of what I've done with it, there's this link to the short stories I've written so far (in the last few days, actually) helped by GPT-3, but in December of last year I started writing a 67 part fanfiction of a Japanese light novel series I was reading at the time, which might or might not be interesting to people who aren't into crazy fanfiction, that starts in this link (and that gets good around part four or five).

I've got AI Dungeon open on another tab right now. I'm excited to try it. I'm going to check out more of your GPT-3 stories too! I'm curious what the input used was to get the text about mom's big welcoming breasts though, lol. >_>

It's important to understand how GPT-3 works: AI Dungeon doesn't own GPT-3. It's a huge artificial brain that runs in some Microsoft supercomputers handled by a research company called OpenAI. Running this service costs quite a bit for the websites that offer it to the final user, which is why most require subscription services. AI Dungeon without the subscription runs the "Griffin" model, which uses GPT-2, which is significantly worse. The GPT-3 model is the "Dragon" one.
For every request, GPT-3 receives a summary and as much as 1500 words or so (around two pages) that came before the point in the text where you asked it to produce something. GPT-3 cannot know anything of the context of your story before those 1500 words and the summary you pass it, but additionally AI Dungeon has a system called "World Info" in which it also adds to that 1500 content a series of keywords and descriptions such as the following:
Keys: "I, me, myself"
Content: "I am a man.
I am twenty years old.
I work at a shoe shop.
I'm married to X person."
Whenever AI Dungeon detects any of those keywords in the text, it includes the related content.
As others have put it, writing a "serious" text with GPT-3 is a dance. AI Dungeon gives you the option to either tell GPT-3 that you are doing something, or that you are saying something, but I only use the "story" option, in which you add text that GPT-3 will take as canon. You aren't forced to use anything GPT-3 returns. You can alter any part of it, ask him to produce an alternative, or even just tell him to keep going and produce a result after another. It's a tremendous help in terms of creativity.
Using this story as an example, I started out with the concept of a guy who wakes up in a different body in the vicinity every time he goes to sleep. I wrote the opening, until 'I open the bedroom door carefully and scout the surroundings. A hallway leads to five other rooms. A second floor'. I asked GPT-3 to produce a result, and it said 'And I hear voices coming from downstairs, young ones.' (it likely added something else, but I deleted that part). I thought it sounded good for the story, so I decided that the protagonist having children was going to become part of the story. In the "World Info" I wrote something like "I have two teenage children". GPT-3 then has that in mind for the following results.
I usually "act" as the protagonist, in a roleplaying sort of way, and let GPT-3 act as the remaining characters. However, if from time to time I figure out good lines for the other characters, I put them in. GPT-3 also makes your character say lines, if it feels like it, and if they are good to whatever extent, I use that as well.
Regarding the part you mentioned:
I wrote this: 'Glenn avoids looking at me as he retrieves his backpack, which he had rested against the back of a nearby sofa. He gives me a short wave and attempts to turn to leave, but I rush over to him, force the kid to turn around and I embrace him tightly.'
GPT-3 wrote this: '"I'm sorry," I say, "I'm so sorry. I love you."
"I know, mom," he mutters.
He stands stiffly in my embrace for a moment before he returns the hug a bit.'
I wrote this: '"You feel your mommy's big, welcoming breasts pressing themselves against you?" I say softly in his ear. "Replicating that with a new girl who isn't related to you is your sole goal in life, my dear boy. As soon as possible, too. You don't want to go through the dreadful decades that await you regretting that you didn't have sex with some big breasted high schooler."'
GPT-3 wrote this: '"Ew, mom!" he says, then attempts to free himself.
"We have to leave, mom," Carla reminds me.'
Saying weird things to GPT-3 is very entertaining, as it often produces interesting and surprising results.
Frankly, you came across AI Dungeon at the worst possible time. As recently as yesterday they tried on a fraction of their users a censorship model with the excuse of preventing people writing sexual content with minors even in their unpublished stories. As a result, even stuff like a father saying 'I love you' to his son, or seemingly unrelated stuff like a character attempting to get on a horse, are getting no response from GPT-3 for some users. The community is enraged at the moment, and I don't know what's going to come out of this.


This is extremely interesting and I understand now your excitement for creating stories with it. I'm not a highly creative person, but I could easily see myself using this tool as a platform to practice my creativity with. The possibilities seem endless with GPT-3.
Thanks for posting examples of how you program GPT-3's behavior. That part is of particular interest to me, especially because I suck creatively. Maybe I can siphon some ideas from it.
I'm sure Shūzō Oshimi would find this new censorship model distasteful, as are most censorship models.

Yes, any censorship model would have blocked Oshimi's stories for sure, all of them that I can think of (and he's my favorite current mangaka at the moment), but also most of Inio Asano's. I don't understand any of it myself. I recall back when I tried to send my work in Spanish for contests and such, the small print of some of them included "we won't consider stories that feature violence or harmful content". In the end all of it it's about imposing someone's arbitrary morality on other people's works. The issue with what is currently happening in AI Dungeon is that they were also censoring some people's unpublished stories which obviously weren't supposed to be seen by others. The community is in a turmoil about all this crap. The company claimed that they were trying to protect some people from getting hurt, and then some of those people complained that the company behind AI Dungeon was censoring their private stories about trying to process such harm having been done to them. It's a mess.