Mini Episode - GPT4 was just released, here's what you need to know
How to use it, how much it costs etc. I read all the release notes and help docs how about GPT4 so you don't have to.
I usually send out only one deep-dive AI topic a week. But when the next major model comes out, it warrants an extra episode. This email is short and sweet. Let’s learn about GPT4.
GPT4 was just released, and will probably dominate the next couple days of news.
There will be a ton of great articles and examples comparing it to GPT3, opinions about how it changes things, new issues, impact on the industry etc.
I decided to just focus on the nitty-gritty details, how can we use GPT4, get access to GPT4, what is the cost etc.
GPT4 Main Takeaways:
You can use GPT4 today, if you subscribe to ChatGPT Plus ($20 a month).
Under Model, you can select GPT-4 to try it out.
You can use 100 messages on the GPT-4 model every 4 hours. After that, you have to wait for your quota to reset.
API access is not yet public
You can get on the API waitlist here.
GPT4 can take in, and generate up to 25,000 words
About 8x more than ChatGPT.
GPT4 understands text and pictures.
Meaning it can understand images and express ideas about them.
GPT4 training finished in August 2022. They have been putting in guardrails since then.
In internal evaluations, GPT-4 is 82% less likely to respond to requests for disallowed content
40% more likely to produce accurate, factual responses than GPT-3.5.
Price for 8k token (how about 6000 words) model is:
$0.03/1k prompt tokens
$0.06/1k sampled tokens
Price for 32k token (24,000 words) model is:
$0.06/1k prompt tokens
$0.12/1k sampled tokens
Open AI does not currently offer fine-tuning using GPT-4.
GPT-4 still has many known limitations
Open AI acknowledges that social biases, hallucinations, and adversarial prompts are all still a problem.
Takeaways
A lot of rumors about GPT4 were way off.
Very powerful model, but isn’t going to change the world overnight.
I would sign up for API access today, (even if you don’t know what you want to build).
Exciting time to be alive.
Thanks for reading, see you on Friday!
-Josh
Links
API Waitlist - https://openai.com/waitlist/gpt-4-api
Main site - https://openai.com/research/gpt-4
More details - https://openai.com/product/gpt-4