News

OpenAI Unveils GPT-4 Turbo with 128K Context Window

December 1, 2023 2 min read

OpenAI’s GPT-4 Turbo continues to reshape the AI landscape following its November announcement, with developers rapidly adopting the new model’s expanded capabilities and significantly reduced costs.

Massive Context Window Expansion

The standout feature of GPT-4 Turbo is its 128,000 token context window, equivalent to approximately 300 pages of text. This represents a dramatic increase from the original GPT-4’s 8,000 and 32,000 token limits, enabling entirely new use cases:

  • Analyzing entire codebases at once
  • Processing lengthy legal documents
  • Summarizing full books or research papers
  • Maintaining much longer conversational contexts

Significant Price Reductions

OpenAI has made GPT-4 Turbo substantially more affordable:

ModelInput (per 1K tokens)Output (per 1K tokens)
GPT-4 Turbo$0.01$0.03
GPT-4 (8K)$0.03$0.06
GPT-4 (32K)$0.06$0.12

This represents a 3x reduction in input costs and 2x reduction in output costs compared to the original GPT-4.

Updated Knowledge Cutoff

GPT-4 Turbo’s training data extends to April 2023, a significant improvement over GPT-4’s September 2021 cutoff. This means the model has knowledge of more recent events, technologies, and developments.

New Capabilities

The model introduces several powerful new features:

JSON Mode

Developers can now guarantee valid JSON output, eliminating parsing errors and simplifying API integrations.

Reproducible Outputs

A new seed parameter allows developers to get consistent outputs, making debugging and testing significantly easier.

Function Calling Improvements

Multiple functions can now be called in a single message, and the model follows function schemas more accurately.

Vision Integration

GPT-4 Turbo with Vision combines text and image understanding in a single model, though currently in preview.

Developer Adoption

The response from the developer community has been overwhelmingly positive. Companies are already leveraging the expanded context window for:

  • Customer service bots with full conversation history
  • Document analysis applications
  • Code review and generation tools
  • Research assistants

Looking Ahead

OpenAI has indicated that GPT-4 Turbo will continue to receive updates, with the company committed to improving both capabilities and reliability. The model represents OpenAI’s effort to make powerful AI more accessible and affordable for developers building the next generation of AI applications.