OpenAI unveils GPT-4 Turbo with API and vision capabilities in ChatGPT.

Open AI Announced major improvements in its latest. Artificial intelligence (AI) Model GPT-4 Turbo on Tuesday. The AI ​​model now comes with computer vision capabilities, allowing it to process and analyze multimedia input. It can answer questions about photos, videos, and more. The company also highlighted several AI tools that run with vision from the GPT-4 Turbo including AI coding assistant Devine and Healthify’s Snap feature. Last week, AI firm introduced A new feature that will allow users to edit images created by DALL-E 3 within ChatGPT.

The announcement was made via the official account of the OpenAI developers, who said in an X (formerly known as Twitter). Post, “GPT-4 Turbo with Vision is now generally available in the API. Vision applications can now also use JSON mode and function calling. Later also OpenAI’s X account revealed That this feature is now available in the API and is being rolled out in ChatGPT.

GPT-4 Turbo with Vision is basically. GPT-4 Foundation model with higher token output introduced with Turbo model, and it now comes with better computer vision for analyzing multimedia files. Sight abilities can be used in a variety of ways. For example, an end user can use this capability by uploading a photo of the Taj Mahal to ChatGPT, and asking it to specify what material the building is made of. Developers can take this a step further and fine-tune the capability in their tools for specific purposes.

OpenAI highlighted some of these use cases in a post. Devin of Cognition AI ChatbotWhich is AI powered coding. AssistantGPT-4 uses Turbo with Vision to visualize its sandbox environment for complex coding tasks and program creation.

Similarly, Indian calorie tracking and nutrition feedback platform Healthify has a feature called Snap where users can click on a food item or a photo of the food, and the platform displays the potential calories in it. With GPT-4 Turbo with vision capabilities, it now suggests what the user should do to burn extra calories or ways to reduce calories in food.

Notably, this AI model has a context of 1,28,000 tokens and its training data runs till December 2023.

---