Just three months after launching tech-generating superstar ChatGPT, and just days after releasing a blog post about its “plans” for artificial general intelligence (AGI), OpenAI yesterday released its ChatGPT and Whisper APIs. issued. APIs make it easy to integrate ChatGPT into different applications.
According to the blog post, the APIs give developers “access to advanced language (not just chat!) and speech-to-text capabilities.” In addition, thanks to “system-wide optimizations,” OpenAI said it has achieved a 90% cost reduction for ChatGPT since December and is now passing those savings on to API users.
>> Follow VentureBeat’s ongoing Chat GPT coverage<<
Want to read news directly to your inbox?
Sign up for VB Daily.
Subscribe
Thousands of developers probably immediately scrapped their weekend plans to start construction.
“We’re diving into this as soon as possible,” said Nate Sanders, co-founder of qualitative data insights platform Artifact IO, which has already fully integrated GPT-3 into its platform. The pass has several features that take advantage of question-and-answer, summarizing, and inquiry techniques. We’ll experiment with how chained contexts and windowed tasks can increase the precision of the tasks we perform.
Pricing is the ‘biggest headline’
The ChatGPT API costs $0.002 per 1k tokens, which OpenAI says is 10x cheaper than existing GPT-3.5 models.
“From our perspective, pricing is the biggest headline,” said Max Shaw, SVP of Product, which offers digital experience software solutions. “Developers can now proactively explore use cases that were previously cost-prohibitive.”
The drop-in cost to run ChatGPT is “impressive,” Gartner analyst Rowan Kiran told VentureBeat via email — likely the result of “a combination of improvements in the infrastructure model and application software running itself.”
OpenAI offers a clear format and framework for building on top of APIs.
An exciting aspect of the announcement, Curran added, is the release of the Chat Markup Language, OpenAI’s format for developers to interact with the ChatGPT API.
“It gives developers working with OpenAI a very clear format and framework to build on top of these APIs,” he explained. “This model is a good first step in building best practices around prompts to enable greater security for applications using LLM [large language model] prompts and responses,” he points out. They will be doing more work to develop the markup language and thereby make the model more ‘steerable’ – so hopefully this will be a successful attempt to lay the foundation for a standard format for interacting with these models.
OpenAI offers opt-in for data sharing.
Another controversial aspect of the announcement is that data sharing is opt-in rather than opt-out.
“The default assumption is that companies keep the data sent to their APIs and do whatever they want, including improving their models,” said Mark Riddle, a professor at the Georgia Tech School of Interactive Computing and associate director of Georgia Tech Machine. can use.” educational institution. “AI researchers and companies need all the data they can get and that leaves readily available data on the table.”
But strategically, OpenAI needs companies to adopt its technology before competitors do. “Third-party companies that roll out services built on ChatGPT may be talking about proprietary stuff,” he said. For example, JP Morgan prohibits employees from using ChatGPT because they may discuss clients or investments. “They don’t want OpenAI to use it, sell it, or train it in future versions of the technology. This could give more companies the confidence to build on top of the technology,” he explained.
Shopify offers one of the first ChatGPT API use cases.
One company that already has a ChatGPT API is e-commerce platform Shopify. Yesterday, it announced an AI-powered search feature for its Shop app leveraging OpenAI’s ChatGPT API.
Shopify’s consumer shopping app has always been essential to solving the company’s biggest challenges for its more than 1.75 million merchants. Improving in-app search as part of the ChatGPT API beta was a key opportunity in its efforts, Moqdad Jafar, director of AI initiatives at Shopify, a product lead, told VentureBeat.
“It gave us an opportunity to look at chat as a way to search in a completely different way,” he said. “We didn’t want to waste any time, we wanted to get something out there as quickly as possible.”
The result is that Shop’s 100 million users now have an AI-powered personal shopper who can chat about everything from gift recommendations to style advice and home decor ideas. Users can tap the purple icon in the search bar at the top of the Home tab, and start chatting by asking a specific question or using one of the existing prompts.
However, there were some essential t.
Cala was an early user of the DALL-E API, now plans to tap the ChatGPT API.
Meanwhile, New York City-based Kala, a startup that bills itself as “the world’s first operating system for fashion,” showed an early use case for the DALL-E API in October. Now, the company says it is ready to implement the ChatGPT and Whisper APIs as well.
“I’ve recorded all my Zoom calls for the past four years, so I’m planning to replicate the Whisper API and then train through the chatGPT API,” said Kala cofounder Andrew White. “It will enable me to talk myself through difficult issues, create outlines for the deck, draft tweets, or blog posts with specific retrospective context for me and Kala.”
White added that he wouldn’t be surprised if help articles and FAQs disappear forever, replaced by some sort of chatbot. “I’ve thought about doing away with my landing page and using only text input to say ‘Welcome to Cala, how can we help?’ “Have thought about keeping it,” he said.
what will happen now?
Besides the ChatGPT API hackathons already planned for this weekend in San Francisco, one thing is certain, at least according to White. “Every Fortune 500 company board member is asking leadership about their AI strategy, so I’m sure we’ll see the ChatGPT API implemented across the board,” he said.
Of course, ChatGPT’s familiar challenges — especially its tendency to be deceptively confident — haven’t gone away. And while the Shop app is primarily about implementing the ChatGPT API on the search side, when it comes to prompts, “everything people are going to do can be hacked instantly,” Shopify said. said K Jaffer, who said users interact with the bot about party planning, for example.
“We’ve tried to put constraints on the search results that will come back, but bot is bot,” he said.
Meanwhile, the developers are doing a bit of work to get started.
“I’m excited to see where this goes and how the role of the developer will evolve,” said Hadi Chami, developer advocate and manager of LeadTools. “Low-code apps set the scene for urban developers and AI will help drive a whole new set of capabilities for customer service, coding and anticipated software updates.”