Be part of our each day and weekly newsletters for the most recent updates and unique content material on industry-leading AI protection. Be taught Extra
Elon Musk has been making headlines just lately for his political actions and rocket launches, however that hasn’t stopped the six-company proprietor/operator from transferring ahead with xAI, his synthetic intelligence startup.
As we speak, Musk introduced through his social community X (previously Twitter) that xAI now provides an utility programming interface (API) that third-party builders can now use to entry and construct functions and options powered by xAI’s Grok giant language fashions.
Musk posted a easy message on his X account, “The @xAI API is now stay!” round 12 pm ET on Monday, October 21, following up with a reply publish that included a hyperlink to the xAI API sign-on web page.
In response to xAI’s documentation, its API give builders entry to Grok-2 and Grok-2 mini, xAI’s newest multimodal language fashions, which additionally embody the potential to generate permissive pictures with Black Forest Labs’ Flux.1 diffusion mannequin.
Nevertheless, in my restricted check of it, I used to be solely in a position to entry a mannequin named “Grok-beta.” Notably, the complete API web site is labeled on the prime as a “public beta,” so presumably the xAI builders and engineers might be figuring out numerous bugs and including new options within the coming days.
Positioning and pricing
Releasing the xAI API is useful for xAI and Musk’s higher quest to go head-to-head in opposition to his former firm OpenAI (which he co-founded and left), which provides an API as properly.
The xAI API provides a web-based console for creating API keys, exploring endpoints, and integrating fashions into functions.
It helps REST, gRPC, and SDKs, and is appropriate with different AI providers equivalent to OpenAI, enabling clean integration with current techniques.
I signed up to take a look at the pricing and spent $25 on pay as you go credit to see if I may get entry to the fashions, however was solely in a position to entry “grok-beta” on the time of this text’s publication.
It supplies 131,072 tokens of context, and the API can deal with 1 request per second (RPS) and as much as 10 requests per minute (RPM).
For now, OpenAI’s pricing for its AI fashions is essentially cheaper than xAI’s, with GPT-4o costing builders $2.50 per 1 million enter tokens/$10 per 1 million output tokens, versus Grok’s $5 per million enter/$15 per output (although OpenAI’s new reasoning mannequin o1 is dearer than each at $15/$60).
• Textual content and Code Era: The Grok fashions can deal with duties like producing code, summarizing content material, and performing information extraction. This flexibility makes them worthwhile for a variety of use circumstances, together with software program growth and information evaluation.
• Imaginative and prescient: The fashions can analyze and generate pictures, increasing their use past text-based duties to multimedia and visible content material era.
• Operate Calling: The xAI API permits fashions to work together with exterior instruments, equivalent to APIs and databases. This permits real-world duties like reserving a flight, accessing IoT gadgets (e.g., unlocking a Tesla), or fetching stay information from web sites.
New dev options
Toby Pohlen, a founding member of xAI, shared extra particulars about constructing the brand new xAI API in a thread on the social community X immediately, writing, “Making a scalable API from scratch was a large effort. Listed below are a few of my favorite engineering highlights.”
As he defined, xAI’s API contains:
• Utilization Explorer: The xAI Console features a utilization explorer that tracks API consumption, much like what’s present in main cloud supplier platforms, giving builders insights into their useful resource utilization and prices.
• Simplified Crew Administration: Small companies can bind an e-mail area to their groups, making it simpler to handle customers and groups within the platform.
• Enhanced Safety: Customers can view all lively classes within the account app, and sign off of any unrecognized gadgets. As well as, each time the account is accessed from a brand new IP tackle, the person is notified by e-mail.
The platform additionally helps two-factor authentication through TouchID, safety keys (e.g., Yubikey), and authenticator apps.
Learn how to get began with xAI’s new API
To start utilizing the xAI API, builders should join through the xAI Console, onboard their groups, and configure billing.
Every crew is assigned its personal API keys and billing setup, making certain that enterprises can monitor prices and handle assets successfully.
As Pohlen highlighted, crew administration is streamlined for smaller firms by way of the flexibility to bind an e-mail area to their groups.
Whether or not devs flock to xAI’s API and undertake it alongside or rather than different compelling alternate options within the gen AI age equivalent to OpenAI, Anthropic, Google, Microsoft, and extra, stays to be seen. However at the least, now xAI is giving them the choice.