Musk’s xAI is Getting Better: Grok-1.5 Offers 16 Times Longer Short-Term Memory, Improved Reasoning

. It essentially enables the model to offer 16 times higher short-term memory and as a result, the ability to process substantially longer documents.

For those unfamiliar, in LLMs, tokens are the smallest units of data that can be processed. In the context of text, a token can be a word or a part of a word. Reportedly, the enhanced version of Grok can also deal with more complex prompts.Grok-1.5 now also performs better coding and math-related tasks. To give an idea, Musk’s AI startup has shared some benchmark results they have tested with the new model.

“In our tests, Grok-1.5 achieved a 50.6% score on the MATH benchmark and a 90% score on the GSM8K benchmark, two math benchmarks covering a wide range of grade school to high school competition problems.” xAI added “Additionally, it scored 74.1% on the HumanEval benchmark, which evaluates code generation and problem-solving abilities.”

Grok-1.5 is built on a custom distributed training framework based on JAX, Rust, and Kubernetes. A custom training coordinator ensures that problematic nodes are automatically detected and removed from the training job. In short, they have managed to optimize their training process.subscribers. Speaking of the availability of Grok-1.5, the platform notes that early testers and existing Grok users or X Premium+ subscribers will get the opportunity ‘soon’.

Gizmochina brings you the best of Chinese Tech from emerging smartphone companies, innovative startups, to crazy smart home products and revolutionary technologies.© 2024 Gizmochina | All rights reserved | If you buy something via one of our affiliate links, Gizmochina may earn a commission.

Malaysia Latest News, Malaysia Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

S'porean Man Allegedly Throws Banknotes at Thai Police Officer & Assaults Him After Getting Traffic FineA Singaporean national is facing up to 1-year imprisonment and up to THB20,000 (RM2,629) fine in Thailand after he allegedly assaulted a local police officer
Source: WORLDOFBUZZ - 🏆 19. / 53 Read more »

Thai Man Goes on Drug-Fueled Rampage Through Temple, Dies from Getting Impaled by Buddha StatueA Thai man's violent rampage through a temple ended up in tragedy after he was impaled by a Buddha statue after he tried to climb and deface it.
Source: WORLDOFBUZZ - 🏆 19. / 53 Read more »

Suria KLCC’s Pelita Replica Getting Hate On Social Media, Gets Labelled “Recycled Deco”Over the past few days, netizens have levelled criticism against Suria KLCC for their giant pelita decoration.
Source: therakyatpost - 🏆 14. / 59 Read more »

Why you keep getting Covid-19 but those around you don’tAnother person has emerged from the woodwork claiming to be an heir of the Sulu Sultan and is asking the Malaysian government to pay him billions.
Source: staronline - 🏆 4. / 75 Read more »

GST a far better taxation system than SST, says Dr WeeThey are hosts of travel reality series 'Girls' Spectacular Journey'.
Source: staronline - 🏆 4. / 75 Read more »

Govt sticking with existing instruments while reviewing GST for better streamliningIn the last recorded moments before the 13-year-old boy’s death, he was filmed by surveillance cameras sitting on a scooter, surrounded by three of his classmates. An hour later, his phone went dead, kicking off a frantic search by relatives.
Source: staronline - 🏆 4. / 75 Read more »