A handheld Sega Mega Drive, known as the Mega 95 and which plays original carts, has been announced by accessory maker Hyperkin.
ChatGPT-style AI system coming to Apple iPhones, iPads? Report hints AppleGPT in-the-works
22.12.2023 - 15:07 / tech.hindustantimes.com / Ai
Artificial intelligence (AI) has been the buzzword of 2023, and companies are making efforts to incorporate this technology into their suite of products. Earlier this year, it was reported that Apple had developed an internal service similar to ChatGPT, which helps employees test new features, summarize text, and answer questions based on the data it has learned. Mark Gurman in July claimed that Apple was working on its own AI model. The heart of this large language model (LLM) work is a fresh framework called Ajax. The ChatGPT-like app, nicknamed "Apple GPT," is just one of the many possibilities that the Ajax framework can offer. Now, a research paper filed by Apple hints at Large Language Models (LLMs) possibly running on Apple devices including iPhone and iPad!
The research paper (first spotted by VentureBeat) is titled “LLM in a flash: Efficient Large Language Model Inference with Limited Memory”. It tackles the key challenge that is running on-device LLMs, especially for devices with limited DRAM capacity. For the unaware, LLMs contain billions of parameters. Thus, making them run on devices with restricted DRAM poses a challenge. To solve this problem, the paper suggests that LLMs can be run on-device by storing the model parameters on flash memory but bringing them on demand to DRAM.
Keivan Alizadeh, a Machine Learning Engineer at Apple and lead author of the paper said, “Our method involves constructing an inference cost model that harmonizes with the flash memory behavior, guiding us to optimize in two critical areas: reducing the volume of data transferred from flash and reading data in larger, more contiguous chunks.”
The team used two principle techniques - “Windowing, and row-column bundling. Windowing reuses previously activated neurons to reduce the data transfer, while row-column bundling increases the size of data chunks read from flash memory. Both of these techniques have led to a 4-5x increase in the Apple M1 Max SoC.
In theory, this context-adaptive loading could pave the way for running LLMs on devices with limited memory such as iPhones and iPads.
The website gametalkz.com is an aggregator of news from open sources. The source is indicated at the beginning and at the end of the announcement. You can send a complaint on the news if you find it unreliable.
Top Authors
Popular Topics
gamingbolt.com
09.01.2024 / 08:37
WB Games Has Multiple Unannounced Harry Potter Titles in the Works
Hogwarts Legacy has been a raving success for WB Games, having sold over 22 million copies worldwide over the course of 2023 to become the year’s highest-selling game. In light of that success, it’s no surprise that the company plans on releasing plenty more titles set in the Harry Potter universe.
tech.hindustantimes.com
09.01.2024 / 03:58
Even As Apple iPhone 15 Sales in China Slumped, Huawei Mate 60 Soared High! Know why
Apple Inc.'s iPhone sales slump in China is deepening and the company is likely to see volumes decline further this year, according to Jefferies analysts led by Edison Lee. The iPhone maker's latest generation, iPhone 15, got off to an atypically sluggish start in China last year, which most recently expanded to a 30% year-on-year decline, Lee and colleagues said in a note on Sunday, citing industry checks. The rest of the country's mobile market grew in December, with Huawei Technologies Co. growing fastest on the back of its new Mate 60 device lineup.
gamespot.com
08.01.2024 / 23:28
Hogwarts Legacy Sells 22 Million Copies, "Series" Of Other Harry Potter Games In The Works
The products discussed here were independently chosen by our editors. GameSpot may get a share of the revenue if you buy anything featured on our site.
gamesradar.com
08.01.2024 / 17:09
Five Nights at Freddy's star confirms there's a sequel in the works
Five Nights at Freddy's star Josh Hutcherson has confirmed that the horror movie will be getting a sequel.
gameranx.com
08.01.2024 / 13:24
Rumor: PlayStation Exclusive Metal Gear Solid Remake Still In The Works
A Metal Gear Solid remake is reportedly on the way, but under some surprising conditions.
wccftech.com
06.01.2024 / 12:03
Marvel’s Spider-Man 2 Unofficial PC Port Is in the Works; Already Runs at 60 FPS
An unofficial Marvel’s Spider-Man 2 PC port is currently in the works, and it's already running great in its very early version.
techradar.com
04.01.2024 / 10:16
New Game Plus is in the works for RoboCop: Rogue City
RoboCop: Rogue City is set to receive a New Game Plus mode, as announced on the game's official Twitter page. Unfortunately, no details as to when exactly we can expect this update were shared, but more information is likely to follow in the coming weeks, which may answer some questions.
thegamer.com
02.01.2024 / 21:33
Jack Black Will Reportedly Play Steve In The Minecraft Movie
Jack Black is set to star in yet another big video game movie adaptation, as it's being reported that the actor will play Steve in the upcoming Minecraft movie.
rockpapershotgun.com
02.01.2024 / 18:43
NCSoft's Project Skyline rumoured to be Horizon MMO, in the works for PC and Unreal Engine 5
Guild Wars publisher NCSoft's long-rumoured Horizon: Zero Dawn spin-off is a full-blown MMORPG codenamed Project Skyline, will run on Unreal Engine 5, and is coming to PC and mobile with a PS5 release still TBC, according to a brace of job listings and CVs fished from the post-apocalyptic robo-wilds of yonder internet. Also according to the said listings, it won’t be out for a while.
tech.hindustantimes.com
02.01.2024 / 18:17
Apple iPhone user? Surprise! You may get Samsung Galaxy S24's AI call translation tool too
Samsung is set to revolutionize communication with the upcoming Samsung Galaxy S24 series, scheduled for release in a couple of weeks - likely, January 17 or January 18. It is set to pack a groundbreaking feature that will enable real-time AI call translations, making it a game-changer for users worldwide. The good news is that this AI call translation feature is not exclusive to Samsung devices, it extends its benefits to users conversing with non-Samsung Galaxy phones too. Whether you're using an Apple iPhone, Oppo handset, or any other Amdroid brand, you can still experience the convenience of real-time translations when communicating with a Samsung Galaxy device. Samsung's commitment to inclusivity is evident as they break down language barriers without limiting functionality to their own devices, and this innovative translation capability will seamlessly bridge language gaps.
techradar.com
02.01.2024 / 11:24
Mickey Mouse has only been in the public domain for a day, and there's already a horror game in the works
Infestation 88 was announced by developers Nightmare Forge Games yesterday (January 1) in the New Year celebrations as the iconic black and white cartoon character Steamboat Willie (an older version of Mickey Mouse) is now in the public domain.