LOGO
LOGO

TODAY'S TOP STORIES

Meta To Launch Chameleon Multi-modal LLM

By RTTNews Staff Writer   ✉   | Published:   | Follow Us On Google News
rttnewslogo20mar2024 lt

As the artificial intelligence game intensifies, Meta Platforms (META) is working on a state-of-the-art multi-modal large language model named Chameleon.

According to the company's research paper, the proposed LLM can single-handedly perform tasks previously performed by different models and could integrate information better than previous ones.

The paper noted that Chameleon uses an 'early-fusion token-based mixed-modal' architecture, under which the model learns from a combination of images, code, text, and other inputs. Additionally, it uses a mix of images, text and code tokens to create sequences.

"Chameleon's unified token space allows it to seamlessly reason over and generate interleaved image and text sequences, without the need for modality-specific components," the research paper stated.

The latest model is trained in two stages using a dataset of 4.4 trillion tokens of text, image-text combinations, and sequences of interwoven texts and images. The researchers trained two versions of Chameleon using 7 billion parameters and one with 34 billion parameters for more than 5 million hours on Nvidia A100 80GB GPUs.

Meanwhile, Meta's competitors - OpenAI has launched GPT-4o and Microsoft (MSFT) has introduced MAI-1 model a few weeks ago.

For comments and feedback contact: editorial@rttnews.com

Business News

Global Economics Weekly Update - April 27 – May 01, 2026

May 01, 2026 15:54 ET
Central banks dominated the economics news flow this week with almost all major ones announcing their latest policy decisions and many boosted expectations for a rate hike in June. In other news, several countries released the preliminary data for first quarter economic growth. In the U.S., comments by Fed Chair Jerome Powell were also in focus as his term ends this month.

Latest Updates on COVID-19