TII
The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) in the world, as independently verified by Hugging Face.
This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240812019509/en/
UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture (Photo: AETOSWire)
As the first SSLM for Falcon, it departs from prior Falcon models which all use a transformer-based architecture. This new Falcon Mamba 7B model is yet another example of the pioneering research the institute is conducting and the breakthrough tools and products it makes available to the community in an open source format.
H.E. Faisal Al Bannai, Secretary General of ATRC and Adviser to the UAE President for Strategic Research and Advanced Technology Affairs, said: “The Falcon Mamba 7B marks TII’s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi as a global hub for AI research and development. This achievement highlights the UAE’s unwavering commitment to innovation.”
For transformer architecture models, Falcon Mamba 7B outperforms Meta’s Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on the newly introduced benchmarks from HuggingFace. Meanwhile for the other SSLMs, Falcon Mamba 7B beats all other open source models in the old benchmarks and it will be the be first model on HuggingFace’s new tougher benchmark leaderboard.
Dr. Najwa Aaraj, Chief Executive of TII, said: “The Technology Innovation Institute continues to push the boundaries of technology with its Falcon series of AI models. The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives.”
State Space models are extremely performant at understanding complex situations that evolve over time, such as a whole book. This is because SSLMs do not require additional memory to digest such large bits of information.
Transformer based models, on the other hand, are very efficient at remembering and using information they have processed earlier in a sequence. This makes them very good at tasks like content generation, however, because they compare every word with every other word, this requires significant computational power.
SSLMs can find applications in various fields such as estimation, forecasting, and control tasks. Similar to the transformer architecture models, they also excel in Natural Language Processing tasks and can be applied to machine translation, text summarization, computer vision, and audio processing.
Dr. Hakim Hacid, Acting Chief Researcher of the TII’s AI Cross-Center Unit, said: “As we introduce the Falcon Mamba 7B, I’m proud of the collaborative ecosystem of TII that nurtured its development. This release represents a significant stride forward, inspiring fresh perspectives and further fueling the quest for intelligent systems. At TII, we’re pushing the boundaries of both SSLM and transformer models to spark further innovation in generative AI.”
Falcon LLMs have been downloaded over 45 million times, proving the outstanding success of the models. Falcon Mamba 7B will be released under TII Falcon License 2.0, the permissive Apache 2.0-based software license which includes an acceptable use policy that promotes the responsible use of AI. More information on the new model can be found at FalconLLM.TII.ae.
*Source: AETOSWire
To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.
View source version on businesswire.com: https://www.businesswire.com/news/home/20240812019509/en/
About Business Wire
Subscribe to releases from Business Wire
Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.
Latest releases from Business Wire
Dubai to Host Dubai Woodshow’s 21st Edition, from April 14th to 16th, 202516.9.2024 08:30:00 CEST | Press release
Dubai is gearing up to host the 21st edition of Dubai Woodshow, the premier international trade fair focusing on the wood, furniture, and woodworking machinery industries in the MENA region (Middle East and North Africa), gathering more than 600 exhibitors from +50 countries around the world. Scheduled from April 14 to 16 at the Dubai World Trade Centre, the prestigious event will bring together industry professionals, manufacturers, suppliers and wood machinery and tools specialists, to showcase the latest products, services and technologies in the industry. It will also provide an exciting platform to display a wide variety of wood and woodworking machinery and tools, attracting international investors and businessmen to the region, which contributes to driving economic diversification and industrial advancement. Dubai WoodShow offers exhibitors the opportunity to connect with their existing customers and discuss prospects and possible synergies to expand their business, while identi
Curatis: Significantly Increased Sales in Core Business and Projects in Development Pipeline on Track16.9.2024 08:20:00 CEST | Press release
Curatis Holding (SIX:CURN) reports revenues of CHF 2.0m for H1 2024, whereby Curatis AG is only included for 2 months. Curatis AG was able to increase sales in the distribution business by 31% per cent to CHF 4.3m in the entire 6 months of 2024 compared to the first 6 months of 2023. The loss amounted to CHF 3.8m due to non-cash one-off effects and amortisation as well as transaction costs for the acquisition of Curatis AG. Cash flow, including one-time transaction costs for the business combination of over CHF 1 million, was CHF -0.7m. As planned, Curatis also submitted the orphan drug designation application for its lead product candidate C-PBTE-01 to the US Food and Drug Administration (FDA) and expects a response from the FDA in Q4 2024. Business development and finances Product sales in the first half of the year amounted to CHF 1.75m and services revenues to CHF0.23m, whereby Curatis AG, which was acquired on 26 April 2024, is only included in this figure for 2 months. Curatis AG
International ID Day: Thales Stands up for a Legal and Trusted Identity for Everyone16.9.2024 08:00:00 CEST | Press release
On the International Identity Day ‘ID Day’, Thales reaffirms its dedication to supporting global identity initiatives and driving technological advancements that foster inclusion, security, and trust. Around the world, more than 850 million individuals do not have a legal identity, preventing them from claiming their rights and accessing fundamental citizen services e.g. health, education, employment. Thales has been working for more than thirty years to make trustworthy identities a reality for everyone, employing cutting-edge and responsible technology for biometrics and digital ID solutions. On September 16th, Thales celebrates the International Identity Day (ID Day), a symbolic day to highlight the United Nations' Sustainable Development Goal16.9 to provide a legal identity for all. ID Day is dedicated to raising awareness about the importance of legal identity as a fundamental human right and a key enabler of inclusive social and economic development. Thales supports global effort
Incyte’s CDK2 Inhibitor INCB123667 Shows Promising Evidence of Clinical Activity in Patients with Advanced Solid Tumors, Notably Ovarian Cancer14.9.2024 18:45:00 CEST | Press release
New antitumor response data from a range of doses and regimens unveiled today at Incyte investor eventThese results build upon safety and tolerability data presented earlier today during a mini-oral presentation at the European Society of Medical Oncology (ESMO) Congress 2024Findings support the initiation of a pivotal trial in ovarian cancer, expected to begin in 2025; additional plans to evaluate INCB123667 in combination with other treatments are underway Incyte (Nasdaq:INCY) today announced new early clinical data for INCB123667, a highly selective, potential first-in-class CDK2 inhibitor, in patients with advanced solid tumors. The trial results, presented during a mini-oral presentation at the European Society of Medical Oncology (ESMO) with new, updated data shared during the Company’s investor event, highlight the potential of INCB123667 as a differentiated treatment option for cancers with increased Cyclin E1 activity, amplification and/or overexpression in cells predictive of
Incyte’s Retifanlimab (Zynyz®) Extends Progression-Free Survival in Patients with Squamous Cell Anal Carcinoma (SCAC); Data Featured at ESMO 2024 Presidential Symposium14.9.2024 16:30:00 CEST | Press release
- Phase 3 POD1UM-303/InterAACT2 trial met primary endpoint of progression-free survival and demonstrated improvement across secondary endpoints in patients with squamous cell anal carcinoma (SCAC) taking retifanlimab in combination with platinum-based chemotherapy (carboplatin-paclitaxel) - Late-breaking data presented at the European Society for Medical Oncology (ESMO) Congress 2024 support the planned U.S. filing of a supplemental Biologics License Application (sBLA) for retifanlimab in SCAC by year-end 2024 - Incyte to host an in-person analyst and investor event to review key data at ESMO on Saturday, September 14, 2024 from 1:00-2:30 p.m. ET (7:00-8:30 p.m. CEST) Incyte (Nasdaq:INCY) today announced results from the Phase 3 POD1UM-303/InterAACT2 trial of retifanlimab (Zynyz®), a humanized monoclonal antibody targeting programmed death receptor-1 (PD-1), in combination with platinum-based chemotherapy (carboplatin–paclitaxel) for the treatment of adults with inoperable locally recu
In our pressroom you can read all our latest releases, find our press contacts, images, documents and other relevant information about us.
Visit our pressroom